2024-04-25T02:21:31.711 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T02:21:31.712 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}} --owner scheduled_teuthology@teuthology --verbose --name teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672388 -- /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672388/orig.config.yaml 2024-04-25T02:21:31.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T02:21:31.875 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672388 branch: squid description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7672388' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8528 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 122/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi067.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJxcNkqh1mAx+uimlhw/Bqp8ug8F3RzFoRGIoQvWZSCtn5sKHtzVxMZ+xb9CrC/s9xAf2ULEeBaK6uT/2Wqgb88= smithi176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH0sGA8v3kTiw8nTmktUUT8/oMousjIrePS6gsiQ3zulc+dqLTVDcTP3BbzkQq7+MZuARgZrbK3YnyUZODz/qOk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - check-counter: counters: mgr: - min: 4 name: finisher-volumes.complete_latency.avgcount - expected_val: 0 name: finisher-volumes.queue_len - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestPerModuleFinsherThread teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-24_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T02:21:31.875 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa; will attempt to use it 2024-04-25T02:21:31.876 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks 2024-04-25T02:21:31.876 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T02:21:31.878 INFO:teuthology.task.internal:Checking packages... 2024-04-25T02:21:31.904 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-25T02:21:31.904 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:21:31.904 INFO:teuthology.packaging:ref: None 2024-04-25T02:21:31.904 INFO:teuthology.packaging:tag: None 2024-04-25T02:21:31.904 INFO:teuthology.packaging:branch: squid 2024-04-25T02:21:31.904 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:21:31.905 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-25T02:21:32.190 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2445.gd2c45d97 2024-04-25T02:21:32.191 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T02:21:32.199 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T02:21:32.199 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T02:21:32.238 INFO:teuthology.task.internal:Saving configuration 2024-04-25T02:21:32.257 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T02:21:32.265 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T02:21:32.293 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672388', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 02:16:23.923287', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJxcNkqh1mAx+uimlhw/Bqp8ug8F3RzFoRGIoQvWZSCtn5sKHtzVxMZ+xb9CrC/s9xAf2ULEeBaK6uT/2Wqgb88='} 2024-04-25T02:21:32.314 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672388', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 02:16:23.921739', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH0sGA8v3kTiw8nTmktUUT8/oMousjIrePS6gsiQ3zulc+dqLTVDcTP3BbzkQq7+MZuARgZrbK3YnyUZODz/qOk='} 2024-04-25T02:21:32.314 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T02:21:32.320 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-25T02:21:32.320 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-25T02:21:32.321 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T02:21:32.385 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5345b560d0>, signals=[15]) 2024-04-25T02:21:32.386 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T02:21:32.394 INFO:teuthology.task.internal:Opening connections... 2024-04-25T02:21:32.394 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2024-04-25T02:21:32.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:21:32.485 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi176.front.sepia.ceph.com 2024-04-25T02:21:32.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:21:32.559 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T02:21:32.565 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2024-04-25T02:21:32.584 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2024-04-25T02:21:32.585 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-04-25T02:21:32.642 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2024-04-25T02:21:32.642 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9" 2024-04-25T02:21:32.642 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2024-04-25T02:21:32.642 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2024-04-25T02:21:32.642 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9" 2024-04-25T02:21:32.642 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9" 2024-04-25T02:21:32.643 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T02:21:32.643 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2024-04-25T02:21:32.643 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon" 2024-04-25T02:21:32.643 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T02:21:32.643 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2024-04-25T02:21:32.643 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T02:21:32.643 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T02:21:32.643 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T02:21:32.644 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-04-25T02:21:32.668 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2024-04-25T02:21:32.686 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2024-04-25T02:21:32.686 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2024-04-25T02:21:32.743 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2024-04-25T02:21:32.744 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9" 2024-04-25T02:21:32.744 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2024-04-25T02:21:32.744 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2024-04-25T02:21:32.744 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9" 2024-04-25T02:21:32.744 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9" 2024-04-25T02:21:32.744 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T02:21:32.744 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2024-04-25T02:21:32.744 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon" 2024-04-25T02:21:32.744 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T02:21:32.744 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2024-04-25T02:21:32.744 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T02:21:32.744 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T02:21:32.744 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T02:21:32.745 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2024-04-25T02:21:32.768 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T02:21:32.777 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T02:21:32.781 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T02:21:32.782 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2024-04-25T02:21:32.784 DEBUG:teuthology.orchestra.run.smithi176:> test '!' -e /home/ubuntu/cephtest 2024-04-25T02:21:32.800 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T02:21:32.805 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T02:21:32.806 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2024-04-25T02:21:32.842 DEBUG:teuthology.orchestra.run.smithi176:> test -z $(ls -A /var/lib/ceph) 2024-04-25T02:21:32.878 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T02:21:32.929 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T02:21:32.944 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-04-25T02:21:32.944 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-04-25T02:21:32.944 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-04-25T02:21:32.945 DEBUG:teuthology.orchestra.run.smithi067:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T02:21:32.945 DEBUG:teuthology.orchestra.run.smithi176:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T02:21:32.961 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:21:32.961 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-04-25T02:21:32.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:21:32.962 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2024-04-25T02:21:33.017 INFO:teuthology.orchestra.run.smithi176.stdout:5.14.0-437.el9.x86_64 2024-04-25T02:21:33.017 INFO:teuthology.task.kernel:Running kernel on smithi176: 5.14.0-437.el9.x86_64 2024-04-25T02:21:33.017 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum install -y kernel 2024-04-25T02:21:33.020 INFO:teuthology.orchestra.run.smithi067.stdout:5.14.0-437.el9.x86_64 2024-04-25T02:21:33.020 INFO:teuthology.task.kernel:Running kernel on smithi067: 5.14.0-437.el9.x86_64 2024-04-25T02:21:33.020 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum install -y kernel 2024-04-25T02:21:35.216 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-25T02:21:36.154 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.0 MB 00:01 2024-04-25T02:21:38.255 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-04-25T02:21:38.358 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 19 MB 00:02 2024-04-25T02:21:43.534 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.2 MB 00:01 2024-04-25T02:21:45.143 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 16 kB 00:00 2024-04-25T02:21:45.305 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.2 MB 00:03 2024-04-25T02:21:46.915 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 16 kB 00:00 2024-04-25T02:21:47.261 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-25T02:21:48.635 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-25T02:21:52.569 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-04-25T02:21:53.599 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-04-25T02:21:54.567 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T02:21:54.567 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T02:21:54.659 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-04-25T02:21:54.661 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2024-04-25T02:21:54.661 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-04-25T02:21:54.779 DEBUG:teuthology.orchestra.run.smithi067:> echo no | sudo yum reinstall kernel || true 2024-04-25T02:21:55.301 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 02:21:52 AM UTC. 2024-04-25T02:21:55.421 INFO:teuthology.orchestra.run.smithi176.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T02:21:55.422 INFO:teuthology.orchestra.run.smithi176.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T02:21:55.424 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-04-25T02:21:55.439 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-04-25T02:21:55.439 INFO:teuthology.orchestra.run.smithi067.stdout: Package Architecture Version Repository Size 2024-04-25T02:21:55.439 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-04-25T02:21:55.439 INFO:teuthology.orchestra.run.smithi067.stdout:Reinstalling: 2024-04-25T02:21:55.439 INFO:teuthology.orchestra.run.smithi067.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T02:21:55.439 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:21:55.439 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-04-25T02:21:55.439 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-04-25T02:21:55.439 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:21:55.439 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 255 k 2024-04-25T02:21:55.439 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 0 2024-04-25T02:21:55.440 INFO:teuthology.orchestra.run.smithi067.stderr:Operation aborted. 2024-04-25T02:21:55.500 INFO:teuthology.orchestra.run.smithi067.stdout:Is this ok [y/N]: 2024-04-25T02:21:55.500 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum reinstall -y kernel || true 2024-04-25T02:21:55.515 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-04-25T02:21:55.516 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-04-25T02:21:55.516 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-04-25T02:21:55.637 DEBUG:teuthology.orchestra.run.smithi176:> echo no | sudo yum reinstall kernel || true 2024-04-25T02:21:56.014 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:00:04 ago on Thu 25 Apr 2024 02:21:52 AM UTC. 2024-04-25T02:21:56.135 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-04-25T02:21:56.135 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-04-25T02:21:56.136 INFO:teuthology.orchestra.run.smithi067.stdout: Package Architecture Version Repository Size 2024-04-25T02:21:56.136 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-04-25T02:21:56.136 INFO:teuthology.orchestra.run.smithi067.stdout:Reinstalling: 2024-04-25T02:21:56.136 INFO:teuthology.orchestra.run.smithi067.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T02:21:56.136 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:21:56.136 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-04-25T02:21:56.136 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-04-25T02:21:56.136 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:21:56.136 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 255 k 2024-04-25T02:21:56.136 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 0 2024-04-25T02:21:56.136 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-04-25T02:21:56.177 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 02:21:53 AM UTC. 2024-04-25T02:21:56.312 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-04-25T02:21:56.320 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-04-25T02:21:56.320 INFO:teuthology.orchestra.run.smithi176.stdout: Package Architecture Version Repository Size 2024-04-25T02:21:56.320 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-04-25T02:21:56.321 INFO:teuthology.orchestra.run.smithi176.stdout:Reinstalling: 2024-04-25T02:21:56.321 INFO:teuthology.orchestra.run.smithi176.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T02:21:56.321 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:21:56.321 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-04-25T02:21:56.321 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-04-25T02:21:56.321 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:21:56.321 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 255 k 2024-04-25T02:21:56.321 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 0 2024-04-25T02:21:56.321 INFO:teuthology.orchestra.run.smithi176.stderr:Operation aborted. 2024-04-25T02:21:56.377 INFO:teuthology.orchestra.run.smithi176.stdout:Is this ok [y/N]: 2024-04-25T02:21:56.378 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum reinstall -y kernel || true 2024-04-25T02:21:56.722 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-5.14.0-437.el9.x86_64.rpm 811 kB/s | 255 kB 00:00 2024-04-25T02:21:56.722 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:21:56.722 INFO:teuthology.orchestra.run.smithi067.stdout:Total 435 kB/s | 255 kB 00:00 2024-04-25T02:21:56.736 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-04-25T02:21:56.866 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 02:21:53 AM UTC. 2024-04-25T02:21:56.924 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-04-25T02:21:56.924 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-04-25T02:21:56.929 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-04-25T02:21:56.929 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-04-25T02:21:56.982 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-04-25T02:21:56.982 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-04-25T02:21:56.982 INFO:teuthology.orchestra.run.smithi176.stdout: Package Architecture Version Repository Size 2024-04-25T02:21:56.983 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-04-25T02:21:56.983 INFO:teuthology.orchestra.run.smithi176.stdout:Reinstalling: 2024-04-25T02:21:56.983 INFO:teuthology.orchestra.run.smithi176.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T02:21:56.983 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:21:56.983 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-04-25T02:21:56.983 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-04-25T02:21:56.983 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:21:56.984 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 255 k 2024-04-25T02:21:56.984 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 0 2024-04-25T02:21:56.984 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-04-25T02:21:57.071 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-04-25T02:21:57.156 INFO:teuthology.orchestra.run.smithi067.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T02:21:57.156 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T02:21:57.334 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-5.14.0-437.el9.x86_64.rpm 939 kB/s | 255 kB 00:00 2024-04-25T02:21:57.334 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:21:57.334 INFO:teuthology.orchestra.run.smithi176.stdout:Total 727 kB/s | 255 kB 00:00 2024-04-25T02:21:57.350 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-04-25T02:21:57.529 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-04-25T02:21:57.529 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-04-25T02:21:57.534 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-04-25T02:21:57.535 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-04-25T02:21:57.665 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-04-25T02:21:57.751 INFO:teuthology.orchestra.run.smithi176.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T02:21:57.751 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T02:21:57.923 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T02:21:57.923 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T02:21:58.431 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T02:21:58.432 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T02:21:58.603 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T02:21:58.603 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:21:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:Reinstalled: 2024-04-25T02:21:58.603 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T02:21:58.603 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:21:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-04-25T02:21:58.785 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T02:21:58.833 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T02:21:58.833 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T02:21:58.833 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T02:21:58.833 DEBUG:teuthology.parallel:result is None 2024-04-25T02:21:59.153 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T02:21:59.153 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:21:59.153 INFO:teuthology.orchestra.run.smithi176.stdout:Reinstalled: 2024-04-25T02:21:59.153 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T02:21:59.153 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:21:59.153 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-04-25T02:21:59.345 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T02:21:59.391 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T02:21:59.391 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T02:21:59.391 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T02:21:59.391 DEBUG:teuthology.parallel:result is None 2024-04-25T02:21:59.391 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T02:21:59.399 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T02:21:59.399 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T02:21:59.401 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T02:21:59.416 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T02:21:59.422 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T02:21:59.432 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T02:21:59.432 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T02:21:59.458 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T02:21:59.497 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T02:21:59.503 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T02:21:59.504 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T02:21:59.521 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T02:21:59.550 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T02:21:59.567 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T02:21:59.587 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T02:21:59.604 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T02:21:59.605 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T02:21:59.612 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T02:21:59.612 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T02:21:59.615 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T02:21:59.639 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T02:21:59.647 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T02:21:59.648 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T02:21:59.682 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T02:21:59.696 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T02:21:59.776 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T02:21:59.835 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T02:21:59.914 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T02:21:59.956 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:21:59.957 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T02:22:00.020 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T02:22:00.058 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T02:22:00.114 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T02:22:00.194 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T02:22:00.235 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:22:00.235 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T02:22:00.298 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2024-04-25T02:22:00.300 DEBUG:teuthology.orchestra.run.smithi176:> sudo service rsyslog restart 2024-04-25T02:22:00.332 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:22:00.381 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:22:00.693 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T02:22:00.701 INFO:teuthology.task.internal:Starting timer... 2024-04-25T02:22:00.701 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T02:22:00.762 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T02:22:00.770 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-25T02:22:00.770 DEBUG:teuthology.orchestra.run.smithi067:> sudo service auditd rotate 2024-04-25T02:22:00.829 INFO:teuthology.orchestra.run.smithi067.stdout:Rotating logs: 2024-04-25T02:22:00.831 DEBUG:teuthology.orchestra.run.smithi176:> sudo service auditd rotate 2024-04-25T02:22:00.888 INFO:teuthology.orchestra.run.smithi176.stdout:Rotating logs: 2024-04-25T02:22:00.889 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T02:22:00.889 DEBUG:teuthology.orchestra.run.smithi067:> /usr/sbin/getenforce 2024-04-25T02:22:00.914 INFO:teuthology.orchestra.run.smithi067.stdout:Permissive 2024-04-25T02:22:00.915 DEBUG:teuthology.orchestra.run.smithi176:> /usr/sbin/getenforce 2024-04-25T02:22:00.931 INFO:teuthology.orchestra.run.smithi176.stdout:Permissive 2024-04-25T02:22:00.932 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi067.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi176.front.sepia.ceph.com': 'permissive'} 2024-04-25T02:22:00.932 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T02:22:00.979 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:22:00.980 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T02:22:01.004 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:22:01.004 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T02:22:01.005 DEBUG:teuthology.orchestra.run.smithi067:> sudo /usr/sbin/setenforce permissive 2024-04-25T02:22:01.045 DEBUG:teuthology.orchestra.run.smithi176:> sudo /usr/sbin/setenforce permissive 2024-04-25T02:22:01.118 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T02:22:01.127 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T02:22:01.144 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T02:22:01.145 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi067.front.sepia.ceph.com,smithi176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T02:25:32.949 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi067.front.sepia.ceph.com'), Remote(name='ubuntu@smithi176.front.sepia.ceph.com')] 2024-04-25T02:25:32.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-04-25T02:25:32.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:25:33.027 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-04-25T02:25:33.110 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-04-25T02:25:33.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-04-25T02:25:33.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:25:33.182 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-04-25T02:25:33.260 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-04-25T02:25:33.261 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T02:25:33.270 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T02:25:33.270 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T02:25:33.271 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:25:33.273 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T02:25:33.273 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:25:33.300 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T02:25:33.314 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T02:25:33.327 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T02:25:33.338 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: ntpd: command not found 2024-04-25T02:25:33.341 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T02:25:33.349 INFO:teuthology.orchestra.run.smithi067.stdout:506 Cannot talk to daemon 2024-04-25T02:25:33.363 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: ntpd: command not found 2024-04-25T02:25:33.363 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T02:25:33.373 INFO:teuthology.orchestra.run.smithi176.stdout:506 Cannot talk to daemon 2024-04-25T02:25:33.376 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T02:25:33.386 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T02:25:33.399 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T02:25:33.432 INFO:teuthology.orchestra.run.smithi067.stderr:bash: line 1: ntpq: command not found 2024-04-25T02:25:33.436 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:25:33.436 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2024-04-25T02:25:33.436 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:25:33.436 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:25:33.436 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:25:33.436 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:25:33.462 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2024-04-25T02:25:33.465 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:25:33.466 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2024-04-25T02:25:33.466 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:25:33.466 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:25:33.466 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:25:33.466 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:25:33.467 INFO:teuthology.run_tasks:Running task install... 2024-04-25T02:25:33.481 DEBUG:teuthology.task.install:project ceph 2024-04-25T02:25:33.481 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-25T02:25:33.482 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-25T02:25:33.482 INFO:teuthology.task.install:Using flavor: default 2024-04-25T02:25:33.489 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T02:25:33.489 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T02:25:33.490 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T02:25:33.490 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:25:33.492 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T02:25:33.492 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:25:33.647 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/ 2024-04-25T02:25:33.647 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2445.gd2c45d97 2024-04-25T02:25:33.711 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/ 2024-04-25T02:25:33.711 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2445.gd2c45d97 2024-04-25T02:25:33.768 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T02:25:33.768 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:25:33.768 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T02:25:33.795 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T02:25:33.795 DEBUG:teuthology.orchestra.run.smithi067:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2c45d977142e024a59b68a8f1dce8f0b9840551/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T02:25:33.831 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T02:25:33.831 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:25:33.831 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T02:25:33.857 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T02:25:33.857 DEBUG:teuthology.orchestra.run.smithi176:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2c45d977142e024a59b68a8f1dce8f0b9840551/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T02:25:33.869 DEBUG:teuthology.orchestra.run.smithi067:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T02:25:33.922 DEBUG:teuthology.orchestra.run.smithi176:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T02:25:33.952 DEBUG:teuthology.orchestra.run.smithi067:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T02:25:33.995 DEBUG:teuthology.orchestra.run.smithi176:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T02:25:34.022 INFO:teuthology.orchestra.run.smithi067.stdout:check_obsoletes = 1 2024-04-25T02:25:34.023 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum clean all 2024-04-25T02:25:34.078 INFO:teuthology.orchestra.run.smithi176.stdout:check_obsoletes = 1 2024-04-25T02:25:34.079 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum clean all 2024-04-25T02:25:34.273 INFO:teuthology.orchestra.run.smithi067.stdout:48 files removed 2024-04-25T02:25:34.300 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T02:25:34.310 INFO:teuthology.orchestra.run.smithi176.stdout:48 files removed 2024-04-25T02:25:34.337 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T02:25:34.950 INFO:teuthology.orchestra.run.smithi176.stdout:ceph packages for x86_64 245 kB/s | 83 kB 00:00 2024-04-25T02:25:35.127 INFO:teuthology.orchestra.run.smithi067.stdout:ceph packages for x86_64 153 kB/s | 83 kB 00:00 2024-04-25T02:25:35.377 INFO:teuthology.orchestra.run.smithi176.stdout:ceph noarch packages 30 kB/s | 11 kB 00:00 2024-04-25T02:25:35.553 INFO:teuthology.orchestra.run.smithi067.stdout:ceph noarch packages 30 kB/s | 11 kB 00:00 2024-04-25T02:25:35.726 INFO:teuthology.orchestra.run.smithi176.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-04-25T02:25:35.912 INFO:teuthology.orchestra.run.smithi067.stdout:ceph source packages 5.9 kB/s | 1.9 kB 00:00 2024-04-25T02:25:38.077 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - BaseOS 3.5 MB/s | 8.0 MB 00:02 2024-04-25T02:25:40.111 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - BaseOS 1.9 MB/s | 8.0 MB 00:04 2024-04-25T02:25:43.260 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 19 MB 00:04 2024-04-25T02:25:43.387 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - AppStream 8.7 MB/s | 19 MB 00:02 2024-04-25T02:25:47.623 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-25T02:25:48.969 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.2 MB 00:02 2024-04-25T02:25:49.331 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-04-25T02:25:50.869 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-25T02:25:50.953 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 16 kB 00:00 2024-04-25T02:25:52.796 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-25T02:25:56.182 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 9.4 kB/s | 1.7 kB 00:00 2024-04-25T02:25:57.821 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-25T02:25:58.375 INFO:teuthology.orchestra.run.smithi067.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T02:25:58.376 INFO:teuthology.orchestra.run.smithi067.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T02:25:58.387 INFO:teuthology.orchestra.run.smithi067.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T02:25:58.388 INFO:teuthology.orchestra.run.smithi067.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T02:25:58.389 INFO:teuthology.orchestra.run.smithi067.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T02:25:58.390 INFO:teuthology.orchestra.run.smithi067.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T02:25:58.391 INFO:teuthology.orchestra.run.smithi067.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T02:25:58.393 INFO:teuthology.orchestra.run.smithi067.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T02:25:58.394 INFO:teuthology.orchestra.run.smithi067.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T02:25:58.458 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-04-25T02:25:58.467 INFO:teuthology.orchestra.run.smithi067.stdout:======================================================================================= 2024-04-25T02:25:58.467 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-04-25T02:25:58.467 INFO:teuthology.orchestra.run.smithi067.stdout:======================================================================================= 2024-04-25T02:25:58.467 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-04-25T02:25:58.468 INFO:teuthology.orchestra.run.smithi067.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T02:25:58.468 INFO:teuthology.orchestra.run.smithi067.stdout: ceph x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 6.6 k 2024-04-25T02:25:58.468 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.4 M 2024-04-25T02:25:58.468 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 890 k 2024-04-25T02:25:58.468 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 145 k 2024-04-25T02:25:58.468 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 1.5 M 2024-04-25T02:25:58.468 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 141 k 2024-04-25T02:25:58.468 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 3.5 M 2024-04-25T02:25:58.468 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 7.4 M 2024-04-25T02:25:58.468 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 49 k 2024-04-25T02:25:58.469 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 10 M 2024-04-25T02:25:58.469 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 48 M 2024-04-25T02:25:58.469 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 264 k 2024-04-25T02:25:58.469 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 762 k 2024-04-25T02:25:58.469 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 222 k 2024-04-25T02:25:58.469 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-shell x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 27 k 2024-04-25T02:25:58.469 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-top noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 18 k 2024-04-25T02:25:58.469 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T02:25:58.469 INFO:teuthology.orchestra.run.smithi067.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T02:25:58.469 INFO:teuthology.orchestra.run.smithi067.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T02:25:58.469 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 32 k 2024-04-25T02:25:58.470 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 745 k 2024-04-25T02:25:58.470 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 127 k 2024-04-25T02:25:58.470 INFO:teuthology.orchestra.run.smithi067.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T02:25:58.470 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T02:25:58.470 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T02:25:58.470 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T02:25:58.470 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T02:25:58.470 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T02:25:58.470 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 162 k 2024-04-25T02:25:58.470 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 321 k 2024-04-25T02:25:58.471 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 299 k 2024-04-25T02:25:58.471 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 99 k 2024-04-25T02:25:58.471 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 85 k 2024-04-25T02:25:58.471 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T02:25:58.471 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 171 k 2024-04-25T02:25:58.471 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T02:25:58.471 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrading: 2024-04-25T02:25:58.471 INFO:teuthology.orchestra.run.smithi067.stdout: librados2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.4 M 2024-04-25T02:25:58.471 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T02:25:58.471 INFO:teuthology.orchestra.run.smithi067.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T02:25:58.471 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T02:25:58.472 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-04-25T02:25:58.472 INFO:teuthology.orchestra.run.smithi067.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T02:25:58.472 INFO:teuthology.orchestra.run.smithi067.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T02:25:58.472 INFO:teuthology.orchestra.run.smithi067.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T02:25:58.472 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 21 M 2024-04-25T02:25:58.472 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 32 k 2024-04-25T02:25:58.472 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 2.4 M 2024-04-25T02:25:58.472 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 249 k 2024-04-25T02:25:58.472 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 4.7 M 2024-04-25T02:25:58.472 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 17 M 2024-04-25T02:25:58.472 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 15 k 2024-04-25T02:25:58.473 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 25 k 2024-04-25T02:25:58.473 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T02:25:58.473 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T02:25:58.473 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T02:25:58.473 INFO:teuthology.orchestra.run.smithi067.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T02:25:58.473 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T02:25:58.473 INFO:teuthology.orchestra.run.smithi067.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T02:25:58.473 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T02:25:58.473 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T02:25:58.473 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 163 k 2024-04-25T02:25:58.473 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T02:25:58.474 INFO:teuthology.orchestra.run.smithi067.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T02:25:58.474 INFO:teuthology.orchestra.run.smithi067.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T02:25:58.474 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T02:25:58.474 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T02:25:58.474 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 501 k 2024-04-25T02:25:58.474 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T02:25:58.474 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.3 M 2024-04-25T02:25:58.474 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T02:25:58.474 INFO:teuthology.orchestra.run.smithi067.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T02:25:58.474 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T02:25:58.475 INFO:teuthology.orchestra.run.smithi067.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T02:25:58.475 INFO:teuthology.orchestra.run.smithi067.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T02:25:58.475 INFO:teuthology.orchestra.run.smithi067.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T02:25:58.475 INFO:teuthology.orchestra.run.smithi067.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T02:25:58.475 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T02:25:58.475 INFO:teuthology.orchestra.run.smithi067.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T02:25:58.475 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T02:25:58.475 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T02:25:58.475 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T02:25:58.475 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T02:25:58.475 INFO:teuthology.orchestra.run.smithi067.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T02:25:58.476 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T02:25:58.476 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T02:25:58.476 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T02:25:58.476 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 45 k 2024-04-25T02:25:58.476 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 133 k 2024-04-25T02:25:58.476 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T02:25:58.476 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T02:25:58.476 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T02:25:58.476 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T02:25:58.476 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T02:25:58.476 INFO:teuthology.orchestra.run.smithi067.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T02:25:58.477 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T02:25:58.477 INFO:teuthology.orchestra.run.smithi067.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T02:25:58.477 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T02:25:58.477 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T02:25:58.477 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T02:25:58.477 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T02:25:58.477 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T02:25:58.477 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T02:25:58.477 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T02:25:58.477 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T02:25:58.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T02:25:58.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T02:25:58.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T02:25:58.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T02:25:58.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T02:25:58.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T02:25:58.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T02:25:58.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T02:25:58.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T02:25:58.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T02:25:58.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T02:25:58.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T02:25:58.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T02:25:58.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T02:25:58.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T02:25:58.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T02:25:58.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T02:25:58.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T02:25:58.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T02:25:58.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T02:25:58.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T02:25:58.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T02:25:58.480 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T02:25:58.480 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T02:25:58.480 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T02:25:58.480 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T02:25:58.480 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T02:25:58.480 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T02:25:58.480 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T02:25:58.480 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T02:25:58.480 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T02:25:58.480 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T02:25:58.480 INFO:teuthology.orchestra.run.smithi067.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T02:25:58.480 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T02:25:58.480 INFO:teuthology.orchestra.run.smithi067.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T02:25:58.481 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T02:25:58.481 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T02:25:58.481 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T02:25:58.481 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T02:25:58.481 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T02:25:58.481 INFO:teuthology.orchestra.run.smithi067.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T02:25:58.481 INFO:teuthology.orchestra.run.smithi067.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T02:25:58.481 INFO:teuthology.orchestra.run.smithi067.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T02:25:58.481 INFO:teuthology.orchestra.run.smithi067.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T02:25:58.481 INFO:teuthology.orchestra.run.smithi067.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T02:25:58.481 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T02:25:58.481 INFO:teuthology.orchestra.run.smithi067.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T02:25:58.481 INFO:teuthology.orchestra.run.smithi067.stdout:Installing weak dependencies: 2024-04-25T02:25:58.481 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T02:25:58.482 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:25:58.482 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-04-25T02:25:58.482 INFO:teuthology.orchestra.run.smithi067.stdout:======================================================================================= 2024-04-25T02:25:58.482 INFO:teuthology.orchestra.run.smithi067.stdout:Install 148 Packages 2024-04-25T02:25:58.482 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrade 4 Packages 2024-04-25T02:25:58.482 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:25:58.483 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 220 M 2024-04-25T02:25:58.483 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-04-25T02:25:59.931 INFO:teuthology.orchestra.run.smithi176.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T02:25:59.931 INFO:teuthology.orchestra.run.smithi176.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T02:25:59.942 INFO:teuthology.orchestra.run.smithi176.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T02:25:59.942 INFO:teuthology.orchestra.run.smithi176.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T02:25:59.943 INFO:teuthology.orchestra.run.smithi176.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T02:25:59.944 INFO:teuthology.orchestra.run.smithi176.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T02:25:59.945 INFO:teuthology.orchestra.run.smithi176.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T02:25:59.948 INFO:teuthology.orchestra.run.smithi176.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T02:25:59.949 INFO:teuthology.orchestra.run.smithi176.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T02:25:59.975 INFO:teuthology.orchestra.run.smithi067.stdout:(1/152): ceph-19.0.0-2445.gd2c45d97.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-04-25T02:26:00.009 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-04-25T02:26:00.018 INFO:teuthology.orchestra.run.smithi176.stdout:======================================================================================= 2024-04-25T02:26:00.018 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-04-25T02:26:00.018 INFO:teuthology.orchestra.run.smithi176.stdout:======================================================================================= 2024-04-25T02:26:00.018 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-04-25T02:26:00.018 INFO:teuthology.orchestra.run.smithi176.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T02:26:00.018 INFO:teuthology.orchestra.run.smithi176.stdout: ceph x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 6.6 k 2024-04-25T02:26:00.019 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.4 M 2024-04-25T02:26:00.019 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 890 k 2024-04-25T02:26:00.019 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 145 k 2024-04-25T02:26:00.019 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 1.5 M 2024-04-25T02:26:00.019 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 141 k 2024-04-25T02:26:00.019 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 3.5 M 2024-04-25T02:26:00.019 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 7.4 M 2024-04-25T02:26:00.019 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 49 k 2024-04-25T02:26:00.019 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 10 M 2024-04-25T02:26:00.019 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 48 M 2024-04-25T02:26:00.019 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 264 k 2024-04-25T02:26:00.019 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 762 k 2024-04-25T02:26:00.019 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 222 k 2024-04-25T02:26:00.019 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-shell x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 27 k 2024-04-25T02:26:00.020 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-top noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 18 k 2024-04-25T02:26:00.020 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T02:26:00.020 INFO:teuthology.orchestra.run.smithi176.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T02:26:00.020 INFO:teuthology.orchestra.run.smithi176.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T02:26:00.020 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 32 k 2024-04-25T02:26:00.020 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 745 k 2024-04-25T02:26:00.020 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 127 k 2024-04-25T02:26:00.020 INFO:teuthology.orchestra.run.smithi176.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T02:26:00.020 INFO:teuthology.orchestra.run.smithi176.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T02:26:00.020 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T02:26:00.020 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T02:26:00.020 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T02:26:00.020 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T02:26:00.020 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 162 k 2024-04-25T02:26:00.021 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 321 k 2024-04-25T02:26:00.021 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 299 k 2024-04-25T02:26:00.021 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 99 k 2024-04-25T02:26:00.021 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 85 k 2024-04-25T02:26:00.021 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T02:26:00.021 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 171 k 2024-04-25T02:26:00.021 INFO:teuthology.orchestra.run.smithi176.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T02:26:00.021 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrading: 2024-04-25T02:26:00.021 INFO:teuthology.orchestra.run.smithi176.stdout: librados2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.4 M 2024-04-25T02:26:00.021 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T02:26:00.021 INFO:teuthology.orchestra.run.smithi176.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T02:26:00.021 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T02:26:00.021 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-04-25T02:26:00.021 INFO:teuthology.orchestra.run.smithi176.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T02:26:00.021 INFO:teuthology.orchestra.run.smithi176.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T02:26:00.022 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T02:26:00.022 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 21 M 2024-04-25T02:26:00.022 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 32 k 2024-04-25T02:26:00.022 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 2.4 M 2024-04-25T02:26:00.022 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 249 k 2024-04-25T02:26:00.022 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 4.7 M 2024-04-25T02:26:00.022 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 17 M 2024-04-25T02:26:00.022 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 15 k 2024-04-25T02:26:00.022 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 25 k 2024-04-25T02:26:00.022 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T02:26:00.022 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T02:26:00.022 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T02:26:00.022 INFO:teuthology.orchestra.run.smithi176.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T02:26:00.023 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T02:26:00.023 INFO:teuthology.orchestra.run.smithi176.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T02:26:00.023 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T02:26:00.023 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T02:26:00.023 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 163 k 2024-04-25T02:26:00.023 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T02:26:00.023 INFO:teuthology.orchestra.run.smithi176.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T02:26:00.023 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T02:26:00.023 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T02:26:00.023 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T02:26:00.023 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 501 k 2024-04-25T02:26:00.023 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T02:26:00.023 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.3 M 2024-04-25T02:26:00.024 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T02:26:00.024 INFO:teuthology.orchestra.run.smithi176.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T02:26:00.024 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T02:26:00.024 INFO:teuthology.orchestra.run.smithi176.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T02:26:00.024 INFO:teuthology.orchestra.run.smithi176.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T02:26:00.024 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T02:26:00.024 INFO:teuthology.orchestra.run.smithi176.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T02:26:00.024 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T02:26:00.024 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T02:26:00.024 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T02:26:00.024 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T02:26:00.024 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T02:26:00.024 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T02:26:00.024 INFO:teuthology.orchestra.run.smithi176.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T02:26:00.025 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T02:26:00.025 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T02:26:00.025 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T02:26:00.025 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 45 k 2024-04-25T02:26:00.025 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 133 k 2024-04-25T02:26:00.025 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T02:26:00.025 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T02:26:00.025 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T02:26:00.025 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T02:26:00.025 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T02:26:00.025 INFO:teuthology.orchestra.run.smithi176.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T02:26:00.025 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T02:26:00.025 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T02:26:00.025 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T02:26:00.025 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T02:26:00.026 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T02:26:00.026 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T02:26:00.026 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T02:26:00.026 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T02:26:00.026 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T02:26:00.026 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T02:26:00.026 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T02:26:00.026 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T02:26:00.026 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T02:26:00.026 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T02:26:00.026 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T02:26:00.026 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T02:26:00.026 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T02:26:00.027 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T02:26:00.027 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T02:26:00.027 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T02:26:00.027 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T02:26:00.027 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T02:26:00.027 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T02:26:00.027 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T02:26:00.027 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T02:26:00.027 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T02:26:00.027 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T02:26:00.027 INFO:teuthology.orchestra.run.smithi176.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T02:26:00.027 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T02:26:00.027 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T02:26:00.027 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T02:26:00.028 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T02:26:00.028 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T02:26:00.028 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T02:26:00.028 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T02:26:00.028 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T02:26:00.028 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T02:26:00.028 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T02:26:00.028 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T02:26:00.028 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T02:26:00.028 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T02:26:00.028 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T02:26:00.028 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T02:26:00.028 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T02:26:00.028 INFO:teuthology.orchestra.run.smithi176.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T02:26:00.029 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T02:26:00.029 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T02:26:00.029 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T02:26:00.029 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T02:26:00.029 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T02:26:00.029 INFO:teuthology.orchestra.run.smithi176.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T02:26:00.029 INFO:teuthology.orchestra.run.smithi176.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T02:26:00.029 INFO:teuthology.orchestra.run.smithi176.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T02:26:00.029 INFO:teuthology.orchestra.run.smithi176.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T02:26:00.029 INFO:teuthology.orchestra.run.smithi176.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T02:26:00.030 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T02:26:00.030 INFO:teuthology.orchestra.run.smithi176.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T02:26:00.030 INFO:teuthology.orchestra.run.smithi176.stdout:Installing weak dependencies: 2024-04-25T02:26:00.030 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T02:26:00.030 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:26:00.030 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-04-25T02:26:00.030 INFO:teuthology.orchestra.run.smithi176.stdout:======================================================================================= 2024-04-25T02:26:00.030 INFO:teuthology.orchestra.run.smithi176.stdout:Install 148 Packages 2024-04-25T02:26:00.030 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrade 4 Packages 2024-04-25T02:26:00.030 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:26:00.031 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 220 M 2024-04-25T02:26:00.031 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-04-25T02:26:00.600 INFO:teuthology.orchestra.run.smithi067.stdout:(2/152): ceph-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.4 MB/s | 890 kB 00:00 2024-04-25T02:26:00.692 INFO:teuthology.orchestra.run.smithi067.stdout:(3/152): ceph-immutable-object-cache-19.0.0-244 1.5 MB/s | 145 kB 00:00 2024-04-25T02:26:01.080 INFO:teuthology.orchestra.run.smithi176.stdout:(1/152): ceph-19.0.0-2445.gd2c45d97.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-04-25T02:26:01.284 INFO:teuthology.orchestra.run.smithi067.stdout:(4/152): ceph-base-19.0.0-2445.gd2c45d97.el9.x8 3.3 MB/s | 5.4 MB 00:01 2024-04-25T02:26:01.509 INFO:teuthology.orchestra.run.smithi067.stdout:(5/152): ceph-mds-19.0.0-2445.gd2c45d97.el9.x86 2.9 MB/s | 2.4 MB 00:00 2024-04-25T02:26:01.618 INFO:teuthology.orchestra.run.smithi067.stdout:(6/152): ceph-mgr-19.0.0-2445.gd2c45d97.el9.x86 4.5 MB/s | 1.5 MB 00:00 2024-04-25T02:26:01.855 INFO:teuthology.orchestra.run.smithi176.stdout:(2/152): ceph-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.1 MB/s | 890 kB 00:00 2024-04-25T02:26:01.989 INFO:teuthology.orchestra.run.smithi176.stdout:(3/152): ceph-immutable-object-cache-19.0.0-244 1.1 MB/s | 145 kB 00:00 2024-04-25T02:26:03.064 INFO:teuthology.orchestra.run.smithi176.stdout:(4/152): ceph-mds-19.0.0-2445.gd2c45d97.el9.x86 2.2 MB/s | 2.4 MB 00:01 2024-04-25T02:26:03.614 INFO:teuthology.orchestra.run.smithi176.stdout:(5/152): ceph-base-19.0.0-2445.gd2c45d97.el9.x8 1.9 MB/s | 5.4 MB 00:02 2024-04-25T02:26:03.656 INFO:teuthology.orchestra.run.smithi176.stdout:(6/152): ceph-mgr-19.0.0-2445.gd2c45d97.el9.x86 2.5 MB/s | 1.5 MB 00:00 2024-04-25T02:26:03.710 INFO:teuthology.orchestra.run.smithi067.stdout:(7/152): ceph-mon-19.0.0-2445.gd2c45d97.el9.x86 2.1 MB/s | 4.7 MB 00:02 2024-04-25T02:26:04.810 INFO:teuthology.orchestra.run.smithi067.stdout:(8/152): ceph-osd-19.0.0-2445.gd2c45d97.el9.x86 5.3 MB/s | 17 MB 00:03 2024-04-25T02:26:04.885 INFO:teuthology.orchestra.run.smithi067.stdout:(9/152): ceph-selinux-19.0.0-2445.gd2c45d97.el9 337 kB/s | 25 kB 00:00 2024-04-25T02:26:05.956 INFO:teuthology.orchestra.run.smithi176.stdout:(7/152): ceph-mon-19.0.0-2445.gd2c45d97.el9.x86 2.0 MB/s | 4.7 MB 00:02 2024-04-25T02:26:06.623 INFO:teuthology.orchestra.run.smithi176.stdout:(8/152): ceph-common-19.0.0-2445.gd2c45d97.el9. 3.6 MB/s | 21 MB 00:05 2024-04-25T02:26:06.690 INFO:teuthology.orchestra.run.smithi176.stdout:(9/152): ceph-selinux-19.0.0-2445.gd2c45d97.el9 380 kB/s | 25 kB 00:00 2024-04-25T02:26:09.540 INFO:teuthology.orchestra.run.smithi176.stdout:(10/152): ceph-radosgw-19.0.0-2445.gd2c45d97.el 2.9 MB/s | 10 MB 00:03 2024-04-25T02:26:09.659 INFO:teuthology.orchestra.run.smithi176.stdout:(11/152): cephfs-mirror-19.0.0-2445.gd2c45d97.e 1.9 MB/s | 222 kB 00:00 2024-04-25T02:26:09.715 INFO:teuthology.orchestra.run.smithi176.stdout:(12/152): cephfs-shell-19.0.0-2445.gd2c45d97.el 465 kB/s | 27 kB 00:00 2024-04-25T02:26:09.782 INFO:teuthology.orchestra.run.smithi176.stdout:(13/152): libcephfs-devel-19.0.0-2445.gd2c45d97 478 kB/s | 32 kB 00:00 2024-04-25T02:26:09.999 INFO:teuthology.orchestra.run.smithi176.stdout:(14/152): libcephfs2-19.0.0-2445.gd2c45d97.el9. 3.4 MB/s | 745 kB 00:00 2024-04-25T02:26:10.074 INFO:teuthology.orchestra.run.smithi176.stdout:(15/152): libcephsqlite-19.0.0-2445.gd2c45d97.e 2.1 MB/s | 163 kB 00:00 2024-04-25T02:26:10.149 INFO:teuthology.orchestra.run.smithi176.stdout:(16/152): librados-devel-19.0.0-2445.gd2c45d97. 1.7 MB/s | 127 kB 00:00 2024-04-25T02:26:10.450 INFO:teuthology.orchestra.run.smithi176.stdout:(17/152): ceph-osd-19.0.0-2445.gd2c45d97.el9.x8 2.5 MB/s | 17 MB 00:06 2024-04-25T02:26:10.483 INFO:teuthology.orchestra.run.smithi176.stdout:(18/152): libradosstriper1-19.0.0-2445.gd2c45d9 1.5 MB/s | 501 kB 00:00 2024-04-25T02:26:10.533 INFO:teuthology.orchestra.run.smithi176.stdout:(19/152): python3-ceph-argparse-19.0.0-2445.gd2 905 kB/s | 45 kB 00:00 2024-04-25T02:26:10.560 INFO:teuthology.orchestra.run.smithi067.stdout:(10/152): ceph-radosgw-19.0.0-2445.gd2c45d97.el 1.5 MB/s | 10 MB 00:06 2024-04-25T02:26:10.592 INFO:teuthology.orchestra.run.smithi176.stdout:(20/152): python3-ceph-common-19.0.0-2445.gd2c4 2.2 MB/s | 133 kB 00:00 2024-04-25T02:26:10.660 INFO:teuthology.orchestra.run.smithi176.stdout:(21/152): python3-cephfs-19.0.0-2445.gd2c45d97. 2.4 MB/s | 162 kB 00:00 2024-04-25T02:26:10.777 INFO:teuthology.orchestra.run.smithi176.stdout:(22/152): python3-rados-19.0.0-2445.gd2c45d97.e 2.7 MB/s | 321 kB 00:00 2024-04-25T02:26:10.894 INFO:teuthology.orchestra.run.smithi067.stdout:(11/152): cephfs-mirror-19.0.0-2445.gd2c45d97.e 667 kB/s | 222 kB 00:00 2024-04-25T02:26:10.894 INFO:teuthology.orchestra.run.smithi176.stdout:(23/152): python3-rbd-19.0.0-2445.gd2c45d97.el9 2.5 MB/s | 299 kB 00:00 2024-04-25T02:26:10.960 INFO:teuthology.orchestra.run.smithi176.stdout:(24/152): python3-rgw-19.0.0-2445.gd2c45d97.el9 1.5 MB/s | 99 kB 00:00 2024-04-25T02:26:10.961 INFO:teuthology.orchestra.run.smithi067.stdout:(12/152): cephfs-shell-19.0.0-2445.gd2c45d97.el 406 kB/s | 27 kB 00:00 2024-04-25T02:26:11.018 INFO:teuthology.orchestra.run.smithi176.stdout:(25/152): rbd-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.4 MB/s | 85 kB 00:00 2024-04-25T02:26:11.027 INFO:teuthology.orchestra.run.smithi067.stdout:(13/152): libcephfs-devel-19.0.0-2445.gd2c45d97 477 kB/s | 32 kB 00:00 2024-04-25T02:26:11.453 INFO:teuthology.orchestra.run.smithi067.stdout:(14/152): libcephfs2-19.0.0-2445.gd2c45d97.el9. 1.7 MB/s | 745 kB 00:00 2024-04-25T02:26:11.611 INFO:teuthology.orchestra.run.smithi067.stdout:(15/152): libcephsqlite-19.0.0-2445.gd2c45d97.e 1.0 MB/s | 163 kB 00:00 2024-04-25T02:26:11.704 INFO:teuthology.orchestra.run.smithi067.stdout:(16/152): librados-devel-19.0.0-2445.gd2c45d97. 1.4 MB/s | 127 kB 00:00 2024-04-25T02:26:11.860 INFO:teuthology.orchestra.run.smithi176.stdout:(26/152): librgw2-19.0.0-2445.gd2c45d97.el9.x86 3.8 MB/s | 5.3 MB 00:01 2024-04-25T02:26:11.919 INFO:teuthology.orchestra.run.smithi176.stdout:(27/152): rbd-mirror-19.0.0-2445.gd2c45d97.el9. 3.4 MB/s | 3.1 MB 00:00 2024-04-25T02:26:11.945 INFO:teuthology.orchestra.run.smithi176.stdout:(28/152): rbd-nbd-19.0.0-2445.gd2c45d97.el9.x86 2.0 MB/s | 171 kB 00:00 2024-04-25T02:26:11.970 INFO:teuthology.orchestra.run.smithi176.stdout:(29/152): ceph-grafana-dashboards-19.0.0-2445.g 629 kB/s | 32 kB 00:00 2024-04-25T02:26:11.995 INFO:teuthology.orchestra.run.smithi176.stdout:(30/152): ceph-mgr-cephadm-19.0.0-2445.gd2c45d9 2.7 MB/s | 141 kB 00:00 2024-04-25T02:26:12.145 INFO:teuthology.orchestra.run.smithi067.stdout:(17/152): ceph-test-19.0.0-2445.gd2c45d97.el9.x 6.7 MB/s | 48 MB 00:07 2024-04-25T02:26:12.179 INFO:teuthology.orchestra.run.smithi067.stdout:(18/152): libradosstriper1-19.0.0-2445.gd2c45d9 1.0 MB/s | 501 kB 00:00 2024-04-25T02:26:12.262 INFO:teuthology.orchestra.run.smithi067.stdout:(19/152): python3-ceph-argparse-19.0.0-2445.gd2 542 kB/s | 45 kB 00:00 2024-04-25T02:26:12.363 INFO:teuthology.orchestra.run.smithi067.stdout:(20/152): python3-ceph-common-19.0.0-2445.gd2c4 1.3 MB/s | 133 kB 00:00 2024-04-25T02:26:12.513 INFO:teuthology.orchestra.run.smithi067.stdout:(21/152): python3-cephfs-19.0.0-2445.gd2c45d97. 1.1 MB/s | 162 kB 00:00 2024-04-25T02:26:12.722 INFO:teuthology.orchestra.run.smithi067.stdout:(22/152): python3-rados-19.0.0-2445.gd2c45d97.e 1.5 MB/s | 321 kB 00:00 2024-04-25T02:26:12.729 INFO:teuthology.orchestra.run.smithi176.stdout:(31/152): ceph-mgr-dashboard-19.0.0-2445.gd2c45 4.6 MB/s | 3.5 MB 00:00 2024-04-25T02:26:12.854 INFO:teuthology.orchestra.run.smithi176.stdout:(32/152): ceph-mgr-modules-core-19.0.0-2445.gd2 1.9 MB/s | 249 kB 00:00 2024-04-25T02:26:12.880 INFO:teuthology.orchestra.run.smithi067.stdout:(23/152): librgw2-19.0.0-2445.gd2c45d97.el9.x86 7.2 MB/s | 5.3 MB 00:00 2024-04-25T02:26:12.912 INFO:teuthology.orchestra.run.smithi176.stdout:(33/152): ceph-mgr-rook-19.0.0-2445.gd2c45d97.e 847 kB/s | 49 kB 00:00 2024-04-25T02:26:12.930 INFO:teuthology.orchestra.run.smithi067.stdout:(24/152): python3-rbd-19.0.0-2445.gd2c45d97.el9 1.4 MB/s | 299 kB 00:00 2024-04-25T02:26:12.956 INFO:teuthology.orchestra.run.smithi067.stdout:(25/152): python3-rgw-19.0.0-2445.gd2c45d97.el9 1.3 MB/s | 99 kB 00:00 2024-04-25T02:26:12.963 INFO:teuthology.orchestra.run.smithi176.stdout:(34/152): ceph-prometheus-alerts-19.0.0-2445.gd 306 kB/s | 15 kB 00:00 2024-04-25T02:26:12.989 INFO:teuthology.orchestra.run.smithi067.stdout:(26/152): rbd-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.4 MB/s | 85 kB 00:00 2024-04-25T02:26:13.088 INFO:teuthology.orchestra.run.smithi176.stdout:(35/152): ceph-volume-19.0.0-2445.gd2c45d97.el9 2.1 MB/s | 264 kB 00:00 2024-04-25T02:26:13.131 INFO:teuthology.orchestra.run.smithi067.stdout:(27/152): rbd-nbd-19.0.0-2445.gd2c45d97.el9.x86 1.2 MB/s | 171 kB 00:00 2024-04-25T02:26:13.223 INFO:teuthology.orchestra.run.smithi067.stdout:(28/152): ceph-grafana-dashboards-19.0.0-2445.g 346 kB/s | 32 kB 00:00 2024-04-25T02:26:13.288 INFO:teuthology.orchestra.run.smithi176.stdout:(36/152): cephadm-19.0.0-2445.gd2c45d97.el9.noa 3.7 MB/s | 762 kB 00:00 2024-04-25T02:26:13.323 INFO:teuthology.orchestra.run.smithi067.stdout:(29/152): ceph-mgr-cephadm-19.0.0-2445.gd2c45d9 1.4 MB/s | 141 kB 00:00 2024-04-25T02:26:13.347 INFO:teuthology.orchestra.run.smithi176.stdout:(37/152): cephfs-top-19.0.0-2445.gd2c45d97.el9. 314 kB/s | 18 kB 00:00 2024-04-25T02:26:13.374 INFO:teuthology.orchestra.run.smithi067.stdout:(30/152): rbd-mirror-19.0.0-2445.gd2c45d97.el9. 7.4 MB/s | 3.1 MB 00:00 2024-04-25T02:26:13.572 INFO:teuthology.orchestra.run.smithi176.stdout:(38/152): ceph-mgr-diskprediction-local-19.0.0- 4.7 MB/s | 7.4 MB 00:01 2024-04-25T02:26:13.597 INFO:teuthology.orchestra.run.smithi176.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 321 kB/s | 80 kB 00:00 2024-04-25T02:26:13.789 INFO:teuthology.orchestra.run.smithi176.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-04-25T02:26:13.848 INFO:teuthology.orchestra.run.smithi176.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 803 kB 00:00 2024-04-25T02:26:13.882 INFO:teuthology.orchestra.run.smithi176.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-04-25T02:26:13.940 INFO:teuthology.orchestra.run.smithi176.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-04-25T02:26:13.999 INFO:teuthology.orchestra.run.smithi176.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-04-25T02:26:14.074 INFO:teuthology.orchestra.run.smithi176.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-04-25T02:26:14.141 INFO:teuthology.orchestra.run.smithi176.stdout:(46/152): python3-cryptography-36.0.1-4.el9.x86 4.2 MB/s | 1.2 MB 00:00 2024-04-25T02:26:14.166 INFO:teuthology.orchestra.run.smithi067.stdout:(31/152): ceph-mgr-diskprediction-local-19.0.0- 9.3 MB/s | 7.4 MB 00:00 2024-04-25T02:26:14.166 INFO:teuthology.orchestra.run.smithi176.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-04-25T02:26:14.225 INFO:teuthology.orchestra.run.smithi067.stdout:(32/152): ceph-mgr-modules-core-19.0.0-2445.gd2 4.1 MB/s | 249 kB 00:00 2024-04-25T02:26:14.284 INFO:teuthology.orchestra.run.smithi067.stdout:(33/152): ceph-mgr-rook-19.0.0-2445.gd2c45d97.e 844 kB/s | 49 kB 00:00 2024-04-25T02:26:14.292 INFO:teuthology.orchestra.run.smithi176.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 4.5 MB/s | 689 kB 00:00 2024-04-25T02:26:14.334 INFO:teuthology.orchestra.run.smithi067.stdout:(34/152): ceph-prometheus-alerts-19.0.0-2445.gd 308 kB/s | 15 kB 00:00 2024-04-25T02:26:14.393 INFO:teuthology.orchestra.run.smithi067.stdout:(35/152): ceph-volume-19.0.0-2445.gd2c45d97.el9 4.4 MB/s | 264 kB 00:00 2024-04-25T02:26:14.400 INFO:teuthology.orchestra.run.smithi176.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 987 kB/s | 107 kB 00:00 2024-04-25T02:26:14.434 INFO:teuthology.orchestra.run.smithi176.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 943 kB 00:00 2024-04-25T02:26:14.459 INFO:teuthology.orchestra.run.smithi176.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 368 kB/s | 21 kB 00:00 2024-04-25T02:26:14.493 INFO:teuthology.orchestra.run.smithi067.stdout:(36/152): cephadm-19.0.0-2445.gd2c45d97.el9.noa 7.5 MB/s | 762 kB 00:00 2024-04-25T02:26:14.518 INFO:teuthology.orchestra.run.smithi176.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 562 kB/s | 33 kB 00:00 2024-04-25T02:26:14.543 INFO:teuthology.orchestra.run.smithi176.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-04-25T02:26:14.594 INFO:teuthology.orchestra.run.smithi176.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-04-25T02:26:14.652 INFO:teuthology.orchestra.run.smithi176.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-04-25T02:26:14.693 INFO:teuthology.orchestra.run.smithi067.stdout:(37/152): ceph-common-19.0.0-2445.gd2c45d97.el9 1.4 MB/s | 21 MB 00:15 2024-04-25T02:26:14.711 INFO:teuthology.orchestra.run.smithi176.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-04-25T02:26:14.720 INFO:teuthology.orchestra.run.smithi067.stdout:(38/152): cephfs-top-19.0.0-2445.gd2c45d97.el9. 81 kB/s | 18 kB 00:00 2024-04-25T02:26:14.769 INFO:teuthology.orchestra.run.smithi176.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 780 kB/s | 45 kB 00:00 2024-04-25T02:26:14.778 INFO:teuthology.orchestra.run.smithi067.stdout:(39/152): ceph-mgr-dashboard-19.0.0-2445.gd2c45 2.4 MB/s | 3.5 MB 00:01 2024-04-25T02:26:14.869 INFO:teuthology.orchestra.run.smithi067.stdout:(40/152): fuse-2.9.9-15.el9.x86_64.rpm 459 kB/s | 80 kB 00:00 2024-04-25T02:26:14.944 INFO:teuthology.orchestra.run.smithi067.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-04-25T02:26:14.978 INFO:teuthology.orchestra.run.smithi067.stdout:(42/152): libquadmath-11.4.1-3.el9.x86_64.rpm 975 kB/s | 195 kB 00:00 2024-04-25T02:26:15.003 INFO:teuthology.orchestra.run.smithi067.stdout:(43/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-04-25T02:26:15.028 INFO:teuthology.orchestra.run.smithi067.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-25T02:26:15.053 INFO:teuthology.orchestra.run.smithi067.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-25T02:26:15.079 INFO:teuthology.orchestra.run.smithi067.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-25T02:26:15.104 INFO:teuthology.orchestra.run.smithi067.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-25T02:26:15.138 INFO:teuthology.orchestra.run.smithi067.stdout:(48/152): python3-cryptography-36.0.1-4.el9.x86 6.3 MB/s | 1.2 MB 00:00 2024-04-25T02:26:15.236 INFO:teuthology.orchestra.run.smithi176.stdout:(58/152): ceph-test-19.0.0-2445.gd2c45d97.el9.x 5.6 MB/s | 48 MB 00:08 2024-04-25T02:26:15.270 INFO:teuthology.orchestra.run.smithi176.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 1.3 MB/s | 662 kB 00:00 2024-04-25T02:26:15.321 INFO:teuthology.orchestra.run.smithi067.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 583 kB/s | 107 kB 00:00 2024-04-25T02:26:15.328 INFO:teuthology.orchestra.run.smithi176.stdout:(60/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.7 MB/s | 3.0 MB 00:00 2024-04-25T02:26:15.354 INFO:teuthology.orchestra.run.smithi176.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 305 kB/s | 25 kB 00:00 2024-04-25T02:26:15.380 INFO:teuthology.orchestra.run.smithi067.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 368 kB/s | 21 kB 00:00 2024-04-25T02:26:15.387 INFO:teuthology.orchestra.run.smithi176.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-04-25T02:26:15.421 INFO:teuthology.orchestra.run.smithi067.stdout:(51/152): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 689 kB 00:00 2024-04-25T02:26:15.454 INFO:teuthology.orchestra.run.smithi176.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-04-25T02:26:15.479 INFO:teuthology.orchestra.run.smithi176.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-04-25T02:26:15.489 INFO:teuthology.orchestra.run.smithi067.stdout:(52/152): bison-3.7.4-5.el9.x86_64.rpm 2.4 MB/s | 943 kB 00:00 2024-04-25T02:26:15.513 INFO:teuthology.orchestra.run.smithi176.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 604 kB/s | 35 kB 00:00 2024-04-25T02:26:15.514 INFO:teuthology.orchestra.run.smithi067.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-04-25T02:26:15.538 INFO:teuthology.orchestra.run.smithi176.stdout:(66/152): libtool-2.4.6-45.el9.x86_64.rpm 1.9 MB/s | 582 kB 00:00 2024-04-25T02:26:15.539 INFO:teuthology.orchestra.run.smithi067.stdout:(54/152): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2024-04-25T02:26:15.573 INFO:teuthology.orchestra.run.smithi067.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-04-25T02:26:15.598 INFO:teuthology.orchestra.run.smithi067.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-04-25T02:26:15.631 INFO:teuthology.orchestra.run.smithi067.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-04-25T02:26:15.657 INFO:teuthology.orchestra.run.smithi067.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 772 kB/s | 45 kB 00:00 2024-04-25T02:26:15.807 INFO:teuthology.orchestra.run.smithi067.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2024-04-25T02:26:15.839 INFO:teuthology.orchestra.run.smithi176.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 5.3 MB/s | 1.6 MB 00:00 2024-04-25T02:26:15.849 INFO:teuthology.orchestra.run.smithi067.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 3.0 MB/s | 582 kB 00:00 2024-04-25T02:26:15.874 INFO:teuthology.orchestra.run.smithi067.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 381 kB/s | 25 kB 00:00 2024-04-25T02:26:15.917 INFO:teuthology.orchestra.run.smithi067.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-04-25T02:26:16.000 INFO:teuthology.orchestra.run.smithi067.stdout:(63/152): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-04-25T02:26:16.025 INFO:teuthology.orchestra.run.smithi067.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-04-25T02:26:16.031 INFO:teuthology.orchestra.run.smithi176.stdout:(68/152): openblas-openmp-0.3.21-2.el9.x86_64.r 8.6 MB/s | 4.7 MB 00:00 2024-04-25T02:26:16.065 INFO:teuthology.orchestra.run.smithi176.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 4.0 MB/s | 911 kB 00:00 2024-04-25T02:26:16.075 INFO:teuthology.orchestra.run.smithi067.stdout:(65/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.1 MB/s | 3.0 MB 00:00 2024-04-25T02:26:16.101 INFO:teuthology.orchestra.run.smithi067.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 351 kB/s | 35 kB 00:00 2024-04-25T02:26:16.114 INFO:teuthology.orchestra.run.smithi176.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-04-25T02:26:16.281 INFO:teuthology.orchestra.run.smithi176.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-04-25T02:26:16.382 INFO:teuthology.orchestra.run.smithi176.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 876 kB/s | 87 kB 00:00 2024-04-25T02:26:16.440 INFO:teuthology.orchestra.run.smithi176.stdout:(73/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 4.8 MB/s | 4.4 MB 00:00 2024-04-25T02:26:16.532 INFO:teuthology.orchestra.run.smithi176.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-04-25T02:26:16.568 INFO:teuthology.orchestra.run.smithi067.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 3.4 MB/s | 1.6 MB 00:00 2024-04-25T02:26:16.616 INFO:teuthology.orchestra.run.smithi176.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-04-25T02:26:16.708 INFO:teuthology.orchestra.run.smithi176.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 280 kB/s | 26 kB 00:00 2024-04-25T02:26:16.791 INFO:teuthology.orchestra.run.smithi176.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 230 kB/s | 19 kB 00:00 2024-04-25T02:26:16.826 INFO:teuthology.orchestra.run.smithi067.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-04-25T02:26:16.849 INFO:teuthology.orchestra.run.smithi176.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-25T02:26:16.860 INFO:teuthology.orchestra.run.smithi067.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 3.1 MB/s | 911 kB 00:00 2024-04-25T02:26:16.917 INFO:teuthology.orchestra.run.smithi176.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 518 kB/s | 35 kB 00:00 2024-04-25T02:26:16.919 INFO:teuthology.orchestra.run.smithi067.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-04-25T02:26:16.992 INFO:teuthology.orchestra.run.smithi176.stdout:(80/152): postgresql-server-13.14-1.el9.x86_64. 6.2 MB/s | 5.8 MB 00:00 2024-04-25T02:26:17.035 INFO:teuthology.orchestra.run.smithi067.stdout:(71/152): openblas-openmp-0.3.21-2.el9.x86_64.r 4.7 MB/s | 4.7 MB 00:01 2024-04-25T02:26:17.067 INFO:teuthology.orchestra.run.smithi176.stdout:(81/152): python3-babel-2.9.1-2.el9.noarch.rpm 8.7 MB/s | 6.0 MB 00:00 2024-04-25T02:26:17.069 INFO:teuthology.orchestra.run.smithi067.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-04-25T02:26:17.092 INFO:teuthology.orchestra.run.smithi176.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-04-25T02:26:17.094 INFO:teuthology.orchestra.run.smithi067.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-25T02:26:17.134 INFO:teuthology.orchestra.run.smithi176.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-04-25T02:26:17.160 INFO:teuthology.orchestra.run.smithi176.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-04-25T02:26:17.193 INFO:teuthology.orchestra.run.smithi176.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 721 kB/s | 42 kB 00:00 2024-04-25T02:26:17.194 INFO:teuthology.orchestra.run.smithi067.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-04-25T02:26:17.235 INFO:teuthology.orchestra.run.smithi176.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-04-25T02:26:17.269 INFO:teuthology.orchestra.run.smithi176.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-04-25T02:26:17.270 INFO:teuthology.orchestra.run.smithi067.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-04-25T02:26:17.320 INFO:teuthology.orchestra.run.smithi176.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-04-25T02:26:17.336 INFO:teuthology.orchestra.run.smithi067.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 386 kB/s | 26 kB 00:00 2024-04-25T02:26:17.344 INFO:teuthology.orchestra.run.smithi176.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-04-25T02:26:17.403 INFO:teuthology.orchestra.run.smithi176.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 643 kB/s | 54 kB 00:00 2024-04-25T02:26:17.412 INFO:teuthology.orchestra.run.smithi067.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 255 kB/s | 19 kB 00:00 2024-04-25T02:26:17.486 INFO:teuthology.orchestra.run.smithi176.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 501 kB/s | 42 kB 00:00 2024-04-25T02:26:17.512 INFO:teuthology.orchestra.run.smithi067.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-04-25T02:26:17.596 INFO:teuthology.orchestra.run.smithi067.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 417 kB/s | 35 kB 00:00 2024-04-25T02:26:17.620 INFO:teuthology.orchestra.run.smithi176.stdout:(92/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.3 MB/s | 5.1 MB 00:00 2024-04-25T02:26:17.645 INFO:teuthology.orchestra.run.smithi176.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 278 kB/s | 44 kB 00:00 2024-04-25T02:26:17.671 INFO:teuthology.orchestra.run.smithi067.stdout:(80/152): python3-babel-2.9.1-2.el9.noarch.rpm 9.9 MB/s | 6.0 MB 00:00 2024-04-25T02:26:17.695 INFO:teuthology.orchestra.run.smithi176.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-04-25T02:26:17.721 INFO:teuthology.orchestra.run.smithi176.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 478 kB/s | 36 kB 00:00 2024-04-25T02:26:17.746 INFO:teuthology.orchestra.run.smithi067.stdout:(81/152): postgresql-server-13.14-1.el9.x86_64. 6.5 MB/s | 5.8 MB 00:00 2024-04-25T02:26:17.771 INFO:teuthology.orchestra.run.smithi176.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-04-25T02:26:17.772 INFO:teuthology.orchestra.run.smithi067.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-04-25T02:26:17.805 INFO:teuthology.orchestra.run.smithi176.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 305 kB 00:00 2024-04-25T02:26:17.838 INFO:teuthology.orchestra.run.smithi067.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-04-25T02:26:17.855 INFO:teuthology.orchestra.run.smithi176.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 693 kB/s | 58 kB 00:00 2024-04-25T02:26:17.888 INFO:teuthology.orchestra.run.smithi176.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-04-25T02:26:17.931 INFO:teuthology.orchestra.run.smithi176.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 846 kB/s | 64 kB 00:00 2024-04-25T02:26:17.931 INFO:teuthology.orchestra.run.smithi067.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 487 kB/s | 77 kB 00:00 2024-04-25T02:26:17.972 INFO:teuthology.orchestra.run.smithi176.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 536 kB/s | 45 kB 00:00 2024-04-25T02:26:18.056 INFO:teuthology.orchestra.run.smithi067.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 195 kB/s | 42 kB 00:00 2024-04-25T02:26:18.081 INFO:teuthology.orchestra.run.smithi067.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 1.7 MB/s | 269 kB 00:00 2024-04-25T02:26:18.140 INFO:teuthology.orchestra.run.smithi067.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-04-25T02:26:18.164 INFO:teuthology.orchestra.run.smithi176.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 95 kB/s | 22 kB 00:00 2024-04-25T02:26:18.182 INFO:teuthology.orchestra.run.smithi067.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-04-25T02:26:18.232 INFO:teuthology.orchestra.run.smithi067.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 555 kB/s | 51 kB 00:00 2024-04-25T02:26:18.274 INFO:teuthology.orchestra.run.smithi067.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 585 kB/s | 54 kB 00:00 2024-04-25T02:26:18.416 INFO:teuthology.orchestra.run.smithi067.stdout:(91/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.2 MB/s | 5.1 MB 00:00 2024-04-25T02:26:18.441 INFO:teuthology.orchestra.run.smithi067.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 249 kB/s | 42 kB 00:00 2024-04-25T02:26:18.500 INFO:teuthology.orchestra.run.smithi067.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 528 kB/s | 44 kB 00:00 2024-04-25T02:26:18.525 INFO:teuthology.orchestra.run.smithi067.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-04-25T02:26:18.575 INFO:teuthology.orchestra.run.smithi067.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 476 kB/s | 36 kB 00:00 2024-04-25T02:26:18.609 INFO:teuthology.orchestra.run.smithi067.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 568 kB/s | 47 kB 00:00 2024-04-25T02:26:18.667 INFO:teuthology.orchestra.run.smithi067.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 3.2 MB/s | 305 kB 00:00 2024-04-25T02:26:18.692 INFO:teuthology.orchestra.run.smithi067.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 693 kB/s | 58 kB 00:00 2024-04-25T02:26:18.751 INFO:teuthology.orchestra.run.smithi067.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-04-25T02:26:18.776 INFO:teuthology.orchestra.run.smithi067.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 761 kB/s | 64 kB 00:00 2024-04-25T02:26:18.835 INFO:teuthology.orchestra.run.smithi067.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 536 kB/s | 45 kB 00:00 2024-04-25T02:26:18.861 INFO:teuthology.orchestra.run.smithi067.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-04-25T02:26:18.881 INFO:teuthology.orchestra.run.smithi176.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 950 kB/s | 863 kB 00:00 2024-04-25T02:26:18.961 INFO:teuthology.orchestra.run.smithi067.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 6.7 MB/s | 863 kB 00:00 2024-04-25T02:26:19.031 INFO:teuthology.orchestra.run.smithi176.stdout:(104/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.6 MB/s | 16 MB 00:01 2024-04-25T02:26:19.198 INFO:teuthology.orchestra.run.smithi176.stdout:(105/152): abseil-cpp-20211102.0-3.el9.x86_64.r 530 kB/s | 548 kB 00:01 2024-04-25T02:26:19.553 INFO:teuthology.orchestra.run.smithi067.stdout:(104/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-04-25T02:26:19.682 INFO:teuthology.orchestra.run.smithi176.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 31 kB/s | 19 kB 00:00 2024-04-25T02:26:19.686 INFO:teuthology.orchestra.run.smithi067.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 443 kB/s | 309 kB 00:00 2024-04-25T02:26:19.712 INFO:teuthology.orchestra.run.smithi067.stdout:(106/152): abseil-cpp-20211102.0-3.el9.x86_64.r 644 kB/s | 548 kB 00:00 2024-04-25T02:26:19.828 INFO:teuthology.orchestra.run.smithi067.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 223 kB/s | 26 kB 00:00 2024-04-25T02:26:19.865 INFO:teuthology.orchestra.run.smithi176.stdout:(107/152): libarrow-9.0.0-10.el9.x86_64.rpm 6.9 MB/s | 4.4 MB 00:00 2024-04-25T02:26:19.891 INFO:teuthology.orchestra.run.smithi176.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 124 kB/s | 26 kB 00:00 2024-04-25T02:26:19.912 INFO:teuthology.orchestra.run.smithi067.stdout:(108/152): grpc-data-1.46.7-10.el9.noarch.rpm 54 kB/s | 19 kB 00:00 2024-04-25T02:26:19.916 INFO:teuthology.orchestra.run.smithi176.stdout:(109/152): gperftools-libs-2.9.1-2.el9.x86_64.r 298 kB/s | 309 kB 00:01 2024-04-25T02:26:19.937 INFO:teuthology.orchestra.run.smithi067.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 447 kB/s | 49 kB 00:00 2024-04-25T02:26:20.002 INFO:teuthology.orchestra.run.smithi176.stdout:(110/152): liboath-2.6.7-2.el9.x86_64.rpm 358 kB/s | 49 kB 00:00 2024-04-25T02:26:20.088 INFO:teuthology.orchestra.run.smithi067.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-04-25T02:26:20.110 INFO:teuthology.orchestra.run.smithi176.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 779 kB/s | 151 kB 00:00 2024-04-25T02:26:20.138 INFO:teuthology.orchestra.run.smithi067.stdout:(111/152): libunwind-1.6.2-1.el9.x86_64.rpm 299 kB/s | 67 kB 00:00 2024-04-25T02:26:20.169 INFO:teuthology.orchestra.run.smithi176.stdout:(112/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.9 MB/s | 838 kB 00:00 2024-04-25T02:26:20.194 INFO:teuthology.orchestra.run.smithi176.stdout:(113/152): libunwind-1.6.2-1.el9.x86_64.rpm 222 kB/s | 67 kB 00:00 2024-04-25T02:26:20.213 INFO:teuthology.orchestra.run.smithi067.stdout:(112/152): libarrow-9.0.0-10.el9.x86_64.rpm 8.4 MB/s | 4.4 MB 00:00 2024-04-25T02:26:20.311 INFO:teuthology.orchestra.run.smithi176.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 306 kB/s | 43 kB 00:00 2024-04-25T02:26:20.321 INFO:teuthology.orchestra.run.smithi067.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 401 kB/s | 43 kB 00:00 2024-04-25T02:26:20.353 INFO:teuthology.orchestra.run.smithi176.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 203 kB/s | 32 kB 00:00 2024-04-25T02:26:20.372 INFO:teuthology.orchestra.run.smithi067.stdout:(114/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.9 MB/s | 838 kB 00:00 2024-04-25T02:26:20.403 INFO:teuthology.orchestra.run.smithi176.stdout:(116/152): python3-asyncssh-2.13.2-5.el9.noarch 1.8 MB/s | 548 kB 00:00 2024-04-25T02:26:20.442 INFO:teuthology.orchestra.run.smithi067.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 269 kB/s | 32 kB 00:00 2024-04-25T02:26:20.445 INFO:teuthology.orchestra.run.smithi176.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 112 kB/s | 15 kB 00:00 2024-04-25T02:26:20.472 INFO:teuthology.orchestra.run.smithi067.stdout:(116/152): python3-asyncssh-2.13.2-5.el9.noarch 1.6 MB/s | 548 kB 00:00 2024-04-25T02:26:20.497 INFO:teuthology.orchestra.run.smithi067.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 119 kB/s | 15 kB 00:00 2024-04-25T02:26:20.548 INFO:teuthology.orchestra.run.smithi067.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.6 MB/s | 172 kB 00:00 2024-04-25T02:26:20.588 INFO:teuthology.orchestra.run.smithi176.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 1.9 MB/s | 358 kB 00:00 2024-04-25T02:26:20.607 INFO:teuthology.orchestra.run.smithi067.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-04-25T02:26:20.612 INFO:teuthology.orchestra.run.smithi176.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.8 MB/s | 303 kB 00:00 2024-04-25T02:26:20.637 INFO:teuthology.orchestra.run.smithi176.stdout:(120/152): python3-cheroot-8.6.0-4.el9.noarch.r 604 kB/s | 172 kB 00:00 2024-04-25T02:26:20.738 INFO:teuthology.orchestra.run.smithi176.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 235 kB/s | 35 kB 00:00 2024-04-25T02:26:20.748 INFO:teuthology.orchestra.run.smithi067.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.2 MB/s | 303 kB 00:00 2024-04-25T02:26:20.763 INFO:teuthology.orchestra.run.smithi176.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 1.3 MB/s | 206 kB 00:00 2024-04-25T02:26:20.774 INFO:teuthology.orchestra.run.smithi067.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 156 kB/s | 35 kB 00:00 2024-04-25T02:26:20.799 INFO:teuthology.orchestra.run.smithi067.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 1.0 MB/s | 206 kB 00:00 2024-04-25T02:26:20.885 INFO:teuthology.orchestra.run.smithi067.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-04-25T02:26:20.905 INFO:teuthology.orchestra.run.smithi176.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 867 kB/s | 144 kB 00:00 2024-04-25T02:26:20.910 INFO:teuthology.orchestra.run.smithi067.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 96 kB/s | 11 kB 00:00 2024-04-25T02:26:20.930 INFO:teuthology.orchestra.run.smithi176.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 64 kB/s | 11 kB 00:00 2024-04-25T02:26:20.994 INFO:teuthology.orchestra.run.smithi067.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 162 kB/s | 18 kB 00:00 2024-04-25T02:26:21.019 INFO:teuthology.orchestra.run.smithi067.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 213 kB/s | 23 kB 00:00 2024-04-25T02:26:21.030 INFO:teuthology.orchestra.run.smithi176.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 141 kB/s | 18 kB 00:00 2024-04-25T02:26:21.064 INFO:teuthology.orchestra.run.smithi176.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 173 kB/s | 23 kB 00:00 2024-04-25T02:26:21.094 INFO:teuthology.orchestra.run.smithi067.stdout:(127/152): python3-grpcio-1.46.7-10.el9.x86_64. 5.9 MB/s | 2.0 MB 00:00 2024-04-25T02:26:21.119 INFO:teuthology.orchestra.run.smithi067.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 155 kB/s | 19 kB 00:00 2024-04-25T02:26:21.144 INFO:teuthology.orchestra.run.smithi067.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 157 kB/s | 20 kB 00:00 2024-04-25T02:26:21.164 INFO:teuthology.orchestra.run.smithi176.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 146 kB/s | 19 kB 00:00 2024-04-25T02:26:21.198 INFO:teuthology.orchestra.run.smithi176.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 147 kB/s | 20 kB 00:00 2024-04-25T02:26:21.245 INFO:teuthology.orchestra.run.smithi067.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-04-25T02:26:21.270 INFO:teuthology.orchestra.run.smithi067.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 370 kB/s | 46 kB 00:00 2024-04-25T02:26:21.281 INFO:teuthology.orchestra.run.smithi176.stdout:(129/152): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-04-25T02:26:21.295 INFO:teuthology.orchestra.run.smithi067.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 525 kB/s | 79 kB 00:00 2024-04-25T02:26:21.332 INFO:teuthology.orchestra.run.smithi176.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-04-25T02:26:21.345 INFO:teuthology.orchestra.run.smithi067.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 576 kB/s | 58 kB 00:00 2024-04-25T02:26:21.348 INFO:teuthology.orchestra.run.smithi176.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 308 kB/s | 46 kB 00:00 2024-04-25T02:26:21.371 INFO:teuthology.orchestra.run.smithi067.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-04-25T02:26:21.396 INFO:teuthology.orchestra.run.smithi067.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2024-04-25T02:26:21.416 INFO:teuthology.orchestra.run.smithi176.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 589 kB/s | 79 kB 00:00 2024-04-25T02:26:21.438 INFO:teuthology.orchestra.run.smithi067.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 976 kB/s | 90 kB 00:00 2024-04-25T02:26:21.463 INFO:teuthology.orchestra.run.smithi067.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 307 kB/s | 28 kB 00:00 2024-04-25T02:26:21.489 INFO:teuthology.orchestra.run.smithi067.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-04-25T02:26:21.507 INFO:teuthology.orchestra.run.smithi176.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-04-25T02:26:21.539 INFO:teuthology.orchestra.run.smithi067.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-04-25T02:26:21.564 INFO:teuthology.orchestra.run.smithi067.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 589 kB/s | 59 kB 00:00 2024-04-25T02:26:21.589 INFO:teuthology.orchestra.run.smithi067.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 355 kB/s | 36 kB 00:00 2024-04-25T02:26:21.591 INFO:teuthology.orchestra.run.smithi176.stdout:(134/152): python3-natsort-7.1.1-5.el9.noarch.r 223 kB/s | 58 kB 00:00 2024-04-25T02:26:21.608 INFO:teuthology.orchestra.run.smithi176.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 85 kB/s | 16 kB 00:00 2024-04-25T02:26:21.631 INFO:teuthology.orchestra.run.smithi067.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 554 kB/s | 51 kB 00:00 2024-04-25T02:26:21.650 INFO:teuthology.orchestra.run.smithi176.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 633 kB/s | 90 kB 00:00 2024-04-25T02:26:21.665 INFO:teuthology.orchestra.run.smithi067.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-04-25T02:26:21.707 INFO:teuthology.orchestra.run.smithi067.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 765 kB/s | 90 kB 00:00 2024-04-25T02:26:21.725 INFO:teuthology.orchestra.run.smithi176.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 211 kB/s | 28 kB 00:00 2024-04-25T02:26:21.740 INFO:teuthology.orchestra.run.smithi067.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-04-25T02:26:21.750 INFO:teuthology.orchestra.run.smithi176.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 216 kB/s | 31 kB 00:00 2024-04-25T02:26:21.765 INFO:teuthology.orchestra.run.smithi067.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2024-04-25T02:26:21.800 INFO:teuthology.orchestra.run.smithi176.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-04-25T02:26:21.816 INFO:teuthology.orchestra.run.smithi067.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-25T02:26:21.859 INFO:teuthology.orchestra.run.smithi176.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 442 kB/s | 59 kB 00:00 2024-04-25T02:26:21.893 INFO:teuthology.orchestra.run.smithi176.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 251 kB/s | 36 kB 00:00 2024-04-25T02:26:21.924 INFO:teuthology.orchestra.run.smithi067.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-04-25T02:26:21.943 INFO:teuthology.orchestra.run.smithi176.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 358 kB/s | 51 kB 00:00 2024-04-25T02:26:22.002 INFO:teuthology.orchestra.run.smithi176.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-04-25T02:26:22.035 INFO:teuthology.orchestra.run.smithi176.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 630 kB/s | 90 kB 00:00 2024-04-25T02:26:22.127 INFO:teuthology.orchestra.run.smithi176.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 2.3 MB/s | 427 kB 00:00 2024-04-25T02:26:22.152 INFO:teuthology.orchestra.run.smithi176.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 133 kB/s | 20 kB 00:00 2024-04-25T02:26:22.186 INFO:teuthology.orchestra.run.smithi176.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-04-25T02:26:22.545 INFO:teuthology.orchestra.run.smithi176.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 3.8 MB/s | 1.6 MB 00:00 2024-04-25T02:26:22.608 INFO:teuthology.orchestra.run.smithi067.stdout:(149/152): librbd1-19.0.0-2445.gd2c45d97.el9.x8 4.0 MB/s | 3.1 MB 00:00 2024-04-25T02:26:22.700 INFO:teuthology.orchestra.run.smithi067.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 1.7 MB/s | 1.3 MB 00:00 2024-04-25T02:26:23.003 INFO:teuthology.orchestra.run.smithi176.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 2.9 MB/s | 1.3 MB 00:00 2024-04-25T02:26:23.228 INFO:teuthology.orchestra.run.smithi176.stdout:(150/152): librbd1-19.0.0-2445.gd2c45d97.el9.x8 3.0 MB/s | 3.1 MB 00:01 2024-04-25T02:26:23.279 INFO:teuthology.orchestra.run.smithi176.stdout:(151/152): librados2-19.0.0-2445.gd2c45d97.el9. 3.0 MB/s | 3.4 MB 00:01 2024-04-25T02:26:23.320 INFO:teuthology.orchestra.run.smithi176.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 7.6 MB/s | 2.4 MB 00:00 2024-04-25T02:26:23.326 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:26:23.326 INFO:teuthology.orchestra.run.smithi176.stdout:Total 9.4 MB/s | 220 MB 00:23 2024-04-25T02:26:23.925 INFO:teuthology.orchestra.run.smithi067.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 1.8 MB/s | 2.4 MB 00:01 2024-04-25T02:26:24.436 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-04-25T02:26:24.579 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-04-25T02:26:24.579 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-04-25T02:26:25.333 INFO:teuthology.orchestra.run.smithi067.stdout:(152/152): librados2-19.0.0-2445.gd2c45d97.el9. 972 kB/s | 3.4 MB 00:03 2024-04-25T02:26:25.339 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:26:25.339 INFO:teuthology.orchestra.run.smithi067.stdout:Total 8.2 MB/s | 220 MB 00:26 2024-04-25T02:26:26.360 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-04-25T02:26:26.360 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-04-25T02:26:26.442 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-04-25T02:26:26.602 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-04-25T02:26:26.602 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-04-25T02:26:28.461 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-04-25T02:26:28.461 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-04-25T02:26:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-04-25T02:26:32.399 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T02:26:32.437 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T02:26:32.490 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T02:26:32.524 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T02:26:32.550 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T02:26:32.592 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T02:26:32.984 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T02:26:33.035 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T02:26:33.160 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T02:26:33.186 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T02:26:33.278 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T02:26:33.315 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-25T02:26:33.468 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T02:26:33.521 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T02:26:33.548 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T02:26:33.652 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T02:26:33.682 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-25T02:26:33.728 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-25T02:26:33.750 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T02:26:33.771 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T02:26:33.954 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T02:26:33.982 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T02:26:34.106 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T02:26:34.202 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T02:26:34.231 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T02:26:34.266 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T02:26:34.330 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T02:26:34.373 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T02:26:34.417 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T02:26:34.449 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T02:26:34.477 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T02:26:34.519 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-04-25T02:26:34.545 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T02:26:34.599 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T02:26:34.624 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T02:26:34.630 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T02:26:34.665 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T02:26:34.677 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T02:26:34.730 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T02:26:34.740 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T02:26:34.781 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T02:26:34.784 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 31/156 2024-04-25T02:26:34.806 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T02:26:34.819 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 32/156 2024-04-25T02:26:34.848 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 33/156 2024-04-25T02:26:34.848 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T02:26:34.916 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T02:26:34.962 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T02:26:35.036 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T02:26:35.166 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T02:26:35.196 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T02:26:35.231 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T02:26:35.306 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T02:26:35.422 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T02:26:35.457 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T02:26:35.533 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T02:26:35.562 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-25T02:26:35.718 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T02:26:35.748 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T02:26:35.776 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T02:26:35.826 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T02:26:35.855 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T02:26:35.890 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T02:26:35.920 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 43/156 2024-04-25T02:26:35.950 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T02:26:35.961 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T02:26:36.100 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T02:26:36.129 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-25T02:26:36.131 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T02:26:36.189 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T02:26:36.203 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-25T02:26:36.214 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T02:26:36.243 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T02:26:36.244 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T02:26:36.315 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T02:26:36.340 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T02:26:36.381 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T02:26:36.423 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T02:26:36.432 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T02:26:36.458 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T02:26:36.463 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T02:26:36.505 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T02:26:36.544 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T02:26:36.574 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T02:26:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T02:26:36.680 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T02:26:36.712 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T02:26:36.732 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T02:26:36.748 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T02:26:36.763 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T02:26:36.803 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T02:26:36.824 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T02:26:36.872 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T02:26:36.896 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T02:26:36.915 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T02:26:36.937 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T02:26:36.947 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T02:26:36.968 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T02:26:36.975 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T02:26:36.994 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T02:26:37.019 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T02:26:37.048 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T02:26:37.092 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T02:26:37.100 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T02:26:37.128 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T02:26:37.180 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T02:26:37.227 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T02:26:37.259 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T02:26:37.260 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T02:26:37.287 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T02:26:37.290 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 31/156 2024-04-25T02:26:37.321 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T02:26:37.335 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 32/156 2024-04-25T02:26:37.363 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 33/156 2024-04-25T02:26:37.385 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T02:26:37.416 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T02:26:37.436 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T02:26:37.447 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T02:26:37.473 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T02:26:37.478 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T02:26:37.523 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T02:26:37.556 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T02:26:37.568 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T02:26:37.599 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T02:26:37.686 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T02:26:37.701 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T02:26:37.729 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T02:26:37.757 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T02:26:37.760 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T02:26:37.807 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T02:26:37.905 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T02:26:37.961 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T02:26:38.311 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T02:26:38.420 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T02:26:38.454 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T02:26:38.497 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T02:26:38.527 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 43/156 2024-04-25T02:26:38.569 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T02:26:38.675 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T02:26:38.717 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T02:26:38.737 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T02:26:38.750 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T02:26:38.797 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T02:26:38.848 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T02:26:38.852 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T02:26:38.899 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T02:26:38.944 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T02:26:38.980 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T02:26:38.985 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T02:26:39.017 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T02:26:39.018 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T02:26:39.065 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T02:26:39.099 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T02:26:39.144 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T02:26:39.186 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T02:26:39.197 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T02:26:39.233 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T02:26:39.311 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T02:26:39.330 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T02:26:39.374 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T02:26:39.412 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T02:26:39.454 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T02:26:39.552 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T02:26:39.587 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T02:26:39.627 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T02:26:39.660 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T02:26:39.677 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T02:26:39.754 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T02:26:39.892 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T02:26:39.925 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T02:26:39.948 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T02:26:39.953 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T02:26:39.988 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T02:26:40.027 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T02:26:40.055 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T02:26:40.059 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T02:26:40.089 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T02:26:40.123 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T02:26:40.165 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T02:26:40.207 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T02:26:40.241 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T02:26:40.334 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T02:26:40.380 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T02:26:40.411 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T02:26:40.458 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T02:26:40.569 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T02:26:40.630 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T02:26:41.272 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T02:26:41.361 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T02:26:41.388 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T02:26:41.405 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T02:26:41.430 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T02:26:41.451 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T02:26:41.485 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T02:26:41.588 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T02:26:41.635 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T02:26:41.726 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T02:26:41.741 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T02:26:41.761 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T02:26:41.776 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-25T02:26:41.867 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-25T02:26:41.897 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 100/156 2024-04-25T02:26:41.934 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T02:26:41.945 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T02:26:41.975 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T02:26:42.055 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T02:26:42.404 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T02:26:42.437 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-25T02:26:42.508 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-25T02:26:42.539 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 104/156 2024-04-25T02:26:42.741 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T02:26:42.862 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T02:26:44.193 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T02:26:44.254 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T02:26:44.291 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T02:26:44.324 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T02:26:44.660 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T02:26:44.695 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-25T02:26:44.786 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-25T02:26:44.795 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T02:26:44.816 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 100/156 2024-04-25T02:26:44.843 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T02:26:44.853 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T02:26:45.348 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T02:26:45.381 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-25T02:26:45.387 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T02:26:45.438 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-25T02:26:45.452 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-25T02:26:45.482 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 104/156 2024-04-25T02:26:45.540 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-25T02:26:45.540 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T02:26:45.540 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T02:26:45.540 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:26:45.572 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-25T02:26:47.825 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T02:26:47.862 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T02:26:48.432 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T02:26:48.482 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-25T02:26:48.573 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-25T02:26:48.573 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T02:26:48.574 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T02:26:48.574 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:26:48.600 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-25T02:26:56.906 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-25T02:26:56.980 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /sys 2024-04-25T02:26:56.980 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /proc 2024-04-25T02:26:56.980 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /mnt 2024-04-25T02:26:56.980 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /var/tmp 2024-04-25T02:26:56.980 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /home 2024-04-25T02:26:56.980 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /root 2024-04-25T02:26:56.981 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /tmp 2024-04-25T02:26:56.981 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:26:57.083 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-25T02:26:57.098 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-25T02:26:57.098 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:26:57.098 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T02:26:57.098 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:26:58.586 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-25T02:26:58.611 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-25T02:26:58.611 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:26:58.612 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T02:26:58.612 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T02:26:58.612 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T02:26:58.612 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:26:58.845 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-25T02:26:58.867 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-25T02:26:58.867 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:26:58.867 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T02:26:58.867 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T02:26:58.867 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T02:26:58.867 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:26:59.312 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-25T02:26:59.334 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-25T02:26:59.334 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:26:59.334 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T02:26:59.334 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T02:26:59.334 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T02:26:59.334 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:26:59.434 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T02:26:59.490 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T02:26:59.545 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T02:26:59.730 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T02:26:59.779 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T02:26:59.857 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T02:26:59.945 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T02:27:00.085 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T02:27:00.120 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T02:27:00.152 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T02:27:00.179 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T02:27:00.637 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-25T02:27:00.664 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-25T02:27:00.664 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /sys 2024-04-25T02:27:00.664 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /proc 2024-04-25T02:27:00.664 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /mnt 2024-04-25T02:27:00.664 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /var/tmp 2024-04-25T02:27:00.664 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /home 2024-04-25T02:27:00.664 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /root 2024-04-25T02:27:00.664 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /tmp 2024-04-25T02:27:00.664 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:00.669 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-25T02:27:00.701 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 124/156 2024-04-25T02:27:00.779 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 125/156 2024-04-25T02:27:00.809 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-25T02:27:00.845 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-25T02:27:00.862 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-25T02:27:00.862 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:27:00.862 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T02:27:00.862 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:01.851 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-25T02:27:01.903 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-25T02:27:02.392 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-25T02:27:02.417 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-25T02:27:02.417 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:27:02.417 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T02:27:02.417 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T02:27:02.417 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T02:27:02.417 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:02.649 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-25T02:27:02.674 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-25T02:27:02.674 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:27:02.675 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T02:27:02.675 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T02:27:02.675 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T02:27:02.675 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:02.874 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-25T02:27:02.903 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-25T02:27:03.015 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-25T02:27:03.133 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-25T02:27:03.157 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-25T02:27:03.158 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:27:03.158 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T02:27:03.158 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T02:27:03.158 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T02:27:03.158 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:03.168 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 129/156 2024-04-25T02:27:03.197 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-25T02:27:03.220 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-25T02:27:03.220 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:27:03.220 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T02:27:03.220 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T02:27:03.220 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T02:27:03.220 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:03.264 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-25T02:27:03.271 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T02:27:03.275 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-25T02:27:03.330 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T02:27:03.374 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 132/156 2024-04-25T02:27:03.394 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T02:27:03.429 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 133/156 2024-04-25T02:27:03.593 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T02:27:03.643 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T02:27:03.724 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T02:27:03.814 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T02:27:03.955 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T02:27:04.009 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T02:27:04.041 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T02:27:04.068 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T02:27:04.330 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T02:27:04.358 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-25T02:27:04.381 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-25T02:27:04.381 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:27:04.381 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T02:27:04.381 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T02:27:04.381 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T02:27:04.381 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:04.426 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-25T02:27:04.448 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-25T02:27:04.448 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:27:04.448 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T02:27:04.448 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:04.493 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-25T02:27:04.515 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-25T02:27:04.516 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:27:04.516 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T02:27:04.516 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T02:27:04.516 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T02:27:04.516 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:04.518 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-25T02:27:04.550 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-25T02:27:04.573 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 124/156 2024-04-25T02:27:04.629 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 125/156 2024-04-25T02:27:04.673 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-25T02:27:04.827 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-25T02:27:04.850 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-25T02:27:04.850 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:27:04.850 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T02:27:04.850 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T02:27:04.850 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T02:27:04.850 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:05.763 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-25T02:27:05.799 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-25T02:27:06.814 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-25T02:27:06.841 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-25T02:27:06.952 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-25T02:27:07.129 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 129/156 2024-04-25T02:27:07.152 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-25T02:27:07.176 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-25T02:27:07.177 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:27:07.177 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T02:27:07.177 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T02:27:07.177 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T02:27:07.177 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:07.228 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-25T02:27:07.239 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-25T02:27:07.341 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 132/156 2024-04-25T02:27:07.394 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 133/156 2024-04-25T02:27:08.339 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T02:27:08.380 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-25T02:27:08.404 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-25T02:27:08.404 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:27:08.404 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T02:27:08.404 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T02:27:08.404 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T02:27:08.404 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:08.447 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-25T02:27:08.470 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-25T02:27:08.470 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:27:08.470 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T02:27:08.470 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:08.523 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-25T02:27:08.547 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-25T02:27:08.547 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:27:08.547 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T02:27:08.547 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T02:27:08.547 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T02:27:08.547 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:08.874 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-25T02:27:08.897 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-25T02:27:08.897 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T02:27:08.897 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T02:27:08.898 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T02:27:08.898 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T02:27:08.898 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:09.380 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 139/156 2024-04-25T02:27:09.421 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 140/156 2024-04-25T02:27:09.462 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 141/156 2024-04-25T02:27:09.494 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T02:27:09.530 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T02:27:09.710 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 144/156 2024-04-25T02:27:09.750 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T02:27:09.781 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 146/156 2024-04-25T02:27:10.352 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T02:27:10.394 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T02:27:10.414 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T02:27:11.242 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 148/156 2024-04-25T02:27:11.341 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T02:27:11.381 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T02:27:11.462 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T02:27:11.494 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T02:27:11.495 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T02:27:11.570 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T02:27:11.595 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T02:27:11.598 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T02:27:11.678 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T02:27:11.752 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T02:27:13.653 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 139/156 2024-04-25T02:27:13.703 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 140/156 2024-04-25T02:27:13.743 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 141/156 2024-04-25T02:27:13.775 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T02:27:13.802 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T02:27:13.995 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 144/156 2024-04-25T02:27:14.040 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T02:27:14.070 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 146/156 2024-04-25T02:27:14.787 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T02:27:14.825 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T02:27:14.846 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T02:27:15.755 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 148/156 2024-04-25T02:27:15.847 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T02:27:15.889 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T02:27:15.972 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T02:27:16.001 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T02:27:16.001 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T02:27:16.085 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T02:27:16.118 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T02:27:16.118 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T02:27:16.190 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T02:27:16.261 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T02:27:17.241 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T02:27:17.241 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 1/156 2024-04-25T02:27:17.241 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2/156 2024-04-25T02:27:17.241 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 3/156 2024-04-25T02:27:17.241 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 4/156 2024-04-25T02:27:17.241 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 5/156 2024-04-25T02:27:17.241 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 6/156 2024-04-25T02:27:17.242 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 7/156 2024-04-25T02:27:17.242 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T02:27:17.242 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T02:27:17.242 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-25T02:27:17.242 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/156 2024-04-25T02:27:17.242 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 12/156 2024-04-25T02:27:17.242 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T02:27:17.242 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 14/156 2024-04-25T02:27:17.242 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 15/156 2024-04-25T02:27:17.242 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 16/156 2024-04-25T02:27:17.242 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 17/156 2024-04-25T02:27:17.242 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 18/156 2024-04-25T02:27:17.242 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 19/156 2024-04-25T02:27:17.243 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 20/156 2024-04-25T02:27:17.243 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 21/156 2024-04-25T02:27:17.243 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 22/156 2024-04-25T02:27:17.243 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 23/156 2024-04-25T02:27:17.243 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 24/156 2024-04-25T02:27:17.243 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 25/156 2024-04-25T02:27:17.243 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 26/156 2024-04-25T02:27:17.243 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 27/156 2024-04-25T02:27:17.243 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 28/156 2024-04-25T02:27:17.243 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 29/156 2024-04-25T02:27:17.255 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 30/156 2024-04-25T02:27:17.255 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 31/156 2024-04-25T02:27:17.255 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 32/156 2024-04-25T02:27:17.255 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 33/156 2024-04-25T02:27:17.255 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 34/156 2024-04-25T02:27:17.255 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 35/156 2024-04-25T02:27:17.255 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 36/156 2024-04-25T02:27:17.255 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 37/156 2024-04-25T02:27:17.255 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 38/156 2024-04-25T02:27:17.256 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 39/156 2024-04-25T02:27:17.256 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T02:27:17.256 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T02:27:17.256 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T02:27:17.256 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T02:27:17.256 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T02:27:17.256 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T02:27:17.256 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T02:27:17.256 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T02:27:17.256 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T02:27:17.256 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T02:27:17.256 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T02:27:17.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T02:27:17.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T02:27:17.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T02:27:17.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T02:27:17.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T02:27:17.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T02:27:17.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T02:27:17.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T02:27:17.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T02:27:17.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T02:27:17.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T02:27:17.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T02:27:17.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T02:27:17.258 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T02:27:17.258 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T02:27:17.258 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T02:27:17.258 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T02:27:17.258 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T02:27:17.258 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T02:27:17.258 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T02:27:17.258 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T02:27:17.258 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T02:27:17.258 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T02:27:17.258 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T02:27:17.258 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T02:27:17.258 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T02:27:17.258 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T02:27:17.259 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T02:27:17.259 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T02:27:17.259 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T02:27:17.259 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T02:27:17.259 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T02:27:17.259 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T02:27:17.259 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T02:27:17.259 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T02:27:17.259 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T02:27:17.259 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T02:27:17.259 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T02:27:17.259 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T02:27:17.259 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T02:27:17.260 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T02:27:17.260 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T02:27:17.260 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T02:27:17.260 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T02:27:17.260 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T02:27:17.260 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T02:27:17.260 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T02:27:17.260 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T02:27:17.260 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T02:27:17.260 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T02:27:17.260 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T02:27:17.260 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T02:27:17.260 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T02:27:17.260 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T02:27:17.260 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T02:27:17.261 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T02:27:17.261 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T02:27:17.261 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T02:27:17.261 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T02:27:17.261 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T02:27:17.261 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T02:27:17.261 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T02:27:17.261 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T02:27:17.261 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T02:27:17.261 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T02:27:17.261 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T02:27:17.261 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T02:27:17.261 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T02:27:17.261 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T02:27:17.261 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T02:27:17.261 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T02:27:17.262 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T02:27:17.262 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T02:27:17.262 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T02:27:17.262 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T02:27:17.262 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T02:27:17.262 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T02:27:17.262 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T02:27:17.262 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T02:27:17.262 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T02:27:17.262 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T02:27:17.262 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T02:27:17.262 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T02:27:17.262 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T02:27:17.263 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T02:27:17.263 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T02:27:17.263 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T02:27:17.263 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T02:27:17.263 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T02:27:17.263 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T02:27:17.263 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T02:27:17.263 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T02:27:17.263 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T02:27:17.263 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T02:27:17.263 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T02:27:17.263 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T02:27:17.263 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T02:27:17.263 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T02:27:17.264 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 149/156 2024-04-25T02:27:17.264 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T02:27:17.264 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 151/156 2024-04-25T02:27:17.264 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T02:27:17.264 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T02:27:17.264 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T02:27:17.264 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T02:27:19.348 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T02:27:19.348 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:19.348 INFO:teuthology.orchestra.run.smithi176.stdout:Upgraded: 2024-04-25T02:27:19.348 INFO:teuthology.orchestra.run.smithi176.stdout: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.349 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.349 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T02:27:19.349 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T02:27:19.349 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-04-25T02:27:19.349 INFO:teuthology.orchestra.run.smithi176.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T02:27:19.349 INFO:teuthology.orchestra.run.smithi176.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T02:27:19.349 INFO:teuthology.orchestra.run.smithi176.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T02:27:19.349 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T02:27:19.349 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.349 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.349 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.349 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.349 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:19.349 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.349 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.350 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.350 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:19.350 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:19.350 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:19.350 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:19.350 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:19.350 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.350 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.350 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:19.350 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.350 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.350 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.350 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:19.351 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:19.351 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.351 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.351 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:19.351 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T02:27:19.351 INFO:teuthology.orchestra.run.smithi176.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T02:27:19.351 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T02:27:19.351 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T02:27:19.351 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T02:27:19.351 INFO:teuthology.orchestra.run.smithi176.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T02:27:19.351 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T02:27:19.351 INFO:teuthology.orchestra.run.smithi176.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T02:27:19.351 INFO:teuthology.orchestra.run.smithi176.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T02:27:19.351 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T02:27:19.352 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T02:27:19.352 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.352 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.352 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.352 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T02:27:19.352 INFO:teuthology.orchestra.run.smithi176.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T02:27:19.352 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T02:27:19.352 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T02:27:19.352 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T02:27:19.352 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.352 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.352 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T02:27:19.352 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.352 INFO:teuthology.orchestra.run.smithi176.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T02:27:19.353 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T02:27:19.353 INFO:teuthology.orchestra.run.smithi176.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T02:27:19.353 INFO:teuthology.orchestra.run.smithi176.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T02:27:19.353 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T02:27:19.353 INFO:teuthology.orchestra.run.smithi176.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T02:27:19.353 INFO:teuthology.orchestra.run.smithi176.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T02:27:19.353 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T02:27:19.353 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T02:27:19.353 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T02:27:19.353 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T02:27:19.353 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T02:27:19.353 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T02:27:19.353 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T02:27:19.353 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T02:27:19.354 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T02:27:19.354 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T02:27:19.354 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T02:27:19.354 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T02:27:19.354 INFO:teuthology.orchestra.run.smithi176.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T02:27:19.354 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T02:27:19.354 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T02:27:19.354 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T02:27:19.354 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.354 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.354 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.354 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T02:27:19.354 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T02:27:19.354 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T02:27:19.355 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T02:27:19.355 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T02:27:19.355 INFO:teuthology.orchestra.run.smithi176.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T02:27:19.355 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T02:27:19.355 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T02:27:19.355 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T02:27:19.355 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T02:27:19.355 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T02:27:19.355 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T02:27:19.355 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T02:27:19.355 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T02:27:19.355 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T02:27:19.355 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T02:27:19.355 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T02:27:19.356 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T02:27:19.356 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T02:27:19.356 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T02:27:19.356 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T02:27:19.356 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T02:27:19.356 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T02:27:19.356 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T02:27:19.356 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T02:27:19.357 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T02:27:19.357 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T02:27:19.357 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T02:27:19.357 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T02:27:19.357 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T02:27:19.357 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T02:27:19.357 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T02:27:19.357 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T02:27:19.357 INFO:teuthology.orchestra.run.smithi176.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T02:27:19.357 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T02:27:19.357 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T02:27:19.357 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T02:27:19.357 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T02:27:19.357 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T02:27:19.358 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T02:27:19.358 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.358 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.358 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T02:27:19.358 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T02:27:19.358 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T02:27:19.358 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.358 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T02:27:19.358 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T02:27:19.358 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T02:27:19.358 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T02:27:19.358 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T02:27:19.358 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T02:27:19.359 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T02:27:19.359 INFO:teuthology.orchestra.run.smithi176.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T02:27:19.359 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T02:27:19.359 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T02:27:19.359 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T02:27:19.359 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T02:27:19.359 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T02:27:19.359 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T02:27:19.359 INFO:teuthology.orchestra.run.smithi176.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T02:27:19.359 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.359 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.359 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:19.359 INFO:teuthology.orchestra.run.smithi176.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T02:27:19.359 INFO:teuthology.orchestra.run.smithi176.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T02:27:19.359 INFO:teuthology.orchestra.run.smithi176.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T02:27:19.360 INFO:teuthology.orchestra.run.smithi176.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T02:27:19.360 INFO:teuthology.orchestra.run.smithi176.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T02:27:19.360 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T02:27:19.360 INFO:teuthology.orchestra.run.smithi176.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T02:27:19.360 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:19.360 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-04-25T02:27:19.744 DEBUG:teuthology.parallel:result is None 2024-04-25T02:27:21.902 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T02:27:21.902 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 1/156 2024-04-25T02:27:21.902 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2/156 2024-04-25T02:27:21.902 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 3/156 2024-04-25T02:27:21.902 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 4/156 2024-04-25T02:27:21.902 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 5/156 2024-04-25T02:27:21.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 6/156 2024-04-25T02:27:21.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 7/156 2024-04-25T02:27:21.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T02:27:21.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T02:27:21.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-25T02:27:21.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/156 2024-04-25T02:27:21.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 12/156 2024-04-25T02:27:21.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T02:27:21.904 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 14/156 2024-04-25T02:27:21.904 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 15/156 2024-04-25T02:27:21.904 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 16/156 2024-04-25T02:27:21.904 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 17/156 2024-04-25T02:27:21.904 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 18/156 2024-04-25T02:27:21.904 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 19/156 2024-04-25T02:27:21.904 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 20/156 2024-04-25T02:27:21.904 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 21/156 2024-04-25T02:27:21.904 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 22/156 2024-04-25T02:27:21.904 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 23/156 2024-04-25T02:27:21.904 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 24/156 2024-04-25T02:27:21.904 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 25/156 2024-04-25T02:27:21.904 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 26/156 2024-04-25T02:27:21.905 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 27/156 2024-04-25T02:27:21.918 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 28/156 2024-04-25T02:27:21.919 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 29/156 2024-04-25T02:27:21.919 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 30/156 2024-04-25T02:27:21.919 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 31/156 2024-04-25T02:27:21.919 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 32/156 2024-04-25T02:27:21.919 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 33/156 2024-04-25T02:27:21.919 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 34/156 2024-04-25T02:27:21.919 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 35/156 2024-04-25T02:27:21.919 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 36/156 2024-04-25T02:27:21.919 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 37/156 2024-04-25T02:27:21.919 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 38/156 2024-04-25T02:27:21.919 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 39/156 2024-04-25T02:27:21.919 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T02:27:21.920 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T02:27:21.920 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T02:27:21.920 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T02:27:21.920 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T02:27:21.920 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T02:27:21.920 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T02:27:21.920 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T02:27:21.920 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T02:27:21.920 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T02:27:21.920 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T02:27:21.920 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T02:27:21.920 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T02:27:21.920 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T02:27:21.921 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T02:27:21.921 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T02:27:21.921 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T02:27:21.921 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T02:27:21.921 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T02:27:21.921 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T02:27:21.921 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T02:27:21.921 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T02:27:21.921 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T02:27:21.921 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T02:27:21.921 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T02:27:21.921 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T02:27:21.921 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T02:27:21.921 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T02:27:21.922 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T02:27:21.922 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T02:27:21.922 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T02:27:21.922 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T02:27:21.922 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T02:27:21.922 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T02:27:21.922 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T02:27:21.922 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T02:27:21.922 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T02:27:21.922 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T02:27:21.922 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T02:27:21.922 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T02:27:21.923 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T02:27:21.923 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T02:27:21.923 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T02:27:21.923 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T02:27:21.923 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T02:27:21.923 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T02:27:21.923 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T02:27:21.923 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T02:27:21.923 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T02:27:21.923 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T02:27:21.923 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T02:27:21.923 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T02:27:21.923 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T02:27:21.923 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T02:27:21.924 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T02:27:21.924 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T02:27:21.924 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T02:27:21.924 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T02:27:21.924 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T02:27:21.924 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T02:27:21.924 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T02:27:21.924 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T02:27:21.924 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T02:27:21.924 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T02:27:21.924 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T02:27:21.924 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T02:27:21.924 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T02:27:21.925 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T02:27:21.925 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T02:27:21.925 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T02:27:21.925 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T02:27:21.925 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T02:27:21.925 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T02:27:21.925 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T02:27:21.925 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T02:27:21.925 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T02:27:21.925 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T02:27:21.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T02:27:21.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T02:27:21.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T02:27:21.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T02:27:21.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T02:27:21.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T02:27:21.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T02:27:21.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T02:27:21.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T02:27:21.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T02:27:21.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T02:27:21.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T02:27:21.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T02:27:21.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T02:27:21.927 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T02:27:21.927 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T02:27:21.927 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T02:27:21.927 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T02:27:21.927 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T02:27:21.927 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T02:27:21.927 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T02:27:21.927 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T02:27:21.927 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T02:27:21.927 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T02:27:21.928 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T02:27:21.928 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T02:27:21.928 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T02:27:21.928 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T02:27:21.928 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T02:27:21.928 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T02:27:21.928 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T02:27:21.928 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T02:27:21.928 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 149/156 2024-04-25T02:27:21.928 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T02:27:21.928 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 151/156 2024-04-25T02:27:21.928 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T02:27:21.928 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T02:27:21.929 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T02:27:21.929 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T02:27:24.104 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T02:27:24.105 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:24.105 INFO:teuthology.orchestra.run.smithi067.stdout:Upgraded: 2024-04-25T02:27:24.105 INFO:teuthology.orchestra.run.smithi067.stdout: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.105 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.105 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T02:27:24.105 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T02:27:24.105 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-04-25T02:27:24.105 INFO:teuthology.orchestra.run.smithi067.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T02:27:24.105 INFO:teuthology.orchestra.run.smithi067.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T02:27:24.105 INFO:teuthology.orchestra.run.smithi067.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T02:27:24.105 INFO:teuthology.orchestra.run.smithi067.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T02:27:24.106 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.106 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.106 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.106 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.106 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:24.106 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.106 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.106 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.106 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:24.106 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:24.106 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:24.106 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:24.106 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:24.107 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.107 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.107 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:24.107 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.107 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.107 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.107 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:24.107 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:24.107 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.107 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.107 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T02:27:24.107 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T02:27:24.107 INFO:teuthology.orchestra.run.smithi067.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T02:27:24.108 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T02:27:24.108 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T02:27:24.108 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T02:27:24.108 INFO:teuthology.orchestra.run.smithi067.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T02:27:24.108 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T02:27:24.108 INFO:teuthology.orchestra.run.smithi067.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T02:27:24.108 INFO:teuthology.orchestra.run.smithi067.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T02:27:24.108 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T02:27:24.108 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T02:27:24.108 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.108 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.108 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.108 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T02:27:24.108 INFO:teuthology.orchestra.run.smithi067.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T02:27:24.109 INFO:teuthology.orchestra.run.smithi067.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T02:27:24.109 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T02:27:24.109 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T02:27:24.109 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.109 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.109 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T02:27:24.109 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.109 INFO:teuthology.orchestra.run.smithi067.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T02:27:24.109 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T02:27:24.109 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T02:27:24.109 INFO:teuthology.orchestra.run.smithi067.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T02:27:24.109 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T02:27:24.109 INFO:teuthology.orchestra.run.smithi067.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T02:27:24.110 INFO:teuthology.orchestra.run.smithi067.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T02:27:24.110 INFO:teuthology.orchestra.run.smithi067.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T02:27:24.110 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T02:27:24.110 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T02:27:24.110 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T02:27:24.110 INFO:teuthology.orchestra.run.smithi067.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T02:27:24.110 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T02:27:24.110 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T02:27:24.110 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T02:27:24.111 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T02:27:24.111 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T02:27:24.111 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T02:27:24.111 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T02:27:24.111 INFO:teuthology.orchestra.run.smithi067.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T02:27:24.111 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T02:27:24.111 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T02:27:24.111 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T02:27:24.111 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.111 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.112 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.112 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T02:27:24.112 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T02:27:24.112 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T02:27:24.112 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T02:27:24.112 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T02:27:24.112 INFO:teuthology.orchestra.run.smithi067.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T02:27:24.112 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T02:27:24.112 INFO:teuthology.orchestra.run.smithi067.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T02:27:24.112 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T02:27:24.112 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T02:27:24.112 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T02:27:24.112 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T02:27:24.113 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T02:27:24.113 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T02:27:24.113 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T02:27:24.113 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T02:27:24.113 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T02:27:24.113 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T02:27:24.113 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T02:27:24.113 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T02:27:24.113 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T02:27:24.113 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T02:27:24.113 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T02:27:24.113 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T02:27:24.113 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T02:27:24.113 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T02:27:24.114 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T02:27:24.114 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T02:27:24.114 INFO:teuthology.orchestra.run.smithi067.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T02:27:24.114 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T02:27:24.114 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T02:27:24.114 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T02:27:24.114 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T02:27:24.114 INFO:teuthology.orchestra.run.smithi067.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T02:27:24.114 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T02:27:24.114 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T02:27:24.114 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T02:27:24.114 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T02:27:24.114 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T02:27:24.115 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T02:27:24.115 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.115 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.115 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T02:27:24.115 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T02:27:24.115 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T02:27:24.115 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.115 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T02:27:24.115 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T02:27:24.115 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T02:27:24.115 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T02:27:24.116 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T02:27:24.116 INFO:teuthology.orchestra.run.smithi067.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T02:27:24.116 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T02:27:24.116 INFO:teuthology.orchestra.run.smithi067.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T02:27:24.116 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T02:27:24.116 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T02:27:24.116 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T02:27:24.116 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T02:27:24.116 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T02:27:24.116 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T02:27:24.116 INFO:teuthology.orchestra.run.smithi067.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T02:27:24.116 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.116 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.117 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T02:27:24.117 INFO:teuthology.orchestra.run.smithi067.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T02:27:24.117 INFO:teuthology.orchestra.run.smithi067.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T02:27:24.117 INFO:teuthology.orchestra.run.smithi067.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T02:27:24.117 INFO:teuthology.orchestra.run.smithi067.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T02:27:24.117 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T02:27:24.117 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T02:27:24.117 INFO:teuthology.orchestra.run.smithi067.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T02:27:24.117 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:24.118 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-04-25T02:27:24.451 DEBUG:teuthology.parallel:result is None 2024-04-25T02:27:24.452 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:27:24.679 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T02:27:24.700 INFO:teuthology.orchestra.run.smithi067.stdout:19.0.0-2445.gd2c45d97.el9 2024-04-25T02:27:24.701 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445.gd2c45d97.el9 2024-04-25T02:27:24.701 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445.gd2c45d97 is installed. 2024-04-25T02:27:24.703 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:27:24.843 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T02:27:24.868 INFO:teuthology.orchestra.run.smithi176.stdout:19.0.0-2445.gd2c45d97.el9 2024-04-25T02:27:24.869 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445.gd2c45d97.el9 2024-04-25T02:27:24.869 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445.gd2c45d97 is installed. 2024-04-25T02:27:24.870 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T02:27:24.871 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:27:24.871 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T02:27:24.897 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:27:24.897 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T02:27:24.938 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T02:27:24.938 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:27:24.938 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T02:27:24.963 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T02:27:25.027 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:27:25.027 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T02:27:25.053 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T02:27:25.119 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T02:27:25.119 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:27:25.119 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T02:27:25.145 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T02:27:25.210 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:27:25.210 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T02:27:25.235 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T02:27:25.300 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T02:27:25.300 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:27:25.301 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T02:27:25.326 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T02:27:25.391 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:27:25.391 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T02:27:25.416 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T02:27:25.481 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T02:27:25.572 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T02:27:25.572 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 777 /var/log/ceph 2024-04-25T02:27:25.575 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 777 /var/log/ceph 2024-04-25T02:27:25.599 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T02:27:25.599 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T02:27:25.639 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T02:27:25.663 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T02:27:25.663 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T02:27:25.703 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T02:27:25.733 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T02:27:25.733 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T02:27:25.733 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T02:27:25.733 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:27:25.733 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T02:27:25.782 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T02:27:25.894 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T02:27:25.920 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:27:25.920 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T02:27:25.935 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T02:27:26.042 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T02:27:26.090 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T02:27:26.091 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T02:27:26.091 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672388', 'branch': 'squid', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7672388', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8528, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'sleep_before_teardown': 0, 'subset': '122/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi067.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJxcNkqh1mAx+uimlhw/Bqp8ug8F3RzFoRGIoQvWZSCtn5sKHtzVxMZ+xb9CrC/s9xAf2ULEeBaK6uT/2Wqgb88=', 'smithi176.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH0sGA8v3kTiw8nTmktUUT8/oMousjIrePS6gsiQ3zulc+dqLTVDcTP3BbzkQq7+MZuARgZrbK3YnyUZODz/qOk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'check-counter': {'counters': {'mgr': [{'min': 4, 'name': 'finisher-volumes.complete_latency.avgcount'}, {'expected_val': 0, 'name': 'finisher-volumes.queue_len'}]}}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestPerModuleFinsherThread']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-24_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T02:27:26.092 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T02:27:26.094 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T02:27:26.139 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T02:27:26.150 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T02:27:26.203 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:27:26.203 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T02:27:26.227 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T02:27:26.228 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 2024-04-25T02:27:26.283 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T02:27:26.283 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:27:26.283 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-25T02:27:26.283 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:27:26.283 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:27:26.283 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-04-25 02:27:16.627539404 +0000 2024-04-25T02:27:26.283 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-04-25 02:25:14.253485899 +0000 2024-04-25T02:27:26.283 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-04-25 02:25:14.253485899 +0000 2024-04-25T02:27:26.284 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-04-25 02:25:14.253485899 +0000 2024-04-25T02:27:26.284 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T02:27:26.347 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-04-25T02:27:26.348 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-04-25T02:27:26.348 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000263587 s, 1.9 MB/s 2024-04-25T02:27:26.349 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T02:27:26.406 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 2024-04-25T02:27:26.461 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T02:27:26.461 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:27:26.462 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-25T02:27:26.462 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:27:26.462 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:27:26.462 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-04-25 02:27:16.627539404 +0000 2024-04-25T02:27:26.462 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-04-25 02:25:14.593477986 +0000 2024-04-25T02:27:26.462 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-04-25 02:25:14.593477986 +0000 2024-04-25T02:27:26.462 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-04-25 02:25:14.593477986 +0000 2024-04-25T02:27:26.462 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T02:27:26.524 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-04-25T02:27:26.525 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-04-25T02:27:26.525 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000213125 s, 2.4 MB/s 2024-04-25T02:27:26.526 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T02:27:26.581 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 2024-04-25T02:27:26.637 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T02:27:26.638 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:27:26.638 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T02:27:26.638 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:27:26.638 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:27:26.638 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-04-25 02:27:16.628539383 +0000 2024-04-25T02:27:26.638 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-04-25 02:25:14.955469563 +0000 2024-04-25T02:27:26.639 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-04-25 02:25:14.955469563 +0000 2024-04-25T02:27:26.639 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-04-25 02:25:14.955469563 +0000 2024-04-25T02:27:26.639 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T02:27:26.700 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-04-25T02:27:26.700 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-04-25T02:27:26.700 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000202237 s, 2.5 MB/s 2024-04-25T02:27:26.701 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T02:27:26.757 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 2024-04-25T02:27:26.813 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T02:27:26.813 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:27:26.813 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-25T02:27:26.813 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:27:26.813 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:27:26.813 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-04-25 02:27:16.628539383 +0000 2024-04-25T02:27:26.813 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-04-25 02:25:15.303461464 +0000 2024-04-25T02:27:26.813 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-04-25 02:25:15.303461464 +0000 2024-04-25T02:27:26.813 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-04-25 02:25:15.303461464 +0000 2024-04-25T02:27:26.813 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T02:27:26.875 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-04-25T02:27:26.875 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-04-25T02:27:26.876 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.00028081 s, 1.8 MB/s 2024-04-25T02:27:26.877 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T02:27:26.933 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:27:26.933 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:27:26.933 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T02:27:26.950 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T02:27:26.950 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_1 2024-04-25T02:27:27.006 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T02:27:27.006 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:27:27.006 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-25T02:27:27.007 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:27:27.007 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:27:27.007 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-04-25 02:27:12.119135771 +0000 2024-04-25T02:27:27.007 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-04-25 02:25:10.840384792 +0000 2024-04-25T02:27:27.007 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-04-25 02:25:10.840384792 +0000 2024-04-25T02:27:27.007 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-04-25 02:25:10.840384792 +0000 2024-04-25T02:27:27.007 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T02:27:27.069 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-04-25T02:27:27.070 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-04-25T02:27:27.070 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000211007 s, 2.4 MB/s 2024-04-25T02:27:27.071 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T02:27:27.128 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_2 2024-04-25T02:27:27.183 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T02:27:27.184 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:27:27.184 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-25T02:27:27.184 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:27:27.184 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:27:27.184 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-04-25 02:27:12.119135771 +0000 2024-04-25T02:27:27.184 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-04-25 02:25:11.190381695 +0000 2024-04-25T02:27:27.184 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-04-25 02:25:11.190381695 +0000 2024-04-25T02:27:27.184 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-04-25 02:25:11.190381695 +0000 2024-04-25T02:27:27.184 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T02:27:27.248 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-04-25T02:27:27.248 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-04-25T02:27:27.248 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000209385 s, 2.4 MB/s 2024-04-25T02:27:27.249 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T02:27:27.305 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_3 2024-04-25T02:27:27.360 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T02:27:27.360 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:27:27.360 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-25T02:27:27.360 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:27:27.360 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:27:27.360 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-04-25 02:27:12.119135771 +0000 2024-04-25T02:27:27.360 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-04-25 02:25:11.562378404 +0000 2024-04-25T02:27:27.360 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-04-25 02:25:11.562378404 +0000 2024-04-25T02:27:27.361 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-04-25 02:25:11.562378404 +0000 2024-04-25T02:27:27.361 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T02:27:27.422 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-04-25T02:27:27.422 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-04-25T02:27:27.422 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.00018901 s, 2.7 MB/s 2024-04-25T02:27:27.423 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T02:27:27.479 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_4 2024-04-25T02:27:27.534 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T02:27:27.534 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:27:27.534 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-25T02:27:27.534 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:27:27.534 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:27:27.534 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-04-25 02:27:12.120135762 +0000 2024-04-25T02:27:27.534 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-04-25 02:25:11.919375246 +0000 2024-04-25T02:27:27.534 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-04-25 02:25:11.919375246 +0000 2024-04-25T02:27:27.534 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-04-25 02:25:11.919375246 +0000 2024-04-25T02:27:27.535 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T02:27:27.596 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-04-25T02:27:27.596 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-04-25T02:27:27.596 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000250834 s, 2.0 MB/s 2024-04-25T02:27:27.597 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T02:27:27.652 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T02:27:27.653 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T02:27:27.653 INFO:tasks.ceph:Generating config... 2024-04-25T02:27:27.654 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T02:27:27.654 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T02:27:27.654 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T02:27:27.654 INFO:tasks.ceph:[client] pid file = 2024-04-25T02:27:27.654 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T02:27:27.654 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T02:27:27.654 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T02:27:27.654 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T02:27:27.655 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T02:27:27.655 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T02:27:27.655 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T02:27:27.655 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T02:27:27.655 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T02:27:27.655 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T02:27:27.655 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T02:27:27.655 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T02:27:27.655 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T02:27:27.655 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T02:27:27.655 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-04-25T02:27:27.655 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T02:27:27.655 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T02:27:27.655 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T02:27:27.655 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T02:27:27.656 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T02:27:27.656 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T02:27:27.656 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T02:27:27.656 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-25T02:27:27.656 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-25T02:27:27.656 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-25T02:27:27.656 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T02:27:27.656 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T02:27:27.656 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T02:27:27.656 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T02:27:27.656 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T02:27:27.656 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T02:27:27.656 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T02:27:27.656 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T02:27:27.656 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T02:27:27.657 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T02:27:27.657 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T02:27:27.657 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T02:27:27.657 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T02:27:27.657 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T02:27:27.657 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T02:27:27.706 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T02:27:27.709 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T02:27:27.752 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T02:27:27.818 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.67'), ('mon.b', '172.21.15.176'), ('mon.c', '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]')] 2024-04-25T02:27:27.818 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.67,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T02:27:27.819 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:27:27.819 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T02:27:27.874 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.67 --add b 172.21.15.176 --addv c '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:27:27.960 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:27:27.960 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: generated fsid 84283662-9e10-4d0d-b377-8e43b1f6e3af 2024-04-25T02:27:27.960 INFO:teuthology.orchestra.run.smithi067.stdout:setting min_mon_release = quincy 2024-04-25T02:27:27.960 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 0 2024-04-25T02:27:27.960 INFO:teuthology.orchestra.run.smithi067.stdout:fsid 84283662-9e10-4d0d-b377-8e43b1f6e3af 2024-04-25T02:27:27.961 INFO:teuthology.orchestra.run.smithi067.stdout:last_changed 2024-04-25T02:27:27.958127+0000 2024-04-25T02:27:27.961 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-04-25T02:27:27.958127+0000 2024-04-25T02:27:27.961 INFO:teuthology.orchestra.run.smithi067.stdout:min_mon_release 17 (quincy) 2024-04-25T02:27:27.961 INFO:teuthology.orchestra.run.smithi067.stdout:election_strategy: 1 2024-04-25T02:27:27.961 INFO:teuthology.orchestra.run.smithi067.stdout:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-04-25T02:27:27.961 INFO:teuthology.orchestra.run.smithi067.stdout:1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.b 2024-04-25T02:27:27.961 INFO:teuthology.orchestra.run.smithi067.stdout:2: [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] mon.c 2024-04-25T02:27:27.961 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T02:27:27.962 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T02:27:27.977 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 84283662-9e10-4d0d-b377-8e43b1f6e3af... 2024-04-25T02:27:27.978 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:27:28.019 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:27:28.059 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2024-04-25T02:27:28.059 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2024-04-25T02:27:28.059 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:27:28.059 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2024-04-25T02:27:28.059 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.059 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2024-04-25T02:27:28.059 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.060 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2024-04-25T02:27:28.060 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.060 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2024-04-25T02:27:28.060 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2024-04-25T02:27:28.060 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.060 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2024-04-25T02:27:28.060 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2024-04-25T02:27:28.060 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.060 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:27:28.060 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2024-04-25T02:27:28.060 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.060 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:27:28.060 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:27:28.060 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.060 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2024-04-25T02:27:28.060 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.061 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2024-04-25T02:27:28.061 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2024-04-25T02:27:28.061 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:27:28.061 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:27:28.061 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2024-04-25T02:27:28.061 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:27:28.061 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2024-04-25T02:27:28.061 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:27:28.061 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:27:28.061 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2024-04-25T02:27:28.061 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.061 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:27:28.061 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.061 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2024-04-25T02:27:28.061 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.062 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2024-04-25T02:27:28.062 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.062 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2024-04-25T02:27:28.062 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2024-04-25T02:27:28.062 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2024-04-25T02:27:28.062 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = "172.21.15.67,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-04-25T02:27:28.062 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on skipped message = False 2024-04-25T02:27:28.062 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = 84283662-9e10-4d0d-b377-8e43b1f6e3af 2024-04-25T02:27:28.062 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.062 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2024-04-25T02:27:28.062 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2024-04-25T02:27:28.062 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.062 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2024-04-25T02:27:28.062 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2024-04-25T02:27:28.063 INFO:teuthology.orchestra.run.smithi176.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:27:28.063 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.063 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2024-04-25T02:27:28.063 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2024-04-25T02:27:28.063 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.063 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2024-04-25T02:27:28.063 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2024-04-25T02:27:28.063 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2024-04-25T02:27:28.063 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug trim objects = true 2024-04-25T02:27:28.063 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.063 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2024-04-25T02:27:28.063 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2024-04-25T02:27:28.063 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.063 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:27:28.064 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.064 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2024-04-25T02:27:28.064 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.064 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2024-04-25T02:27:28.064 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.064 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:27:28.064 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2024-04-25T02:27:28.064 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.064 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2024-04-25T02:27:28.064 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2024-04-25T02:27:28.064 INFO:teuthology.orchestra.run.smithi176.stdout: bdev async discard = True 2024-04-25T02:27:28.064 INFO:teuthology.orchestra.run.smithi176.stdout: bdev enable discard = True 2024-04-25T02:27:28.064 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore allocator = bitmap 2024-04-25T02:27:28.064 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore block size = 96636764160 2024-04-25T02:27:28.064 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore fsck on mount = True 2024-04-25T02:27:28.064 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluefs = 1/20 2024-04-25T02:27:28.064 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluestore = 1/20 2024-04-25T02:27:28.065 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-04-25T02:27:28.065 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2024-04-25T02:27:28.065 INFO:teuthology.orchestra.run.smithi176.stdout: debug rocksdb = 4/10 2024-04-25T02:27:28.065 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:27:28.065 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd full ratio = 0.9 2024-04-25T02:27:28.065 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:27:28.065 INFO:teuthology.orchestra.run.smithi176.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:27:28.065 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = bluestore 2024-04-25T02:27:28.065 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2024-04-25T02:27:28.065 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.065 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2024-04-25T02:27:28.065 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-04-25T02:27:28.065 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2024-04-25T02:27:28.065 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-04-25T02:27:28.065 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-04-25T02:27:28.066 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:27:28.066 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:27:28.066 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2024-04-25T02:27:28.066 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2024-04-25T02:27:28.066 INFO:teuthology.orchestra.run.smithi176.stdout: debug finisher = 20 2024-04-25T02:27:28.066 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.066 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2024-04-25T02:27:28.066 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-04-25T02:27:28.066 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-04-25T02:27:28.066 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2024-04-25T02:27:28.066 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-04-25T02:27:28.066 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2024-04-25T02:27:28.066 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2024-04-25T02:27:28.066 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:27:28.066 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2024-04-25T02:27:28.067 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2024-04-25T02:27:28.067 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:27:28.067 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.067 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:27:28.067 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:27:28.067 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:27:28.067 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.067 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:27:28.067 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:27:28.067 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:27:28.067 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.067 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2024-04-25T02:27:28.068 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:27:28.068 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.068 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:27:28.068 INFO:teuthology.orchestra.run.smithi176.stdout: mon down mkfs grace = 300 2024-04-25T02:27:28.068 INFO:teuthology.orchestra.run.smithi176.stdout: mon op complaint time = 120 2024-04-25T02:27:28.068 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-04-25T02:27:28.068 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2024-04-25T02:27:28.068 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2024-04-25T02:27:28.068 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2024-04-25T02:27:28.068 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2024-04-25T02:27:28.068 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:27:28.068 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:27:28.068 INFO:teuthology.orchestra.run.smithi176.stdout: client mount timeout = 600 2024-04-25T02:27:28.068 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2024-04-25T02:27:28.068 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-04-25T02:27:28.069 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = "" 2024-04-25T02:27:28.069 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2024-04-25T02:27:28.069 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2024-04-25T02:27:28.069 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2024-04-25T02:27:28.069 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.b] 2024-04-25T02:27:28.069 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.c] 2024-04-25T02:27:28.069 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-04-25T02:27:28.069 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-04-25T02:27:28.069 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-04-25T02:27:28.069 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-04-25T02:27:28.069 INFO:teuthology.orchestra.run.smithi176.stdout:[mds] 2024-04-25T02:27:28.069 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds = 20 2024-04-25T02:27:28.069 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds balancer = 20 2024-04-25T02:27:28.069 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-04-25T02:27:28.069 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug frag = True 2024-04-25T02:27:28.070 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug scatterstat = True 2024-04-25T02:27:28.070 INFO:teuthology.orchestra.run.smithi176.stdout: mds op complaint time = 180 2024-04-25T02:27:28.070 INFO:teuthology.orchestra.run.smithi176.stdout: mds verify scatter = True 2024-04-25T02:27:28.070 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2024-04-25T02:27:28.070 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2024-04-25T02:27:28.070 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2024-04-25T02:27:28.071 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2024-04-25T02:27:28.071 INFO:teuthology.orchestra.run.smithi067.stdout: chdir = "" 2024-04-25T02:27:28.071 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:27:28.071 INFO:teuthology.orchestra.run.smithi067.stdout: auth supported = cephx 2024-04-25T02:27:28.072 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.072 INFO:teuthology.orchestra.run.smithi067.stdout: filestore xattr use omap = true 2024-04-25T02:27:28.072 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.072 INFO:teuthology.orchestra.run.smithi067.stdout: mon clock drift allowed = 1.000 2024-04-25T02:27:28.072 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.072 INFO:teuthology.orchestra.run.smithi067.stdout: osd crush chooseleaf type = 0 2024-04-25T02:27:28.072 INFO:teuthology.orchestra.run.smithi067.stdout: auth debug = true 2024-04-25T02:27:28.072 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.072 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on old message = true 2024-04-25T02:27:28.072 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on bug = true 2024-04-25T02:27:28.072 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.072 INFO:teuthology.orchestra.run.smithi067.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:27:28.072 INFO:teuthology.orchestra.run.smithi067.stdout: mon pg warn max object skew = 0 2024-04-25T02:27:28.072 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.072 INFO:teuthology.orchestra.run.smithi067.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:27:28.073 INFO:teuthology.orchestra.run.smithi067.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:27:28.073 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.073 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default size = 2 2024-04-25T02:27:28.073 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.073 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow primary affinity = true 2024-04-25T02:27:28.073 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow pg remap = true 2024-04-25T02:27:28.073 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:27:28.073 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:27:28.073 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on no sortbitwise = false 2024-04-25T02:27:28.073 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:27:28.073 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on too few osds = false 2024-04-25T02:27:28.073 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:27:28.073 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:27:28.073 INFO:teuthology.orchestra.run.smithi067.stdout: mon_allow_pool_size_one = true 2024-04-25T02:27:28.073 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.074 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:27:28.074 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.074 INFO:teuthology.orchestra.run.smithi067.stdout: osd default data pool replay window = 5 2024-04-25T02:27:28.074 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.074 INFO:teuthology.orchestra.run.smithi067.stdout: mon allow pool delete = true 2024-04-25T02:27:28.074 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.074 INFO:teuthology.orchestra.run.smithi067.stdout: mon cluster log file level = debug 2024-04-25T02:27:28.074 INFO:teuthology.orchestra.run.smithi067.stdout: debug asserts on shutdown = true 2024-04-25T02:27:28.074 INFO:teuthology.orchestra.run.smithi067.stdout: mon health detail to clog = false 2024-04-25T02:27:28.074 INFO:teuthology.orchestra.run.smithi067.stdout: mon host = "172.21.15.67,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-04-25T02:27:28.074 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on skipped message = False 2024-04-25T02:27:28.074 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = 84283662-9e10-4d0d-b377-8e43b1f6e3af 2024-04-25T02:27:28.074 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.075 INFO:teuthology.orchestra.run.smithi067.stdout:[osd] 2024-04-25T02:27:28.075 INFO:teuthology.orchestra.run.smithi067.stdout: osd journal size = 100 2024-04-25T02:27:28.075 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.075 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub load threshold = 5.0 2024-04-25T02:27:28.075 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub max interval = 600 2024-04-25T02:27:28.075 INFO:teuthology.orchestra.run.smithi067.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:27:28.075 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.075 INFO:teuthology.orchestra.run.smithi067.stdout: osd recover clone overlap = true 2024-04-25T02:27:28.075 INFO:teuthology.orchestra.run.smithi067.stdout: osd recovery max chunk = 1048576 2024-04-25T02:27:28.075 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.075 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug shutdown = true 2024-04-25T02:27:28.075 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug op order = true 2024-04-25T02:27:28.075 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug verify stray on activate = true 2024-04-25T02:27:28.075 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug trim objects = true 2024-04-25T02:27:28.075 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.076 INFO:teuthology.orchestra.run.smithi067.stdout: osd open classes on start = true 2024-04-25T02:27:28.076 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug pg log writeout = true 2024-04-25T02:27:28.076 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.076 INFO:teuthology.orchestra.run.smithi067.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:27:28.076 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.076 INFO:teuthology.orchestra.run.smithi067.stdout: osd map max advance = 10 2024-04-25T02:27:28.076 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.076 INFO:teuthology.orchestra.run.smithi067.stdout: journal zero on create = true 2024-04-25T02:27:28.076 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.076 INFO:teuthology.orchestra.run.smithi067.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:27:28.076 INFO:teuthology.orchestra.run.smithi067.stdout: filestore apply finisher threads = 3 2024-04-25T02:27:28.076 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.076 INFO:teuthology.orchestra.run.smithi067.stdout: bdev debug aio = true 2024-04-25T02:27:28.076 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug misdirected ops = true 2024-04-25T02:27:28.076 INFO:teuthology.orchestra.run.smithi067.stdout: bdev async discard = True 2024-04-25T02:27:28.077 INFO:teuthology.orchestra.run.smithi067.stdout: bdev enable discard = True 2024-04-25T02:27:28.077 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore allocator = bitmap 2024-04-25T02:27:28.077 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore block size = 96636764160 2024-04-25T02:27:28.077 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore fsck on mount = True 2024-04-25T02:27:28.077 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluefs = 1/20 2024-04-25T02:27:28.077 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluestore = 1/20 2024-04-25T02:27:28.077 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-04-25T02:27:28.077 INFO:teuthology.orchestra.run.smithi067.stdout: debug osd = 20 2024-04-25T02:27:28.077 INFO:teuthology.orchestra.run.smithi067.stdout: debug rocksdb = 4/10 2024-04-25T02:27:28.077 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:27:28.077 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd full ratio = 0.9 2024-04-25T02:27:28.077 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:27:28.077 INFO:teuthology.orchestra.run.smithi067.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:27:28.077 INFO:teuthology.orchestra.run.smithi067.stdout: osd objectstore = bluestore 2024-04-25T02:27:28.077 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2024-04-25T02:27:28.078 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.078 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr] 2024-04-25T02:27:28.078 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-04-25T02:27:28.078 INFO:teuthology.orchestra.run.smithi067.stdout: debug mgr = 20 2024-04-25T02:27:28.078 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-04-25T02:27:28.078 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-04-25T02:27:28.078 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:27:28.078 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:27:28.078 INFO:teuthology.orchestra.run.smithi067.stdout: mgr/telemetry/nag = false 2024-04-25T02:27:28.078 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2024-04-25T02:27:28.078 INFO:teuthology.orchestra.run.smithi067.stdout: debug finisher = 20 2024-04-25T02:27:28.078 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.078 INFO:teuthology.orchestra.run.smithi067.stdout:[mon] 2024-04-25T02:27:28.078 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-04-25T02:27:28.079 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-04-25T02:27:28.079 INFO:teuthology.orchestra.run.smithi067.stdout: debug paxos = 20 2024-04-25T02:27:28.079 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-04-25T02:27:28.079 INFO:teuthology.orchestra.run.smithi067.stdout: mon data avail warn = 5 2024-04-25T02:27:28.079 INFO:teuthology.orchestra.run.smithi067.stdout: mon mgr mkfs grace = 240 2024-04-25T02:27:28.079 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:27:28.079 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd reporter subtree level = osd 2024-04-25T02:27:28.079 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd prime pg temp = true 2024-04-25T02:27:28.079 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:27:28.079 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.079 INFO:teuthology.orchestra.run.smithi067.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:27:28.079 INFO:teuthology.orchestra.run.smithi067.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:27:28.079 INFO:teuthology.orchestra.run.smithi067.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:27:28.079 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.079 INFO:teuthology.orchestra.run.smithi067.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:27:28.079 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:27:28.080 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:27:28.080 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.080 INFO:teuthology.orchestra.run.smithi067.stdout: # 1m isn't quite enough 2024-04-25T02:27:28.080 INFO:teuthology.orchestra.run.smithi067.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:27:28.080 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.080 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:27:28.080 INFO:teuthology.orchestra.run.smithi067.stdout: mon down mkfs grace = 300 2024-04-25T02:27:28.080 INFO:teuthology.orchestra.run.smithi067.stdout: mon op complaint time = 120 2024-04-25T02:27:28.080 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:27:28.080 INFO:teuthology.orchestra.run.smithi067.stdout:[client] 2024-04-25T02:27:28.080 INFO:teuthology.orchestra.run.smithi067.stdout: rgw cache enabled = true 2024-04-25T02:27:28.080 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable ops log = true 2024-04-25T02:27:28.080 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable usage log = true 2024-04-25T02:27:28.080 INFO:teuthology.orchestra.run.smithi067.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:27:28.080 INFO:teuthology.orchestra.run.smithi067.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:27:28.081 INFO:teuthology.orchestra.run.smithi067.stdout: client mount timeout = 600 2024-04-25T02:27:28.081 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2024-04-25T02:27:28.081 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-04-25T02:27:28.081 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = "" 2024-04-25T02:27:28.081 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2024-04-25T02:27:28.081 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2024-04-25T02:27:28.081 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.a] 2024-04-25T02:27:28.081 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.b] 2024-04-25T02:27:28.081 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.c] 2024-04-25T02:27:28.081 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2024-04-25T02:27:28.081 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2024-04-25T02:27:28.081 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2024-04-25T02:27:28.081 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d] 2024-04-25T02:27:28.081 INFO:teuthology.orchestra.run.smithi067.stdout:[mds] 2024-04-25T02:27:28.081 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds = 20 2024-04-25T02:27:28.082 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds balancer = 20 2024-04-25T02:27:28.082 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-04-25T02:27:28.082 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug frag = True 2024-04-25T02:27:28.082 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug scatterstat = True 2024-04-25T02:27:28.082 INFO:teuthology.orchestra.run.smithi067.stdout: mds op complaint time = 180 2024-04-25T02:27:28.082 INFO:teuthology.orchestra.run.smithi067.stdout: mds verify scatter = True 2024-04-25T02:27:28.082 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2024-04-25T02:27:28.082 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2024-04-25T02:27:28.082 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2024-04-25T02:27:28.082 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T02:27:28.082 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T02:27:28.165 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T02:27:28.165 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:27:28.165 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T02:27:28.180 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:27:28.180 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T02:27:28.235 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi067.front.sepia.ceph.com 2024-04-25T02:27:28.235 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:27:28.235 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T02:27:28.235 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T02:27:28.330 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:27:28.330 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:27:28.385 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi176.front.sepia.ceph.com 2024-04-25T02:27:28.385 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:27:28.385 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T02:27:28.385 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T02:27:28.419 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:27:28.419 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:27:28.474 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T02:27:28.474 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T02:27:28.474 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T02:27:28.524 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T02:27:28.527 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T02:27:28.599 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T02:27:28.602 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T02:27:28.602 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T02:27:28.652 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T02:27:28.654 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T02:27:28.678 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T02:27:28.768 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T02:27:28.771 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T02:27:28.795 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T02:27:28.844 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T02:27:28.846 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T02:27:28.869 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T02:27:28.957 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T02:27:28.959 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T02:27:28.982 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T02:27:28.982 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T02:27:29.023 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T02:27:29.035 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-25T02:27:29.116 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-25T02:27:29.129 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T02:27:29.168 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T02:27:29.179 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-25T02:27:29.258 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-25T02:27:29.269 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T02:27:29.270 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T02:27:29.270 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T02:27:29.294 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:27:29.295 INFO:tasks.ceph:role: osd.0 2024-04-25T02:27:29.295 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-25T02:27:29.295 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T02:27:29.366 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:27:29.366 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:27:29.366 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:27:29.366 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T02:27:29.367 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:27:29.367 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:27:29.367 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:27:29.367 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T02:27:29.367 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:27:29.367 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:27:29.854 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-04-25T02:27:29.856 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-04-25T02:27:29.856 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T02:27:29.982 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T02:27:30.016 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T02:27:30.083 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:27:30.083 INFO:tasks.ceph:role: osd.1 2024-04-25T02:27:30.083 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-25T02:27:30.083 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T02:27:30.157 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:27:30.157 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:27:30.157 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:27:30.157 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T02:27:30.157 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:27:30.157 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:27:30.157 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:27:30.157 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T02:27:30.158 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:27:30.158 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:27:30.617 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-04-25T02:27:30.619 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-04-25T02:27:30.620 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T02:27:30.709 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T02:27:30.737 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T02:27:30.803 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:27:30.803 INFO:tasks.ceph:role: osd.2 2024-04-25T02:27:30.803 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-25T02:27:30.803 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T02:27:30.874 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:27:30.874 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:27:30.874 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:27:30.874 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T02:27:30.874 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:27:30.874 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:27:30.874 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:27:30.874 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T02:27:30.875 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:27:30.875 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:27:31.354 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-04-25T02:27:31.356 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-04-25T02:27:31.356 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T02:27:31.481 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T02:27:31.512 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T02:27:31.576 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:27:31.576 INFO:tasks.ceph:role: osd.3 2024-04-25T02:27:31.576 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-25T02:27:31.576 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T02:27:31.647 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:27:31.648 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:27:31.648 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:27:31.648 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T02:27:31.648 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:27:31.648 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:27:31.648 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:27:31.648 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T02:27:31.648 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:27:31.648 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:27:32.170 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-04-25T02:27:32.172 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-04-25T02:27:32.172 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T02:27:32.307 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T02:27:32.339 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:27:32.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:32.430+0000 7efcb2a1e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T02:27:32.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:32.430+0000 7efcb2a1e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T02:27:32.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:32.430+0000 7efcb2a1e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T02:27:32.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:32.430+0000 7efcb2a1e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T02:27:32.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:32.430+0000 7efcb2a1e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T02:27:32.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:32.430+0000 7efcb2a1e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T02:27:35.292 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T02:27:35.322 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:27:35.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:35.409+0000 7f6b807c0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T02:27:35.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:35.410+0000 7f6b807c0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T02:27:35.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:35.410+0000 7f6b807c0640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T02:27:35.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:35.410+0000 7f6b807c0640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T02:27:35.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:35.410+0000 7f6b807c0640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T02:27:35.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:35.410+0000 7f6b807c0640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T02:27:38.270 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T02:27:38.300 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:27:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:38.388+0000 7fce35214640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T02:27:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:38.389+0000 7fce35214640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T02:27:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:38.389+0000 7fce35214640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T02:27:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:38.389+0000 7fce35214640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T02:27:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:38.389+0000 7fce35214640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T02:27:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:38.389+0000 7fce35214640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T02:27:41.246 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T02:27:41.278 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:27:41.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:41.367+0000 7f6493d44640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T02:27:41.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:41.367+0000 7f6493d44640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T02:27:41.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:41.367+0000 7f6493d44640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T02:27:41.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:41.367+0000 7f6493d44640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T02:27:41.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:41.367+0000 7f6493d44640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T02:27:41.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:27:41.368+0000 7f6493d44640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T02:27:44.227 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T02:27:44.257 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T02:27:44.285 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T02:27:44.286 INFO:tasks.ceph:role: osd.4 2024-04-25T02:27:44.286 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com 2024-04-25T02:27:44.286 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T02:27:44.362 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:27:44.362 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:27:44.362 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:27:44.362 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T02:27:44.362 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:27:44.362 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:27:44.362 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:27:44.362 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T02:27:44.362 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:27:44.362 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:27:44.870 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-04-25T02:27:44.872 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-04-25T02:27:44.873 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T02:27:45.004 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T02:27:45.036 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T02:27:45.105 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T02:27:45.105 INFO:tasks.ceph:role: osd.5 2024-04-25T02:27:45.105 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com 2024-04-25T02:27:45.106 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T02:27:45.176 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:27:45.176 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:27:45.176 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:27:45.176 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T02:27:45.176 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:27:45.176 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:27:45.177 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:27:45.177 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T02:27:45.177 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:27:45.177 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:27:45.630 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-04-25T02:27:45.632 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-04-25T02:27:45.632 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T02:27:45.724 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T02:27:45.751 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T02:27:45.815 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T02:27:45.815 INFO:tasks.ceph:role: osd.6 2024-04-25T02:27:45.815 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com 2024-04-25T02:27:45.815 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T02:27:45.886 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:27:45.886 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:27:45.887 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:27:45.887 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T02:27:45.887 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:27:45.887 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:27:45.887 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:27:45.887 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T02:27:45.887 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:27:45.887 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:27:46.382 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-04-25T02:27:46.384 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-04-25T02:27:46.384 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T02:27:46.524 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T02:27:46.557 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T02:27:46.622 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T02:27:46.622 INFO:tasks.ceph:role: osd.7 2024-04-25T02:27:46.622 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com 2024-04-25T02:27:46.623 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T02:27:46.693 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:27:46.693 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:27:46.693 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:27:46.694 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T02:27:46.694 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:27:46.694 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:27:46.694 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:27:46.694 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T02:27:46.694 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:27:46.694 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:27:47.222 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-04-25T02:27:47.224 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-04-25T02:27:47.224 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T02:27:47.364 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T02:27:47.394 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:27:47.482 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:47.478+0000 7fcb7c8e3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T02:27:47.483 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:47.479+0000 7fcb7c8e3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T02:27:47.483 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:47.479+0000 7fcb7c8e3640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T02:27:47.483 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:47.479+0000 7fcb7c8e3640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T02:27:47.483 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:47.479+0000 7fcb7c8e3640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T02:27:47.483 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:47.479+0000 7fcb7c8e3640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T02:27:50.337 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T02:27:50.364 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:27:50.453 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:50.450+0000 7f8f4663a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T02:27:50.453 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:50.450+0000 7f8f4663a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T02:27:50.454 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:50.450+0000 7f8f4663a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T02:27:50.454 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:50.450+0000 7f8f4663a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T02:27:50.454 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:50.450+0000 7f8f4663a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T02:27:50.454 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:50.451+0000 7f8f4663a640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T02:27:53.296 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T02:27:53.323 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:27:53.410 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:53.406+0000 7f0c51843640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T02:27:53.410 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:53.406+0000 7f0c51843640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T02:27:53.410 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:53.406+0000 7f0c51843640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T02:27:53.410 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:53.406+0000 7f0c51843640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T02:27:53.410 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:53.406+0000 7f0c51843640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T02:27:53.410 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:53.407+0000 7f0c51843640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T02:27:56.093 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:27:56.096 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:27:56.272 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T02:27:56.295 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:27:56.379 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:56.375+0000 7fe6bcf50640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T02:27:56.379 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:56.375+0000 7fe6bcf50640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T02:27:56.379 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:56.375+0000 7fe6bcf50640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T02:27:56.379 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:56.375+0000 7fe6bcf50640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T02:27:56.379 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:56.375+0000 7fe6bcf50640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T02:27:56.379 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:27:56.376+0000 7fe6bcf50640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T02:27:59.235 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T02:27:59.301 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T02:27:59.302 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:27:59.302 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T02:27:59.332 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:27:59.332 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T02:27:59.401 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:27:59.401 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T02:27:59.468 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:27:59.469 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T02:27:59.536 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:27:59.536 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T02:27:59.604 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:27:59.604 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T02:27:59.670 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:27:59.670 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T02:27:59.736 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:27:59.736 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T02:27:59.765 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:27:59.765 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T02:27:59.832 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:27:59.833 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T02:27:59.898 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:27:59.898 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T02:27:59.963 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:27:59.963 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T02:28:00.028 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:28:00.028 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T02:28:00.092 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:28:00.092 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T02:28:00.156 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:28:00.156 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T02:28:00.175 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:28:00.175 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-25T02:28:00.233 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:28:00.233 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T02:28:00.248 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:28:00.248 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-25T02:28:00.303 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T02:28:00.303 DEBUG:teuthology.orchestra.run.smithi067:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T02:28:00.305 DEBUG:teuthology.orchestra.run.smithi176:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T02:28:00.346 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.y] 2024-04-25T02:28:00.346 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCQvylmEjQmHxAARBqxaZnHoYMatA/pNB8vJA== 2024-04-25T02:28:00.346 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2024-04-25T02:28:00.347 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCQvylmWcy+JhAANb0D1giuHVHgKuMgpXq12Q== 2024-04-25T02:28:00.347 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2024-04-25T02:28:00.347 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCQvylmtN+0LRAAwHOGcpdIM2nj18k/Gp3s5A== 2024-04-25T02:28:00.347 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.0] 2024-04-25T02:28:00.347 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCUvylmtLasGRAA614HMQoWCDmPL7S6ZgGsbg== 2024-04-25T02:28:00.347 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.1] 2024-04-25T02:28:00.347 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCXvylmNEN5GBAAbQQUv7UsJl7s0q1NpyBNbA== 2024-04-25T02:28:00.347 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.2] 2024-04-25T02:28:00.347 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCavylm5pI0FxAAY16ieuMghyCk1Tw9fbk37Q== 2024-04-25T02:28:00.347 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.3] 2024-04-25T02:28:00.347 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCdvylm1WACFhAAte7GQuyvfCJMxeh9rEUWhA== 2024-04-25T02:28:00.347 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.x] 2024-04-25T02:28:00.347 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCQvylmxJaeIxAAzjrkU7jdyEC5YZkkq80ZZg== 2024-04-25T02:28:00.347 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2024-04-25T02:28:00.348 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCQvylm2/sxMhAAdlCv6DVRbxlmuI0UhRaBug== 2024-04-25T02:28:00.348 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d] 2024-04-25T02:28:00.348 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCQvylmrOrqOBAAoNdqYG4PWrrCEdC9ay/+rw== 2024-04-25T02:28:00.348 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.4] 2024-04-25T02:28:00.348 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCjvylmgtybHBAAmtJjiAx82EohqvGBWTKXqA== 2024-04-25T02:28:00.348 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.5] 2024-04-25T02:28:00.348 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCmvylmhp7nGhAA3Cdw9khlX/9iikvKPsvWKw== 2024-04-25T02:28:00.348 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.6] 2024-04-25T02:28:00.348 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCpvylm2MFNGBAAAdNcsfOmnT5klPxzZnxs7w== 2024-04-25T02:28:00.348 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.7] 2024-04-25T02:28:00.348 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCsvylmF+1vFhAAu5iJ9zpmTMMnG74d4D36NQ== 2024-04-25T02:28:00.348 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-04-25T02:28:00.348 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCRvylm9w5GARAAYGhC/7jDn/aVYwTEFFwjyg== 2024-04-25T02:28:00.348 INFO:teuthology.orchestra.run.smithi067.stdout:[client.2] 2024-04-25T02:28:00.349 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCRvylmyLfXBhAA12x/Rg+FGVCUOZlXmA1MmA== 2024-04-25T02:28:00.349 INFO:teuthology.orchestra.run.smithi067.stdout:[client.1] 2024-04-25T02:28:00.349 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCRvylm4jbjCRAASo9ABKQGqafHuY2p5tuVsA== 2024-04-25T02:28:00.349 INFO:teuthology.orchestra.run.smithi067.stdout:[client.3] 2024-04-25T02:28:00.349 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCRvylmmh9IDxAAV4Km22GhI1KEH6Wwaxo88A== 2024-04-25T02:28:00.365 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.y] 2024-04-25T02:28:00.365 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCQvylmEjQmHxAARBqxaZnHoYMatA/pNB8vJA== 2024-04-25T02:28:00.365 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-04-25T02:28:00.365 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCQvylmWcy+JhAANb0D1giuHVHgKuMgpXq12Q== 2024-04-25T02:28:00.365 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-04-25T02:28:00.365 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCQvylmtN+0LRAAwHOGcpdIM2nj18k/Gp3s5A== 2024-04-25T02:28:00.365 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.0] 2024-04-25T02:28:00.365 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCUvylmtLasGRAA614HMQoWCDmPL7S6ZgGsbg== 2024-04-25T02:28:00.365 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.1] 2024-04-25T02:28:00.365 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCXvylmNEN5GBAAbQQUv7UsJl7s0q1NpyBNbA== 2024-04-25T02:28:00.366 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.2] 2024-04-25T02:28:00.366 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCavylm5pI0FxAAY16ieuMghyCk1Tw9fbk37Q== 2024-04-25T02:28:00.366 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.3] 2024-04-25T02:28:00.366 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCdvylm1WACFhAAte7GQuyvfCJMxeh9rEUWhA== 2024-04-25T02:28:00.366 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.x] 2024-04-25T02:28:00.366 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCQvylmxJaeIxAAzjrkU7jdyEC5YZkkq80ZZg== 2024-04-25T02:28:00.366 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-04-25T02:28:00.366 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCQvylm2/sxMhAAdlCv6DVRbxlmuI0UhRaBug== 2024-04-25T02:28:00.366 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-04-25T02:28:00.366 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCQvylmrOrqOBAAoNdqYG4PWrrCEdC9ay/+rw== 2024-04-25T02:28:00.366 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.4] 2024-04-25T02:28:00.366 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCjvylmgtybHBAAmtJjiAx82EohqvGBWTKXqA== 2024-04-25T02:28:00.366 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.5] 2024-04-25T02:28:00.366 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCmvylmhp7nGhAA3Cdw9khlX/9iikvKPsvWKw== 2024-04-25T02:28:00.367 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.6] 2024-04-25T02:28:00.367 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCpvylm2MFNGBAAAdNcsfOmnT5klPxzZnxs7w== 2024-04-25T02:28:00.367 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.7] 2024-04-25T02:28:00.367 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCsvylmF+1vFhAAu5iJ9zpmTMMnG74d4D36NQ== 2024-04-25T02:28:00.367 INFO:teuthology.orchestra.run.smithi176.stdout:[client.0] 2024-04-25T02:28:00.367 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCRvylm9w5GARAAYGhC/7jDn/aVYwTEFFwjyg== 2024-04-25T02:28:00.367 INFO:teuthology.orchestra.run.smithi176.stdout:[client.2] 2024-04-25T02:28:00.367 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCRvylmyLfXBhAA12x/Rg+FGVCUOZlXmA1MmA== 2024-04-25T02:28:00.367 INFO:teuthology.orchestra.run.smithi176.stdout:[client.1] 2024-04-25T02:28:00.367 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCRvylm4jbjCRAASo9ABKQGqafHuY2p5tuVsA== 2024-04-25T02:28:00.367 INFO:teuthology.orchestra.run.smithi176.stdout:[client.3] 2024-04-25T02:28:00.367 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCRvylmmh9IDxAAV4Km22GhI1KEH6Wwaxo88A== 2024-04-25T02:28:00.368 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T02:28:00.392 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T02:28:00.456 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:28:00.459 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:28:00.512 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:28:00.515 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:28:00.567 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:28:00.569 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:28:00.617 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:28:00.619 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:28:00.668 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:28:00.670 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:28:00.719 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:28:00.722 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:28:00.769 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T02:28:00.772 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T02:28:00.819 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:28:00.822 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:28:00.873 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:28:00.875 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:28:00.926 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:28:00.928 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:28:00.976 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:28:00.979 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:28:01.027 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:28:01.029 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:28:01.078 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:28:01.080 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:28:01.129 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:28:01.131 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:28:01.183 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:28:01.185 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:28:01.237 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:28:01.239 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:28:01.291 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:28:01.293 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:28:01.344 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T02:28:01.344 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T02:28:01.368 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T02:28:01.464 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T02:28:01.488 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T02:28:01.511 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T02:28:01.604 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T02:28:01.628 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T02:28:01.691 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T02:28:01.785 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T02:28:01.808 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:28:01.810 DEBUG:teuthology.orchestra.run.smithi176:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:28:01.862 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T02:28:01.863 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T02:28:01.863 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T02:28:01.866 INFO:tasks.ceph.mon.a:Started 2024-04-25T02:28:01.866 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T02:28:01.866 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T02:28:01.904 INFO:tasks.ceph.mon.b:Started 2024-04-25T02:28:01.905 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T02:28:01.905 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T02:28:01.906 INFO:tasks.ceph.mon.c:Started 2024-04-25T02:28:01.907 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T02:28:01.907 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T02:28:01.907 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T02:28:01.909 INFO:tasks.ceph.mgr.y:Started 2024-04-25T02:28:01.909 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T02:28:01.909 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T02:28:01.911 INFO:tasks.ceph.mgr.x:Started 2024-04-25T02:28:01.911 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T02:28:01.911 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T02:28:02.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.009+0000 7f3da2883640 1 Processor -- start 2024-04-25T02:28:02.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.009+0000 7f3da2883640 1 -- start start 2024-04-25T02:28:02.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.010+0000 7f3da2883640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d9c0c8640 0x7f3d9c0d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.010+0000 7f3da2883640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3d9c0d29d0 0x7f3d9c0d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.010+0000 7f3da2883640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d9c0d0000 con 0x7f3d9c0c6680 2024-04-25T02:28:02.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.010+0000 7f3da2883640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3d9c15fd60 con 0x7f3d9c0d29d0 2024-04-25T02:28:02.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.010+0000 7f3da2883640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3d9c0c5ba0 con 0x7f3d9c0c8640 2024-04-25T02:28:02.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.010+0000 7f3d9b7fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3d9c0d29d0 0x7f3d9c0d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.010+0000 7f3da0e20640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f3d9c0c6680 0x7f3d9c0c6b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:50182/0 (socket says 172.21.15.67:50182) 2024-04-25T02:28:02.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.010+0000 7f3d9b7fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3d9c0d29d0 0x7f3d9c0d09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:55384/0 (socket says 172.21.15.67:55384) 2024-04-25T02:28:02.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.010+0000 7f3da0e20640 1 -- 172.21.15.67:0/2102816713 learned_addr learned my addr 172.21.15.67:0/2102816713 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:02.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.010+0000 7f3d9bfff640 1 --2- 172.21.15.67:0/2102816713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d9c0c8640 0x7f3d9c0d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.010+0000 7f3d9b7fe640 1 -- 172.21.15.67:0/2102816713 >> v2:172.21.15.176:3300/0 conn(0x7f3d9c0d29d0 msgr2=0x7f3d9c0d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T02:28:02.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.010+0000 7f3d9b7fe640 1 -- 172.21.15.67:0/2102816713 >> v2:172.21.15.176:3300/0 conn(0x7f3d9c0d29d0 msgr2=0x7f3d9c0d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:28:02.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.010+0000 7f3d9b7fe640 1 --2- 172.21.15.67:0/2102816713 >> v2:172.21.15.176:3300/0 conn(0x7f3d9c0d29d0 0x7f3d9c0d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T02:28:02.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.010+0000 7f3d9b7fe640 1 --2- 172.21.15.67:0/2102816713 >> v2:172.21.15.176:3300/0 conn(0x7f3d9c0d29d0 0x7f3d9c0d09b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:28:02.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.010+0000 7f3d9bfff640 1 -- 172.21.15.67:0/2102816713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d9c0c8640 msgr2=0x7f3d9c0d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T02:28:02.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.010+0000 7f3d9bfff640 1 -- 172.21.15.67:0/2102816713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d9c0c8640 msgr2=0x7f3d9c0d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:28:02.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.010+0000 7f3d9bfff640 1 --2- 172.21.15.67:0/2102816713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d9c0c8640 0x7f3d9c0d0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T02:28:02.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.010+0000 7f3d9bfff640 1 --2- 172.21.15.67:0/2102816713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d9c0c8640 0x7f3d9c0d0470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:28:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.172+0000 7f3d9affd640 1 -- 172.21.15.67:0/2102816713 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1268003071 0 0) 0x7f3d9c0d0000 con 0x7f3d9c0c6680 2024-04-25T02:28:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.172+0000 7f3d9affd640 1 -- 172.21.15.67:0/2102816713 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d84003520 con 0x7f3d9c0c6680 2024-04-25T02:28:02.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.176+0000 7f3d9affd640 1 -- 172.21.15.67:0/2102816713 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3847226380 0 0) 0x7f3d84003520 con 0x7f3d9c0c6680 2024-04-25T02:28:02.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.176+0000 7f3d9affd640 1 -- 172.21.15.67:0/2102816713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d9c0c8640 msgr2=0x7f3d9c0d0470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:28:02.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.176+0000 7f3d9affd640 1 --2- 172.21.15.67:0/2102816713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d9c0c8640 0x7f3d9c0d0470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.176+0000 7f3d9affd640 1 -- 172.21.15.67:0/2102816713 >> v2:172.21.15.176:3300/0 conn(0x7f3d9c0d29d0 msgr2=0x7f3d9c0d09b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:28:02.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.176+0000 7f3d9affd640 1 --2- 172.21.15.67:0/2102816713 >> v2:172.21.15.176:3300/0 conn(0x7f3d9c0d29d0 0x7f3d9c0d09b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.176+0000 7f3d9affd640 1 -- 172.21.15.67:0/2102816713 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9c0c5e80 con 0x7f3d9c0c6680 2024-04-25T02:28:02.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.176+0000 7f3d9affd640 1 -- 172.21.15.67:0/2102816713 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f3d940019f0 con 0x7f3d9c0c6680 2024-04-25T02:28:02.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.177+0000 7f3d9affd640 1 -- 172.21.15.67:0/2102816713 >> v1:172.21.15.176:6789/0 conn(0x7f3d9c0c6680 legacy=0x7f3d9c0c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:02.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.177+0000 7f3d9affd640 1 --2- 172.21.15.67:0/2102816713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d840039b0 0x7f3d84003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.177+0000 7f3d9affd640 1 --2- 172.21.15.67:0/2102816713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d840043c0 0x7f3d840048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.177+0000 7f3d9affd640 1 --2- 172.21.15.67:0/2102816713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d84004fc0 0x7f3d8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.177+0000 7f3d9affd640 1 -- 172.21.15.67:0/2102816713 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9c15fd60 con 0x7f3d84004fc0 2024-04-25T02:28:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.177+0000 7f3d9affd640 1 -- 172.21.15.67:0/2102816713 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9c0c5ba0 con 0x7f3d840043c0 2024-04-25T02:28:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.177+0000 7f3d9affd640 1 -- 172.21.15.67:0/2102816713 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3d8400bf00 con 0x7f3d840039b0 2024-04-25T02:28:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.177+0000 7f3d9b7fe640 1 --2- 172.21.15.67:0/2102816713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d840043c0 0x7f3d840048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.177+0000 7f3da0e20640 1 --2- 172.21.15.67:0/2102816713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d84004fc0 0x7f3d8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.177+0000 7f3d9bfff640 1 --2- 172.21.15.67:0/2102816713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d840039b0 0x7f3d84003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.177+0000 7f3da0e20640 1 -- 172.21.15.67:0/2102816713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d840039b0 msgr2=0x7f3d84003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.177+0000 7f3da0e20640 1 --2- 172.21.15.67:0/2102816713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d840039b0 0x7f3d84003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.177+0000 7f3da0e20640 1 -- 172.21.15.67:0/2102816713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d840043c0 msgr2=0x7f3d840048a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.177+0000 7f3da0e20640 1 --2- 172.21.15.67:0/2102816713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d840043c0 0x7f3d840048a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.177+0000 7f3da0e20640 1 -- 172.21.15.67:0/2102816713 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d84003520 con 0x7f3d84004fc0 2024-04-25T02:28:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.177+0000 7f3d9bfff640 1 --2- 172.21.15.67:0/2102816713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d840039b0 0x7f3d84003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:02.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.177+0000 7f3d9b7fe640 1 --2- 172.21.15.67:0/2102816713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d840043c0 0x7f3d840048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:02.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.178+0000 7f3da0e20640 1 --2- 172.21.15.67:0/2102816713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d84004fc0 0x7f3d8400b9c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3d940013d0 tx=0x7f3d84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d92a590575369f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:02.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.178+0000 7f3d9affd640 1 -- 172.21.15.67:0/2102816713 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9400a4e0 con 0x7f3d84004fc0 2024-04-25T02:28:02.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.178+0000 7f3d9affd640 1 -- 172.21.15.67:0/2102816713 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d9402f070 con 0x7f3d84004fc0 2024-04-25T02:28:02.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.178+0000 7f3d9affd640 1 -- 172.21.15.67:0/2102816713 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9402bce0 con 0x7f3d84004fc0 2024-04-25T02:28:02.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.179+0000 7f3da2883640 1 -- 172.21.15.67:0/2102816713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d84004fc0 msgr2=0x7f3d8400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:02.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.179+0000 7f3da2883640 1 --2- 172.21.15.67:0/2102816713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d84004fc0 0x7f3d8400b9c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3d940013d0 tx=0x7f3d84005830 comp rx=0 tx=0).stop 2024-04-25T02:28:02.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.179+0000 7f3da0e20640 1 -- 172.21.15.67:0/2102816713 reap_dead start 2024-04-25T02:28:02.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.179+0000 7f3da2883640 1 -- 172.21.15.67:0/2102816713 shutdown_connections 2024-04-25T02:28:02.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.179+0000 7f3da2883640 1 -- 172.21.15.67:0/2102816713 >> 172.21.15.67:0/2102816713 conn(0x7f3d9c0d1eb0 msgr2=0x7f3d9c0d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:02.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.179+0000 7f3da2883640 1 -- 172.21.15.67:0/2102816713 shutdown_connections 2024-04-25T02:28:02.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.179+0000 7f3da2883640 1 -- 172.21.15.67:0/2102816713 wait complete. 2024-04-25T02:28:02.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.181+0000 7f3da2883640 1 Processor -- start 2024-04-25T02:28:02.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.181+0000 7f3da2883640 1 -- start start 2024-04-25T02:28:02.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3da2883640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d84004fc0 0x7f3d9c0b6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3da2883640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d9c14fe90 0x7f3d9c0b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3da2883640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d9c0b42a0 0x7f3d9c0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3da2883640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9c0d0470 con 0x7f3d84004fc0 2024-04-25T02:28:02.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3da2883640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9c0cfc90 con 0x7f3d9c0b42a0 2024-04-25T02:28:02.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3da2883640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3d9c0d05f0 con 0x7f3d9c14fe90 2024-04-25T02:28:02.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3d9bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d84004fc0 0x7f3d9c0b6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3d9bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d84004fc0 0x7f3d9c0b6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48134/0 (socket says 172.21.15.67:48134) 2024-04-25T02:28:02.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3d9bfff640 1 -- 172.21.15.67:0/783812649 learned_addr learned my addr 172.21.15.67:0/783812649 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:02.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3da0e20640 1 --2- 172.21.15.67:0/783812649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d9c0b42a0 0x7f3d9c0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3d9b7fe640 1 --2- 172.21.15.67:0/783812649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d9c14fe90 0x7f3d9c0b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3d9bfff640 1 -- 172.21.15.67:0/783812649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d9c14fe90 msgr2=0x7f3d9c0b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:02.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3d9bfff640 1 --2- 172.21.15.67:0/783812649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d9c14fe90 0x7f3d9c0b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3d9bfff640 1 -- 172.21.15.67:0/783812649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d9c0b42a0 msgr2=0x7f3d9c0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:02.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3d9bfff640 1 --2- 172.21.15.67:0/783812649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d9c0b42a0 0x7f3d9c0b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3d9bfff640 1 -- 172.21.15.67:0/783812649 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9c0b29b0 con 0x7f3d84004fc0 2024-04-25T02:28:02.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3d9bfff640 1 --2- 172.21.15.67:0/783812649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d84004fc0 0x7f3d9c0b6de0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c010990 tx=0x7f3d8c010e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:02.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3d98ff9640 1 -- 172.21.15.67:0/783812649 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c01a020 con 0x7f3d84004fc0 2024-04-25T02:28:02.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3d98ff9640 1 -- 172.21.15.67:0/783812649 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d8c00ea60 con 0x7f3d84004fc0 2024-04-25T02:28:02.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3da2883640 1 -- 172.21.15.67:0/783812649 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d9c150630 con 0x7f3d84004fc0 2024-04-25T02:28:02.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3d98ff9640 1 -- 172.21.15.67:0/783812649 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c00ee30 con 0x7f3d84004fc0 2024-04-25T02:28:02.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.182+0000 7f3da2883640 1 -- 172.21.15.67:0/783812649 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d9c150bf0 con 0x7f3d84004fc0 2024-04-25T02:28:02.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.183+0000 7f3d98ff9640 1 -- 172.21.15.67:0/783812649 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3d8c01d020 con 0x7f3d84004fc0 2024-04-25T02:28:02.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.183+0000 7f3d98ff9640 1 -- 172.21.15.67:0/783812649 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3d8c014a00 con 0x7f3d84004fc0 2024-04-25T02:28:02.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.183+0000 7f3da2883640 1 -- 172.21.15.67:0/783812649 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d9c0681f0 con 0x7f3d84004fc0 2024-04-25T02:28:02.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.186+0000 7f3d98ff9640 1 -- 172.21.15.67:0/783812649 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3d8c024020 con 0x7f3d84004fc0 2024-04-25T02:28:02.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.253+0000 7f3da2883640 1 -- 172.21.15.67:0/783812649 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f3d9c06e8c0 con 0x7f3d84004fc0 2024-04-25T02:28:02.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.255+0000 7f3d98ff9640 1 -- 172.21.15.67:0/783812649 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f3d8c014430 con 0x7f3d84004fc0 2024-04-25T02:28:02.258 INFO:teuthology.orchestra.run.smithi067.stderr:adjusted tunables profile to default 2024-04-25T02:28:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.256+0000 7f3da2883640 1 -- 172.21.15.67:0/783812649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d84004fc0 msgr2=0x7f3d9c0b6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.256+0000 7f3da2883640 1 --2- 172.21.15.67:0/783812649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d84004fc0 0x7f3d9c0b6de0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c010990 tx=0x7f3d8c010e50 comp rx=0 tx=0).stop 2024-04-25T02:28:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.256+0000 7f3da2883640 1 -- 172.21.15.67:0/783812649 shutdown_connections 2024-04-25T02:28:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.256+0000 7f3da2883640 1 --2- 172.21.15.67:0/783812649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d9c0b42a0 0x7f3d9c0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.256+0000 7f3da2883640 1 --2- 172.21.15.67:0/783812649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d9c14fe90 0x7f3d9c0b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.256+0000 7f3da2883640 1 --2- 172.21.15.67:0/783812649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d84004fc0 0x7f3d9c0b6de0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.256+0000 7f3da2883640 1 -- 172.21.15.67:0/783812649 >> 172.21.15.67:0/783812649 conn(0x7f3d9c0d1eb0 msgr2=0x7f3d9c070600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.256+0000 7f3da2883640 1 -- 172.21.15.67:0/783812649 shutdown_connections 2024-04-25T02:28:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:02.256+0000 7f3da2883640 1 -- 172.21.15.67:0/783812649 wait complete. 2024-04-25T02:28:02.269 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T02:28:02.270 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T02:28:02.270 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:28:02.270 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T02:28:02.284 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:02.281+0000 7f6425723040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T02:28:02.294 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:28:02.294 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T02:28:02.297 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:02.295+0000 7f6e0d779040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T02:28:02.321 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:28:02.321 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T02:28:02.386 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:28:02.386 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T02:28:02.430 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:02.426+0000 7f6425723040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:28:02.448 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:02.445+0000 7f6e0d779040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:28:02.450 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:28:02.450 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T02:28:02.473 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:28:02.474 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T02:28:02.485 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:02.481+0000 7f6425723040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T02:28:02.504 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:02.501+0000 7f6e0d779040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T02:28:02.507 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:28:02.507 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T02:28:02.570 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:28:02.570 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T02:28:02.633 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new bb2ccd5c-757b-4db8-87c5-1b2ecf608400 0 2024-04-25T02:28:02.737 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:02.734+0000 7f6425723040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T02:28:02.753 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:02.750+0000 7f6e0d779040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T02:28:02.770 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.767+0000 7fc227363640 1 Processor -- start 2024-04-25T02:28:02.770 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.767+0000 7fc227363640 1 -- start start 2024-04-25T02:28:02.772 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.768+0000 7fc227363640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc22015e760 0x7fc2200cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.772 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.768+0000 7fc227363640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2200d1470 0x7fc22006bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.773 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.768+0000 7fc227363640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2200cff80 con 0x7fc2200d0900 2024-04-25T02:28:02.773 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.768+0000 7fc227363640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc2200d28a0 con 0x7fc22015e760 2024-04-25T02:28:02.773 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.768+0000 7fc227363640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc2200d2250 con 0x7fc2200d1470 2024-04-25T02:28:02.773 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.768+0000 7fc225900640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2200d1470 0x7fc22006bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.773 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.768+0000 7fc225900640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2200d1470 0x7fc22006bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:33126/0 (socket says 172.21.15.176:33126) 2024-04-25T02:28:02.773 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.768+0000 7fc225900640 1 -- 172.21.15.176:0/2187858723 learned_addr learned my addr 172.21.15.176:0/2187858723 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-04-25T02:28:02.773 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.768+0000 7fc2250ff640 1 --2- 172.21.15.176:0/2187858723 >> v2:172.21.15.67:3300/0 conn(0x7fc22015e760 0x7fc2200cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.773 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.768+0000 7fc225900640 1 -- 172.21.15.176:0/2187858723 >> v2:172.21.15.67:3300/0 conn(0x7fc22015e760 msgr2=0x7fc2200cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:02.773 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.768+0000 7fc225900640 1 --2- 172.21.15.176:0/2187858723 >> v2:172.21.15.67:3300/0 conn(0x7fc22015e760 0x7fc2200cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.773 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.768+0000 7fc225900640 1 -- 172.21.15.176:0/2187858723 >> v1:172.21.15.67:6789/0 conn(0x7fc2200d0900 legacy=0x7fc2200d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:02.773 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.768+0000 7fc225900640 1 -- 172.21.15.176:0/2187858723 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2200d2530 con 0x7fc2200d1470 2024-04-25T02:28:02.773 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.768+0000 7fc2250ff640 1 --2- 172.21.15.176:0/2187858723 >> v2:172.21.15.67:3300/0 conn(0x7fc22015e760 0x7fc2200cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:02.774 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.769+0000 7fc225900640 1 --2- 172.21.15.176:0/2187858723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2200d1470 0x7fc22006bfb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc218009e50 tx=0x7fc21802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=863cb9796078dd36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:02.774 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.769+0000 7fc217fff640 1 -- 172.21.15.176:0/2187858723 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc218036070 con 0x7fc2200d1470 2024-04-25T02:28:02.774 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.769+0000 7fc217fff640 1 -- 172.21.15.176:0/2187858723 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc218031600 con 0x7fc2200d1470 2024-04-25T02:28:02.774 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.769+0000 7fc217fff640 1 -- 172.21.15.176:0/2187858723 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2180319d0 con 0x7fc2200d1470 2024-04-25T02:28:02.777 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.770+0000 7fc227363640 1 -- 172.21.15.176:0/2187858723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2200d1470 msgr2=0x7fc22006bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:02.777 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.770+0000 7fc227363640 1 --2- 172.21.15.176:0/2187858723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2200d1470 0x7fc22006bfb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc218009e50 tx=0x7fc21802a710 comp rx=0 tx=0).stop 2024-04-25T02:28:02.777 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.770+0000 7fc227363640 1 -- 172.21.15.176:0/2187858723 shutdown_connections 2024-04-25T02:28:02.777 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.770+0000 7fc227363640 1 --2- 172.21.15.176:0/2187858723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2200d1470 0x7fc22006bfb0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.777 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.770+0000 7fc227363640 1 --2- 172.21.15.176:0/2187858723 >> v2:172.21.15.67:3300/0 conn(0x7fc22015e760 0x7fc2200cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.777 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.770+0000 7fc227363640 1 -- 172.21.15.176:0/2187858723 >> 172.21.15.176:0/2187858723 conn(0x7fc2200d41b0 msgr2=0x7fc2200d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:02.777 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.770+0000 7fc227363640 1 -- 172.21.15.176:0/2187858723 shutdown_connections 2024-04-25T02:28:02.777 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.770+0000 7fc227363640 1 -- 172.21.15.176:0/2187858723 wait complete. 2024-04-25T02:28:02.778 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.771+0000 7fc227363640 1 Processor -- start 2024-04-25T02:28:02.778 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.771+0000 7fc227363640 1 -- start start 2024-04-25T02:28:02.778 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc227363640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2200d0900 0x7fc2201f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.778 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc227363640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2200d1470 0x7fc22015d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.778 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc227363640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc22015e760 0x7fc2200c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.778 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc227363640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc22015eb40 con 0x7fc22015e760 2024-04-25T02:28:02.778 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc227363640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc2200d3d40 con 0x7fc2200d1470 2024-04-25T02:28:02.778 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc227363640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc22015ecc0 con 0x7fc2200d0900 2024-04-25T02:28:02.778 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc2250ff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2200d0900 0x7fc2201f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.778 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc2248fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2200d1470 0x7fc22015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.778 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc2248fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2200d1470 0x7fc22015d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:34892/0 (socket says 172.21.15.176:34892) 2024-04-25T02:28:02.778 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc2248fe640 1 -- 172.21.15.176:0/2948825770 learned_addr learned my addr 172.21.15.176:0/2948825770 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-04-25T02:28:02.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc225900640 1 --2- 172.21.15.176:0/2948825770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc22015e760 0x7fc2200c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc2248fe640 1 -- 172.21.15.176:0/2948825770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2200d0900 msgr2=0x7fc2201f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:02.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc2248fe640 1 --2- 172.21.15.176:0/2948825770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2200d0900 0x7fc2201f4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc2248fe640 1 -- 172.21.15.176:0/2948825770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc22015e760 msgr2=0x7fc2200c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:02.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc2248fe640 1 --2- 172.21.15.176:0/2948825770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc22015e760 0x7fc2200c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc2248fe640 1 -- 172.21.15.176:0/2948825770 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2200c7c80 con 0x7fc2200d1470 2024-04-25T02:28:02.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc2250ff640 1 --2- 172.21.15.176:0/2948825770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2200d0900 0x7fc2201f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:02.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc2248fe640 1 --2- 172.21.15.176:0/2948825770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2200d1470 0x7fc22015d320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00c430 tx=0x7fc21c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:02.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc215ffb640 1 -- 172.21.15.176:0/2948825770 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c0052d0 con 0x7fc2200d1470 2024-04-25T02:28:02.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc215ffb640 1 -- 172.21.15.176:0/2948825770 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc21c005490 con 0x7fc2200d1470 2024-04-25T02:28:02.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc227363640 1 -- 172.21.15.176:0/2948825770 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2200c7f60 con 0x7fc2200d1470 2024-04-25T02:28:02.779 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.772+0000 7fc215ffb640 1 -- 172.21.15.176:0/2948825770 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c007260 con 0x7fc2200d1470 2024-04-25T02:28:02.780 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.773+0000 7fc227363640 1 -- 172.21.15.176:0/2948825770 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2200c8520 con 0x7fc2200d1470 2024-04-25T02:28:02.780 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.773+0000 7fc215ffb640 1 -- 172.21.15.176:0/2948825770 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc21c007400 con 0x7fc2200d1470 2024-04-25T02:28:02.780 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.773+0000 7fc215ffb640 1 -- 172.21.15.176:0/2948825770 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fc21c0035f0 con 0x7fc2200d1470 2024-04-25T02:28:02.780 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.774+0000 7fc227363640 1 -- 172.21.15.176:0/2948825770 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc220069110 con 0x7fc2200d1470 2024-04-25T02:28:02.780 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.776+0000 7fc215ffb640 1 -- 172.21.15.176:0/2948825770 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc21c003b40 con 0x7fc2200d1470 2024-04-25T02:28:02.786 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:02.783+0000 7f6425723040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T02:28:02.801 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:02.798+0000 7f6e0d779040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T02:28:02.851 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.847+0000 7fc227363640 1 -- 172.21.15.176:0/2948825770 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bb2ccd5c-757b-4db8-87c5-1b2ecf608400", "id": 0} v 0) -- 0x7fc2200ba040 con 0x7fc2200d1470 2024-04-25T02:28:02.855 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.852+0000 7fc215ffb640 1 -- 172.21.15.176:0/2948825770 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bb2ccd5c-757b-4db8-87c5-1b2ecf608400", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fc21c003d20 con 0x7fc2200d1470 2024-04-25T02:28:02.856 INFO:teuthology.orchestra.run.smithi176.stdout:0 2024-04-25T02:28:02.857 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.853+0000 7fc227363640 1 -- 172.21.15.176:0/2948825770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2200d1470 msgr2=0x7fc22015d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:02.857 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.853+0000 7fc227363640 1 --2- 172.21.15.176:0/2948825770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2200d1470 0x7fc22015d320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00c430 tx=0x7fc21c00c8f0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.857 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.853+0000 7fc227363640 1 -- 172.21.15.176:0/2948825770 shutdown_connections 2024-04-25T02:28:02.857 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.853+0000 7fc227363640 1 --2- 172.21.15.176:0/2948825770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc22015e760 0x7fc2200c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.857 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.853+0000 7fc227363640 1 --2- 172.21.15.176:0/2948825770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2200d1470 0x7fc22015d320 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.857 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.853+0000 7fc227363640 1 --2- 172.21.15.176:0/2948825770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2200d0900 0x7fc2201f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.857 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.853+0000 7fc227363640 1 -- 172.21.15.176:0/2948825770 >> 172.21.15.176:0/2948825770 conn(0x7fc2200d41b0 msgr2=0x7fc22015eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:02.858 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.853+0000 7fc227363640 1 -- 172.21.15.176:0/2948825770 shutdown_connections 2024-04-25T02:28:02.858 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.853+0000 7fc227363640 1 -- 172.21.15.176:0/2948825770 wait complete. 2024-04-25T02:28:02.867 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 6e6a2fdf-4851-445b-891e-32c70858c1ed 1 2024-04-25T02:28:02.964 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.961+0000 7fd5f41fb640 1 Processor -- start 2024-04-25T02:28:02.965 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.961+0000 7fd5f41fb640 1 -- start start 2024-04-25T02:28:02.966 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.962+0000 7fd5f41fb640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd5ec15e170 0x7fd5ec072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.966 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.962+0000 7fd5f41fb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5ec0aeab0 0x7fd5ec072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.967 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.962+0000 7fd5f41fb640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd5ec0af760 0x7fd5ec0afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.967 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.962+0000 7fd5f41fb640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd5ec0ae620 con 0x7fd5ec0af760 2024-04-25T02:28:02.967 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.962+0000 7fd5f41fb640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd5ec0b0130 con 0x7fd5ec15e170 2024-04-25T02:28:02.967 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.962+0000 7fd5f41fb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd5ec0ada10 con 0x7fd5ec0aeab0 2024-04-25T02:28:02.967 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.962+0000 7fd5f1f97640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd5ec15e170 0x7fd5ec072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.967 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.962+0000 7fd5f1796640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5ec0aeab0 0x7fd5ec072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.967 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.962+0000 7fd5f1796640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5ec0aeab0 0x7fd5ec072fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:33146/0 (socket says 172.21.15.176:33146) 2024-04-25T02:28:02.967 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.962+0000 7fd5f1f97640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd5ec15e170 0x7fd5ec072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:34898/0 (socket says 172.21.15.176:34898) 2024-04-25T02:28:02.967 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.962+0000 7fd5f1796640 1 -- 172.21.15.176:0/1775179987 learned_addr learned my addr 172.21.15.176:0/1775179987 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-04-25T02:28:02.967 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.962+0000 7fd5f2798640 1 --2- 172.21.15.176:0/1775179987 >> v2:172.21.15.67:3300/0 conn(0x7fd5ec0af760 0x7fd5ec0afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.967 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.962+0000 7fd5f1f97640 1 -- 172.21.15.176:0/1775179987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5ec0aeab0 msgr2=0x7fd5ec072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:02.967 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.962+0000 7fd5f1f97640 1 --2- 172.21.15.176:0/1775179987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5ec0aeab0 0x7fd5ec072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.968 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.962+0000 7fd5f1f97640 1 -- 172.21.15.176:0/1775179987 >> v2:172.21.15.67:3300/0 conn(0x7fd5ec0af760 msgr2=0x7fd5ec0afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:02.968 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.962+0000 7fd5f1f97640 1 --2- 172.21.15.176:0/1775179987 >> v2:172.21.15.67:3300/0 conn(0x7fd5ec0af760 0x7fd5ec0afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.968 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.962+0000 7fd5f1f97640 1 -- 172.21.15.176:0/1775179987 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5ec0adcf0 con 0x7fd5ec15e170 2024-04-25T02:28:02.968 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.963+0000 7fd5f1f97640 1 --2- 172.21.15.176:0/1775179987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5ec15e170 0x7fd5ec072a70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec071b90 tx=0x7fd5e802a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d6cefdbc03d569e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:02.968 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.963+0000 7fd5f0f95640 1 -- 172.21.15.176:0/1775179987 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8037070 con 0x7fd5ec15e170 2024-04-25T02:28:02.968 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.963+0000 7fd5f0f95640 1 -- 172.21.15.176:0/1775179987 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e802add0 con 0x7fd5ec15e170 2024-04-25T02:28:02.968 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.963+0000 7fd5f0f95640 1 -- 172.21.15.176:0/1775179987 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8032660 con 0x7fd5ec15e170 2024-04-25T02:28:02.971 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.963+0000 7fd5f41fb640 1 -- 172.21.15.176:0/1775179987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5ec15e170 msgr2=0x7fd5ec072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:02.971 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.963+0000 7fd5f41fb640 1 --2- 172.21.15.176:0/1775179987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5ec15e170 0x7fd5ec072a70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec071b90 tx=0x7fd5e802a080 comp rx=0 tx=0).stop 2024-04-25T02:28:02.971 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.963+0000 7fd5f41fb640 1 -- 172.21.15.176:0/1775179987 shutdown_connections 2024-04-25T02:28:02.971 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.963+0000 7fd5f41fb640 1 --2- 172.21.15.176:0/1775179987 >> v2:172.21.15.67:3300/0 conn(0x7fd5ec0af760 0x7fd5ec0afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.971 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.963+0000 7fd5f41fb640 1 --2- 172.21.15.176:0/1775179987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5ec0aeab0 0x7fd5ec072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.972 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.963+0000 7fd5f41fb640 1 --2- 172.21.15.176:0/1775179987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5ec15e170 0x7fd5ec072a70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.972 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.964+0000 7fd5f41fb640 1 -- 172.21.15.176:0/1775179987 >> 172.21.15.176:0/1775179987 conn(0x7fd5ec071f50 msgr2=0x7fd5ec072360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:02.972 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.964+0000 7fd5f41fb640 1 -- 172.21.15.176:0/1775179987 shutdown_connections 2024-04-25T02:28:02.972 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.964+0000 7fd5f41fb640 1 -- 172.21.15.176:0/1775179987 wait complete. 2024-04-25T02:28:02.972 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.965+0000 7fd5f41fb640 1 Processor -- start 2024-04-25T02:28:02.972 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.965+0000 7fd5f41fb640 1 -- start start 2024-04-25T02:28:02.972 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.965+0000 7fd5f41fb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5ec0aeab0 0x7fd5ec157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.972 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.965+0000 7fd5f41fb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5ec0af760 0x7fd5ec1e33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.972 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.965+0000 7fd5f41fb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5ec15e170 0x7fd5ec145650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:02.972 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.965+0000 7fd5f41fb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ec15e550 con 0x7fd5ec15e170 2024-04-25T02:28:02.972 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.965+0000 7fd5f41fb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ec0ae2b0 con 0x7fd5ec0aeab0 2024-04-25T02:28:02.972 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5f41fb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd5ec06b0c0 con 0x7fd5ec0af760 2024-04-25T02:28:02.972 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5f1f97640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5ec0aeab0 0x7fd5ec157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.973 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5f1f97640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5ec0aeab0 0x7fd5ec157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:34900/0 (socket says 172.21.15.176:34900) 2024-04-25T02:28:02.973 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5f1f97640 1 -- 172.21.15.176:0/2643256010 learned_addr learned my addr 172.21.15.176:0/2643256010 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-04-25T02:28:02.973 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5f1796640 1 --2- 172.21.15.176:0/2643256010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5ec0af760 0x7fd5ec1e33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.973 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5f2798640 1 --2- 172.21.15.176:0/2643256010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5ec15e170 0x7fd5ec145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:02.973 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5f1f97640 1 -- 172.21.15.176:0/2643256010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5ec0af760 msgr2=0x7fd5ec1e33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:02.973 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5f1f97640 1 --2- 172.21.15.176:0/2643256010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5ec0af760 0x7fd5ec1e33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.973 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5f1f97640 1 -- 172.21.15.176:0/2643256010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5ec15e170 msgr2=0x7fd5ec145650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:02.973 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5f1f97640 1 --2- 172.21.15.176:0/2643256010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5ec15e170 0x7fd5ec145650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:02.973 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5f1f97640 1 -- 172.21.15.176:0/2643256010 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5ec1567c0 con 0x7fd5ec0aeab0 2024-04-25T02:28:02.973 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5f1796640 1 --2- 172.21.15.176:0/2643256010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5ec0af760 0x7fd5ec1e33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:02.973 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5f1f97640 1 --2- 172.21.15.176:0/2643256010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5ec0aeab0 0x7fd5ec157860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8000c00 tx=0x7fd5e80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:02.973 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5e27fc640 1 -- 172.21.15.176:0/2643256010 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8037040 con 0x7fd5ec0aeab0 2024-04-25T02:28:02.973 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5e27fc640 1 -- 172.21.15.176:0/2643256010 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e8042070 con 0x7fd5ec0aeab0 2024-04-25T02:28:02.974 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5f41fb640 1 -- 172.21.15.176:0/2643256010 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5ec156aa0 con 0x7fd5ec0aeab0 2024-04-25T02:28:02.974 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5e27fc640 1 -- 172.21.15.176:0/2643256010 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e803d660 con 0x7fd5ec0aeab0 2024-04-25T02:28:02.974 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5f41fb640 1 -- 172.21.15.176:0/2643256010 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5ec157060 con 0x7fd5ec0aeab0 2024-04-25T02:28:02.974 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5e27fc640 1 -- 172.21.15.176:0/2643256010 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd5e803d800 con 0x7fd5ec0aeab0 2024-04-25T02:28:02.974 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.966+0000 7fd5e27fc640 1 -- 172.21.15.176:0/2643256010 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fd5e8047cb0 con 0x7fd5ec0aeab0 2024-04-25T02:28:02.974 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.967+0000 7fd5f41fb640 1 -- 172.21.15.176:0/2643256010 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5ec0681f0 con 0x7fd5ec0aeab0 2024-04-25T02:28:02.974 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:02.971+0000 7fd5e27fc640 1 -- 172.21.15.176:0/2643256010 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd5e8047460 con 0x7fd5ec0aeab0 2024-04-25T02:28:03.047 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.043+0000 7fd5f41fb640 1 -- 172.21.15.176:0/2643256010 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6e6a2fdf-4851-445b-891e-32c70858c1ed", "id": 1} v 0) -- 0x7fd5ec0b5c80 con 0x7fd5ec0aeab0 2024-04-25T02:28:03.055 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.052+0000 7fd5e27fc640 1 -- 172.21.15.176:0/2643256010 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6e6a2fdf-4851-445b-891e-32c70858c1ed", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fd5e803dc30 con 0x7fd5ec0aeab0 2024-04-25T02:28:03.055 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-04-25T02:28:03.056 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.052+0000 7fd5f41fb640 1 -- 172.21.15.176:0/2643256010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5ec0aeab0 msgr2=0x7fd5ec157860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.056 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.052+0000 7fd5f41fb640 1 --2- 172.21.15.176:0/2643256010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5ec0aeab0 0x7fd5ec157860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8000c00 tx=0x7fd5e80046c0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.056 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.053+0000 7fd5f41fb640 1 -- 172.21.15.176:0/2643256010 shutdown_connections 2024-04-25T02:28:03.056 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.053+0000 7fd5f41fb640 1 --2- 172.21.15.176:0/2643256010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5ec15e170 0x7fd5ec145650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.057 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.053+0000 7fd5f41fb640 1 --2- 172.21.15.176:0/2643256010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5ec0af760 0x7fd5ec1e33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.057 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.053+0000 7fd5f41fb640 1 --2- 172.21.15.176:0/2643256010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5ec0aeab0 0x7fd5ec157860 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.057 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.053+0000 7fd5f41fb640 1 -- 172.21.15.176:0/2643256010 >> 172.21.15.176:0/2643256010 conn(0x7fd5ec071f50 msgr2=0x7fd5ec0b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:03.057 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.053+0000 7fd5f41fb640 1 -- 172.21.15.176:0/2643256010 shutdown_connections 2024-04-25T02:28:03.057 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.053+0000 7fd5f41fb640 1 -- 172.21.15.176:0/2643256010 wait complete. 2024-04-25T02:28:03.067 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 31160699-f824-47fe-ad35-1211c5461ca5 2 2024-04-25T02:28:03.165 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.161+0000 7ff0db909640 1 Processor -- start 2024-04-25T02:28:03.165 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.161+0000 7ff0db909640 1 -- start start 2024-04-25T02:28:03.166 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.162+0000 7ff0db909640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff0d41440f0 0x7ff0d415f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.166 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.162+0000 7ff0db909640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0d4072a70 0x7ff0d4072ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.166 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.162+0000 7ff0db909640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0d415f950 con 0x7ff0d40cd8e0 2024-04-25T02:28:03.166 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.162+0000 7ff0db909640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff0d40cf5f0 con 0x7ff0d41440f0 2024-04-25T02:28:03.166 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.162+0000 7ff0db909640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff0d40d0a10 con 0x7ff0d4072a70 2024-04-25T02:28:03.166 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.162+0000 7ff0d9ea6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0d4072a70 0x7ff0d4072ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.167 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.162+0000 7ff0d9ea6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0d4072a70 0x7ff0d4072ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:33158/0 (socket says 172.21.15.176:33158) 2024-04-25T02:28:03.167 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.162+0000 7ff0d9ea6640 1 -- 172.21.15.176:0/1716765054 learned_addr learned my addr 172.21.15.176:0/1716765054 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-04-25T02:28:03.167 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.162+0000 7ff0d96a5640 1 --2- 172.21.15.176:0/1716765054 >> v2:172.21.15.67:3300/0 conn(0x7ff0d41440f0 0x7ff0d415f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.167 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.162+0000 7ff0d9ea6640 1 -- 172.21.15.176:0/1716765054 >> v2:172.21.15.67:3300/0 conn(0x7ff0d41440f0 msgr2=0x7ff0d415f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:03.167 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.162+0000 7ff0d9ea6640 1 --2- 172.21.15.176:0/1716765054 >> v2:172.21.15.67:3300/0 conn(0x7ff0d41440f0 0x7ff0d415f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.167 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.162+0000 7ff0d9ea6640 1 -- 172.21.15.176:0/1716765054 >> v1:172.21.15.67:6789/0 conn(0x7ff0d40cd8e0 legacy=0x7ff0d40d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.167 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.162+0000 7ff0d9ea6640 1 -- 172.21.15.176:0/1716765054 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d40cde40 con 0x7ff0d4072a70 2024-04-25T02:28:03.168 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.163+0000 7ff0d9ea6640 1 --2- 172.21.15.176:0/1716765054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0d4072a70 0x7ff0d4072ea0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00d150 tx=0x7ff0cc02c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=637036282a27cdce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:03.168 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.163+0000 7ff0cbfff640 1 -- 172.21.15.176:0/1716765054 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc009600 con 0x7ff0d4072a70 2024-04-25T02:28:03.168 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.163+0000 7ff0cbfff640 1 -- 172.21.15.176:0/1716765054 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0cc037070 con 0x7ff0d4072a70 2024-04-25T02:28:03.168 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.163+0000 7ff0cbfff640 1 -- 172.21.15.176:0/1716765054 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc0099c0 con 0x7ff0d4072a70 2024-04-25T02:28:03.168 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.164+0000 7ff0db909640 1 -- 172.21.15.176:0/1716765054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0d4072a70 msgr2=0x7ff0d4072ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.168 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.164+0000 7ff0db909640 1 --2- 172.21.15.176:0/1716765054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0d4072a70 0x7ff0d4072ea0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00d150 tx=0x7ff0cc02c920 comp rx=0 tx=0).stop 2024-04-25T02:28:03.168 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.164+0000 7ff0db909640 1 -- 172.21.15.176:0/1716765054 shutdown_connections 2024-04-25T02:28:03.168 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.164+0000 7ff0db909640 1 --2- 172.21.15.176:0/1716765054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0d4072a70 0x7ff0d4072ea0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.164+0000 7ff0db909640 1 --2- 172.21.15.176:0/1716765054 >> v2:172.21.15.67:3300/0 conn(0x7ff0d41440f0 0x7ff0d415f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.164+0000 7ff0db909640 1 -- 172.21.15.176:0/1716765054 >> 172.21.15.176:0/1716765054 conn(0x7ff0d4071f50 msgr2=0x7ff0d4072360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:03.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.164+0000 7ff0db909640 1 -- 172.21.15.176:0/1716765054 shutdown_connections 2024-04-25T02:28:03.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.164+0000 7ff0db909640 1 -- 172.21.15.176:0/1716765054 wait complete. 2024-04-25T02:28:03.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.165+0000 7ff0db909640 1 Processor -- start 2024-04-25T02:28:03.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.165+0000 7ff0db909640 1 -- start start 2024-04-25T02:28:03.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.166+0000 7ff0db909640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0d4072a70 0x7ff0d41402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.166+0000 7ff0db909640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0d40cd8e0 0x7ff0d415d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.166+0000 7ff0db909640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0d41440f0 0x7ff0d40a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.166+0000 7ff0db909640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d40cfb00 con 0x7ff0d41440f0 2024-04-25T02:28:03.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.166+0000 7ff0db909640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d40733e0 con 0x7ff0d40cd8e0 2024-04-25T02:28:03.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.166+0000 7ff0db909640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff0d40cfde0 con 0x7ff0d4072a70 2024-04-25T02:28:03.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.166+0000 7ff0d96a5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0d4072a70 0x7ff0d41402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.166+0000 7ff0d8ea4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0d40cd8e0 0x7ff0d415d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.166+0000 7ff0d96a5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0d4072a70 0x7ff0d41402e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:33162/0 (socket says 172.21.15.176:33162) 2024-04-25T02:28:03.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.166+0000 7ff0d8ea4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0d40cd8e0 0x7ff0d415d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:34914/0 (socket says 172.21.15.176:34914) 2024-04-25T02:28:03.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.166+0000 7ff0d96a5640 1 -- 172.21.15.176:0/487933376 learned_addr learned my addr 172.21.15.176:0/487933376 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-04-25T02:28:03.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.166+0000 7ff0d9ea6640 1 --2- 172.21.15.176:0/487933376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0d41440f0 0x7ff0d40a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.166+0000 7ff0d8ea4640 1 -- 172.21.15.176:0/487933376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0d4072a70 msgr2=0x7ff0d41402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.166+0000 7ff0d8ea4640 1 --2- 172.21.15.176:0/487933376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0d4072a70 0x7ff0d41402e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.166+0000 7ff0d8ea4640 1 -- 172.21.15.176:0/487933376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0d41440f0 msgr2=0x7ff0d40a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.166+0000 7ff0d8ea4640 1 --2- 172.21.15.176:0/487933376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0d41440f0 0x7ff0d40a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.166+0000 7ff0d8ea4640 1 -- 172.21.15.176:0/487933376 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d40ad3a0 con 0x7ff0d40cd8e0 2024-04-25T02:28:03.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.167+0000 7ff0d8ea4640 1 --2- 172.21.15.176:0/487933376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0d40cd8e0 0x7ff0d415d9b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4071b90 tx=0x7ff0d000c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:03.173 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.167+0000 7ff0c9ffb640 1 -- 172.21.15.176:0/487933376 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0017070 con 0x7ff0d40cd8e0 2024-04-25T02:28:03.173 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.167+0000 7ff0c9ffb640 1 -- 172.21.15.176:0/487933376 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d00052f0 con 0x7ff0d40cd8e0 2024-04-25T02:28:03.173 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.167+0000 7ff0db909640 1 -- 172.21.15.176:0/487933376 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d40ab770 con 0x7ff0d40cd8e0 2024-04-25T02:28:03.173 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.167+0000 7ff0c9ffb640 1 -- 172.21.15.176:0/487933376 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0003850 con 0x7ff0d40cd8e0 2024-04-25T02:28:03.173 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.167+0000 7ff0c9ffb640 1 -- 172.21.15.176:0/487933376 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff0d001a070 con 0x7ff0d40cd8e0 2024-04-25T02:28:03.173 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.167+0000 7ff0db909640 1 -- 172.21.15.176:0/487933376 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d40abd30 con 0x7ff0d40cd8e0 2024-04-25T02:28:03.173 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.167+0000 7ff0c9ffb640 1 -- 172.21.15.176:0/487933376 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7ff0d0011590 con 0x7ff0d40cd8e0 2024-04-25T02:28:03.173 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.168+0000 7ff0db909640 1 -- 172.21.15.176:0/487933376 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d40681f0 con 0x7ff0d40cd8e0 2024-04-25T02:28:03.174 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.171+0000 7ff0c9ffb640 1 -- 172.21.15.176:0/487933376 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff0d0022020 con 0x7ff0d40cd8e0 2024-04-25T02:28:03.257 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.254+0000 7ff0db909640 1 -- 172.21.15.176:0/487933376 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "31160699-f824-47fe-ad35-1211c5461ca5", "id": 2} v 0) -- 0x7ff0d40d0bc0 con 0x7ff0d40cd8e0 2024-04-25T02:28:03.263 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.259+0000 7ff0c9ffb640 1 -- 172.21.15.176:0/487933376 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "31160699-f824-47fe-ad35-1211c5461ca5", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7ff0d40ad3a0 con 0x7ff0d40cd8e0 2024-04-25T02:28:03.263 INFO:teuthology.orchestra.run.smithi176.stdout:2 2024-04-25T02:28:03.264 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.260+0000 7ff0db909640 1 -- 172.21.15.176:0/487933376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0d40cd8e0 msgr2=0x7ff0d415d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.264 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.260+0000 7ff0db909640 1 --2- 172.21.15.176:0/487933376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0d40cd8e0 0x7ff0d415d9b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4071b90 tx=0x7ff0d000c820 comp rx=0 tx=0).stop 2024-04-25T02:28:03.264 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.260+0000 7ff0db909640 1 -- 172.21.15.176:0/487933376 shutdown_connections 2024-04-25T02:28:03.264 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.260+0000 7ff0db909640 1 --2- 172.21.15.176:0/487933376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0d41440f0 0x7ff0d40a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.264 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.260+0000 7ff0db909640 1 --2- 172.21.15.176:0/487933376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0d40cd8e0 0x7ff0d415d9b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.264 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.260+0000 7ff0db909640 1 --2- 172.21.15.176:0/487933376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0d4072a70 0x7ff0d41402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.264 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.260+0000 7ff0db909640 1 -- 172.21.15.176:0/487933376 >> 172.21.15.176:0/487933376 conn(0x7ff0d4071f50 msgr2=0x7ff0d40b4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:03.264 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.260+0000 7ff0db909640 1 -- 172.21.15.176:0/487933376 shutdown_connections 2024-04-25T02:28:03.265 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.260+0000 7ff0db909640 1 -- 172.21.15.176:0/487933376 wait complete. 2024-04-25T02:28:03.274 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new f3e63257-ae6d-4588-9cba-f4639f27497a 3 2024-04-25T02:28:03.372 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.368+0000 7f9c1c615640 1 Processor -- start 2024-04-25T02:28:03.372 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.368+0000 7f9c1c615640 1 -- start start 2024-04-25T02:28:03.375 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.369+0000 7f9c1c615640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c140c8640 0x7f9c140d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.375 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.369+0000 7f9c1c615640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9c140cdb40 0x7f9c140d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.375 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.369+0000 7f9c1c615640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c140d0000 con 0x7f9c140d29d0 2024-04-25T02:28:03.375 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.369+0000 7f9c1c615640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f9c1415fd60 con 0x7f9c140cdb40 2024-04-25T02:28:03.375 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.369+0000 7f9c1c615640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9c140c5ba0 con 0x7f9c140c8640 2024-04-25T02:28:03.375 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.369+0000 7f9c1a3b1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c140c8640 0x7f9c140d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.375 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.369+0000 7f9c19bb0640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f9c140d29d0 0x7f9c140c6680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:60046/0 (socket says 172.21.15.176:60046) 2024-04-25T02:28:03.375 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.369+0000 7f9c19bb0640 1 -- 172.21.15.176:0/3255283796 learned_addr learned my addr 172.21.15.176:0/3255283796 (peer_addr_for_me v1:172.21.15.176:0/0) 2024-04-25T02:28:03.375 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.370+0000 7f9c1abb2640 1 --2- 172.21.15.176:0/3255283796 >> v2:172.21.15.67:3300/0 conn(0x7f9c140cdb40 0x7f9c140d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.376 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.370+0000 7f9c1a3b1640 1 -- 172.21.15.176:0/3255283796 >> v2:172.21.15.67:3300/0 conn(0x7f9c140cdb40 msgr2=0x7f9c140d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:03.376 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.370+0000 7f9c1a3b1640 1 --2- 172.21.15.176:0/3255283796 >> v2:172.21.15.67:3300/0 conn(0x7f9c140cdb40 0x7f9c140d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.376 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.370+0000 7f9c1a3b1640 1 -- 172.21.15.176:0/3255283796 >> v1:172.21.15.176:6789/0 conn(0x7f9c140d29d0 legacy=0x7f9c140c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.376 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.370+0000 7f9c1a3b1640 1 -- 172.21.15.176:0/3255283796 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c140c5e80 con 0x7f9c140c8640 2024-04-25T02:28:03.376 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.370+0000 7f9c193af640 1 -- 172.21.15.176:0/3255283796 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1461379637 0 0) 0x7f9c140d0000 con 0x7f9c140d29d0 2024-04-25T02:28:03.376 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.370+0000 7f9c1abb2640 1 --2- 172.21.15.176:0/3255283796 >> v2:172.21.15.67:3300/0 conn(0x7f9c140cdb40 0x7f9c140d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:03.376 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.370+0000 7f9c1a3b1640 1 --2- 172.21.15.176:0/3255283796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c140c8640 0x7f9c140d0470 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9c040097a0 tx=0x7f9c0402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=924e294849bc775 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:03.376 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.371+0000 7f9c193af640 1 -- 172.21.15.176:0/3255283796 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c04037070 con 0x7f9c140c8640 2024-04-25T02:28:03.376 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.371+0000 7f9c193af640 1 -- 172.21.15.176:0/3255283796 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c04032440 con 0x7f9c140c8640 2024-04-25T02:28:03.376 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.371+0000 7f9c193af640 1 -- 172.21.15.176:0/3255283796 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c04032810 con 0x7f9c140c8640 2024-04-25T02:28:03.376 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.371+0000 7f9c1c615640 1 -- 172.21.15.176:0/3255283796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c140c8640 msgr2=0x7f9c140d0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.376 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.371+0000 7f9c1c615640 1 --2- 172.21.15.176:0/3255283796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c140c8640 0x7f9c140d0470 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9c040097a0 tx=0x7f9c0402a180 comp rx=0 tx=0).stop 2024-04-25T02:28:03.376 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.371+0000 7f9c1c615640 1 -- 172.21.15.176:0/3255283796 shutdown_connections 2024-04-25T02:28:03.377 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.371+0000 7f9c1c615640 1 --2- 172.21.15.176:0/3255283796 >> v2:172.21.15.67:3300/0 conn(0x7f9c140cdb40 0x7f9c140d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.377 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.371+0000 7f9c1c615640 1 --2- 172.21.15.176:0/3255283796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c140c8640 0x7f9c140d0470 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.377 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.371+0000 7f9c1c615640 1 -- 172.21.15.176:0/3255283796 >> 172.21.15.176:0/3255283796 conn(0x7f9c140d1eb0 msgr2=0x7f9c140d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:03.377 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.371+0000 7f9c1c615640 1 -- 172.21.15.176:0/3255283796 shutdown_connections 2024-04-25T02:28:03.377 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.371+0000 7f9c1c615640 1 -- 172.21.15.176:0/3255283796 wait complete. 2024-04-25T02:28:03.379 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.373+0000 7f9c1c615640 1 Processor -- start 2024-04-25T02:28:03.379 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.373+0000 7f9c1c615640 1 -- start start 2024-04-25T02:28:03.379 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.373+0000 7f9c1c615640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c140cdb40 0x7f9c1414a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.379 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.373+0000 7f9c1c615640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c140d29d0 0x7f9c140ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.379 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.373+0000 7f9c1c615640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c140caf20 0x7f9c1415b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.379 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.373+0000 7f9c1c615640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9c140c6d90 con 0x7f9c140d29d0 2024-04-25T02:28:03.380 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.373+0000 7f9c1c615640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9c140cfc90 con 0x7f9c140caf20 2024-04-25T02:28:03.380 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.373+0000 7f9c1c615640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9c140c6f10 con 0x7f9c140cdb40 2024-04-25T02:28:03.380 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.373+0000 7f9c1a3b1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c140cdb40 0x7f9c1414a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.380 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.373+0000 7f9c1a3b1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c140cdb40 0x7f9c1414a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:33190/0 (socket says 172.21.15.176:33190) 2024-04-25T02:28:03.380 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.373+0000 7f9c1abb2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c140caf20 0x7f9c1415b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.380 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.373+0000 7f9c1a3b1640 1 -- 172.21.15.176:0/480206471 learned_addr learned my addr 172.21.15.176:0/480206471 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-04-25T02:28:03.380 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.373+0000 7f9c19bb0640 1 --2- 172.21.15.176:0/480206471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c140d29d0 0x7f9c140ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.380 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.374+0000 7f9c1a3b1640 1 -- 172.21.15.176:0/480206471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c140caf20 msgr2=0x7f9c1415b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.380 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.374+0000 7f9c1a3b1640 1 --2- 172.21.15.176:0/480206471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c140caf20 0x7f9c1415b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.380 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.374+0000 7f9c1a3b1640 1 -- 172.21.15.176:0/480206471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c140d29d0 msgr2=0x7f9c140ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.380 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.374+0000 7f9c1a3b1640 1 --2- 172.21.15.176:0/480206471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c140d29d0 0x7f9c140ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.380 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.374+0000 7f9c1a3b1640 1 -- 172.21.15.176:0/480206471 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c140cb550 con 0x7f9c140cdb40 2024-04-25T02:28:03.380 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.374+0000 7f9c19bb0640 1 --2- 172.21.15.176:0/480206471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c140d29d0 0x7f9c140ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:03.381 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.374+0000 7f9c1a3b1640 1 --2- 172.21.15.176:0/480206471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c140cdb40 0x7f9c1414a9f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9c040098c0 tx=0x7f9c040046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:03.381 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.374+0000 7f9c0affd640 1 -- 172.21.15.176:0/480206471 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c04037040 con 0x7f9c140cdb40 2024-04-25T02:28:03.381 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.374+0000 7f9c0affd640 1 -- 172.21.15.176:0/480206471 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c04030770 con 0x7f9c140cdb40 2024-04-25T02:28:03.381 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.374+0000 7f9c1c615640 1 -- 172.21.15.176:0/480206471 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c140cb830 con 0x7f9c140cdb40 2024-04-25T02:28:03.381 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.374+0000 7f9c0affd640 1 -- 172.21.15.176:0/480206471 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c04030b40 con 0x7f9c140cdb40 2024-04-25T02:28:03.381 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.374+0000 7f9c1c615640 1 -- 172.21.15.176:0/480206471 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c1414b670 con 0x7f9c140cdb40 2024-04-25T02:28:03.381 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.374+0000 7f9c0affd640 1 -- 172.21.15.176:0/480206471 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9c04044020 con 0x7f9c140cdb40 2024-04-25T02:28:03.381 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.374+0000 7f9c0affd640 1 -- 172.21.15.176:0/480206471 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f9c040468a0 con 0x7f9c140cdb40 2024-04-25T02:28:03.381 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.375+0000 7f9c1c615640 1 -- 172.21.15.176:0/480206471 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c140681f0 con 0x7f9c140cdb40 2024-04-25T02:28:03.381 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.377+0000 7f9c0affd640 1 -- 172.21.15.176:0/480206471 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f9c04032e20 con 0x7f9c140cdb40 2024-04-25T02:28:03.452 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.449+0000 7f9c1c615640 1 -- 172.21.15.176:0/480206471 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f3e63257-ae6d-4588-9cba-f4639f27497a", "id": 3} v 0) -- 0x7f9c1406e8c0 con 0x7f9c140cdb40 2024-04-25T02:28:03.457 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.454+0000 7f9c0affd640 1 -- 172.21.15.176:0/480206471 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f3e63257-ae6d-4588-9cba-f4639f27497a", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f9c04030e20 con 0x7f9c140cdb40 2024-04-25T02:28:03.458 INFO:teuthology.orchestra.run.smithi176.stdout:3 2024-04-25T02:28:03.459 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.455+0000 7f9c1c615640 1 -- 172.21.15.176:0/480206471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c140cdb40 msgr2=0x7f9c1414a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.459 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.455+0000 7f9c1c615640 1 --2- 172.21.15.176:0/480206471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c140cdb40 0x7f9c1414a9f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9c040098c0 tx=0x7f9c040046c0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.459 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.455+0000 7f9c1c615640 1 -- 172.21.15.176:0/480206471 shutdown_connections 2024-04-25T02:28:03.459 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.455+0000 7f9c1c615640 1 --2- 172.21.15.176:0/480206471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c140caf20 0x7f9c1415b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.459 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.455+0000 7f9c1c615640 1 --2- 172.21.15.176:0/480206471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c140d29d0 0x7f9c140ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.459 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.455+0000 7f9c1c615640 1 --2- 172.21.15.176:0/480206471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c140cdb40 0x7f9c1414a9f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.459 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.455+0000 7f9c1c615640 1 -- 172.21.15.176:0/480206471 >> 172.21.15.176:0/480206471 conn(0x7f9c140d1eb0 msgr2=0x7f9c140d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:03.459 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.455+0000 7f9c1c615640 1 -- 172.21.15.176:0/480206471 shutdown_connections 2024-04-25T02:28:03.459 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.455+0000 7f9c1c615640 1 -- 172.21.15.176:0/480206471 wait complete. 2024-04-25T02:28:03.469 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new b7fd1a66-b411-4d8c-9daa-e13d551d421d 4 2024-04-25T02:28:03.543 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:03.539+0000 7f6425723040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T02:28:03.566 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.563+0000 7fb76d87d640 1 Processor -- start 2024-04-25T02:28:03.566 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.563+0000 7fb76d87d640 1 -- start start 2024-04-25T02:28:03.569 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.564+0000 7fb76d87d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb7681619d0 0x7fb7680d1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.569 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.564+0000 7fb76d87d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b3b30 0x7fb7680d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.569 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.564+0000 7fb76d87d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7680d24f0 con 0x7fb7680d2cf0 2024-04-25T02:28:03.569 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.564+0000 7fb76d87d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb7680d0b30 con 0x7fb7681619d0 2024-04-25T02:28:03.570 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.564+0000 7fb76d87d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb7680d0e10 con 0x7fb7680b3b30 2024-04-25T02:28:03.570 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.564+0000 7fb7667fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b3b30 0x7fb7680d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.570 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.564+0000 7fb7667fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b3b30 0x7fb7680d27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:33192/0 (socket says 172.21.15.176:33192) 2024-04-25T02:28:03.570 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.564+0000 7fb7667fc640 1 -- 172.21.15.176:0/3026747455 learned_addr learned my addr 172.21.15.176:0/3026747455 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-04-25T02:28:03.570 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.565+0000 7fb766ffd640 1 --2- 172.21.15.176:0/3026747455 >> v2:172.21.15.67:3300/0 conn(0x7fb7681619d0 0x7fb7680d1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.570 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.565+0000 7fb7667fc640 1 -- 172.21.15.176:0/3026747455 >> v2:172.21.15.67:3300/0 conn(0x7fb7681619d0 msgr2=0x7fb7680d1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:03.570 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.565+0000 7fb7667fc640 1 --2- 172.21.15.176:0/3026747455 >> v2:172.21.15.67:3300/0 conn(0x7fb7681619d0 0x7fb7680d1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.570 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.565+0000 7fb7667fc640 1 -- 172.21.15.176:0/3026747455 >> v1:172.21.15.67:6789/0 conn(0x7fb7680d2cf0 legacy=0x7fb7681620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.570 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.565+0000 7fb7667fc640 1 -- 172.21.15.176:0/3026747455 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7680d10f0 con 0x7fb7680b3b30 2024-04-25T02:28:03.570 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.565+0000 7fb766ffd640 1 --2- 172.21.15.176:0/3026747455 >> v2:172.21.15.67:3300/0 conn(0x7fb7681619d0 0x7fb7680d1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:03.570 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.565+0000 7fb7667fc640 1 --2- 172.21.15.176:0/3026747455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b3b30 0x7fb7680d27b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009870 tx=0x7fb75c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b70b986258573cec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:03.570 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.566+0000 7fb765ffb640 1 -- 172.21.15.176:0/3026747455 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c037070 con 0x7fb7680b3b30 2024-04-25T02:28:03.570 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.566+0000 7fb765ffb640 1 -- 172.21.15.176:0/3026747455 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb75c032440 con 0x7fb7680b3b30 2024-04-25T02:28:03.571 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.566+0000 7fb765ffb640 1 -- 172.21.15.176:0/3026747455 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c032810 con 0x7fb7680b3b30 2024-04-25T02:28:03.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.566+0000 7fb76d87d640 1 -- 172.21.15.176:0/3026747455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b3b30 msgr2=0x7fb7680d27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.566+0000 7fb76d87d640 1 --2- 172.21.15.176:0/3026747455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b3b30 0x7fb7680d27b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009870 tx=0x7fb75c02a270 comp rx=0 tx=0).stop 2024-04-25T02:28:03.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.567+0000 7fb76d87d640 1 -- 172.21.15.176:0/3026747455 shutdown_connections 2024-04-25T02:28:03.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.567+0000 7fb76d87d640 1 --2- 172.21.15.176:0/3026747455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b3b30 0x7fb7680d27b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.567+0000 7fb76d87d640 1 --2- 172.21.15.176:0/3026747455 >> v2:172.21.15.67:3300/0 conn(0x7fb7681619d0 0x7fb7680d1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.567+0000 7fb76d87d640 1 -- 172.21.15.176:0/3026747455 >> 172.21.15.176:0/3026747455 conn(0x7fb76809d4b0 msgr2=0x7fb7680d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:03.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.567+0000 7fb76d87d640 1 -- 172.21.15.176:0/3026747455 shutdown_connections 2024-04-25T02:28:03.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.567+0000 7fb76d87d640 1 -- 172.21.15.176:0/3026747455 wait complete. 2024-04-25T02:28:03.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.568+0000 7fb76d87d640 1 Processor -- start 2024-04-25T02:28:03.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.568+0000 7fb76d87d640 1 -- start start 2024-04-25T02:28:03.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb76d87d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b3b30 0x7fb768154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb76d87d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7680d2cf0 0x7fb7680cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb76d87d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7681619d0 0x7fb7681602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb76d87d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb768161db0 con 0x7fb7680d2cf0 2024-04-25T02:28:03.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb76d87d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb7680cece0 con 0x7fb7681619d0 2024-04-25T02:28:03.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb76d87d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb7680d0800 con 0x7fb7680b3b30 2024-04-25T02:28:03.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb766ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b3b30 0x7fb768154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb766ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b3b30 0x7fb768154bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:33204/0 (socket says 172.21.15.176:33204) 2024-04-25T02:28:03.576 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb7677fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7681619d0 0x7fb7681602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.576 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb766ffd640 1 -- 172.21.15.176:0/1993297449 learned_addr learned my addr 172.21.15.176:0/1993297449 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-04-25T02:28:03.576 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb7667fc640 1 --2- 172.21.15.176:0/1993297449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7680d2cf0 0x7fb7680cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.576 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb7677fe640 1 -- 172.21.15.176:0/1993297449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b3b30 msgr2=0x7fb768154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.576 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb7677fe640 1 --2- 172.21.15.176:0/1993297449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b3b30 0x7fb768154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.576 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb7677fe640 1 -- 172.21.15.176:0/1993297449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7680d2cf0 msgr2=0x7fb7680cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.576 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb7677fe640 1 --2- 172.21.15.176:0/1993297449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7680d2cf0 0x7fb7680cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.576 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb7677fe640 1 -- 172.21.15.176:0/1993297449 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7680cd330 con 0x7fb7681619d0 2024-04-25T02:28:03.576 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb766ffd640 1 --2- 172.21.15.176:0/1993297449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b3b30 0x7fb768154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:03.576 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb7677fe640 1 --2- 172.21.15.176:0/1993297449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7681619d0 0x7fb7681602b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb76000c700 tx=0x7fb76000cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:03.576 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb74ffff640 1 -- 172.21.15.176:0/1993297449 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760003b70 con 0x7fb7681619d0 2024-04-25T02:28:03.576 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb74ffff640 1 -- 172.21.15.176:0/1993297449 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb760003d10 con 0x7fb7681619d0 2024-04-25T02:28:03.576 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb74ffff640 1 -- 172.21.15.176:0/1993297449 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760005310 con 0x7fb7681619d0 2024-04-25T02:28:03.576 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.569+0000 7fb76d87d640 1 -- 172.21.15.176:0/1993297449 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7680c8270 con 0x7fb7681619d0 2024-04-25T02:28:03.577 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.570+0000 7fb76d87d640 1 -- 172.21.15.176:0/1993297449 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7680c8830 con 0x7fb7681619d0 2024-04-25T02:28:03.577 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.570+0000 7fb74ffff640 1 -- 172.21.15.176:0/1993297449 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb7600054b0 con 0x7fb7681619d0 2024-04-25T02:28:03.577 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.570+0000 7fb74ffff640 1 -- 172.21.15.176:0/1993297449 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fb7600129c0 con 0x7fb7681619d0 2024-04-25T02:28:03.577 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.571+0000 7fb76d87d640 1 -- 172.21.15.176:0/1993297449 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb768069110 con 0x7fb7681619d0 2024-04-25T02:28:03.577 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.573+0000 7fb74ffff640 1 -- 172.21.15.176:0/1993297449 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb760012c10 con 0x7fb7681619d0 2024-04-25T02:28:03.635 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:03.632+0000 7f6425723040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T02:28:03.648 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.645+0000 7fb76d87d640 1 -- 172.21.15.176:0/1993297449 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b7fd1a66-b411-4d8c-9daa-e13d551d421d", "id": 4} v 0) -- 0x7fb7680d1780 con 0x7fb7681619d0 2024-04-25T02:28:03.654 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.651+0000 7fb74ffff640 1 -- 172.21.15.176:0/1993297449 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b7fd1a66-b411-4d8c-9daa-e13d551d421d", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fb760012df0 con 0x7fb7681619d0 2024-04-25T02:28:03.655 INFO:teuthology.orchestra.run.smithi176.stdout:4 2024-04-25T02:28:03.656 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.652+0000 7fb76d87d640 1 -- 172.21.15.176:0/1993297449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7681619d0 msgr2=0x7fb7681602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.656 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.652+0000 7fb76d87d640 1 --2- 172.21.15.176:0/1993297449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7681619d0 0x7fb7681602b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb76000c700 tx=0x7fb76000cbc0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.656 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.652+0000 7fb76d87d640 1 -- 172.21.15.176:0/1993297449 shutdown_connections 2024-04-25T02:28:03.656 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.652+0000 7fb76d87d640 1 --2- 172.21.15.176:0/1993297449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7681619d0 0x7fb7681602b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.656 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.652+0000 7fb76d87d640 1 --2- 172.21.15.176:0/1993297449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7680d2cf0 0x7fb7680cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.656 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.652+0000 7fb76d87d640 1 --2- 172.21.15.176:0/1993297449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7680b3b30 0x7fb768154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.656 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.652+0000 7fb76d87d640 1 -- 172.21.15.176:0/1993297449 >> 172.21.15.176:0/1993297449 conn(0x7fb76809d4b0 msgr2=0x7fb76815e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:03.656 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.652+0000 7fb76d87d640 1 -- 172.21.15.176:0/1993297449 shutdown_connections 2024-04-25T02:28:03.656 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.652+0000 7fb76d87d640 1 -- 172.21.15.176:0/1993297449 wait complete. 2024-04-25T02:28:03.666 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 8e677963-5047-40fe-bffa-80aeff20500d 5 2024-04-25T02:28:03.681 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:03.678+0000 7f6425723040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T02:28:03.710 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:03.707+0000 7f6e0d779040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T02:28:03.763 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.759+0000 7f70d0590640 1 Processor -- start 2024-04-25T02:28:03.763 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.759+0000 7f70d0590640 1 -- start start 2024-04-25T02:28:03.764 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.760+0000 7f70d0590640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70c815c410 0x7f70c806b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.764 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.760+0000 7f70d0590640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f70c80d19f0 0x7f70c806b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.765 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.760+0000 7f70d0590640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c80c4760 con 0x7f70c806dc30 2024-04-25T02:28:03.765 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.760+0000 7f70d0590640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f70c80d0440 con 0x7f70c815c410 2024-04-25T02:28:03.765 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.760+0000 7f70d0590640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f70c806f410 con 0x7f70c80d19f0 2024-04-25T02:28:03.765 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.760+0000 7f70cdb2b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f70c80d19f0 0x7f70c806b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.765 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.760+0000 7f70cdb2b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f70c80d19f0 0x7f70c806b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:34942/0 (socket says 172.21.15.176:34942) 2024-04-25T02:28:03.765 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.760+0000 7f70cdb2b640 1 -- 172.21.15.176:0/166948247 learned_addr learned my addr 172.21.15.176:0/166948247 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-04-25T02:28:03.765 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.760+0000 7f70ce32c640 1 --2- 172.21.15.176:0/166948247 >> v2:172.21.15.67:3300/0 conn(0x7f70c815c410 0x7f70c806b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.765 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.761+0000 7f70cdb2b640 1 -- 172.21.15.176:0/166948247 >> v2:172.21.15.67:3300/0 conn(0x7f70c815c410 msgr2=0x7f70c806b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:03.765 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.761+0000 7f70cdb2b640 1 --2- 172.21.15.176:0/166948247 >> v2:172.21.15.67:3300/0 conn(0x7f70c815c410 0x7f70c806b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.765 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.761+0000 7f70cdb2b640 1 -- 172.21.15.176:0/166948247 >> v1:172.21.15.67:6789/0 conn(0x7f70c806dc30 legacy=0x7f70c806f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.765 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.761+0000 7f70cdb2b640 1 -- 172.21.15.176:0/166948247 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c8072c30 con 0x7f70c80d19f0 2024-04-25T02:28:03.767 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.762+0000 7f70cdb2b640 1 --2- 172.21.15.176:0/166948247 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70c80d19f0 0x7f70c806b600 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f70c80b09a0 tx=0x7f70c402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffacaadac35b4cb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:03.767 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.762+0000 7f70cd32a640 1 -- 172.21.15.176:0/166948247 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c4037070 con 0x7f70c80d19f0 2024-04-25T02:28:03.767 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.762+0000 7f70cd32a640 1 -- 172.21.15.176:0/166948247 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c4032440 con 0x7f70c80d19f0 2024-04-25T02:28:03.767 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.762+0000 7f70cd32a640 1 -- 172.21.15.176:0/166948247 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c4032810 con 0x7f70c80d19f0 2024-04-25T02:28:03.767 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.762+0000 7f70d0590640 1 -- 172.21.15.176:0/166948247 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70c80d19f0 msgr2=0x7f70c806b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.767 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.762+0000 7f70d0590640 1 --2- 172.21.15.176:0/166948247 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70c80d19f0 0x7f70c806b600 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f70c80b09a0 tx=0x7f70c402a270 comp rx=0 tx=0).stop 2024-04-25T02:28:03.767 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.763+0000 7f70d0590640 1 -- 172.21.15.176:0/166948247 shutdown_connections 2024-04-25T02:28:03.767 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.763+0000 7f70d0590640 1 --2- 172.21.15.176:0/166948247 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70c80d19f0 0x7f70c806b600 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.767 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.763+0000 7f70d0590640 1 --2- 172.21.15.176:0/166948247 >> v2:172.21.15.67:3300/0 conn(0x7f70c815c410 0x7f70c806b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.767 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.763+0000 7f70d0590640 1 -- 172.21.15.176:0/166948247 >> 172.21.15.176:0/166948247 conn(0x7f70c80d0ed0 msgr2=0x7f70c80d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:03.768 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.763+0000 7f70d0590640 1 -- 172.21.15.176:0/166948247 shutdown_connections 2024-04-25T02:28:03.768 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.763+0000 7f70d0590640 1 -- 172.21.15.176:0/166948247 wait complete. 2024-04-25T02:28:03.770 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.764+0000 7f70d0590640 1 Processor -- start 2024-04-25T02:28:03.770 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.764+0000 7f70d0590640 1 -- start start 2024-04-25T02:28:03.770 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.764+0000 7f70d0590640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70c806dc30 0x7f70c8156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.770 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.764+0000 7f70d0590640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70c80d19f0 0x7f70c809fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.770 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.764+0000 7f70d0590640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70c815c410 0x7f70c809ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:03.770 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70d0590640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f70c80cedd0 con 0x7f70c80d19f0 2024-04-25T02:28:03.770 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70d0590640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f70c80d0940 con 0x7f70c806dc30 2024-04-25T02:28:03.771 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70d0590640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f70c80728c0 con 0x7f70c815c410 2024-04-25T02:28:03.771 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70ce32c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70c806dc30 0x7f70c8156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.771 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70ce32c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70c806dc30 0x7f70c8156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:34956/0 (socket says 172.21.15.176:34956) 2024-04-25T02:28:03.771 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70ce32c640 1 -- 172.21.15.176:0/2499419914 learned_addr learned my addr 172.21.15.176:0/2499419914 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-04-25T02:28:03.771 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70ceb2d640 1 --2- 172.21.15.176:0/2499419914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70c815c410 0x7f70c809ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.771 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70cdb2b640 1 --2- 172.21.15.176:0/2499419914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70c80d19f0 0x7f70c809fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:03.771 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70ce32c640 1 -- 172.21.15.176:0/2499419914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70c815c410 msgr2=0x7f70c809ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.771 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70ce32c640 1 --2- 172.21.15.176:0/2499419914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70c815c410 0x7f70c809ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.771 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70ce32c640 1 -- 172.21.15.176:0/2499419914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70c80d19f0 msgr2=0x7f70c809fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.771 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70ce32c640 1 --2- 172.21.15.176:0/2499419914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70c80d19f0 0x7f70c809fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.771 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70ce32c640 1 -- 172.21.15.176:0/2499419914 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c81e5bf0 con 0x7f70c806dc30 2024-04-25T02:28:03.771 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70ceb2d640 1 --2- 172.21.15.176:0/2499419914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70c815c410 0x7f70c809ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:03.771 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70cdb2b640 1 --2- 172.21.15.176:0/2499419914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70c80d19f0 0x7f70c809fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:03.771 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70ce32c640 1 --2- 172.21.15.176:0/2499419914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70c806dc30 0x7f70c8156140 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00e8a0 tx=0x7f70bc00ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:03.772 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70baffd640 1 -- 172.21.15.176:0/2499419914 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc017070 con 0x7f70c806dc30 2024-04-25T02:28:03.772 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70baffd640 1 -- 172.21.15.176:0/2499419914 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70bc00c940 con 0x7f70c806dc30 2024-04-25T02:28:03.772 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70baffd640 1 -- 172.21.15.176:0/2499419914 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc00cd30 con 0x7f70c806dc30 2024-04-25T02:28:03.772 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70d0590640 1 -- 172.21.15.176:0/2499419914 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70c81e5910 con 0x7f70c806dc30 2024-04-25T02:28:03.772 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70d0590640 1 -- 172.21.15.176:0/2499419914 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70c81e6bb0 con 0x7f70c806dc30 2024-04-25T02:28:03.772 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.765+0000 7f70baffd640 1 -- 172.21.15.176:0/2499419914 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f70bc01a070 con 0x7f70c806dc30 2024-04-25T02:28:03.772 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.766+0000 7f70baffd640 1 -- 172.21.15.176:0/2499419914 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f70bc013470 con 0x7f70c806dc30 2024-04-25T02:28:03.772 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.766+0000 7f70d0590640 1 -- 172.21.15.176:0/2499419914 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70c8067e40 con 0x7f70c806dc30 2024-04-25T02:28:03.772 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.768+0000 7f70baffd640 1 -- 172.21.15.176:0/2499419914 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f70bc006480 con 0x7f70c806dc30 2024-04-25T02:28:03.800 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:03.798+0000 7f6e0d779040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T02:28:03.844 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.840+0000 7f70d0590640 1 -- 172.21.15.176:0/2499419914 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8e677963-5047-40fe-bffa-80aeff20500d", "id": 5} v 0) -- 0x7f70c80681f0 con 0x7f70c806dc30 2024-04-25T02:28:03.845 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:03.842+0000 7f6e0d779040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T02:28:03.849 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.846+0000 7f70baffd640 1 -- 172.21.15.176:0/2499419914 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e677963-5047-40fe-bffa-80aeff20500d", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f70bc006660 con 0x7f70c806dc30 2024-04-25T02:28:03.849 INFO:teuthology.orchestra.run.smithi176.stdout:5 2024-04-25T02:28:03.850 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.846+0000 7f70d0590640 1 -- 172.21.15.176:0/2499419914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70c806dc30 msgr2=0x7f70c8156140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:03.850 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.846+0000 7f70d0590640 1 --2- 172.21.15.176:0/2499419914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70c806dc30 0x7f70c8156140 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00e8a0 tx=0x7f70bc00ed60 comp rx=0 tx=0).stop 2024-04-25T02:28:03.850 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.846+0000 7f70d0590640 1 -- 172.21.15.176:0/2499419914 shutdown_connections 2024-04-25T02:28:03.850 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.846+0000 7f70d0590640 1 --2- 172.21.15.176:0/2499419914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70c815c410 0x7f70c809ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.851 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.846+0000 7f70d0590640 1 --2- 172.21.15.176:0/2499419914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70c80d19f0 0x7f70c809fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.851 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.846+0000 7f70d0590640 1 --2- 172.21.15.176:0/2499419914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70c806dc30 0x7f70c8156140 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:03.851 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.846+0000 7f70d0590640 1 -- 172.21.15.176:0/2499419914 >> 172.21.15.176:0/2499419914 conn(0x7f70c80d0ed0 msgr2=0x7f70c8071e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:03.851 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.847+0000 7f70d0590640 1 -- 172.21.15.176:0/2499419914 shutdown_connections 2024-04-25T02:28:03.851 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.847+0000 7f70d0590640 1 -- 172.21.15.176:0/2499419914 wait complete. 2024-04-25T02:28:03.856 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:03.853+0000 7f6425723040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T02:28:03.860 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 557dd6b1-d269-4c61-b41d-21f80688911c 6 2024-04-25T02:28:03.907 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:03.904+0000 7f6425723040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T02:28:03.964 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:03.960+0000 7f6425723040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T02:28:03.999 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.995+0000 7f7575ba9640 1 Processor -- start 2024-04-25T02:28:03.999 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.995+0000 7f7575ba9640 1 -- start start 2024-04-25T02:28:04.009 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.996+0000 7f7575ba9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f757015e760 0x7f75700cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:04.009 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.996+0000 7f7575ba9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f75700d0900 0x7f75700d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:04.009 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.996+0000 7f7575ba9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75700d12a0 0x7f75700d2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:04.010 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.996+0000 7f7575ba9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f75700d28a0 con 0x7f757015e760 2024-04-25T02:28:04.010 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.996+0000 7f7575ba9640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f75700d1710 con 0x7f75700d0900 2024-04-25T02:28:04.010 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.996+0000 7f7575ba9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f75700cff80 con 0x7f75700d12a0 2024-04-25T02:28:04.010 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.996+0000 7f756ffff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75700d12a0 0x7f75700d2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:04.010 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.996+0000 7f7567fff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f75700d0900 0x7f75700d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:04.011 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.996+0000 7f756ffff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75700d12a0 0x7f75700d2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:33218/0 (socket says 172.21.15.176:33218) 2024-04-25T02:28:04.011 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.996+0000 7f756ffff640 1 -- 172.21.15.176:0/551800092 learned_addr learned my addr 172.21.15.176:0/551800092 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-04-25T02:28:04.011 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.996+0000 7f756f7fe640 1 --2- 172.21.15.176:0/551800092 >> v2:172.21.15.67:3300/0 conn(0x7f757015e760 0x7f75700cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:04.011 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.997+0000 7f756ffff640 1 -- 172.21.15.176:0/551800092 >> v2:172.21.15.176:3300/0 conn(0x7f75700d0900 msgr2=0x7f75700d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:04.011 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.997+0000 7f756ffff640 1 --2- 172.21.15.176:0/551800092 >> v2:172.21.15.176:3300/0 conn(0x7f75700d0900 0x7f75700d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.012 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.997+0000 7f756ffff640 1 -- 172.21.15.176:0/551800092 >> v2:172.21.15.67:3300/0 conn(0x7f757015e760 msgr2=0x7f75700cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:04.012 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.997+0000 7f756ffff640 1 --2- 172.21.15.176:0/551800092 >> v2:172.21.15.67:3300/0 conn(0x7f757015e760 0x7f75700cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.012 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.997+0000 7f756ffff640 1 -- 172.21.15.176:0/551800092 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75700d2250 con 0x7f75700d12a0 2024-04-25T02:28:04.012 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.997+0000 7f7567fff640 1 --2- 172.21.15.176:0/551800092 >> v2:172.21.15.176:3300/0 conn(0x7f75700d0900 0x7f75700d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:04.012 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.997+0000 7f756f7fe640 1 --2- 172.21.15.176:0/551800092 >> v2:172.21.15.67:3300/0 conn(0x7f757015e760 0x7f75700cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:04.013 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.997+0000 7f756ffff640 1 --2- 172.21.15.176:0/551800092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75700d12a0 0x7f75700d2d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f75700b3be0 tx=0x7f756802a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcbde028f89b39c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:04.013 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.997+0000 7f756effd640 1 -- 172.21.15.176:0/551800092 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568036070 con 0x7f75700d12a0 2024-04-25T02:28:04.013 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.997+0000 7f756effd640 1 -- 172.21.15.176:0/551800092 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7568031600 con 0x7f75700d12a0 2024-04-25T02:28:04.013 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.997+0000 7f756effd640 1 -- 172.21.15.176:0/551800092 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75680319d0 con 0x7f75700d12a0 2024-04-25T02:28:04.013 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.998+0000 7f7575ba9640 1 -- 172.21.15.176:0/551800092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75700d12a0 msgr2=0x7f75700d2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:04.013 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.998+0000 7f7575ba9640 1 --2- 172.21.15.176:0/551800092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75700d12a0 0x7f75700d2d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f75700b3be0 tx=0x7f756802a6a0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.014 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.998+0000 7f7575ba9640 1 -- 172.21.15.176:0/551800092 shutdown_connections 2024-04-25T02:28:04.014 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.998+0000 7f7575ba9640 1 --2- 172.21.15.176:0/551800092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75700d12a0 0x7f75700d2d30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.014 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.998+0000 7f7575ba9640 1 --2- 172.21.15.176:0/551800092 >> v2:172.21.15.176:3300/0 conn(0x7f75700d0900 0x7f75700d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.014 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.998+0000 7f7575ba9640 1 --2- 172.21.15.176:0/551800092 >> v2:172.21.15.67:3300/0 conn(0x7f757015e760 0x7f75700cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.014 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.998+0000 7f7575ba9640 1 -- 172.21.15.176:0/551800092 >> 172.21.15.176:0/551800092 conn(0x7f75700d41b0 msgr2=0x7f75700d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:04.014 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.998+0000 7f7575ba9640 1 -- 172.21.15.176:0/551800092 shutdown_connections 2024-04-25T02:28:04.015 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.998+0000 7f7575ba9640 1 -- 172.21.15.176:0/551800092 wait complete. 2024-04-25T02:28:04.015 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.999+0000 7f7575ba9640 1 Processor -- start 2024-04-25T02:28:04.015 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:03.999+0000 7f7575ba9640 1 -- start start 2024-04-25T02:28:04.015 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.000+0000 7f7575ba9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75700d0900 0x7f75701535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:04.015 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.000+0000 7f7575ba9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75700d12a0 0x7f75700cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:04.015 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.000+0000 7f7575ba9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f757015e760 0x7f75700cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:04.016 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.000+0000 7f7575ba9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f757015eb40 con 0x7f757015e760 2024-04-25T02:28:04.016 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.000+0000 7f7575ba9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f75700b0e40 con 0x7f75700d12a0 2024-04-25T02:28:04.016 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.000+0000 7f7575ba9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f757015ecc0 con 0x7f75700d0900 2024-04-25T02:28:04.016 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.000+0000 7f756f7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75700d0900 0x7f75701535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:04.016 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.000+0000 7f7567fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75700d12a0 0x7f75700cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:04.017 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.000+0000 7f756f7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75700d0900 0x7f75701535d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:33234/0 (socket says 172.21.15.176:33234) 2024-04-25T02:28:04.017 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.000+0000 7f756f7fe640 1 -- 172.21.15.176:0/3274659956 learned_addr learned my addr 172.21.15.176:0/3274659956 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-04-25T02:28:04.017 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.000+0000 7f756ffff640 1 --2- 172.21.15.176:0/3274659956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f757015e760 0x7f75700cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:04.017 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.000+0000 7f7567fff640 1 -- 172.21.15.176:0/3274659956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75700d0900 msgr2=0x7f75701535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:04.017 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.000+0000 7f7567fff640 1 --2- 172.21.15.176:0/3274659956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75700d0900 0x7f75701535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.017 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.000+0000 7f7567fff640 1 -- 172.21.15.176:0/3274659956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f757015e760 msgr2=0x7f75700cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:04.018 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.000+0000 7f7567fff640 1 --2- 172.21.15.176:0/3274659956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f757015e760 0x7f75700cdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.018 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.001+0000 7f7567fff640 1 -- 172.21.15.176:0/3274659956 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75700c8a20 con 0x7f75700d12a0 2024-04-25T02:28:04.018 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.001+0000 7f756f7fe640 1 --2- 172.21.15.176:0/3274659956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75700d0900 0x7f75701535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:04.018 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.001+0000 7f7567fff640 1 --2- 172.21.15.176:0/3274659956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75700d12a0 0x7f75700cd6f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f755800e840 tx=0x7f755800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:04.018 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.001+0000 7f756cff9640 1 -- 172.21.15.176:0/3274659956 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7558004030 con 0x7f75700d12a0 2024-04-25T02:28:04.019 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.001+0000 7f756cff9640 1 -- 172.21.15.176:0/3274659956 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75580041f0 con 0x7f75700d12a0 2024-04-25T02:28:04.019 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.001+0000 7f7575ba9640 1 -- 172.21.15.176:0/3274659956 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75700c8d00 con 0x7f75700d12a0 2024-04-25T02:28:04.019 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.001+0000 7f756cff9640 1 -- 172.21.15.176:0/3274659956 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755800c8e0 con 0x7f75700d12a0 2024-04-25T02:28:04.019 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.001+0000 7f7575ba9640 1 -- 172.21.15.176:0/3274659956 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75700c92c0 con 0x7f75700d12a0 2024-04-25T02:28:04.019 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.001+0000 7f756cff9640 1 -- 172.21.15.176:0/3274659956 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7558003610 con 0x7f75700d12a0 2024-04-25T02:28:04.019 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.001+0000 7f756cff9640 1 -- 172.21.15.176:0/3274659956 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f7558013c90 con 0x7f75700d12a0 2024-04-25T02:28:04.020 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.002+0000 7f7575ba9640 1 -- 172.21.15.176:0/3274659956 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f757008d940 con 0x7f75700d12a0 2024-04-25T02:28:04.020 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.004+0000 7f756cff9640 1 -- 172.21.15.176:0/3274659956 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f757008d940 con 0x7f75700d12a0 2024-04-25T02:28:04.020 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:04.015+0000 7f6e0d779040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T02:28:04.074 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:04.071+0000 7f6e0d779040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T02:28:04.077 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.074+0000 7f7575ba9640 1 -- 172.21.15.176:0/3274659956 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "557dd6b1-d269-4c61-b41d-21f80688911c", "id": 6} v 0) -- 0x7f7570069110 con 0x7f75700d12a0 2024-04-25T02:28:04.080 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:04.077+0000 7f6425723040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:28:04.083 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.079+0000 7f756cff9640 1 -- 172.21.15.176:0/3274659956 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "557dd6b1-d269-4c61-b41d-21f80688911c", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f7558017020 con 0x7f75700d12a0 2024-04-25T02:28:04.083 INFO:teuthology.orchestra.run.smithi176.stdout:6 2024-04-25T02:28:04.084 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.080+0000 7f7575ba9640 1 -- 172.21.15.176:0/3274659956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75700d12a0 msgr2=0x7f75700cd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:04.084 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.080+0000 7f7575ba9640 1 --2- 172.21.15.176:0/3274659956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75700d12a0 0x7f75700cd6f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f755800e840 tx=0x7f755800ed00 comp rx=0 tx=0).stop 2024-04-25T02:28:04.084 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.080+0000 7f7575ba9640 1 -- 172.21.15.176:0/3274659956 shutdown_connections 2024-04-25T02:28:04.084 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.080+0000 7f7575ba9640 1 --2- 172.21.15.176:0/3274659956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f757015e760 0x7f75700cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.084 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.080+0000 7f7575ba9640 1 --2- 172.21.15.176:0/3274659956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75700d12a0 0x7f75700cd6f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.084 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.080+0000 7f7575ba9640 1 --2- 172.21.15.176:0/3274659956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75700d0900 0x7f75701535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.084 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.080+0000 7f7575ba9640 1 -- 172.21.15.176:0/3274659956 >> 172.21.15.176:0/3274659956 conn(0x7f75700d41b0 msgr2=0x7f75700d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:04.084 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.080+0000 7f7575ba9640 1 -- 172.21.15.176:0/3274659956 shutdown_connections 2024-04-25T02:28:04.084 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.080+0000 7f7575ba9640 1 -- 172.21.15.176:0/3274659956 wait complete. 2024-04-25T02:28:04.094 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 7a073ce6-b4ab-4f16-a37f-0fc2b602d687 7 2024-04-25T02:28:04.129 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:04.126+0000 7f6e0d779040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T02:28:04.232 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.228+0000 7f3ff8989640 1 Processor -- start 2024-04-25T02:28:04.232 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.228+0000 7f3ff8989640 1 -- start start 2024-04-25T02:28:04.234 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.229+0000 7f3ff8989640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3ff40d19f0 0x7f3ff40ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:04.234 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.229+0000 7f3ff8989640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3ff40d0100 0x7f3ff40cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:04.234 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.229+0000 7f3ff8989640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ff406be00 con 0x7f3ff40cf930 2024-04-25T02:28:04.234 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.229+0000 7f3ff8989640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3ff40d0650 con 0x7f3ff40d0100 2024-04-25T02:28:04.234 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.229+0000 7f3ff8989640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3ff4071f40 con 0x7f3ff40d19f0 2024-04-25T02:28:04.234 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.229+0000 7f3febfff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3ff40d19f0 0x7f3ff40ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:04.234 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.229+0000 7f3febfff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3ff40d19f0 0x7f3ff40ccd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:34980/0 (socket says 172.21.15.176:34980) 2024-04-25T02:28:04.234 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.229+0000 7f3febfff640 1 -- 172.21.15.176:0/802286494 learned_addr learned my addr 172.21.15.176:0/802286494 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-04-25T02:28:04.234 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.229+0000 7f3ff2d9d640 1 --2- 172.21.15.176:0/802286494 >> v2:172.21.15.67:3300/0 conn(0x7f3ff40d0100 0x7f3ff40cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:04.234 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.230+0000 7f3febfff640 1 -- 172.21.15.176:0/802286494 >> v2:172.21.15.67:3300/0 conn(0x7f3ff40d0100 msgr2=0x7f3ff40cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:04.234 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.230+0000 7f3febfff640 1 --2- 172.21.15.176:0/802286494 >> v2:172.21.15.67:3300/0 conn(0x7f3ff40d0100 0x7f3ff40cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.234 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.230+0000 7f3febfff640 1 -- 172.21.15.176:0/802286494 >> v1:172.21.15.67:6789/0 conn(0x7f3ff40cf930 legacy=0x7f3ff40cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:04.235 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.230+0000 7f3febfff640 1 -- 172.21.15.176:0/802286494 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff40d08a0 con 0x7f3ff40d19f0 2024-04-25T02:28:04.235 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.230+0000 7f3febfff640 1 --2- 172.21.15.176:0/802286494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ff40d19f0 0x7f3ff40ccd00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3ff40706d0 tx=0x7f3fdc02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1e95e8b58da811a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:04.235 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.230+0000 7f3ff1d9b640 1 -- 172.21.15.176:0/802286494 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc037070 con 0x7f3ff40d19f0 2024-04-25T02:28:04.235 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.230+0000 7f3ff1d9b640 1 -- 172.21.15.176:0/802286494 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fdc032440 con 0x7f3ff40d19f0 2024-04-25T02:28:04.235 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.230+0000 7f3ff1d9b640 1 -- 172.21.15.176:0/802286494 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc032810 con 0x7f3ff40d19f0 2024-04-25T02:28:04.236 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.231+0000 7f3ff8989640 1 -- 172.21.15.176:0/802286494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ff40d19f0 msgr2=0x7f3ff40ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:04.236 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.231+0000 7f3ff8989640 1 --2- 172.21.15.176:0/802286494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ff40d19f0 0x7f3ff40ccd00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3ff40706d0 tx=0x7f3fdc02a270 comp rx=0 tx=0).stop 2024-04-25T02:28:04.236 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.231+0000 7f3ff8989640 1 -- 172.21.15.176:0/802286494 shutdown_connections 2024-04-25T02:28:04.236 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.231+0000 7f3ff8989640 1 --2- 172.21.15.176:0/802286494 >> v2:172.21.15.67:3300/0 conn(0x7f3ff40d0100 0x7f3ff40cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.236 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.231+0000 7f3ff8989640 1 --2- 172.21.15.176:0/802286494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ff40d19f0 0x7f3ff40ccd00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.236 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.231+0000 7f3ff8989640 1 -- 172.21.15.176:0/802286494 >> 172.21.15.176:0/802286494 conn(0x7f3ff40d0ed0 msgr2=0x7f3ff40d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:04.236 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.231+0000 7f3ff8989640 1 -- 172.21.15.176:0/802286494 shutdown_connections 2024-04-25T02:28:04.236 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.231+0000 7f3ff8989640 1 -- 172.21.15.176:0/802286494 wait complete. 2024-04-25T02:28:04.236 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.232+0000 7f3ff8989640 1 Processor -- start 2024-04-25T02:28:04.236 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.232+0000 7f3ff8989640 1 -- start start 2024-04-25T02:28:04.239 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.233+0000 7f3ff8989640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ff40cf930 0x7f3ff41e97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:04.239 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.233+0000 7f3ff8989640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ff40d0100 0x7f3ff41e7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:04.239 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.233+0000 7f3ff8989640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ff40d19f0 0x7f3ff40a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:04.239 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.233+0000 7f3ff8989640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff406bad0 con 0x7f3ff40d0100 2024-04-25T02:28:04.239 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.233+0000 7f3ff8989640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff40cd780 con 0x7f3ff40cf930 2024-04-25T02:28:04.239 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.233+0000 7f3ff8989640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff40cfd10 con 0x7f3ff40d19f0 2024-04-25T02:28:04.239 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.233+0000 7f3ff259c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ff40cf930 0x7f3ff41e97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:04.239 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.233+0000 7f3ff259c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ff40cf930 0x7f3ff41e97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:34984/0 (socket says 172.21.15.176:34984) 2024-04-25T02:28:04.239 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.233+0000 7f3ff259c640 1 -- 172.21.15.176:0/1049491670 learned_addr learned my addr 172.21.15.176:0/1049491670 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-04-25T02:28:04.239 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.233+0000 7f3ff2d9d640 1 --2- 172.21.15.176:0/1049491670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ff40d19f0 0x7f3ff40a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:04.239 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.233+0000 7f3febfff640 1 --2- 172.21.15.176:0/1049491670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ff40d0100 0x7f3ff41e7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:04.239 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.233+0000 7f3ff259c640 1 -- 172.21.15.176:0/1049491670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ff40d19f0 msgr2=0x7f3ff40a1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:04.240 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.233+0000 7f3ff259c640 1 --2- 172.21.15.176:0/1049491670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ff40d19f0 0x7f3ff40a1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.240 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.233+0000 7f3ff259c640 1 -- 172.21.15.176:0/1049491670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ff40d0100 msgr2=0x7f3ff41e7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:04.240 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.233+0000 7f3ff259c640 1 --2- 172.21.15.176:0/1049491670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ff40d0100 0x7f3ff41e7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.240 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.234+0000 7f3ff259c640 1 -- 172.21.15.176:0/1049491670 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff41e87a0 con 0x7f3ff40cf930 2024-04-25T02:28:04.240 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.234+0000 7f3febfff640 1 --2- 172.21.15.176:0/1049491670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ff40d0100 0x7f3ff41e7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:04.240 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.234+0000 7f3ff259c640 1 --2- 172.21.15.176:0/1049491670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ff40cf930 0x7f3ff41e97f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400c3c0 tx=0x7f3fe400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:04.240 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.234+0000 7f3feaffd640 1 -- 172.21.15.176:0/1049491670 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe40052d0 con 0x7f3ff40cf930 2024-04-25T02:28:04.240 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.234+0000 7f3feaffd640 1 -- 172.21.15.176:0/1049491670 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe4005490 con 0x7f3ff40cf930 2024-04-25T02:28:04.240 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.234+0000 7f3ff8989640 1 -- 172.21.15.176:0/1049491670 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff41e8d10 con 0x7f3ff40cf930 2024-04-25T02:28:04.240 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.234+0000 7f3feaffd640 1 -- 172.21.15.176:0/1049491670 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4007260 con 0x7f3ff40cf930 2024-04-25T02:28:04.240 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.234+0000 7f3ff8989640 1 -- 172.21.15.176:0/1049491670 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff41e92d0 con 0x7f3ff40cf930 2024-04-25T02:28:04.240 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.234+0000 7f3feaffd640 1 -- 172.21.15.176:0/1049491670 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3fe4007400 con 0x7f3ff40cf930 2024-04-25T02:28:04.240 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.234+0000 7f3feaffd640 1 -- 172.21.15.176:0/1049491670 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f3fe4011bf0 con 0x7f3ff40cf930 2024-04-25T02:28:04.240 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.235+0000 7f3ff8989640 1 -- 172.21.15.176:0/1049491670 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ff41e8a30 con 0x7f3ff40cf930 2024-04-25T02:28:04.241 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.237+0000 7f3feaffd640 1 -- 172.21.15.176:0/1049491670 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3fe40035f0 con 0x7f3ff40cf930 2024-04-25T02:28:04.247 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:04.244+0000 7f6e0d779040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:28:04.312 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.308+0000 7f3ff8989640 1 -- 172.21.15.176:0/1049491670 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7a073ce6-b4ab-4f16-a37f-0fc2b602d687", "id": 7} v 0) -- 0x7f3ff40681f0 con 0x7f3ff40cf930 2024-04-25T02:28:04.316 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.313+0000 7f3feaffd640 1 -- 172.21.15.176:0/1049491670 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7a073ce6-b4ab-4f16-a37f-0fc2b602d687", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f3fe4003a00 con 0x7f3ff40cf930 2024-04-25T02:28:04.316 INFO:teuthology.orchestra.run.smithi176.stdout:7 2024-04-25T02:28:04.318 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.314+0000 7f3ff8989640 1 -- 172.21.15.176:0/1049491670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ff40cf930 msgr2=0x7f3ff41e97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:04.318 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.314+0000 7f3ff8989640 1 --2- 172.21.15.176:0/1049491670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ff40cf930 0x7f3ff41e97f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400c3c0 tx=0x7f3fe400c880 comp rx=0 tx=0).stop 2024-04-25T02:28:04.318 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.314+0000 7f3ff8989640 1 -- 172.21.15.176:0/1049491670 shutdown_connections 2024-04-25T02:28:04.318 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.314+0000 7f3ff8989640 1 --2- 172.21.15.176:0/1049491670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ff40d19f0 0x7f3ff40a1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.318 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.314+0000 7f3ff8989640 1 --2- 172.21.15.176:0/1049491670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ff40d0100 0x7f3ff41e7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.318 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.314+0000 7f3ff8989640 1 --2- 172.21.15.176:0/1049491670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ff40cf930 0x7f3ff41e97f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.319 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.314+0000 7f3ff8989640 1 -- 172.21.15.176:0/1049491670 >> 172.21.15.176:0/1049491670 conn(0x7f3ff40d0ed0 msgr2=0x7f3ff40b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:04.319 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.314+0000 7f3ff8989640 1 -- 172.21.15.176:0/1049491670 shutdown_connections 2024-04-25T02:28:04.319 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:04.314+0000 7f3ff8989640 1 -- 172.21.15.176:0/1049491670 wait complete. 2024-04-25T02:28:04.332 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T02:28:04.332 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T02:28:04.334 INFO:tasks.ceph.osd.0:Started 2024-04-25T02:28:04.334 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T02:28:04.334 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T02:28:04.338 INFO:tasks.ceph.osd.1:Started 2024-04-25T02:28:04.338 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T02:28:04.338 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T02:28:04.340 INFO:tasks.ceph.osd.2:Started 2024-04-25T02:28:04.340 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T02:28:04.340 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T02:28:04.342 INFO:tasks.ceph.osd.3:Started 2024-04-25T02:28:04.343 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T02:28:04.343 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T02:28:04.346 INFO:tasks.ceph.osd.4:Started 2024-04-25T02:28:04.346 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T02:28:04.346 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T02:28:04.350 INFO:tasks.ceph.osd.5:Started 2024-04-25T02:28:04.350 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T02:28:04.350 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T02:28:04.353 INFO:tasks.ceph.osd.6:Started 2024-04-25T02:28:04.353 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T02:28:04.354 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T02:28:04.357 INFO:tasks.ceph.osd.7:Started 2024-04-25T02:28:04.357 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:04.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.483+0000 7f26976ba640 1 Processor -- start 2024-04-25T02:28:04.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.483+0000 7f26976ba640 1 -- start start 2024-04-25T02:28:04.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.484+0000 7f26976ba640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f26900c8640 0x7f26900d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:04.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.484+0000 7f26976ba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26900cdb40 0x7f26900d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:04.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.484+0000 7f26976ba640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26900d0000 con 0x7f26900d29d0 2024-04-25T02:28:04.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.484+0000 7f26976ba640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f269015fd60 con 0x7f26900c8640 2024-04-25T02:28:04.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.484+0000 7f26976ba640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f26900c5ba0 con 0x7f26900cdb40 2024-04-25T02:28:04.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.484+0000 7f2695c57640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26900cdb40 0x7f26900d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:04.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.484+0000 7f2694c55640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f26900d29d0 0x7f26900c6680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:50242/0 (socket says 172.21.15.67:50242) 2024-04-25T02:28:04.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.484+0000 7f2694c55640 1 -- 172.21.15.67:0/885587723 learned_addr learned my addr 172.21.15.67:0/885587723 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:04.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.484+0000 7f2695456640 1 --2- 172.21.15.67:0/885587723 >> v2:172.21.15.176:3300/0 conn(0x7f26900c8640 0x7f26900d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:04.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.484+0000 7f2695456640 1 -- 172.21.15.67:0/885587723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26900cdb40 msgr2=0x7f26900d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:04.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.484+0000 7f2695456640 1 --2- 172.21.15.67:0/885587723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26900cdb40 0x7f26900d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.485+0000 7f2695456640 1 -- 172.21.15.67:0/885587723 >> v1:172.21.15.176:6789/0 conn(0x7f26900d29d0 legacy=0x7f26900c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:04.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.485+0000 7f2687fff640 1 -- 172.21.15.67:0/885587723 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2815221733 0 0) 0x7f26900d0000 con 0x7f26900d29d0 2024-04-25T02:28:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.485+0000 7f2695456640 1 -- 172.21.15.67:0/885587723 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26900c5e80 con 0x7f26900c8640 2024-04-25T02:28:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.485+0000 7f2695c57640 1 --2- 172.21.15.67:0/885587723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26900cdb40 0x7f26900d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.485+0000 7f2695456640 1 --2- 172.21.15.67:0/885587723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26900c8640 0x7f26900d0470 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f268c0097a0 tx=0x7f268c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b294995c29712cf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.485+0000 7f2687fff640 1 -- 172.21.15.67:0/885587723 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c037070 con 0x7f26900c8640 2024-04-25T02:28:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.485+0000 7f2687fff640 1 -- 172.21.15.67:0/885587723 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f268c032440 con 0x7f26900c8640 2024-04-25T02:28:04.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.485+0000 7f2687fff640 1 -- 172.21.15.67:0/885587723 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c032810 con 0x7f26900c8640 2024-04-25T02:28:04.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.486+0000 7f26976ba640 1 -- 172.21.15.67:0/885587723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26900c8640 msgr2=0x7f26900d0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:04.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.486+0000 7f26976ba640 1 --2- 172.21.15.67:0/885587723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26900c8640 0x7f26900d0470 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f268c0097a0 tx=0x7f268c02a180 comp rx=0 tx=0).stop 2024-04-25T02:28:04.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.486+0000 7f26976ba640 1 -- 172.21.15.67:0/885587723 shutdown_connections 2024-04-25T02:28:04.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.486+0000 7f26976ba640 1 --2- 172.21.15.67:0/885587723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26900cdb40 0x7f26900d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.486+0000 7f26976ba640 1 --2- 172.21.15.67:0/885587723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26900c8640 0x7f26900d0470 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.486+0000 7f26976ba640 1 -- 172.21.15.67:0/885587723 >> 172.21.15.67:0/885587723 conn(0x7f26900d1eb0 msgr2=0x7f26900d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:04.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.486+0000 7f26976ba640 1 -- 172.21.15.67:0/885587723 shutdown_connections 2024-04-25T02:28:04.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.486+0000 7f26976ba640 1 -- 172.21.15.67:0/885587723 wait complete. 2024-04-25T02:28:04.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.487+0000 7f26976ba640 1 Processor -- start 2024-04-25T02:28:04.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.487+0000 7f26976ba640 1 -- start start 2024-04-25T02:28:04.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.488+0000 7f26976ba640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26900cdb40 0x7f269015d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:04.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.488+0000 7f26976ba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26900d29d0 0x7f26900b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:04.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.488+0000 7f26976ba640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26900b7300 0x7f26900b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:04.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.488+0000 7f26976ba640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f26900c6d90 con 0x7f26900cdb40 2024-04-25T02:28:04.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.488+0000 7f26976ba640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f26900cfc90 con 0x7f26900d29d0 2024-04-25T02:28:04.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.488+0000 7f26976ba640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f26900c6f10 con 0x7f26900b7300 2024-04-25T02:28:04.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.488+0000 7f2695456640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26900cdb40 0x7f269015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:04.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.488+0000 7f2695456640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26900cdb40 0x7f269015d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48170/0 (socket says 172.21.15.67:48170) 2024-04-25T02:28:04.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.488+0000 7f2695456640 1 -- 172.21.15.67:0/732659111 learned_addr learned my addr 172.21.15.67:0/732659111 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:04.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.488+0000 7f2694c55640 1 --2- 172.21.15.67:0/732659111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26900d29d0 0x7f26900b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:04.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.488+0000 7f2695c57640 1 --2- 172.21.15.67:0/732659111 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26900b7300 0x7f26900b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:04.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.488+0000 7f2695456640 1 -- 172.21.15.67:0/732659111 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26900b7300 msgr2=0x7f26900b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:04.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.488+0000 7f2695456640 1 --2- 172.21.15.67:0/732659111 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26900b7300 0x7f26900b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.489+0000 7f2695456640 1 -- 172.21.15.67:0/732659111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26900d29d0 msgr2=0x7f26900b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:04.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.489+0000 7f2695456640 1 --2- 172.21.15.67:0/732659111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26900d29d0 0x7f26900b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.489+0000 7f2695456640 1 -- 172.21.15.67:0/732659111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26900aee50 con 0x7f26900cdb40 2024-04-25T02:28:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.489+0000 7f2695456640 1 --2- 172.21.15.67:0/732659111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26900cdb40 0x7f269015d820 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f268c0098c0 tx=0x7f268c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.489+0000 7f2685ffb640 1 -- 172.21.15.67:0/732659111 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c037040 con 0x7f26900cdb40 2024-04-25T02:28:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.489+0000 7f2685ffb640 1 -- 172.21.15.67:0/732659111 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f268c030440 con 0x7f26900cdb40 2024-04-25T02:28:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.489+0000 7f26976ba640 1 -- 172.21.15.67:0/732659111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26901e5d90 con 0x7f26900cdb40 2024-04-25T02:28:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.489+0000 7f2685ffb640 1 -- 172.21.15.67:0/732659111 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c030810 con 0x7f26900cdb40 2024-04-25T02:28:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.489+0000 7f26976ba640 1 -- 172.21.15.67:0/732659111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f269015df20 con 0x7f26900cdb40 2024-04-25T02:28:04.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.489+0000 7f2685ffb640 1 -- 172.21.15.67:0/732659111 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f268c044020 con 0x7f26900cdb40 2024-04-25T02:28:04.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.489+0000 7f2685ffb640 1 -- 172.21.15.67:0/732659111 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f268c03daf0 con 0x7f26900cdb40 2024-04-25T02:28:04.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.490+0000 7f26976ba640 1 -- 172.21.15.67:0/732659111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26900681f0 con 0x7f26900cdb40 2024-04-25T02:28:04.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.492+0000 7f2685ffb640 1 -- 172.21.15.67:0/732659111 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f268c03dd90 con 0x7f26900cdb40 2024-04-25T02:28:04.507 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:04.503+0000 7f6425723040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T02:28:04.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.555+0000 7f26976ba640 1 -- 172.21.15.67:0/732659111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f269006e8c0 con 0x7f26900cdb40 2024-04-25T02:28:04.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.555+0000 7f2685ffb640 1 -- 172.21.15.67:0/732659111 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f268c03b430 con 0x7f26900cdb40 2024-04-25T02:28:04.559 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:04.559 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":10,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:04.310396+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:04.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.556+0000 7f26976ba640 1 -- 172.21.15.67:0/732659111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26900cdb40 msgr2=0x7f269015d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:04.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.556+0000 7f26976ba640 1 --2- 172.21.15.67:0/732659111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26900cdb40 0x7f269015d820 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f268c0098c0 tx=0x7f268c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.556+0000 7f26976ba640 1 -- 172.21.15.67:0/732659111 shutdown_connections 2024-04-25T02:28:04.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.556+0000 7f26976ba640 1 --2- 172.21.15.67:0/732659111 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26900b7300 0x7f26900b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.556+0000 7f26976ba640 1 --2- 172.21.15.67:0/732659111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26900d29d0 0x7f26900b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.556+0000 7f26976ba640 1 --2- 172.21.15.67:0/732659111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26900cdb40 0x7f269015d820 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:04.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.556+0000 7f26976ba640 1 -- 172.21.15.67:0/732659111 >> 172.21.15.67:0/732659111 conn(0x7f26900d1eb0 msgr2=0x7f2690070560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:04.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.556+0000 7f26976ba640 1 -- 172.21.15.67:0/732659111 shutdown_connections 2024-04-25T02:28:04.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:04.556+0000 7f26976ba640 1 -- 172.21.15.67:0/732659111 wait complete. 2024-04-25T02:28:04.570 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T02:28:04.570 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T02:28:04.683 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:04.680+0000 7f6e0d779040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T02:28:04.767 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:04.763+0000 7f6425723040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T02:28:04.818 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:04.815+0000 7f6425723040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T02:28:04.933 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:04.929+0000 7f6425723040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T02:28:04.941 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-04-25T02:28:04.938+0000 7ffa37101640 -1 Falling back to public interface 2024-04-25T02:28:04.943 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-04-25T02:28:04.939+0000 7f512d082640 -1 Falling back to public interface 2024-04-25T02:28:04.952 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-04-25T02:28:04.949+0000 7f4ecc20d640 -1 Falling back to public interface 2024-04-25T02:28:04.953 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-04-25T02:28:04.950+0000 7fa375230640 -1 Falling back to public interface 2024-04-25T02:28:04.954 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:04.950+0000 7f6e0d779040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T02:28:04.956 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-04-25T02:28:04.952+0000 7f186bf88640 -1 Falling back to public interface 2024-04-25T02:28:04.963 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-04-25T02:28:04.959+0000 7fade1a0d640 -1 Falling back to public interface 2024-04-25T02:28:04.963 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-04-25T02:28:04.959+0000 7fcfa69c2640 -1 Falling back to public interface 2024-04-25T02:28:04.967 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-04-25T02:28:04.964+0000 7ff51ecb5640 -1 Falling back to public interface 2024-04-25T02:28:05.014 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:05.011+0000 7f6e0d779040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T02:28:05.135 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:05.132+0000 7f6e0d779040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T02:28:05.219 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:05.215+0000 7f6425723040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T02:28:05.268 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:05.264+0000 7f6425723040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T02:28:05.377 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:05.421 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:05.418+0000 7f6425723040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T02:28:05.428 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:05.426+0000 7f6e0d779040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T02:28:05.469 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.466+0000 7fe103110640 1 Processor -- start 2024-04-25T02:28:05.470 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.466+0000 7fe103110640 1 -- start start 2024-04-25T02:28:05.471 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.467+0000 7fe103110640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe0fc06ccb0 0x7fe0fc09aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:05.471 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.467+0000 7fe103110640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0fc06d110 0x7fe0fc09afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:05.471 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.467+0000 7fe103110640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0fc0c7b70 con 0x7fe0fc06c8d0 2024-04-25T02:28:05.471 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.467+0000 7fe103110640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe0fc0c7e50 con 0x7fe0fc06ccb0 2024-04-25T02:28:05.471 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.467+0000 7fe103110640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe0fc0c8130 con 0x7fe0fc06d110 2024-04-25T02:28:05.471 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.468+0000 7fe0fbfff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe0fc06ccb0 0x7fe0fc09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:05.471 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.468+0000 7fe1016ad640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0fc06d110 0x7fe0fc09afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:05.471 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.468+0000 7fe100eac640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fe0fc06c8d0 0x7fe0fc0c7290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:50250/0 (socket says 172.21.15.67:50250) 2024-04-25T02:28:05.472 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.468+0000 7fe100eac640 1 -- 172.21.15.67:0/645866881 learned_addr learned my addr 172.21.15.67:0/645866881 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:05.472 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.468+0000 7fe0fbfff640 1 -- 172.21.15.67:0/645866881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0fc06d110 msgr2=0x7fe0fc09afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:05.472 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.468+0000 7fe0fbfff640 1 --2- 172.21.15.67:0/645866881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0fc06d110 0x7fe0fc09afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:05.472 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.468+0000 7fe0fbfff640 1 -- 172.21.15.67:0/645866881 >> v1:172.21.15.176:6789/0 conn(0x7fe0fc06c8d0 legacy=0x7fe0fc0c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:05.472 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.468+0000 7fe0fb7fe640 1 -- 172.21.15.67:0/645866881 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4241565219 0 0) 0x7fe0fc0c7b70 con 0x7fe0fc06c8d0 2024-04-25T02:28:05.472 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.468+0000 7fe0fbfff640 1 -- 172.21.15.67:0/645866881 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc0c8410 con 0x7fe0fc06ccb0 2024-04-25T02:28:05.472 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.468+0000 7fe1016ad640 1 --2- 172.21.15.67:0/645866881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0fc06d110 0x7fe0fc09afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:05.473 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.469+0000 7fe0fbfff640 1 --2- 172.21.15.67:0/645866881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0fc06ccb0 0x7fe0fc09aa60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80097a0 tx=0x7fe0e802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1545d8e1e42caecd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:05.474 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.469+0000 7fe0fb7fe640 1 -- 172.21.15.67:0/645866881 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8037070 con 0x7fe0fc06ccb0 2024-04-25T02:28:05.474 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.469+0000 7fe0fb7fe640 1 -- 172.21.15.67:0/645866881 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e8032440 con 0x7fe0fc06ccb0 2024-04-25T02:28:05.474 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.469+0000 7fe0fb7fe640 1 -- 172.21.15.67:0/645866881 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8032810 con 0x7fe0fc06ccb0 2024-04-25T02:28:05.474 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.469+0000 7fe103110640 1 -- 172.21.15.67:0/645866881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0fc06ccb0 msgr2=0x7fe0fc09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:05.474 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.469+0000 7fe103110640 1 --2- 172.21.15.67:0/645866881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0fc06ccb0 0x7fe0fc09aa60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80097a0 tx=0x7fe0e802a180 comp rx=0 tx=0).stop 2024-04-25T02:28:05.474 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.469+0000 7fe103110640 1 -- 172.21.15.67:0/645866881 shutdown_connections 2024-04-25T02:28:05.474 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.469+0000 7fe103110640 1 --2- 172.21.15.67:0/645866881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0fc06d110 0x7fe0fc09afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:05.474 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.470+0000 7fe103110640 1 --2- 172.21.15.67:0/645866881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0fc06ccb0 0x7fe0fc09aa60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:05.474 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.470+0000 7fe103110640 1 -- 172.21.15.67:0/645866881 >> 172.21.15.67:0/645866881 conn(0x7fe0fc0d1ea0 msgr2=0x7fe0fc0d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:05.474 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.470+0000 7fe103110640 1 -- 172.21.15.67:0/645866881 shutdown_connections 2024-04-25T02:28:05.475 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.470+0000 7fe103110640 1 -- 172.21.15.67:0/645866881 wait complete. 2024-04-25T02:28:05.475 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.471+0000 7fe103110640 1 Processor -- start 2024-04-25T02:28:05.475 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.471+0000 7fe103110640 1 -- start start 2024-04-25T02:28:05.477 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.472+0000 7fe103110640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0fc06c8d0 0x7fe0fc0b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:05.477 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.472+0000 7fe103110640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0fc06ccb0 0x7fe0fc0b6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:05.477 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.472+0000 7fe103110640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0fc06d110 0x7fe0fc1f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:05.477 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.472+0000 7fe103110640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc0cc950 con 0x7fe0fc06c8d0 2024-04-25T02:28:05.477 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.472+0000 7fe103110640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc0cc7d0 con 0x7fe0fc06ccb0 2024-04-25T02:28:05.477 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.472+0000 7fe103110640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe0fc0ccad0 con 0x7fe0fc06d110 2024-04-25T02:28:05.477 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.472+0000 7fe100eac640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0fc06c8d0 0x7fe0fc0b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:05.478 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.472+0000 7fe100eac640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0fc06c8d0 0x7fe0fc0b4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48176/0 (socket says 172.21.15.67:48176) 2024-04-25T02:28:05.478 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.472+0000 7fe100eac640 1 -- 172.21.15.67:0/813952905 learned_addr learned my addr 172.21.15.67:0/813952905 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:05.478 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.472+0000 7fe0fbfff640 1 --2- 172.21.15.67:0/813952905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0fc06ccb0 0x7fe0fc0b6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:05.478 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.472+0000 7fe1016ad640 1 --2- 172.21.15.67:0/813952905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0fc06d110 0x7fe0fc1f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:05.478 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.472+0000 7fe100eac640 1 -- 172.21.15.67:0/813952905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0fc06d110 msgr2=0x7fe0fc1f4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:05.478 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.472+0000 7fe100eac640 1 --2- 172.21.15.67:0/813952905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0fc06d110 0x7fe0fc1f4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:05.478 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.472+0000 7fe100eac640 1 -- 172.21.15.67:0/813952905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0fc06ccb0 msgr2=0x7fe0fc0b6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:05.478 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.472+0000 7fe100eac640 1 --2- 172.21.15.67:0/813952905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0fc06ccb0 0x7fe0fc0b6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:05.478 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.472+0000 7fe100eac640 1 -- 172.21.15.67:0/813952905 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc0b5b60 con 0x7fe0fc06c8d0 2024-04-25T02:28:05.478 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.472+0000 7fe0fbfff640 1 --2- 172.21.15.67:0/813952905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0fc06ccb0 0x7fe0fc0b6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:05.478 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.472+0000 7fe100eac640 1 --2- 172.21.15.67:0/813952905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0fc06c8d0 0x7fe0fc0b4bc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000c3f0 tx=0x7fe0f000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:05.478 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.473+0000 7fe0f97fa640 1 -- 172.21.15.67:0/813952905 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f00074e0 con 0x7fe0fc06c8d0 2024-04-25T02:28:05.478 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.473+0000 7fe0f97fa640 1 -- 172.21.15.67:0/813952905 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f00047e0 con 0x7fe0fc06c8d0 2024-04-25T02:28:05.478 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.473+0000 7fe0f97fa640 1 -- 172.21.15.67:0/813952905 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0004c10 con 0x7fe0fc06c8d0 2024-04-25T02:28:05.479 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.473+0000 7fe103110640 1 -- 172.21.15.67:0/813952905 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0fc0b52c0 con 0x7fe0fc06c8d0 2024-04-25T02:28:05.479 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.473+0000 7fe103110640 1 -- 172.21.15.67:0/813952905 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0fc0b5880 con 0x7fe0fc06c8d0 2024-04-25T02:28:05.479 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.473+0000 7fe0f97fa640 1 -- 172.21.15.67:0/813952905 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe0f0011070 con 0x7fe0fc06c8d0 2024-04-25T02:28:05.479 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.473+0000 7fe0f97fa640 1 -- 172.21.15.67:0/813952905 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fe0f0013a90 con 0x7fe0fc06c8d0 2024-04-25T02:28:05.479 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.474+0000 7fe103110640 1 -- 172.21.15.67:0/813952905 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0fc0690c0 con 0x7fe0fc06c8d0 2024-04-25T02:28:05.479 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.476+0000 7fe0f97fa640 1 -- 172.21.15.67:0/813952905 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe0f0004db0 con 0x7fe0fc06c8d0 2024-04-25T02:28:05.481 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:05.478+0000 7f6e0d779040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T02:28:05.541 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.538+0000 7fe103110640 1 -- 172.21.15.67:0/813952905 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0fc06be20 con 0x7fe0fc06c8d0 2024-04-25T02:28:05.542 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.539+0000 7fe0f97fa640 1 -- 172.21.15.67:0/813952905 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fe0f0013d90 con 0x7fe0fc06c8d0 2024-04-25T02:28:05.542 INFO:teuthology.misc.health.smithi067.stdout: 2024-04-25T02:28:05.542 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":10,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:04.310396+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:05.543 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.540+0000 7fe103110640 1 -- 172.21.15.67:0/813952905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0fc06c8d0 msgr2=0x7fe0fc0b4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:05.543 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.540+0000 7fe103110640 1 --2- 172.21.15.67:0/813952905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0fc06c8d0 0x7fe0fc0b4bc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000c3f0 tx=0x7fe0f000c7f0 comp rx=0 tx=0).stop 2024-04-25T02:28:05.543 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.540+0000 7fe103110640 1 -- 172.21.15.67:0/813952905 shutdown_connections 2024-04-25T02:28:05.543 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.540+0000 7fe103110640 1 --2- 172.21.15.67:0/813952905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0fc06d110 0x7fe0fc1f4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:05.544 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.540+0000 7fe103110640 1 --2- 172.21.15.67:0/813952905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0fc06ccb0 0x7fe0fc0b6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:05.544 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.540+0000 7fe103110640 1 --2- 172.21.15.67:0/813952905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0fc06c8d0 0x7fe0fc0b4bc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:05.544 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.540+0000 7fe103110640 1 -- 172.21.15.67:0/813952905 >> 172.21.15.67:0/813952905 conn(0x7fe0fc0d1ea0 msgr2=0x7fe0fc0b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:05.544 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.540+0000 7fe103110640 1 -- 172.21.15.67:0/813952905 shutdown_connections 2024-04-25T02:28:05.544 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:05.540+0000 7fe103110640 1 -- 172.21.15.67:0/813952905 wait complete. 2024-04-25T02:28:05.552 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T02:28:05.558 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:05.555+0000 7f6425723040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T02:28:05.607 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:05.604+0000 7f6425723040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T02:28:05.646 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:05.644+0000 7f6e0d779040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T02:28:05.677 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:05.674+0000 7f6425723040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T02:28:05.722 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:05.719+0000 7f6425723040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T02:28:05.790 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:05.787+0000 7f6e0d779040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T02:28:05.842 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:05.839+0000 7f6e0d779040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T02:28:05.915 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:05.912+0000 7f6e0d779040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T02:28:05.962 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:05.959+0000 7f6e0d779040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T02:28:06.200 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:06.196+0000 7f6425723040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T02:28:06.317 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:06.313+0000 7f6425723040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T02:28:06.465 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:06.462+0000 7f6e0d779040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T02:28:06.585 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-25T02:28:06.583+0000 7f6e0d779040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T02:28:07.334 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:07.330+0000 7f63c62aa640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T02:28:07.334 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:28:07.331+0000 7f63c62aa640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T02:28:08.411 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-04-25T02:28:08.408+0000 7f186bf88640 -1 osd.6 0 log_to_monitors true 2024-04-25T02:28:08.422 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-04-25T02:28:08.419+0000 7ffa37101640 -1 osd.1 0 log_to_monitors true 2024-04-25T02:28:08.460 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-04-25T02:28:08.458+0000 7fa375230640 -1 osd.0 0 log_to_monitors true 2024-04-25T02:28:08.462 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-04-25T02:28:08.458+0000 7f512d082640 -1 osd.5 0 log_to_monitors true 2024-04-25T02:28:08.475 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-04-25T02:28:08.472+0000 7fade1a0d640 -1 osd.7 0 log_to_monitors true 2024-04-25T02:28:08.477 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-04-25T02:28:08.475+0000 7f4ecc20d640 -1 osd.2 0 log_to_monitors true 2024-04-25T02:28:08.478 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-04-25T02:28:08.474+0000 7fcfa69c2640 -1 osd.4 0 log_to_monitors true 2024-04-25T02:28:08.484 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-04-25T02:28:08.481+0000 7ff51ecb5640 -1 osd.3 0 log_to_monitors true 2024-04-25T02:28:12.292 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-04-25T02:28:12.289+0000 7fcfa2135640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T02:28:12.305 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-04-25T02:28:12.302+0000 7fcf9a767640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:28:12.359 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:12.387 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-04-25T02:28:12.383+0000 7f18676fb640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T02:28:12.397 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-04-25T02:28:12.394+0000 7f185fd2d640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:28:12.402 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-04-25T02:28:12.399+0000 7f4ec8c37640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T02:28:12.420 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-04-25T02:28:12.416+0000 7f51287f5640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T02:28:12.422 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-04-25T02:28:12.419+0000 7f4ebfa31640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:28:12.428 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-04-25T02:28:12.425+0000 7f5120e27640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:28:12.428 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-04-25T02:28:12.425+0000 7faddcc1d640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T02:28:12.442 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-04-25T02:28:12.439+0000 7ffa32874640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T02:28:12.443 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-04-25T02:28:12.440+0000 7fadd524f640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:28:12.462 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-04-25T02:28:12.459+0000 7ffa2aea6640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:28:12.483 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-04-25T02:28:12.480+0000 7fa36ff55640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T02:28:12.501 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-04-25T02:28:12.498+0000 7fa368587640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:28:12.501 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.498+0000 7fa12a71b640 1 Processor -- start 2024-04-25T02:28:12.501 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.498+0000 7fa12a71b640 1 -- start start 2024-04-25T02:28:12.503 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.499+0000 7fa12a71b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa1240d1cf0 0x7fa1240d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:12.503 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.499+0000 7fa12a71b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1240d2380 con 0x7fa12415e430 2024-04-25T02:28:12.503 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.499+0000 7fa12a71b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1240cf010 con 0x7fa1240d26e0 2024-04-25T02:28:12.503 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.499+0000 7fa12a71b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa1240d5000 con 0x7fa1240d1cf0 2024-04-25T02:28:12.503 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.499+0000 7fa123fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa12415e430 0x7fa1240cfaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40960/0 (socket says 172.21.15.67:40960) 2024-04-25T02:28:12.503 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.499+0000 7fa123fff640 1 -- 172.21.15.67:0/3921535757 learned_addr learned my addr 172.21.15.67:0/3921535757 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:12.503 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.499+0000 7fa1237fe640 1 --2- 172.21.15.67:0/3921535757 >> v2:172.21.15.176:3300/0 conn(0x7fa1240d1cf0 0x7fa1240d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:12.503 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.499+0000 7fa122ffd640 1 -- 172.21.15.67:0/3921535757 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3932767726 0 0) 0x7fa1240cf010 con 0x7fa1240d26e0 2024-04-25T02:28:12.503 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.499+0000 7fa122ffd640 1 -- 172.21.15.67:0/3921535757 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa10c003520 con 0x7fa1240d26e0 2024-04-25T02:28:12.503 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.499+0000 7fa122ffd640 1 -- 172.21.15.67:0/3921535757 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 222147302 0 0) 0x7fa1240d2380 con 0x7fa12415e430 2024-04-25T02:28:12.503 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.499+0000 7fa122ffd640 1 -- 172.21.15.67:0/3921535757 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1240cf010 con 0x7fa12415e430 2024-04-25T02:28:12.503 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.500+0000 7fa1237fe640 1 -- 172.21.15.67:0/3921535757 >> v1:172.21.15.176:6789/0 conn(0x7fa1240d26e0 legacy=0x7fa1240b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:12.504 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.500+0000 7fa1237fe640 1 -- 172.21.15.67:0/3921535757 >> v1:172.21.15.67:6789/0 conn(0x7fa12415e430 legacy=0x7fa1240cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:12.504 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.500+0000 7fa1237fe640 1 -- 172.21.15.67:0/3921535757 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1240cf2f0 con 0x7fa1240d1cf0 2024-04-25T02:28:12.505 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.500+0000 7fa1237fe640 1 --2- 172.21.15.67:0/3921535757 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1240d1cf0 0x7fa1240d4ac0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa1180097a0 tx=0x7fa11802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fe196f9c7794d46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:12.505 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.500+0000 7fa122ffd640 1 -- 172.21.15.67:0/3921535757 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa118037070 con 0x7fa1240d1cf0 2024-04-25T02:28:12.505 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.501+0000 7fa122ffd640 1 -- 172.21.15.67:0/3921535757 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa118032440 con 0x7fa1240d1cf0 2024-04-25T02:28:12.505 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.501+0000 7fa122ffd640 1 -- 172.21.15.67:0/3921535757 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa118032810 con 0x7fa1240d1cf0 2024-04-25T02:28:12.505 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.501+0000 7fa12a71b640 1 -- 172.21.15.67:0/3921535757 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1240d1cf0 msgr2=0x7fa1240d4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:12.505 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.501+0000 7fa12a71b640 1 --2- 172.21.15.67:0/3921535757 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1240d1cf0 0x7fa1240d4ac0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa1180097a0 tx=0x7fa11802a230 comp rx=0 tx=0).stop 2024-04-25T02:28:12.505 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.501+0000 7fa12a71b640 1 -- 172.21.15.67:0/3921535757 shutdown_connections 2024-04-25T02:28:12.505 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.501+0000 7fa12a71b640 1 --2- 172.21.15.67:0/3921535757 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1240d1cf0 0x7fa1240d4ac0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:12.505 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.501+0000 7fa12a71b640 1 -- 172.21.15.67:0/3921535757 >> 172.21.15.67:0/3921535757 conn(0x7fa12409d400 msgr2=0x7fa1240d4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:12.506 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.501+0000 7fa12a71b640 1 -- 172.21.15.67:0/3921535757 shutdown_connections 2024-04-25T02:28:12.506 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.501+0000 7fa12a71b640 1 -- 172.21.15.67:0/3921535757 wait complete. 2024-04-25T02:28:12.506 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.503+0000 7fa12a71b640 1 Processor -- start 2024-04-25T02:28:12.506 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.504+0000 7fa12a71b640 1 -- start start 2024-04-25T02:28:12.509 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.504+0000 7fa12a71b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1240d1cf0 0x7fa1240b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:12.509 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.504+0000 7fa12a71b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1240d26e0 0x7fa124151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:12.509 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.504+0000 7fa12a71b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa12415e430 0x7fa1240b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:12.509 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.504+0000 7fa12a71b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa1240d2b70 con 0x7fa1240d26e0 2024-04-25T02:28:12.509 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.504+0000 7fa12a71b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa1240cf660 con 0x7fa12415e430 2024-04-25T02:28:12.509 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.504+0000 7fa12a71b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa1240d2cf0 con 0x7fa1240d1cf0 2024-04-25T02:28:12.509 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.505+0000 7fa1237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1240d26e0 0x7fa124151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:12.509 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.505+0000 7fa1237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1240d26e0 0x7fa124151500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36136/0 (socket says 172.21.15.67:36136) 2024-04-25T02:28:12.509 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.505+0000 7fa1237fe640 1 -- 172.21.15.67:0/166737876 learned_addr learned my addr 172.21.15.67:0/166737876 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:12.509 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.505+0000 7fa123fff640 1 --2- 172.21.15.67:0/166737876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1240d1cf0 0x7fa1240b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:12.509 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.505+0000 7fa128cb8640 1 --2- 172.21.15.67:0/166737876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa12415e430 0x7fa1240b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:12.510 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.505+0000 7fa1237fe640 1 -- 172.21.15.67:0/166737876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1240d1cf0 msgr2=0x7fa1240b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:12.510 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.505+0000 7fa1237fe640 1 --2- 172.21.15.67:0/166737876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1240d1cf0 0x7fa1240b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:12.510 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.505+0000 7fa1237fe640 1 -- 172.21.15.67:0/166737876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa12415e430 msgr2=0x7fa1240b77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:12.510 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.505+0000 7fa1237fe640 1 --2- 172.21.15.67:0/166737876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa12415e430 0x7fa1240b77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:12.510 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.505+0000 7fa1237fe640 1 -- 172.21.15.67:0/166737876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1240b6440 con 0x7fa1240d26e0 2024-04-25T02:28:12.510 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.505+0000 7fa128cb8640 1 --2- 172.21.15.67:0/166737876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa12415e430 0x7fa1240b77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:12.510 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.505+0000 7fa1237fe640 1 --2- 172.21.15.67:0/166737876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1240d26e0 0x7fa124151500 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa118035040 tx=0x7fa1180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:12.510 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.505+0000 7fa120ff9640 1 -- 172.21.15.67:0/166737876 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa118041030 con 0x7fa1240d26e0 2024-04-25T02:28:12.510 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.505+0000 7fa120ff9640 1 -- 172.21.15.67:0/166737876 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa11803d4e0 con 0x7fa1240d26e0 2024-04-25T02:28:12.510 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.505+0000 7fa12a71b640 1 -- 172.21.15.67:0/166737876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1240b6720 con 0x7fa1240d26e0 2024-04-25T02:28:12.510 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.505+0000 7fa120ff9640 1 -- 172.21.15.67:0/166737876 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa118037040 con 0x7fa1240d26e0 2024-04-25T02:28:12.510 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.505+0000 7fa12a71b640 1 -- 172.21.15.67:0/166737876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1240b6ce0 con 0x7fa1240d26e0 2024-04-25T02:28:12.511 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-04-25T02:28:12.506+0000 7ff51a428640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T02:28:12.511 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.507+0000 7fa12a71b640 1 -- 172.21.15.67:0/166737876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa124075490 con 0x7fa1240d26e0 2024-04-25T02:28:12.512 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.507+0000 7fa120ff9640 1 -- 172.21.15.67:0/166737876 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7fa118044070 con 0x7fa1240d26e0 2024-04-25T02:28:12.512 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.507+0000 7fa120ff9640 1 --2- 172.21.15.67:0/166737876 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa11006bda0 0x7fa11006e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:12.512 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.508+0000 7fa120ff9640 1 -- 172.21.15.67:0/166737876 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fa1180aa5f0 con 0x7fa1240d26e0 2024-04-25T02:28:12.512 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.508+0000 7fa123fff640 1 --2- 172.21.15.67:0/166737876 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa11006bda0 0x7fa11006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:12.512 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.508+0000 7fa123fff640 1 --2- 172.21.15.67:0/166737876 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa11006bda0 0x7fa11006e260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa1140011e0 tx=0x7fa114007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:12.517 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.515+0000 7fa120ff9640 1 -- 172.21.15.67:0/166737876 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa118079e20 con 0x7fa1240d26e0 2024-04-25T02:28:12.528 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-04-25T02:28:12.525+0000 7ff512a5a640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:28:12.702 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.699+0000 7fa12a71b640 1 -- 172.21.15.67:0/166737876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa12415c040 con 0x7fa1240d26e0 2024-04-25T02:28:12.703 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.700+0000 7fa120ff9640 1 -- 172.21.15.67:0/166737876 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fa118079720 con 0x7fa1240d26e0 2024-04-25T02:28:12.703 INFO:teuthology.misc.health.smithi067.stdout: 2024-04-25T02:28:12.703 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":12,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:10.337267+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:12.705 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.702+0000 7fa12a71b640 1 -- 172.21.15.67:0/166737876 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa11006bda0 msgr2=0x7fa11006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:12.705 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.702+0000 7fa12a71b640 1 --2- 172.21.15.67:0/166737876 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa11006bda0 0x7fa11006e260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa1140011e0 tx=0x7fa114007d30 comp rx=0 tx=0).stop 2024-04-25T02:28:12.705 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.702+0000 7fa12a71b640 1 -- 172.21.15.67:0/166737876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1240d26e0 msgr2=0x7fa124151500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:12.705 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.702+0000 7fa12a71b640 1 --2- 172.21.15.67:0/166737876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1240d26e0 0x7fa124151500 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa118035040 tx=0x7fa1180046c0 comp rx=0 tx=0).stop 2024-04-25T02:28:12.706 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.702+0000 7fa12a71b640 1 -- 172.21.15.67:0/166737876 shutdown_connections 2024-04-25T02:28:12.706 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.702+0000 7fa12a71b640 1 --2- 172.21.15.67:0/166737876 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa11006bda0 0x7fa11006e260 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:12.706 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.702+0000 7fa12a71b640 1 --2- 172.21.15.67:0/166737876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa12415e430 0x7fa1240b77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:12.706 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.702+0000 7fa12a71b640 1 --2- 172.21.15.67:0/166737876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1240d26e0 0x7fa124151500 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:12.706 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.702+0000 7fa12a71b640 1 --2- 172.21.15.67:0/166737876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1240d1cf0 0x7fa1240b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:12.706 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.702+0000 7fa12a71b640 1 -- 172.21.15.67:0/166737876 >> 172.21.15.67:0/166737876 conn(0x7fa12409d400 msgr2=0x7fa12415c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:12.706 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.702+0000 7fa12a71b640 1 -- 172.21.15.67:0/166737876 shutdown_connections 2024-04-25T02:28:12.706 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:12.702+0000 7fa12a71b640 1 -- 172.21.15.67:0/166737876 wait complete. 2024-04-25T02:28:12.714 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T02:28:19.521 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:19.625 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.622+0000 7f7f4ecd4640 1 Processor -- start 2024-04-25T02:28:19.626 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.622+0000 7f7f4ecd4640 1 -- start start 2024-04-25T02:28:19.627 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.623+0000 7f7f4ecd4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4806d180 0x7f7f480d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.627 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.623+0000 7f7f4ecd4640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f4815ea70 con 0x7f7f480d0cf0 2024-04-25T02:28:19.627 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.623+0000 7f7f4ecd4640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f480b5810 con 0x7f7f4815e690 2024-04-25T02:28:19.627 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.623+0000 7f7f4ecd4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7f480b5af0 con 0x7f7f4806d180 2024-04-25T02:28:19.627 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.623+0000 7f7f4d271640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7f480d0cf0 0x7f7f480b68b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40976/0 (socket says 172.21.15.67:40976) 2024-04-25T02:28:19.627 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.623+0000 7f7f4d271640 1 -- 172.21.15.67:0/1168435549 learned_addr learned my addr 172.21.15.67:0/1168435549 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:19.628 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.623+0000 7f7f47fff640 1 --2- 172.21.15.67:0/1168435549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4806d180 0x7f7f480d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.628 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.624+0000 7f7f477fe640 1 -- 172.21.15.67:0/1168435549 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4269763198 0 0) 0x7f7f4815ea70 con 0x7f7f480d0cf0 2024-04-25T02:28:19.628 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.624+0000 7f7f477fe640 1 -- 172.21.15.67:0/1168435549 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f30003520 con 0x7f7f480d0cf0 2024-04-25T02:28:19.628 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.624+0000 7f7f477fe640 1 -- 172.21.15.67:0/1168435549 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1306892765 0 0) 0x7f7f480b5810 con 0x7f7f4815e690 2024-04-25T02:28:19.628 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.624+0000 7f7f477fe640 1 -- 172.21.15.67:0/1168435549 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f4815ea70 con 0x7f7f4815e690 2024-04-25T02:28:19.628 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.624+0000 7f7f477fe640 1 -- 172.21.15.67:0/1168435549 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3598736451 0 0) 0x7f7f30003520 con 0x7f7f480d0cf0 2024-04-25T02:28:19.628 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.624+0000 7f7f47fff640 1 -- 172.21.15.67:0/1168435549 >> v1:172.21.15.176:6789/0 conn(0x7f7f4815e690 legacy=0x7f7f480d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.628 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.624+0000 7f7f47fff640 1 -- 172.21.15.67:0/1168435549 >> v1:172.21.15.67:6789/0 conn(0x7f7f480d0cf0 legacy=0x7f7f480b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.628 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.624+0000 7f7f47fff640 1 -- 172.21.15.67:0/1168435549 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f480b5dd0 con 0x7f7f4806d180 2024-04-25T02:28:19.630 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.625+0000 7f7f47fff640 1 --2- 172.21.15.67:0/1168435549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4806d180 0x7f7f480d07b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0097d0 tx=0x7f7f3c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebf535c92f6b2b45 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:19.630 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.625+0000 7f7f477fe640 1 -- 172.21.15.67:0/1168435549 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c037070 con 0x7f7f4806d180 2024-04-25T02:28:19.630 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.625+0000 7f7f477fe640 1 -- 172.21.15.67:0/1168435549 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3c02ac30 con 0x7f7f4806d180 2024-04-25T02:28:19.630 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.625+0000 7f7f477fe640 1 -- 172.21.15.67:0/1168435549 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f400019f0 con 0x7f7f4806d180 2024-04-25T02:28:19.630 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.625+0000 7f7f4ecd4640 1 -- 172.21.15.67:0/1168435549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4806d180 msgr2=0x7f7f480d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.630 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.625+0000 7f7f4ecd4640 1 --2- 172.21.15.67:0/1168435549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4806d180 0x7f7f480d07b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0097d0 tx=0x7f7f3c02a1a0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.630 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.625+0000 7f7f4ecd4640 1 -- 172.21.15.67:0/1168435549 shutdown_connections 2024-04-25T02:28:19.630 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.625+0000 7f7f4ecd4640 1 --2- 172.21.15.67:0/1168435549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4806d180 0x7f7f480d07b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.630 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.625+0000 7f7f4ecd4640 1 -- 172.21.15.67:0/1168435549 >> 172.21.15.67:0/1168435549 conn(0x7f7f480b3a60 msgr2=0x7f7f480b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:19.630 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.625+0000 7f7f4ecd4640 1 -- 172.21.15.67:0/1168435549 shutdown_connections 2024-04-25T02:28:19.630 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.625+0000 7f7f4ecd4640 1 -- 172.21.15.67:0/1168435549 wait complete. 2024-04-25T02:28:19.630 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.627+0000 7f7f4ecd4640 1 Processor -- start 2024-04-25T02:28:19.631 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.627+0000 7f7f4ecd4640 1 -- start start 2024-04-25T02:28:19.632 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f4ecd4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4806d180 0x7f7f481526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.633 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f4ecd4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f480d0cf0 0x7f7f480c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.633 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f4ecd4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4815e690 0x7f7f48160100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.633 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f4ecd4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7f480d12d0 con 0x7f7f480d0cf0 2024-04-25T02:28:19.633 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f4ecd4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7f480b6390 con 0x7f7f4806d180 2024-04-25T02:28:19.633 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f4ecd4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7f480d1450 con 0x7f7f4815e690 2024-04-25T02:28:19.633 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f47fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f480d0cf0 0x7f7f480c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.633 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f47fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f480d0cf0 0x7f7f480c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36152/0 (socket says 172.21.15.67:36152) 2024-04-25T02:28:19.633 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f47fff640 1 -- 172.21.15.67:0/2479521119 learned_addr learned my addr 172.21.15.67:0/2479521119 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:19.633 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f4d271640 1 --2- 172.21.15.67:0/2479521119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4815e690 0x7f7f48160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.633 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f4ca70640 1 --2- 172.21.15.67:0/2479521119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4806d180 0x7f7f481526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.633 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f47fff640 1 -- 172.21.15.67:0/2479521119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4815e690 msgr2=0x7f7f48160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.633 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f47fff640 1 --2- 172.21.15.67:0/2479521119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4815e690 0x7f7f48160100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.633 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f47fff640 1 -- 172.21.15.67:0/2479521119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4806d180 msgr2=0x7f7f481526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.634 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f47fff640 1 --2- 172.21.15.67:0/2479521119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4806d180 0x7f7f481526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.634 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f47fff640 1 -- 172.21.15.67:0/2479521119 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f48152c10 con 0x7f7f480d0cf0 2024-04-25T02:28:19.634 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f4d271640 1 --2- 172.21.15.67:0/2479521119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4815e690 0x7f7f48160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:19.634 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f4ca70640 1 --2- 172.21.15.67:0/2479521119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4806d180 0x7f7f481526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:19.634 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.628+0000 7f7f47fff640 1 --2- 172.21.15.67:0/2479521119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f480d0cf0 0x7f7f480c6c40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0098f0 tx=0x7f7f3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:19.634 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.629+0000 7f7f457fa640 1 -- 172.21.15.67:0/2479521119 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c037050 con 0x7f7f480d0cf0 2024-04-25T02:28:19.634 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.629+0000 7f7f457fa640 1 -- 172.21.15.67:0/2479521119 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3c043070 con 0x7f7f480d0cf0 2024-04-25T02:28:19.634 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.629+0000 7f7f4ecd4640 1 -- 172.21.15.67:0/2479521119 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f480c7700 con 0x7f7f480d0cf0 2024-04-25T02:28:19.634 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.629+0000 7f7f457fa640 1 -- 172.21.15.67:0/2479521119 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c006e10 con 0x7f7f480d0cf0 2024-04-25T02:28:19.634 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.629+0000 7f7f4ecd4640 1 -- 172.21.15.67:0/2479521119 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f480c7cc0 con 0x7f7f480d0cf0 2024-04-25T02:28:19.634 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.630+0000 7f7f4ecd4640 1 -- 172.21.15.67:0/2479521119 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f48075490 con 0x7f7f480d0cf0 2024-04-25T02:28:19.635 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.630+0000 7f7f457fa640 1 -- 172.21.15.67:0/2479521119 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f3c03ca10 con 0x7f7f480d0cf0 2024-04-25T02:28:19.635 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.631+0000 7f7f457fa640 1 --2- 172.21.15.67:0/2479521119 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7f3406be30 0x7f7f3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.635 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.631+0000 7f7f457fa640 1 -- 172.21.15.67:0/2479521119 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f7f3c0ab4d0 con 0x7f7f480d0cf0 2024-04-25T02:28:19.636 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.631+0000 7f7f4ca70640 1 --2- 172.21.15.67:0/2479521119 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7f3406be30 0x7f7f3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.636 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.631+0000 7f7f4ca70640 1 --2- 172.21.15.67:0/2479521119 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7f3406be30 0x7f7f3406e2f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7f38001710 tx=0x7f7f38009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:19.638 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.635+0000 7f7f457fa640 1 -- 172.21.15.67:0/2479521119 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7f3c030e20 con 0x7f7f480d0cf0 2024-04-25T02:28:19.824 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.821+0000 7f7f4ecd4640 1 -- 172.21.15.67:0/2479521119 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f480b4120 con 0x7f7f480d0cf0 2024-04-25T02:28:19.825 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.822+0000 7f7f457fa640 1 -- 172.21.15.67:0/2479521119 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12860 (secure 0 0 0) 0x7f7f3c07a380 con 0x7f7f480d0cf0 2024-04-25T02:28:19.825 INFO:teuthology.misc.health.smithi067.stdout: 2024-04-25T02:28:19.825 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":16,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:16.377479+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:19.827 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.824+0000 7f7f4ecd4640 1 -- 172.21.15.67:0/2479521119 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7f3406be30 msgr2=0x7f7f3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.827 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.824+0000 7f7f4ecd4640 1 --2- 172.21.15.67:0/2479521119 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7f3406be30 0x7f7f3406e2f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7f38001710 tx=0x7f7f38009040 comp rx=0 tx=0).stop 2024-04-25T02:28:19.827 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.824+0000 7f7f4ecd4640 1 -- 172.21.15.67:0/2479521119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f480d0cf0 msgr2=0x7f7f480c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.827 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.824+0000 7f7f4ecd4640 1 --2- 172.21.15.67:0/2479521119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f480d0cf0 0x7f7f480c6c40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0098f0 tx=0x7f7f3c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.827 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.824+0000 7f7f4ecd4640 1 -- 172.21.15.67:0/2479521119 shutdown_connections 2024-04-25T02:28:19.827 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.824+0000 7f7f4ecd4640 1 --2- 172.21.15.67:0/2479521119 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7f3406be30 0x7f7f3406e2f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.828 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.824+0000 7f7f4ecd4640 1 --2- 172.21.15.67:0/2479521119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4815e690 0x7f7f48160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.828 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.824+0000 7f7f4ecd4640 1 --2- 172.21.15.67:0/2479521119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f480d0cf0 0x7f7f480c6c40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.828 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.824+0000 7f7f4ecd4640 1 --2- 172.21.15.67:0/2479521119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4806d180 0x7f7f481526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.828 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.824+0000 7f7f4ecd4640 1 -- 172.21.15.67:0/2479521119 >> 172.21.15.67:0/2479521119 conn(0x7f7f480b3a60 msgr2=0x7f7f4815c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:19.828 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.824+0000 7f7f4ecd4640 1 -- 172.21.15.67:0/2479521119 shutdown_connections 2024-04-25T02:28:19.828 INFO:teuthology.misc.health.smithi067.stderr:2024-04-25T02:28:19.824+0000 7f7f4ecd4640 1 -- 172.21.15.67:0/2479521119 wait complete. 2024-04-25T02:28:19.837 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T02:28:19.837 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T02:28:19.837 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T02:28:19.837 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T02:28:19.839 INFO:tasks.ceph.mds.a:Started 2024-04-25T02:28:19.839 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T02:28:19.840 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T02:28:19.841 INFO:tasks.ceph.mds.c:Started 2024-04-25T02:28:19.842 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T02:28:19.842 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T02:28:19.845 INFO:tasks.ceph.mds.b:Started 2024-04-25T02:28:19.845 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T02:28:19.845 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T02:28:19.847 INFO:tasks.ceph.mds.d:Started 2024-04-25T02:28:19.847 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T02:28:19.848 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:19.916 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-04-25T02:28:19.916 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-04-25T02:28:19.926 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-04-25T02:28:19.927 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-04-25T02:28:19.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.951+0000 7f6ad1763640 1 Processor -- start 2024-04-25T02:28:19.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.951+0000 7f6ad1763640 1 -- start start 2024-04-25T02:28:19.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6ad1763640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6acc0d47b0 0x7f6acc0d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6ad1763640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6acc0d2a30 0x7f6acc160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6ad1763640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6acc15fba0 con 0x7f6acc15ee50 2024-04-25T02:28:19.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6ad1763640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6acc0d4c10 con 0x7f6acc0d47b0 2024-04-25T02:28:19.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6ad1763640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6acc0d4eb0 con 0x7f6acc0d2a30 2024-04-25T02:28:19.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6acaffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6acc15ee50 0x7f6acc15f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41012/0 (socket says 172.21.15.67:41012) 2024-04-25T02:28:19.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6acaffd640 1 -- 172.21.15.67:0/114859349 learned_addr learned my addr 172.21.15.67:0/114859349 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:19.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6ac9ffb640 1 -- 172.21.15.67:0/114859349 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3200119393 0 0) 0x7f6acc15fba0 con 0x7f6acc15ee50 2024-04-25T02:28:19.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6acb7fe640 1 --2- 172.21.15.67:0/114859349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6acc0d2a30 0x7f6acc160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6aca7fc640 1 --2- 172.21.15.67:0/114859349 >> v2:172.21.15.176:3300/0 conn(0x7f6acc0d47b0 0x7f6acc0d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6ac9ffb640 1 -- 172.21.15.67:0/114859349 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ab4003520 con 0x7f6acc15ee50 2024-04-25T02:28:19.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6ac9ffb640 1 -- 172.21.15.67:0/114859349 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2424132950 0 0) 0x7f6ab4003520 con 0x7f6acc15ee50 2024-04-25T02:28:19.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6ac9ffb640 1 -- 172.21.15.67:0/114859349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6acc0d2a30 msgr2=0x7f6acc160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:19.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6ac9ffb640 1 --2- 172.21.15.67:0/114859349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6acc0d2a30 0x7f6acc160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6ac9ffb640 1 -- 172.21.15.67:0/114859349 >> v2:172.21.15.176:3300/0 conn(0x7f6acc0d47b0 msgr2=0x7f6acc0d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:19.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6ac9ffb640 1 --2- 172.21.15.67:0/114859349 >> v2:172.21.15.176:3300/0 conn(0x7f6acc0d47b0 0x7f6acc0d24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6ac9ffb640 1 -- 172.21.15.67:0/114859349 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6acc15fe40 con 0x7f6acc15ee50 2024-04-25T02:28:19.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6ac9ffb640 1 -- 172.21.15.67:0/114859349 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f6abc001670 con 0x7f6acc15ee50 2024-04-25T02:28:19.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6ac9ffb640 1 -- 172.21.15.67:0/114859349 >> v1:172.21.15.67:6789/0 conn(0x7f6acc15ee50 legacy=0x7f6acc15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6ac9ffb640 1 --2- 172.21.15.67:0/114859349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ab40039b0 0x7f6ab4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.952+0000 7f6ac9ffb640 1 --2- 172.21.15.67:0/114859349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6acc0d2a30 0x7f6ab4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.953+0000 7f6ac9ffb640 1 --2- 172.21.15.67:0/114859349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ab4004d40 0x7f6ab40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.953+0000 7f6ac9ffb640 1 -- 172.21.15.67:0/114859349 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc0d4c10 con 0x7f6ab40039b0 2024-04-25T02:28:19.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.953+0000 7f6ac9ffb640 1 -- 172.21.15.67:0/114859349 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc0d4eb0 con 0x7f6ab4004d40 2024-04-25T02:28:19.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.953+0000 7f6ac9ffb640 1 -- 172.21.15.67:0/114859349 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab400b9c0 con 0x7f6acc0d2a30 2024-04-25T02:28:19.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.953+0000 7f6acaffd640 1 --2- 172.21.15.67:0/114859349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ab40039b0 0x7f6ab4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.953+0000 7f6aca7fc640 1 --2- 172.21.15.67:0/114859349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6acc0d2a30 0x7f6ab4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.953+0000 7f6acb7fe640 1 --2- 172.21.15.67:0/114859349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ab4004d40 0x7f6ab40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.953+0000 7f6acaffd640 1 -- 172.21.15.67:0/114859349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6acc0d2a30 msgr2=0x7f6ab4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:19.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.953+0000 7f6acaffd640 1 --2- 172.21.15.67:0/114859349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6acc0d2a30 0x7f6ab4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.953+0000 7f6acaffd640 1 -- 172.21.15.67:0/114859349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ab4004d40 msgr2=0x7f6ab40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:19.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.953+0000 7f6acaffd640 1 --2- 172.21.15.67:0/114859349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ab4004d40 0x7f6ab40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.953+0000 7f6acaffd640 1 -- 172.21.15.67:0/114859349 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab4003520 con 0x7f6ab40039b0 2024-04-25T02:28:19.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.954+0000 7f6acaffd640 1 --2- 172.21.15.67:0/114859349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ab40039b0 0x7f6ab4003dd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00c270 tx=0x7f6ab4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c68b832ecb04b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:19.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.954+0000 7f6ac9ffb640 1 -- 172.21.15.67:0/114859349 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc007d30 con 0x7f6ab40039b0 2024-04-25T02:28:19.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.954+0000 7f6ac9ffb640 1 -- 172.21.15.67:0/114859349 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6abc005ad0 con 0x7f6ab40039b0 2024-04-25T02:28:19.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.954+0000 7f6ac9ffb640 1 -- 172.21.15.67:0/114859349 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc007070 con 0x7f6ab40039b0 2024-04-25T02:28:19.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.954+0000 7f6ad1763640 1 -- 172.21.15.67:0/114859349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ab40039b0 msgr2=0x7f6ab4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.954+0000 7f6ad1763640 1 --2- 172.21.15.67:0/114859349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ab40039b0 0x7f6ab4003dd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00c270 tx=0x7f6ab4005830 comp rx=0 tx=0).stop 2024-04-25T02:28:19.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.954+0000 7f6acb7fe640 1 -- 172.21.15.67:0/114859349 reap_dead start 2024-04-25T02:28:19.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.954+0000 7f6ad1763640 1 -- 172.21.15.67:0/114859349 shutdown_connections 2024-04-25T02:28:19.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.954+0000 7f6ad1763640 1 -- 172.21.15.67:0/114859349 >> 172.21.15.67:0/114859349 conn(0x7f6acc09d450 msgr2=0x7f6acc0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:19.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.954+0000 7f6ad1763640 1 -- 172.21.15.67:0/114859349 shutdown_connections 2024-04-25T02:28:19.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.954+0000 7f6ad1763640 1 -- 172.21.15.67:0/114859349 wait complete. 2024-04-25T02:28:19.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.956+0000 7f6ad1763640 1 Processor -- start 2024-04-25T02:28:19.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.956+0000 7f6ad1763640 1 -- start start 2024-04-25T02:28:19.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.956+0000 7f6ad1763640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ab40039b0 0x7f6acc157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.956+0000 7f6ad1763640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6acc0b5d00 0x7f6acc0c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.956+0000 7f6ad1763640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6acc0b6180 0x7f6acc0c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.956+0000 7f6ad1763640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc160920 con 0x7f6acc0b6180 2024-04-25T02:28:19.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.956+0000 7f6ad1763640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc160400 con 0x7f6ab40039b0 2024-04-25T02:28:19.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.956+0000 7f6ad1763640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6acc160aa0 con 0x7f6acc0b5d00 2024-04-25T02:28:19.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.957+0000 7f6acb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6acc0b6180 0x7f6acc0c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.957+0000 7f6acb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6acc0b6180 0x7f6acc0c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36196/0 (socket says 172.21.15.67:36196) 2024-04-25T02:28:19.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.957+0000 7f6acb7fe640 1 -- 172.21.15.67:0/1926391890 learned_addr learned my addr 172.21.15.67:0/1926391890 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:19.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.957+0000 7f6aca7fc640 1 --2- 172.21.15.67:0/1926391890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6acc0b5d00 0x7f6acc0c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.957+0000 7f6acb7fe640 1 -- 172.21.15.67:0/1926391890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6acc0b5d00 msgr2=0x7f6acc0c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.957+0000 7f6acb7fe640 1 --2- 172.21.15.67:0/1926391890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6acc0b5d00 0x7f6acc0c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.957+0000 7f6acb7fe640 1 -- 172.21.15.67:0/1926391890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ab40039b0 msgr2=0x7f6acc157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.957+0000 7f6acb7fe640 1 --2- 172.21.15.67:0/1926391890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ab40039b0 0x7f6acc157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.957+0000 7f6acb7fe640 1 -- 172.21.15.67:0/1926391890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6acc156b90 con 0x7f6acc0b6180 2024-04-25T02:28:19.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.957+0000 7f6acb7fe640 1 --2- 172.21.15.67:0/1926391890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6acc0b6180 0x7f6acc0c80d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6acc08ddd0 tx=0x7f6ac400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:19.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.957+0000 7f6ab37fe640 1 -- 172.21.15.67:0/1926391890 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac400fe10 con 0x7f6acc0b6180 2024-04-25T02:28:19.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.957+0000 7f6ab37fe640 1 -- 172.21.15.67:0/1926391890 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac4015430 con 0x7f6acc0b6180 2024-04-25T02:28:19.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.957+0000 7f6ab37fe640 1 -- 172.21.15.67:0/1926391890 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4015820 con 0x7f6acc0b6180 2024-04-25T02:28:19.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.957+0000 7f6ad1763640 1 -- 172.21.15.67:0/1926391890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6acc0c8700 con 0x7f6acc0b6180 2024-04-25T02:28:19.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.957+0000 7f6ad1763640 1 -- 172.21.15.67:0/1926391890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6acc1570e0 con 0x7f6acc0b6180 2024-04-25T02:28:19.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.958+0000 7f6ad1763640 1 -- 172.21.15.67:0/1926391890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6acc069110 con 0x7f6acc0b6180 2024-04-25T02:28:19.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.959+0000 7f6ab37fe640 1 -- 172.21.15.67:0/1926391890 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ac40159c0 con 0x7f6acc0b6180 2024-04-25T02:28:19.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.959+0000 7f6ab37fe640 1 --2- 172.21.15.67:0/1926391890 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6ab806be30 0x7f6ab806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.959+0000 7f6ab37fe640 1 -- 172.21.15.67:0/1926391890 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f6ac408b960 con 0x7f6acc0b6180 2024-04-25T02:28:19.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.959+0000 7f6acaffd640 1 --2- 172.21.15.67:0/1926391890 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6ab806be30 0x7f6ab806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.960+0000 7f6acaffd640 1 --2- 172.21.15.67:0/1926391890 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6ab806be30 0x7f6ab806e2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6abc033000 tx=0x7f6abc007000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:19.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:19.963+0000 7f6ab37fe640 1 -- 172.21.15.67:0/1926391890 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6ac4019030 con 0x7f6acc0b6180 2024-04-25T02:28:20.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.151+0000 7f6ad1763640 1 -- 172.21.15.67:0/1926391890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6acc08e200 con 0x7f6acc0b6180 2024-04-25T02:28:20.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.152+0000 7f6ab37fe640 1 -- 172.21.15.67:0/1926391890 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12860 (secure 0 0 0) 0x7f6ac4010040 con 0x7f6acc0b6180 2024-04-25T02:28:20.155 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:20.155 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":16,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:16.377479+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:20.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.154+0000 7f6ad1763640 1 -- 172.21.15.67:0/1926391890 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6ab806be30 msgr2=0x7f6ab806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:20.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.154+0000 7f6ad1763640 1 --2- 172.21.15.67:0/1926391890 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6ab806be30 0x7f6ab806e2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6abc033000 tx=0x7f6abc007000 comp rx=0 tx=0).stop 2024-04-25T02:28:20.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.154+0000 7f6ad1763640 1 -- 172.21.15.67:0/1926391890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6acc0b6180 msgr2=0x7f6acc0c80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:20.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.154+0000 7f6ad1763640 1 --2- 172.21.15.67:0/1926391890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6acc0b6180 0x7f6acc0c80d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6acc08ddd0 tx=0x7f6ac400f580 comp rx=0 tx=0).stop 2024-04-25T02:28:20.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.154+0000 7f6ad1763640 1 -- 172.21.15.67:0/1926391890 shutdown_connections 2024-04-25T02:28:20.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.154+0000 7f6ad1763640 1 --2- 172.21.15.67:0/1926391890 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6ab806be30 0x7f6ab806e2f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.154+0000 7f6ad1763640 1 --2- 172.21.15.67:0/1926391890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6acc0b6180 0x7f6acc0c80d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.154+0000 7f6ad1763640 1 --2- 172.21.15.67:0/1926391890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6acc0b5d00 0x7f6acc0c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.154+0000 7f6ad1763640 1 --2- 172.21.15.67:0/1926391890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ab40039b0 0x7f6acc157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.154+0000 7f6ad1763640 1 -- 172.21.15.67:0/1926391890 >> 172.21.15.67:0/1926391890 conn(0x7f6acc09d450 msgr2=0x7f6acc15cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:20.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.154+0000 7f6ad1763640 1 -- 172.21.15.67:0/1926391890 shutdown_connections 2024-04-25T02:28:20.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.154+0000 7f6ad1763640 1 -- 172.21.15.67:0/1926391890 wait complete. 2024-04-25T02:28:20.168 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:28:20.168 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:28:20.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.268+0000 7f674decd640 1 Processor -- start 2024-04-25T02:28:20.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.268+0000 7f674decd640 1 -- start start 2024-04-25T02:28:20.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.269+0000 7f674decd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f674815e670 0x7f67480d4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.269+0000 7f674decd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f67480b5180 0x7f67480c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.269+0000 7f674decd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f67480d07d0 0x7f67480d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.269+0000 7f674decd640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f67480d1170 con 0x7f67480b5180 2024-04-25T02:28:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.269+0000 7f674decd640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f67480d2a30 con 0x7f67480d07d0 2024-04-25T02:28:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.269+0000 7f674decd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f67480d2d10 con 0x7f674815e670 2024-04-25T02:28:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.269+0000 7f6746ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f67480b5180 0x7f67480c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.269+0000 7f6746ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f67480b5180 0x7f67480c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36206/0 (socket says 172.21.15.67:36206) 2024-04-25T02:28:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.269+0000 7f6746ffd640 1 -- 172.21.15.67:0/1102334712 learned_addr learned my addr 172.21.15.67:0/1102334712 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.270+0000 7f67477fe640 1 --2- 172.21.15.67:0/1102334712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f674815e670 0x7f67480d4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.270+0000 7f6747fff640 1 --2- 172.21.15.67:0/1102334712 >> v2:172.21.15.176:3300/0 conn(0x7f67480d07d0 0x7f67480d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.270+0000 7f6746ffd640 1 -- 172.21.15.67:0/1102334712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f674815e670 msgr2=0x7f67480d4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.270+0000 7f6746ffd640 1 --2- 172.21.15.67:0/1102334712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f674815e670 0x7f67480d4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.270+0000 7f6746ffd640 1 -- 172.21.15.67:0/1102334712 >> v2:172.21.15.176:3300/0 conn(0x7f67480d07d0 msgr2=0x7f67480d0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.270+0000 7f6746ffd640 1 --2- 172.21.15.67:0/1102334712 >> v2:172.21.15.176:3300/0 conn(0x7f67480d07d0 0x7f67480d0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.270+0000 7f6746ffd640 1 -- 172.21.15.67:0/1102334712 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67480cee50 con 0x7f67480b5180 2024-04-25T02:28:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.270+0000 7f67477fe640 1 --2- 172.21.15.67:0/1102334712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f674815e670 0x7f67480d4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.270+0000 7f6746ffd640 1 --2- 172.21.15.67:0/1102334712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67480b5180 0x7f67480c7bf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f67480cabf0 tx=0x7f673c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ca62417acbbcc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.271+0000 7f67467fc640 1 -- 172.21.15.67:0/1102334712 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c037070 con 0x7f67480b5180 2024-04-25T02:28:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.271+0000 7f67467fc640 1 -- 172.21.15.67:0/1102334712 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f673c032440 con 0x7f67480b5180 2024-04-25T02:28:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.271+0000 7f67467fc640 1 -- 172.21.15.67:0/1102334712 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c032810 con 0x7f67480b5180 2024-04-25T02:28:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.271+0000 7f674decd640 1 -- 172.21.15.67:0/1102334712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67480b5180 msgr2=0x7f67480c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.271+0000 7f674decd640 1 --2- 172.21.15.67:0/1102334712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67480b5180 0x7f67480c7bf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f67480cabf0 tx=0x7f673c02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.271+0000 7f674decd640 1 -- 172.21.15.67:0/1102334712 shutdown_connections 2024-04-25T02:28:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.271+0000 7f674decd640 1 --2- 172.21.15.67:0/1102334712 >> v2:172.21.15.176:3300/0 conn(0x7f67480d07d0 0x7f67480d0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.271+0000 7f674decd640 1 --2- 172.21.15.67:0/1102334712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67480b5180 0x7f67480c7bf0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.271+0000 7f674decd640 1 --2- 172.21.15.67:0/1102334712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f674815e670 0x7f67480d4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.271+0000 7f674decd640 1 -- 172.21.15.67:0/1102334712 >> 172.21.15.67:0/1102334712 conn(0x7f67480d40a0 msgr2=0x7f67480d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.271+0000 7f674decd640 1 -- 172.21.15.67:0/1102334712 shutdown_connections 2024-04-25T02:28:20.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.271+0000 7f674decd640 1 -- 172.21.15.67:0/1102334712 wait complete. 2024-04-25T02:28:20.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.272+0000 7f674decd640 1 Processor -- start 2024-04-25T02:28:20.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.273+0000 7f674decd640 1 -- start start 2024-04-25T02:28:20.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.273+0000 7f674decd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67480b5180 0x7f674815a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.273+0000 7f674decd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67480d07d0 0x7f67480a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.273+0000 7f674decd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f674815e670 0x7f67480a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.273+0000 7f674decd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f674815ebd0 con 0x7f67480b5180 2024-04-25T02:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.273+0000 7f674decd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f674815ea50 con 0x7f67480d07d0 2024-04-25T02:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.273+0000 7f674decd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f67480c8130 con 0x7f674815e670 2024-04-25T02:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.273+0000 7f67477fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67480b5180 0x7f674815a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.273+0000 7f67477fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67480b5180 0x7f674815a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36210/0 (socket says 172.21.15.67:36210) 2024-04-25T02:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.273+0000 7f67477fe640 1 -- 172.21.15.67:0/3589467248 learned_addr learned my addr 172.21.15.67:0/3589467248 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.273+0000 7f6747fff640 1 --2- 172.21.15.67:0/3589467248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f674815e670 0x7f67480a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.273+0000 7f6746ffd640 1 --2- 172.21.15.67:0/3589467248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67480d07d0 0x7f67480a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.274+0000 7f67477fe640 1 -- 172.21.15.67:0/3589467248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f674815e670 msgr2=0x7f67480a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.274+0000 7f67477fe640 1 --2- 172.21.15.67:0/3589467248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f674815e670 0x7f67480a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.274+0000 7f67477fe640 1 -- 172.21.15.67:0/3589467248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67480d07d0 msgr2=0x7f67480a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.274+0000 7f67477fe640 1 --2- 172.21.15.67:0/3589467248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67480d07d0 0x7f67480a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.274+0000 7f67477fe640 1 -- 172.21.15.67:0/3589467248 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67480a1520 con 0x7f67480b5180 2024-04-25T02:28:20.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.274+0000 7f67477fe640 1 --2- 172.21.15.67:0/3589467248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67480b5180 0x7f674815a9a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6738007ef0 tx=0x7f673800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:20.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.274+0000 7f672ffff640 1 -- 172.21.15.67:0/3589467248 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673801a070 con 0x7f67480b5180 2024-04-25T02:28:20.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.274+0000 7f672ffff640 1 -- 172.21.15.67:0/3589467248 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6738003b90 con 0x7f67480b5180 2024-04-25T02:28:20.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.274+0000 7f674decd640 1 -- 172.21.15.67:0/3589467248 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67480a1800 con 0x7f67480b5180 2024-04-25T02:28:20.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.274+0000 7f672ffff640 1 -- 172.21.15.67:0/3589467248 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6738004030 con 0x7f67480b5180 2024-04-25T02:28:20.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.274+0000 7f674decd640 1 -- 172.21.15.67:0/3589467248 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67480b6a20 con 0x7f67480b5180 2024-04-25T02:28:20.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.275+0000 7f674decd640 1 -- 172.21.15.67:0/3589467248 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67480681f0 con 0x7f67480b5180 2024-04-25T02:28:20.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.275+0000 7f672ffff640 1 -- 172.21.15.67:0/3589467248 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f673801d070 con 0x7f67480b5180 2024-04-25T02:28:20.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.276+0000 7f672ffff640 1 --2- 172.21.15.67:0/3589467248 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f673406be30 0x7f673406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:20.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.276+0000 7f672ffff640 1 -- 172.21.15.67:0/3589467248 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f673808acd0 con 0x7f67480b5180 2024-04-25T02:28:20.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.276+0000 7f6746ffd640 1 --2- 172.21.15.67:0/3589467248 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f673406be30 0x7f673406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:20.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.276+0000 7f6746ffd640 1 --2- 172.21.15.67:0/3589467248 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f673406be30 0x7f673406e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f673c034000 tx=0x7f673c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:20.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.280+0000 7f672ffff640 1 -- 172.21.15.67:0/3589467248 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6738010070 con 0x7f67480b5180 2024-04-25T02:28:20.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.462+0000 7f674decd640 1 -- 172.21.15.67:0/3589467248 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f674808c0d0 con 0x7f67480b5180 2024-04-25T02:28:20.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.462+0000 7f672ffff640 1 -- 172.21.15.67:0/3589467248 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f6738059380 con 0x7f67480b5180 2024-04-25T02:28:20.466 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:28:20.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.465+0000 7f674decd640 1 -- 172.21.15.67:0/3589467248 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f673406be30 msgr2=0x7f673406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:20.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.465+0000 7f674decd640 1 --2- 172.21.15.67:0/3589467248 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f673406be30 0x7f673406e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f673c034000 tx=0x7f673c02e000 comp rx=0 tx=0).stop 2024-04-25T02:28:20.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.465+0000 7f674decd640 1 -- 172.21.15.67:0/3589467248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67480b5180 msgr2=0x7f674815a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:20.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.465+0000 7f674decd640 1 --2- 172.21.15.67:0/3589467248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67480b5180 0x7f674815a9a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6738007ef0 tx=0x7f673800d4a0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.465+0000 7f674decd640 1 -- 172.21.15.67:0/3589467248 shutdown_connections 2024-04-25T02:28:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.465+0000 7f674decd640 1 --2- 172.21.15.67:0/3589467248 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f673406be30 0x7f673406e2f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.465+0000 7f674decd640 1 --2- 172.21.15.67:0/3589467248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f674815e670 0x7f67480a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.465+0000 7f674decd640 1 --2- 172.21.15.67:0/3589467248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67480d07d0 0x7f67480a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.465+0000 7f674decd640 1 --2- 172.21.15.67:0/3589467248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67480b5180 0x7f674815a9a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.465+0000 7f674decd640 1 -- 172.21.15.67:0/3589467248 >> 172.21.15.67:0/3589467248 conn(0x7f67480d40a0 msgr2=0x7f67480c9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.465+0000 7f674decd640 1 -- 172.21.15.67:0/3589467248 shutdown_connections 2024-04-25T02:28:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.465+0000 7f674decd640 1 -- 172.21.15.67:0/3589467248 wait complete. 2024-04-25T02:28:20.479 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:28:20.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.576+0000 7f9acdf89640 1 Processor -- start 2024-04-25T02:28:20.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.576+0000 7f9acdf89640 1 -- start start 2024-04-25T02:28:20.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.577+0000 7f9acdf89640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9ac8147040 0x7f9ac80b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:20.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.577+0000 7f9acdf89640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ac8161f90 con 0x7f9ac80b42a0 2024-04-25T02:28:20.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.577+0000 7f9acdf89640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ac8162270 con 0x7f9ac80d1720 2024-04-25T02:28:20.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.577+0000 7f9acdf89640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac81628c0 con 0x7f9ac8147040 2024-04-25T02:28:20.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.577+0000 7f9ac6ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9ac80b42a0 0x7f9ac80d1010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41018/0 (socket says 172.21.15.67:41018) 2024-04-25T02:28:20.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.577+0000 7f9ac6ffd640 1 -- 172.21.15.67:0/3228998569 learned_addr learned my addr 172.21.15.67:0/3228998569 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:20.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.577+0000 7f9ac77fe640 1 --2- 172.21.15.67:0/3228998569 >> v2:172.21.15.176:3300/0 conn(0x7f9ac8147040 0x7f9ac80b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:20.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.577+0000 7f9ac67fc640 1 -- 172.21.15.67:0/3228998569 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073452723 0 0) 0x7f9ac8161f90 con 0x7f9ac80b42a0 2024-04-25T02:28:20.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.577+0000 7f9ac67fc640 1 -- 172.21.15.67:0/3228998569 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ab0003520 con 0x7f9ac80b42a0 2024-04-25T02:28:20.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.577+0000 7f9ac77fe640 1 -- 172.21.15.67:0/3228998569 >> v1:172.21.15.176:6789/0 conn(0x7f9ac80d1720 legacy=0x7f9ac806dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:20.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.577+0000 7f9ac77fe640 1 -- 172.21.15.67:0/3228998569 >> v1:172.21.15.67:6789/0 conn(0x7f9ac80b42a0 legacy=0x7f9ac80d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:20.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.577+0000 7f9ac67fc640 1 -- 172.21.15.67:0/3228998569 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3205857154 0 0) 0x7f9ab0003520 con 0x7f9ac80b42a0 2024-04-25T02:28:20.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.577+0000 7f9ac77fe640 1 -- 172.21.15.67:0/3228998569 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac8162550 con 0x7f9ac8147040 2024-04-25T02:28:20.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.578+0000 7f9ac77fe640 1 --2- 172.21.15.67:0/3228998569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ac8147040 0x7f9ac80b3d60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80097a0 tx=0x7f9ab802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc36684adf1be8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:20.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.578+0000 7f9ac67fc640 1 -- 172.21.15.67:0/3228998569 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8037070 con 0x7f9ac8147040 2024-04-25T02:28:20.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.578+0000 7f9ac67fc640 1 -- 172.21.15.67:0/3228998569 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab802abc0 con 0x7f9ac8147040 2024-04-25T02:28:20.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.578+0000 7f9ac67fc640 1 -- 172.21.15.67:0/3228998569 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc001670 con 0x7f9ac8147040 2024-04-25T02:28:20.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.579+0000 7f9acdf89640 1 -- 172.21.15.67:0/3228998569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ac8147040 msgr2=0x7f9ac80b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:20.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.579+0000 7f9acdf89640 1 --2- 172.21.15.67:0/3228998569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ac8147040 0x7f9ac80b3d60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80097a0 tx=0x7f9ab802a130 comp rx=0 tx=0).stop 2024-04-25T02:28:20.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.579+0000 7f9acdf89640 1 -- 172.21.15.67:0/3228998569 shutdown_connections 2024-04-25T02:28:20.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.579+0000 7f9acdf89640 1 --2- 172.21.15.67:0/3228998569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ac8147040 0x7f9ac80b3d60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.579+0000 7f9acdf89640 1 -- 172.21.15.67:0/3228998569 >> 172.21.15.67:0/3228998569 conn(0x7f9ac806c3b0 msgr2=0x7f9ac806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:20.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.579+0000 7f9acdf89640 1 -- 172.21.15.67:0/3228998569 shutdown_connections 2024-04-25T02:28:20.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.579+0000 7f9acdf89640 1 -- 172.21.15.67:0/3228998569 wait complete. 2024-04-25T02:28:20.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.580+0000 7f9acdf89640 1 Processor -- start 2024-04-25T02:28:20.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.580+0000 7f9acdf89640 1 -- start start 2024-04-25T02:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.581+0000 7f9acdf89640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ac80b42a0 0x7f9ac81423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.581+0000 7f9acdf89640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ac80d1720 0x7f9ac8161070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.581+0000 7f9acdf89640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ac8147040 0x7f9ac815f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.581+0000 7f9acdf89640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac80b5eb0 con 0x7f9ac80d1720 2024-04-25T02:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.581+0000 7f9acdf89640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac80b4740 con 0x7f9ac8147040 2024-04-25T02:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.581+0000 7f9acdf89640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac80b6030 con 0x7f9ac80b42a0 2024-04-25T02:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.581+0000 7f9ac6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ac80d1720 0x7f9ac8161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.581+0000 7f9ac6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ac80d1720 0x7f9ac8161070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36220/0 (socket says 172.21.15.67:36220) 2024-04-25T02:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.581+0000 7f9ac6ffd640 1 -- 172.21.15.67:0/2258516397 learned_addr learned my addr 172.21.15.67:0/2258516397 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.581+0000 7f9ac7fff640 1 --2- 172.21.15.67:0/2258516397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ac8147040 0x7f9ac815f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.581+0000 7f9ac77fe640 1 --2- 172.21.15.67:0/2258516397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ac80b42a0 0x7f9ac81423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.581+0000 7f9ac6ffd640 1 -- 172.21.15.67:0/2258516397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ac80b42a0 msgr2=0x7f9ac81423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.581+0000 7f9ac6ffd640 1 --2- 172.21.15.67:0/2258516397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ac80b42a0 0x7f9ac81423a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.581+0000 7f9ac6ffd640 1 -- 172.21.15.67:0/2258516397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ac8147040 msgr2=0x7f9ac815f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:20.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.581+0000 7f9ac6ffd640 1 --2- 172.21.15.67:0/2258516397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ac8147040 0x7f9ac815f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.581+0000 7f9ac6ffd640 1 -- 172.21.15.67:0/2258516397 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac81e9ca0 con 0x7f9ac80d1720 2024-04-25T02:28:20.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.581+0000 7f9ac77fe640 1 --2- 172.21.15.67:0/2258516397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ac80b42a0 0x7f9ac81423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:20.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.581+0000 7f9ac6ffd640 1 --2- 172.21.15.67:0/2258516397 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ac80d1720 0x7f9ac8161070 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00c750 tx=0x7f9abc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:20.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.582+0000 7f9aaffff640 1 -- 172.21.15.67:0/2258516397 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc017070 con 0x7f9ac80d1720 2024-04-25T02:28:20.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.582+0000 7f9aaffff640 1 -- 172.21.15.67:0/2258516397 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9abc005ad0 con 0x7f9ac80d1720 2024-04-25T02:28:20.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.582+0000 7f9acdf89640 1 -- 172.21.15.67:0/2258516397 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac81e9f80 con 0x7f9ac80d1720 2024-04-25T02:28:20.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.582+0000 7f9aaffff640 1 -- 172.21.15.67:0/2258516397 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc007070 con 0x7f9ac80d1720 2024-04-25T02:28:20.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.582+0000 7f9acdf89640 1 -- 172.21.15.67:0/2258516397 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac81428e0 con 0x7f9ac80d1720 2024-04-25T02:28:20.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.583+0000 7f9acdf89640 1 -- 172.21.15.67:0/2258516397 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ac81e7cc0 con 0x7f9ac80d1720 2024-04-25T02:28:20.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.583+0000 7f9aaffff640 1 -- 172.21.15.67:0/2258516397 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9abc01a070 con 0x7f9ac80d1720 2024-04-25T02:28:20.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.583+0000 7f9aaffff640 1 --2- 172.21.15.67:0/2258516397 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9ab406be30 0x7f9ab406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:20.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.584+0000 7f9aaffff640 1 -- 172.21.15.67:0/2258516397 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f9abc089fd0 con 0x7f9ac80d1720 2024-04-25T02:28:20.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.584+0000 7f9ac77fe640 1 --2- 172.21.15.67:0/2258516397 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9ab406be30 0x7f9ab406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:20.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.584+0000 7f9ac77fe640 1 --2- 172.21.15.67:0/2258516397 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9ab406be30 0x7f9ab406e2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8034000 tx=0x7f9ab802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:20.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.588+0000 7f9aaffff640 1 -- 172.21.15.67:0/2258516397 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9abc058cd0 con 0x7f9ac80d1720 2024-04-25T02:28:20.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.809+0000 7f9acdf89640 1 -- 172.21.15.67:0/2258516397 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ac8069110 con 0x7f9ac80d1720 2024-04-25T02:28:20.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.810+0000 7f9aaffff640 1 -- 172.21.15.67:0/2258516397 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1389 (secure 0 0 0) 0x7f9abc0585d0 con 0x7f9ac80d1720 2024-04-25T02:28:20.813 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:20.813 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/267757090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":267757090},{"type":"v1","addr":"172.21.15.67:6833","nonce":267757090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T02:28:20.813 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 2 2024-04-25T02:28:20.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.812+0000 7f9acdf89640 1 -- 172.21.15.67:0/2258516397 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9ab406be30 msgr2=0x7f9ab406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:20.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.812+0000 7f9acdf89640 1 --2- 172.21.15.67:0/2258516397 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9ab406be30 0x7f9ab406e2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8034000 tx=0x7f9ab802e000 comp rx=0 tx=0).stop 2024-04-25T02:28:20.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.812+0000 7f9acdf89640 1 -- 172.21.15.67:0/2258516397 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ac80d1720 msgr2=0x7f9ac8161070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:20.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.812+0000 7f9acdf89640 1 --2- 172.21.15.67:0/2258516397 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ac80d1720 0x7f9ac8161070 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00c750 tx=0x7f9abc00cc10 comp rx=0 tx=0).stop 2024-04-25T02:28:20.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.812+0000 7f9acdf89640 1 -- 172.21.15.67:0/2258516397 shutdown_connections 2024-04-25T02:28:20.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.812+0000 7f9acdf89640 1 --2- 172.21.15.67:0/2258516397 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9ab406be30 0x7f9ab406e2f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.812+0000 7f9acdf89640 1 --2- 172.21.15.67:0/2258516397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ac8147040 0x7f9ac815f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.812+0000 7f9acdf89640 1 --2- 172.21.15.67:0/2258516397 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ac80d1720 0x7f9ac8161070 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.812+0000 7f9acdf89640 1 --2- 172.21.15.67:0/2258516397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ac80b42a0 0x7f9ac81423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:20.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.812+0000 7f9acdf89640 1 -- 172.21.15.67:0/2258516397 >> 172.21.15.67:0/2258516397 conn(0x7f9ac806c3b0 msgr2=0x7f9ac806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:20.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.812+0000 7f9acdf89640 1 -- 172.21.15.67:0/2258516397 shutdown_connections 2024-04-25T02:28:20.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:20.812+0000 7f9acdf89640 1 -- 172.21.15.67:0/2258516397 wait complete. 2024-04-25T02:28:22.826 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:28:22.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.937+0000 7fba4d691640 1 Processor -- start 2024-04-25T02:28:22.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.937+0000 7fba4d691640 1 -- start start 2024-04-25T02:28:22.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.938+0000 7fba4d691640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fba48067200 0x7fba480715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:22.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.938+0000 7fba4d691640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba4806c9b0 con 0x7fba4815e280 2024-04-25T02:28:22.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.938+0000 7fba4d691640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba4806bc70 con 0x7fba4815e660 2024-04-25T02:28:22.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.938+0000 7fba4d691640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fba4806e990 con 0x7fba48067200 2024-04-25T02:28:22.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.938+0000 7fba46ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fba4815e280 0x7fba4806bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51126/0 (socket says 172.21.15.67:51126) 2024-04-25T02:28:22.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.938+0000 7fba46ffd640 1 -- 172.21.15.67:0/1013506337 learned_addr learned my addr 172.21.15.67:0/1013506337 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:22.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.938+0000 7fba477fe640 1 --2- 172.21.15.67:0/1013506337 >> v2:172.21.15.176:3300/0 conn(0x7fba48067200 0x7fba480715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:22.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.938+0000 7fba45ffb640 1 -- 172.21.15.67:0/1013506337 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3949470760 0 0) 0x7fba4806c9b0 con 0x7fba4815e280 2024-04-25T02:28:22.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.938+0000 7fba45ffb640 1 -- 172.21.15.67:0/1013506337 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba30003520 con 0x7fba4815e280 2024-04-25T02:28:22.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.938+0000 7fba477fe640 1 -- 172.21.15.67:0/1013506337 >> v1:172.21.15.176:6789/0 conn(0x7fba4815e660 legacy=0x7fba4806ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:22.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.938+0000 7fba477fe640 1 -- 172.21.15.67:0/1013506337 >> v1:172.21.15.67:6789/0 conn(0x7fba4815e280 legacy=0x7fba4806bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:22.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.938+0000 7fba477fe640 1 -- 172.21.15.67:0/1013506337 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4806e340 con 0x7fba48067200 2024-04-25T02:28:22.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.939+0000 7fba477fe640 1 --2- 172.21.15.67:0/1013506337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba48067200 0x7fba480715e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fba40009d90 tx=0x7fba4002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2888f16bcb207873 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:22.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.939+0000 7fba45ffb640 1 -- 172.21.15.67:0/1013506337 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40007740 con 0x7fba48067200 2024-04-25T02:28:22.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.939+0000 7fba45ffb640 1 -- 172.21.15.67:0/1013506337 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba400078e0 con 0x7fba48067200 2024-04-25T02:28:22.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.939+0000 7fba45ffb640 1 -- 172.21.15.67:0/1013506337 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40007cb0 con 0x7fba48067200 2024-04-25T02:28:22.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.940+0000 7fba4d691640 1 -- 172.21.15.67:0/1013506337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba48067200 msgr2=0x7fba480715e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:22.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.940+0000 7fba4d691640 1 --2- 172.21.15.67:0/1013506337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba48067200 0x7fba480715e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fba40009d90 tx=0x7fba4002a6f0 comp rx=0 tx=0).stop 2024-04-25T02:28:22.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.940+0000 7fba4d691640 1 -- 172.21.15.67:0/1013506337 shutdown_connections 2024-04-25T02:28:22.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.940+0000 7fba4d691640 1 --2- 172.21.15.67:0/1013506337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba48067200 0x7fba480715e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:22.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.940+0000 7fba4d691640 1 -- 172.21.15.67:0/1013506337 >> 172.21.15.67:0/1013506337 conn(0x7fba480d04f0 msgr2=0x7fba480d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:22.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.940+0000 7fba4d691640 1 -- 172.21.15.67:0/1013506337 shutdown_connections 2024-04-25T02:28:22.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.940+0000 7fba4d691640 1 -- 172.21.15.67:0/1013506337 wait complete. 2024-04-25T02:28:22.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.941+0000 7fba4d691640 1 Processor -- start 2024-04-25T02:28:22.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.941+0000 7fba4d691640 1 -- start start 2024-04-25T02:28:22.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.942+0000 7fba4d691640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba48067200 0x7fba4815a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:22.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.942+0000 7fba4d691640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4815e280 0x7fba4815c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:22.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.942+0000 7fba4d691640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba4815e660 0x7fba4815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:22.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.942+0000 7fba4d691640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fba48071ca0 con 0x7fba4815e280 2024-04-25T02:28:22.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.942+0000 7fba4d691640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fba48071b20 con 0x7fba4815e660 2024-04-25T02:28:22.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.942+0000 7fba4d691640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fba48071e20 con 0x7fba48067200 2024-04-25T02:28:22.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.942+0000 7fba467fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4815e280 0x7fba4815c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:22.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.942+0000 7fba467fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4815e280 0x7fba4815c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59102/0 (socket says 172.21.15.67:59102) 2024-04-25T02:28:22.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.942+0000 7fba467fc640 1 -- 172.21.15.67:0/1202564227 learned_addr learned my addr 172.21.15.67:0/1202564227 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:22.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.942+0000 7fba477fe640 1 --2- 172.21.15.67:0/1202564227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba4815e660 0x7fba4815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:22.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.942+0000 7fba46ffd640 1 --2- 172.21.15.67:0/1202564227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba48067200 0x7fba4815a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:22.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.943+0000 7fba467fc640 1 -- 172.21.15.67:0/1202564227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba48067200 msgr2=0x7fba4815a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:22.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.943+0000 7fba467fc640 1 --2- 172.21.15.67:0/1202564227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba48067200 0x7fba4815a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:22.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.943+0000 7fba467fc640 1 -- 172.21.15.67:0/1202564227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba4815e660 msgr2=0x7fba4815c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:22.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.943+0000 7fba467fc640 1 --2- 172.21.15.67:0/1202564227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba4815e660 0x7fba4815c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:22.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.943+0000 7fba467fc640 1 -- 172.21.15.67:0/1202564227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba481e7910 con 0x7fba4815e280 2024-04-25T02:28:22.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.943+0000 7fba467fc640 1 --2- 172.21.15.67:0/1202564227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4815e280 0x7fba4815c280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00c3c0 tx=0x7fba3c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:22.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.943+0000 7fba2f7fe640 1 -- 172.21.15.67:0/1202564227 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c017070 con 0x7fba4815e280 2024-04-25T02:28:22.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.943+0000 7fba2f7fe640 1 -- 172.21.15.67:0/1202564227 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3c0052d0 con 0x7fba4815e280 2024-04-25T02:28:22.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.943+0000 7fba2f7fe640 1 -- 172.21.15.67:0/1202564227 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c003830 con 0x7fba4815e280 2024-04-25T02:28:22.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.943+0000 7fba4d691640 1 -- 172.21.15.67:0/1202564227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba481e7bf0 con 0x7fba4815e280 2024-04-25T02:28:22.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.943+0000 7fba4d691640 1 -- 172.21.15.67:0/1202564227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba481e81b0 con 0x7fba4815e280 2024-04-25T02:28:22.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.944+0000 7fba4d691640 1 -- 172.21.15.67:0/1202564227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba48069110 con 0x7fba4815e280 2024-04-25T02:28:22.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.944+0000 7fba2f7fe640 1 -- 172.21.15.67:0/1202564227 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba3c01a070 con 0x7fba4815e280 2024-04-25T02:28:22.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.945+0000 7fba2f7fe640 1 --2- 172.21.15.67:0/1202564227 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fba3406be30 0x7fba3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:22.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.945+0000 7fba2f7fe640 1 -- 172.21.15.67:0/1202564227 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fba3c089e50 con 0x7fba4815e280 2024-04-25T02:28:22.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.945+0000 7fba46ffd640 1 --2- 172.21.15.67:0/1202564227 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fba3406be30 0x7fba3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:22.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.946+0000 7fba46ffd640 1 --2- 172.21.15.67:0/1202564227 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fba3406be30 0x7fba3406e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fba380011e0 tx=0x7fba38007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:22.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:22.949+0000 7fba2f7fe640 1 -- 172.21.15.67:0/1202564227 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fba3c058470 con 0x7fba4815e280 2024-04-25T02:28:23.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.171+0000 7fba4d691640 1 -- 172.21.15.67:0/1202564227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba48066fe0 con 0x7fba4815e280 2024-04-25T02:28:23.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.172+0000 7fba2f7fe640 1 -- 172.21.15.67:0/1202564227 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3861 (secure 0 0 0) 0x7fba3c05c770 con 0x7fba4815e280 2024-04-25T02:28:23.175 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:23.175 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1246739775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1246739775},{"type":"v1","addr":"172.21.15.67:6835","nonce":1246739775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/267757090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":267757090},{"type":"v1","addr":"172.21.15.67:6833","nonce":267757090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/90768677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":90768677},{"type":"v1","addr":"172.21.15.176:6837","nonce":90768677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1058053785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1058053785},{"type":"v1","addr":"172.21.15.176:6836","nonce":1058053785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T02:28:23.176 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 3 2024-04-25T02:28:23.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.174+0000 7fba4d691640 1 -- 172.21.15.67:0/1202564227 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fba3406be30 msgr2=0x7fba3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:23.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.174+0000 7fba4d691640 1 --2- 172.21.15.67:0/1202564227 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fba3406be30 0x7fba3406e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fba380011e0 tx=0x7fba38007d30 comp rx=0 tx=0).stop 2024-04-25T02:28:23.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.174+0000 7fba4d691640 1 -- 172.21.15.67:0/1202564227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4815e280 msgr2=0x7fba4815c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:23.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.174+0000 7fba4d691640 1 --2- 172.21.15.67:0/1202564227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4815e280 0x7fba4815c280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00c3c0 tx=0x7fba3c00c880 comp rx=0 tx=0).stop 2024-04-25T02:28:23.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.174+0000 7fba4d691640 1 -- 172.21.15.67:0/1202564227 shutdown_connections 2024-04-25T02:28:23.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.174+0000 7fba4d691640 1 --2- 172.21.15.67:0/1202564227 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fba3406be30 0x7fba3406e2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.174+0000 7fba4d691640 1 --2- 172.21.15.67:0/1202564227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba4815e660 0x7fba4815c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.174+0000 7fba4d691640 1 --2- 172.21.15.67:0/1202564227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4815e280 0x7fba4815c280 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.174+0000 7fba4d691640 1 --2- 172.21.15.67:0/1202564227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba48067200 0x7fba4815a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.174+0000 7fba4d691640 1 -- 172.21.15.67:0/1202564227 >> 172.21.15.67:0/1202564227 conn(0x7fba480d04f0 msgr2=0x7fba4806b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:23.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.174+0000 7fba4d691640 1 -- 172.21.15.67:0/1202564227 shutdown_connections 2024-04-25T02:28:23.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.174+0000 7fba4d691640 1 -- 172.21.15.67:0/1202564227 wait complete. 2024-04-25T02:28:23.188 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:23.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.285+0000 7f4913d29640 1 Processor -- start 2024-04-25T02:28:23.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.285+0000 7f4913d29640 1 -- start start 2024-04-25T02:28:23.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.286+0000 7f4913d29640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f490c0d14a0 0x7f490c06e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:23.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.286+0000 7f4913d29640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f490c0d1930 con 0x7f490c0d1010 2024-04-25T02:28:23.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.286+0000 7f4913d29640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f490c0b4470 con 0x7f490c147040 2024-04-25T02:28:23.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.286+0000 7f4913d29640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f490c1628c0 con 0x7f490c0d14a0 2024-04-25T02:28:23.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.286+0000 7f49112c4640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f490c0d1010 0x7f490c06dc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51130/0 (socket says 172.21.15.67:51130) 2024-04-25T02:28:23.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.286+0000 7f49112c4640 1 -- 172.21.15.67:0/301042837 learned_addr learned my addr 172.21.15.67:0/301042837 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:23.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.286+0000 7f49122c6640 1 --2- 172.21.15.67:0/301042837 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f490c0d14a0 0x7f490c06e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:23.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.286+0000 7f4910ac3640 1 -- 172.21.15.67:0/301042837 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2973178438 0 0) 0x7f490c0d1930 con 0x7f490c0d1010 2024-04-25T02:28:23.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.286+0000 7f4910ac3640 1 -- 172.21.15.67:0/301042837 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48f8003520 con 0x7f490c0d1010 2024-04-25T02:28:23.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.287+0000 7f4910ac3640 1 -- 172.21.15.67:0/301042837 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 785755196 0 0) 0x7f490c0b4470 con 0x7f490c147040 2024-04-25T02:28:23.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.287+0000 7f4910ac3640 1 -- 172.21.15.67:0/301042837 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f490c0d1930 con 0x7f490c147040 2024-04-25T02:28:23.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.287+0000 7f4910ac3640 1 -- 172.21.15.67:0/301042837 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4181985062 0 0) 0x7f48f8003520 con 0x7f490c0d1010 2024-04-25T02:28:23.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.287+0000 7f49122c6640 1 -- 172.21.15.67:0/301042837 >> v1:172.21.15.176:6789/0 conn(0x7f490c147040 legacy=0x7f490c0b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:23.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.287+0000 7f49122c6640 1 -- 172.21.15.67:0/301042837 >> v1:172.21.15.67:6789/0 conn(0x7f490c0d1010 legacy=0x7f490c06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:23.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.287+0000 7f49122c6640 1 -- 172.21.15.67:0/301042837 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490c161f90 con 0x7f490c0d14a0 2024-04-25T02:28:23.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.287+0000 7f49122c6640 1 --2- 172.21.15.67:0/301042837 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f490c0d14a0 0x7f490c06e350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4904009dc0 tx=0x7f490402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=476f01f07415f0e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:23.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.287+0000 7f4910ac3640 1 -- 172.21.15.67:0/301042837 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc001670 con 0x7f490c0d14a0 2024-04-25T02:28:23.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.288+0000 7f4910ac3640 1 -- 172.21.15.67:0/301042837 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4904007540 con 0x7f490c0d14a0 2024-04-25T02:28:23.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.288+0000 7f4910ac3640 1 -- 172.21.15.67:0/301042837 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49040078f0 con 0x7f490c0d14a0 2024-04-25T02:28:23.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.288+0000 7f4913d29640 1 -- 172.21.15.67:0/301042837 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f490c0d14a0 msgr2=0x7f490c06e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:23.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.288+0000 7f4913d29640 1 --2- 172.21.15.67:0/301042837 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f490c0d14a0 0x7f490c06e350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4904009dc0 tx=0x7f490402a5d0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.288+0000 7f4913d29640 1 -- 172.21.15.67:0/301042837 shutdown_connections 2024-04-25T02:28:23.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.288+0000 7f4913d29640 1 --2- 172.21.15.67:0/301042837 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f490c0d14a0 0x7f490c06e350 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.288+0000 7f4913d29640 1 -- 172.21.15.67:0/301042837 >> 172.21.15.67:0/301042837 conn(0x7f490c06c3b0 msgr2=0x7f490c06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:23.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.288+0000 7f4913d29640 1 -- 172.21.15.67:0/301042837 shutdown_connections 2024-04-25T02:28:23.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.288+0000 7f4913d29640 1 -- 172.21.15.67:0/301042837 wait complete. 2024-04-25T02:28:23.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.289+0000 7f4913d29640 1 Processor -- start 2024-04-25T02:28:23.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.289+0000 7f4913d29640 1 -- start start 2024-04-25T02:28:23.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.290+0000 7f4913d29640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f490c0d1010 0x7f490c160850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.290+0000 7f4913d29640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f490c0d14a0 0x7f490c0cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.290+0000 7f4913d29640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f490c147040 0x7f490c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.290+0000 7f4913d29640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f490c162d50 con 0x7f490c0d14a0 2024-04-25T02:28:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.290+0000 7f4913d29640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f490c162550 con 0x7f490c147040 2024-04-25T02:28:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.290+0000 7f4913d29640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f490c0b4740 con 0x7f490c0d1010 2024-04-25T02:28:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.290+0000 7f49112c4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f490c0d14a0 0x7f490c0cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.290+0000 7f49112c4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f490c0d14a0 0x7f490c0cf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59118/0 (socket says 172.21.15.67:59118) 2024-04-25T02:28:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.290+0000 7f49112c4640 1 -- 172.21.15.67:0/718722469 learned_addr learned my addr 172.21.15.67:0/718722469 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.290+0000 7f4911ac5640 1 --2- 172.21.15.67:0/718722469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f490c0d1010 0x7f490c160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.290+0000 7f49122c6640 1 --2- 172.21.15.67:0/718722469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f490c147040 0x7f490c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.290+0000 7f49112c4640 1 -- 172.21.15.67:0/718722469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f490c0d1010 msgr2=0x7f490c160850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:23.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.290+0000 7f49112c4640 1 --2- 172.21.15.67:0/718722469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f490c0d1010 0x7f490c160850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.290+0000 7f49112c4640 1 -- 172.21.15.67:0/718722469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f490c147040 msgr2=0x7f490c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:23.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.290+0000 7f49112c4640 1 --2- 172.21.15.67:0/718722469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f490c147040 0x7f490c0cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.290+0000 7f49112c4640 1 -- 172.21.15.67:0/718722469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490c1f8af0 con 0x7f490c0d14a0 2024-04-25T02:28:23.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.291+0000 7f49112c4640 1 --2- 172.21.15.67:0/718722469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f490c0d14a0 0x7f490c0cf4b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48fc001eb0 tx=0x7f48fc00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:23.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.291+0000 7f49027fc640 1 -- 172.21.15.67:0/718722469 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc017070 con 0x7f490c0d14a0 2024-04-25T02:28:23.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.291+0000 7f49027fc640 1 -- 172.21.15.67:0/718722469 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48fc005ad0 con 0x7f490c0d14a0 2024-04-25T02:28:23.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.291+0000 7f49027fc640 1 -- 172.21.15.67:0/718722469 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc007070 con 0x7f490c0d14a0 2024-04-25T02:28:23.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.291+0000 7f4913d29640 1 -- 172.21.15.67:0/718722469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f490c1e7d80 con 0x7f490c0d14a0 2024-04-25T02:28:23.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.291+0000 7f4913d29640 1 -- 172.21.15.67:0/718722469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f490c1e8340 con 0x7f490c0d14a0 2024-04-25T02:28:23.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.292+0000 7f4913d29640 1 -- 172.21.15.67:0/718722469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f490c0b5eb0 con 0x7f490c0d14a0 2024-04-25T02:28:23.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.292+0000 7f49027fc640 1 -- 172.21.15.67:0/718722469 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48fc01a070 con 0x7f490c0d14a0 2024-04-25T02:28:23.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.293+0000 7f49027fc640 1 --2- 172.21.15.67:0/718722469 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f48f006be30 0x7f48f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:23.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.293+0000 7f49027fc640 1 -- 172.21.15.67:0/718722469 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f48fc089fc0 con 0x7f490c0d14a0 2024-04-25T02:28:23.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.293+0000 7f4911ac5640 1 --2- 172.21.15.67:0/718722469 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f48f006be30 0x7f48f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:23.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.294+0000 7f4911ac5640 1 --2- 172.21.15.67:0/718722469 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f48f006be30 0x7f48f006e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4908007fd0 tx=0x7f4908009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:23.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.297+0000 7f49027fc640 1 -- 172.21.15.67:0/718722469 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f490c0b5eb0 con 0x7f490c0d14a0 2024-04-25T02:28:23.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.481+0000 7f4913d29640 1 -- 172.21.15.67:0/718722469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f490c069110 con 0x7f490c0d14a0 2024-04-25T02:28:23.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.482+0000 7f49027fc640 1 -- 172.21.15.67:0/718722469 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12860 (secure 0 0 0) 0x7f48fc058680 con 0x7f490c0d14a0 2024-04-25T02:28:23.485 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:23.485 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":16,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:16.377479+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:23.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.484+0000 7f4913d29640 1 -- 172.21.15.67:0/718722469 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f48f006be30 msgr2=0x7f48f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:23.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.484+0000 7f4913d29640 1 --2- 172.21.15.67:0/718722469 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f48f006be30 0x7f48f006e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4908007fd0 tx=0x7f4908009040 comp rx=0 tx=0).stop 2024-04-25T02:28:23.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.484+0000 7f4913d29640 1 -- 172.21.15.67:0/718722469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f490c0d14a0 msgr2=0x7f490c0cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:23.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.484+0000 7f4913d29640 1 --2- 172.21.15.67:0/718722469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f490c0d14a0 0x7f490c0cf4b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48fc001eb0 tx=0x7f48fc00cbe0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.484+0000 7f4913d29640 1 -- 172.21.15.67:0/718722469 shutdown_connections 2024-04-25T02:28:23.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.484+0000 7f4913d29640 1 --2- 172.21.15.67:0/718722469 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f48f006be30 0x7f48f006e2f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.484+0000 7f4913d29640 1 --2- 172.21.15.67:0/718722469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f490c147040 0x7f490c0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.484+0000 7f4913d29640 1 --2- 172.21.15.67:0/718722469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f490c0d14a0 0x7f490c0cf4b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.484+0000 7f4913d29640 1 --2- 172.21.15.67:0/718722469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f490c0d1010 0x7f490c160850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.484+0000 7f4913d29640 1 -- 172.21.15.67:0/718722469 >> 172.21.15.67:0/718722469 conn(0x7f490c06c3b0 msgr2=0x7f490c0b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:23.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.485+0000 7f4913d29640 1 -- 172.21.15.67:0/718722469 shutdown_connections 2024-04-25T02:28:23.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.485+0000 7f4913d29640 1 -- 172.21.15.67:0/718722469 wait complete. 2024-04-25T02:28:23.498 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:28:23.499 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:28:23.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.599+0000 7f910a51b640 1 Processor -- start 2024-04-25T02:28:23.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.599+0000 7f910a51b640 1 -- start start 2024-04-25T02:28:23.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.600+0000 7f910a51b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910415bfc0 0x7f91040ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:23.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.600+0000 7f910a51b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f91040d0210 0x7f91040cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:23.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.600+0000 7f910a51b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f910415c3a0 con 0x7f910415e9f0 2024-04-25T02:28:23.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.600+0000 7f910a51b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f91040d0760 con 0x7f91040d0210 2024-04-25T02:28:23.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.600+0000 7f910a51b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f91040d0a40 con 0x7f910415bfc0 2024-04-25T02:28:23.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.600+0000 7f91037fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f91040d0210 0x7f91040cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:23.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.600+0000 7f9103fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910415bfc0 0x7f91040ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:23.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.600+0000 7f91037fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f91040d0210 0x7f91040cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:47974/0 (socket says 172.21.15.67:47974) 2024-04-25T02:28:23.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.600+0000 7f9103fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910415bfc0 0x7f91040ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:43592/0 (socket says 172.21.15.67:43592) 2024-04-25T02:28:23.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.600+0000 7f91037fe640 1 -- 172.21.15.67:0/3153050762 learned_addr learned my addr 172.21.15.67:0/3153050762 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:23.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.600+0000 7f9103fff640 1 -- 172.21.15.67:0/3153050762 >> v2:172.21.15.176:3300/0 conn(0x7f91040d0210 msgr2=0x7f91040cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:23.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.600+0000 7f9103fff640 1 --2- 172.21.15.67:0/3153050762 >> v2:172.21.15.176:3300/0 conn(0x7f91040d0210 0x7f91040cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.600+0000 7f9103fff640 1 -- 172.21.15.67:0/3153050762 >> v1:172.21.15.176:6789/0 conn(0x7f910415e9f0 legacy=0x7f9104161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:23.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.600+0000 7f9103fff640 1 -- 172.21.15.67:0/3153050762 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91040d0d20 con 0x7f910415bfc0 2024-04-25T02:28:23.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.600+0000 7f91037fe640 1 --2- 172.21.15.67:0/3153050762 >> v2:172.21.15.176:3300/0 conn(0x7f91040d0210 0x7f91040cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:23.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.601+0000 7f9103fff640 1 --2- 172.21.15.67:0/3153050762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910415bfc0 0x7f91040ce750 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f90f40097a0 tx=0x7f90f402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3da96e8b868c195f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:23.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.601+0000 7f9102ffd640 1 -- 172.21.15.67:0/3153050762 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f4037070 con 0x7f910415bfc0 2024-04-25T02:28:23.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.601+0000 7f9102ffd640 1 -- 172.21.15.67:0/3153050762 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f4032440 con 0x7f910415bfc0 2024-04-25T02:28:23.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.601+0000 7f9102ffd640 1 -- 172.21.15.67:0/3153050762 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f4032810 con 0x7f910415bfc0 2024-04-25T02:28:23.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.602+0000 7f910a51b640 1 -- 172.21.15.67:0/3153050762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910415bfc0 msgr2=0x7f91040ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:23.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.602+0000 7f910a51b640 1 --2- 172.21.15.67:0/3153050762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910415bfc0 0x7f91040ce750 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f90f40097a0 tx=0x7f90f402a180 comp rx=0 tx=0).stop 2024-04-25T02:28:23.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.602+0000 7f910a51b640 1 -- 172.21.15.67:0/3153050762 shutdown_connections 2024-04-25T02:28:23.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.602+0000 7f910a51b640 1 --2- 172.21.15.67:0/3153050762 >> v2:172.21.15.176:3300/0 conn(0x7f91040d0210 0x7f91040cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.602+0000 7f910a51b640 1 --2- 172.21.15.67:0/3153050762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910415bfc0 0x7f91040ce750 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.602+0000 7f910a51b640 1 -- 172.21.15.67:0/3153050762 >> 172.21.15.67:0/3153050762 conn(0x7f91040d1ed0 msgr2=0x7f91040d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:23.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.602+0000 7f910a51b640 1 -- 172.21.15.67:0/3153050762 shutdown_connections 2024-04-25T02:28:23.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.602+0000 7f910a51b640 1 -- 172.21.15.67:0/3153050762 wait complete. 2024-04-25T02:28:23.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.603+0000 7f910a51b640 1 Processor -- start 2024-04-25T02:28:23.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.603+0000 7f910a51b640 1 -- start start 2024-04-25T02:28:23.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.604+0000 7f910a51b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91040d0210 0x7f91040b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:23.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.604+0000 7f910a51b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f910415bfc0 0x7f91040c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:23.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.604+0000 7f910a51b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f910415e9f0 0x7f91040c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:23.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.604+0000 7f910a51b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f91040cf690 con 0x7f910415e9f0 2024-04-25T02:28:23.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.604+0000 7f910a51b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f91040d12e0 con 0x7f910415bfc0 2024-04-25T02:28:23.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.604+0000 7f910a51b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f91040cf810 con 0x7f91040d0210 2024-04-25T02:28:23.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.604+0000 7f9108ab8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f910415e9f0 0x7f91040c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:23.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.604+0000 7f9108ab8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f910415e9f0 0x7f91040c80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59132/0 (socket says 172.21.15.67:59132) 2024-04-25T02:28:23.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.604+0000 7f91037fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f910415bfc0 0x7f91040c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:23.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.604+0000 7f9103fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91040d0210 0x7f91040b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:23.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.604+0000 7f9108ab8640 1 -- 172.21.15.67:0/4079288019 learned_addr learned my addr 172.21.15.67:0/4079288019 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:23.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.605+0000 7f9108ab8640 1 -- 172.21.15.67:0/4079288019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91040d0210 msgr2=0x7f91040b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:23.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.605+0000 7f9108ab8640 1 --2- 172.21.15.67:0/4079288019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91040d0210 0x7f91040b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.605+0000 7f9108ab8640 1 -- 172.21.15.67:0/4079288019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f910415bfc0 msgr2=0x7f91040c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:23.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.605+0000 7f9108ab8640 1 --2- 172.21.15.67:0/4079288019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f910415bfc0 0x7f91040c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.605+0000 7f9108ab8640 1 -- 172.21.15.67:0/4079288019 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91040b4620 con 0x7f910415e9f0 2024-04-25T02:28:23.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.605+0000 7f9108ab8640 1 --2- 172.21.15.67:0/4079288019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f910415e9f0 0x7f91040c80c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00c7d0 tx=0x7f90fc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:23.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.605+0000 7f9100ff9640 1 -- 172.21.15.67:0/4079288019 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc003b70 con 0x7f910415e9f0 2024-04-25T02:28:23.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.605+0000 7f9100ff9640 1 -- 172.21.15.67:0/4079288019 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90fc003d30 con 0x7f910415e9f0 2024-04-25T02:28:23.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.605+0000 7f9100ff9640 1 -- 172.21.15.67:0/4079288019 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc00aa90 con 0x7f910415e9f0 2024-04-25T02:28:23.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.605+0000 7f910a51b640 1 -- 172.21.15.67:0/4079288019 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91040b4900 con 0x7f910415e9f0 2024-04-25T02:28:23.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.605+0000 7f910a51b640 1 -- 172.21.15.67:0/4079288019 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91040c8600 con 0x7f910415e9f0 2024-04-25T02:28:23.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.606+0000 7f910a51b640 1 -- 172.21.15.67:0/4079288019 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9104069110 con 0x7f910415e9f0 2024-04-25T02:28:23.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.606+0000 7f9100ff9640 1 -- 172.21.15.67:0/4079288019 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f90fc00ac30 con 0x7f910415e9f0 2024-04-25T02:28:23.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.607+0000 7f9100ff9640 1 --2- 172.21.15.67:0/4079288019 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f90f006be30 0x7f90f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:23.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.607+0000 7f9100ff9640 1 -- 172.21.15.67:0/4079288019 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f90fc08a930 con 0x7f910415e9f0 2024-04-25T02:28:23.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.607+0000 7f9103fff640 1 --2- 172.21.15.67:0/4079288019 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f90f006be30 0x7f90f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:23.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.608+0000 7f9103fff640 1 --2- 172.21.15.67:0/4079288019 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f90f006be30 0x7f90f006e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f90f4034000 tx=0x7f90f402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:23.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.611+0000 7f9100ff9640 1 -- 172.21.15.67:0/4079288019 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f90fc058ff0 con 0x7f910415e9f0 2024-04-25T02:28:23.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.793+0000 7f910a51b640 1 -- 172.21.15.67:0/4079288019 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f91040b7e50 con 0x7f910415e9f0 2024-04-25T02:28:23.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.794+0000 7f9100ff9640 1 -- 172.21.15.67:0/4079288019 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f90fc05d2f0 con 0x7f910415e9f0 2024-04-25T02:28:23.797 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:28:23.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.796+0000 7f910a51b640 1 -- 172.21.15.67:0/4079288019 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f90f006be30 msgr2=0x7f90f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:23.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.796+0000 7f910a51b640 1 --2- 172.21.15.67:0/4079288019 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f90f006be30 0x7f90f006e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f90f4034000 tx=0x7f90f402e000 comp rx=0 tx=0).stop 2024-04-25T02:28:23.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.796+0000 7f910a51b640 1 -- 172.21.15.67:0/4079288019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f910415e9f0 msgr2=0x7f91040c80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:23.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.796+0000 7f910a51b640 1 --2- 172.21.15.67:0/4079288019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f910415e9f0 0x7f91040c80c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00c7d0 tx=0x7f90fc00cc90 comp rx=0 tx=0).stop 2024-04-25T02:28:23.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.796+0000 7f910a51b640 1 -- 172.21.15.67:0/4079288019 shutdown_connections 2024-04-25T02:28:23.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.796+0000 7f910a51b640 1 --2- 172.21.15.67:0/4079288019 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f90f006be30 0x7f90f006e2f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.796+0000 7f910a51b640 1 --2- 172.21.15.67:0/4079288019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f910415e9f0 0x7f91040c80c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.796+0000 7f910a51b640 1 --2- 172.21.15.67:0/4079288019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f910415bfc0 0x7f91040c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.796+0000 7f910a51b640 1 --2- 172.21.15.67:0/4079288019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91040d0210 0x7f91040b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.796+0000 7f910a51b640 1 -- 172.21.15.67:0/4079288019 >> 172.21.15.67:0/4079288019 conn(0x7f91040d1ed0 msgr2=0x7f910415b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:23.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.796+0000 7f910a51b640 1 -- 172.21.15.67:0/4079288019 shutdown_connections 2024-04-25T02:28:23.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.796+0000 7f910a51b640 1 -- 172.21.15.67:0/4079288019 wait complete. 2024-04-25T02:28:23.811 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T02:28:23.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.908+0000 7fbd1c390640 1 Processor -- start 2024-04-25T02:28:23.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.908+0000 7fbd1c390640 1 -- start start 2024-04-25T02:28:23.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.909+0000 7fbd1c390640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbd1415e210 0x7fbd1406cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:23.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.909+0000 7fbd1c390640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbd1415e5f0 0x7fbd1406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:23.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.909+0000 7fbd1c390640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd140d2cc0 con 0x7fbd140cecc0 2024-04-25T02:28:23.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.909+0000 7fbd1c390640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fbd1406c6f0 con 0x7fbd1415e5f0 2024-04-25T02:28:23.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.909+0000 7fbd1c390640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fbd140d2fa0 con 0x7fbd1415e210 2024-04-25T02:28:23.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.909+0000 7fbd1992b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbd1415e5f0 0x7fbd1406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:23.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.909+0000 7fbd1992b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbd1415e5f0 0x7fbd1406d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59146/0 (socket says 172.21.15.67:59146) 2024-04-25T02:28:23.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.909+0000 7fbd1992b640 1 -- 172.21.15.67:0/1112959201 learned_addr learned my addr 172.21.15.67:0/1112959201 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:23.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.910+0000 7fbd1a12c640 1 --2- 172.21.15.67:0/1112959201 >> v2:172.21.15.176:3300/0 conn(0x7fbd1415e210 0x7fbd1406cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:23.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.910+0000 7fbd1992b640 1 -- 172.21.15.67:0/1112959201 >> v2:172.21.15.176:3300/0 conn(0x7fbd1415e210 msgr2=0x7fbd1406cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:23.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.910+0000 7fbd1992b640 1 --2- 172.21.15.67:0/1112959201 >> v2:172.21.15.176:3300/0 conn(0x7fbd1415e210 0x7fbd1406cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.910+0000 7fbd1992b640 1 -- 172.21.15.67:0/1112959201 >> v1:172.21.15.176:6789/0 conn(0x7fbd140cecc0 legacy=0x7fbd140d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:23.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.910+0000 7fbd1992b640 1 -- 172.21.15.67:0/1112959201 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1406c0a0 con 0x7fbd1415e5f0 2024-04-25T02:28:23.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.910+0000 7fbd1a12c640 1 --2- 172.21.15.67:0/1112959201 >> v2:172.21.15.176:3300/0 conn(0x7fbd1415e210 0x7fbd1406cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:23.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.910+0000 7fbd1992b640 1 --2- 172.21.15.67:0/1112959201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd1415e5f0 0x7fbd1406d0c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009870 tx=0x7fbd0802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd08f0e177e8866 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:23.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.910+0000 7fbd1912a640 1 -- 172.21.15.67:0/1112959201 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd08037070 con 0x7fbd1415e5f0 2024-04-25T02:28:23.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.911+0000 7fbd1912a640 1 -- 172.21.15.67:0/1112959201 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd08032440 con 0x7fbd1415e5f0 2024-04-25T02:28:23.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.911+0000 7fbd1912a640 1 -- 172.21.15.67:0/1112959201 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd08032810 con 0x7fbd1415e5f0 2024-04-25T02:28:23.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.911+0000 7fbd1c390640 1 -- 172.21.15.67:0/1112959201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd1415e5f0 msgr2=0x7fbd1406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:23.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.911+0000 7fbd1c390640 1 --2- 172.21.15.67:0/1112959201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd1415e5f0 0x7fbd1406d0c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009870 tx=0x7fbd0802a250 comp rx=0 tx=0).stop 2024-04-25T02:28:23.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.911+0000 7fbd1c390640 1 -- 172.21.15.67:0/1112959201 shutdown_connections 2024-04-25T02:28:23.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.911+0000 7fbd1c390640 1 --2- 172.21.15.67:0/1112959201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd1415e5f0 0x7fbd1406d0c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.911+0000 7fbd1c390640 1 --2- 172.21.15.67:0/1112959201 >> v2:172.21.15.176:3300/0 conn(0x7fbd1415e210 0x7fbd1406cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.911+0000 7fbd1c390640 1 -- 172.21.15.67:0/1112959201 >> 172.21.15.67:0/1112959201 conn(0x7fbd1408dbb0 msgr2=0x7fbd1409d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:23.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.911+0000 7fbd1c390640 1 -- 172.21.15.67:0/1112959201 shutdown_connections 2024-04-25T02:28:23.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.911+0000 7fbd1c390640 1 -- 172.21.15.67:0/1112959201 wait complete. 2024-04-25T02:28:23.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.912+0000 7fbd1c390640 1 Processor -- start 2024-04-25T02:28:23.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.912+0000 7fbd1c390640 1 -- start start 2024-04-25T02:28:23.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.913+0000 7fbd1c390640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd140cecc0 0x7fbd14149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:23.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.913+0000 7fbd1c390640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd1415e210 0x7fbd141f7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:23.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.913+0000 7fbd1c390640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd1415e5f0 0x7fbd141f7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:23.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.913+0000 7fbd1c390640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbd140d46f0 con 0x7fbd1415e210 2024-04-25T02:28:23.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.913+0000 7fbd1c390640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbd140d4570 con 0x7fbd1415e5f0 2024-04-25T02:28:23.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.913+0000 7fbd1c390640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbd140d4870 con 0x7fbd140cecc0 2024-04-25T02:28:23.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.913+0000 7fbd1992b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd1415e210 0x7fbd141f7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:23.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.913+0000 7fbd1992b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd1415e210 0x7fbd141f7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59152/0 (socket says 172.21.15.67:59152) 2024-04-25T02:28:23.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.913+0000 7fbd1992b640 1 -- 172.21.15.67:0/274662771 learned_addr learned my addr 172.21.15.67:0/274662771 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:23.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.913+0000 7fbd1a12c640 1 --2- 172.21.15.67:0/274662771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd140cecc0 0x7fbd14149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:23.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.913+0000 7fbd1a92d640 1 --2- 172.21.15.67:0/274662771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd1415e5f0 0x7fbd141f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:23.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.913+0000 7fbd1992b640 1 -- 172.21.15.67:0/274662771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd140cecc0 msgr2=0x7fbd14149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:23.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.913+0000 7fbd1992b640 1 --2- 172.21.15.67:0/274662771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd140cecc0 0x7fbd14149cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.913+0000 7fbd1992b640 1 -- 172.21.15.67:0/274662771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd1415e5f0 msgr2=0x7fbd141f7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:23.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.913+0000 7fbd1992b640 1 --2- 172.21.15.67:0/274662771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd1415e5f0 0x7fbd141f7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:23.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.913+0000 7fbd1992b640 1 -- 172.21.15.67:0/274662771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd140cdeb0 con 0x7fbd1415e210 2024-04-25T02:28:23.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.914+0000 7fbd1992b640 1 --2- 172.21.15.67:0/274662771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd1415e210 0x7fbd141f7620 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009870 tx=0x7fbd080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:23.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.914+0000 7fbd12ffd640 1 -- 172.21.15.67:0/274662771 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd08037040 con 0x7fbd1415e210 2024-04-25T02:28:23.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.914+0000 7fbd12ffd640 1 -- 172.21.15.67:0/274662771 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd08004230 con 0x7fbd1415e210 2024-04-25T02:28:23.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.914+0000 7fbd12ffd640 1 -- 172.21.15.67:0/274662771 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd08030620 con 0x7fbd1415e210 2024-04-25T02:28:23.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.914+0000 7fbd1c390640 1 -- 172.21.15.67:0/274662771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd140ce190 con 0x7fbd1415e210 2024-04-25T02:28:23.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.914+0000 7fbd1c390640 1 -- 172.21.15.67:0/274662771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd1415b4f0 con 0x7fbd1415e210 2024-04-25T02:28:23.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.915+0000 7fbd1c390640 1 -- 172.21.15.67:0/274662771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd14069110 con 0x7fbd1415e210 2024-04-25T02:28:23.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.915+0000 7fbd12ffd640 1 -- 172.21.15.67:0/274662771 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd080307c0 con 0x7fbd1415e210 2024-04-25T02:28:23.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.916+0000 7fbd12ffd640 1 --2- 172.21.15.67:0/274662771 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbd0006be30 0x7fbd0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:23.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.916+0000 7fbd12ffd640 1 -- 172.21.15.67:0/274662771 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fbd080ab9f0 con 0x7fbd1415e210 2024-04-25T02:28:23.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.916+0000 7fbd1a12c640 1 --2- 172.21.15.67:0/274662771 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbd0006be30 0x7fbd0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:23.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.916+0000 7fbd1a12c640 1 --2- 172.21.15.67:0/274662771 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbd0006be30 0x7fbd0006e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00a990 tx=0x7fbd0c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:23.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:23.920+0000 7fbd12ffd640 1 -- 172.21.15.67:0/274662771 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbd0807a6f0 con 0x7fbd1415e210 2024-04-25T02:28:24.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.103+0000 7fbd1c390640 1 -- 172.21.15.67:0/274662771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fbd14069110 con 0x7fbd1415e210 2024-04-25T02:28:24.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.103+0000 7fbd12ffd640 1 -- 172.21.15.67:0/274662771 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fbd08079ff0 con 0x7fbd1415e210 2024-04-25T02:28:24.107 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:24.107 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-04-25T02:28:24.107 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:28:24.107 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-04-25T02:28:24.107 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-04-25T02:28:24.107 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:28:24.107 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-04-25T02:28:24.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.105+0000 7fbd1c390640 1 -- 172.21.15.67:0/274662771 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbd0006be30 msgr2=0x7fbd0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:24.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.105+0000 7fbd1c390640 1 --2- 172.21.15.67:0/274662771 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbd0006be30 0x7fbd0006e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00a990 tx=0x7fbd0c008040 comp rx=0 tx=0).stop 2024-04-25T02:28:24.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.105+0000 7fbd1c390640 1 -- 172.21.15.67:0/274662771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd1415e210 msgr2=0x7fbd141f7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:24.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.105+0000 7fbd1c390640 1 --2- 172.21.15.67:0/274662771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd1415e210 0x7fbd141f7620 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009870 tx=0x7fbd080046c0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.105+0000 7fbd1c390640 1 -- 172.21.15.67:0/274662771 shutdown_connections 2024-04-25T02:28:24.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.105+0000 7fbd1c390640 1 --2- 172.21.15.67:0/274662771 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbd0006be30 0x7fbd0006e2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.105+0000 7fbd1c390640 1 --2- 172.21.15.67:0/274662771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd1415e5f0 0x7fbd141f7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.105+0000 7fbd1c390640 1 --2- 172.21.15.67:0/274662771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd1415e210 0x7fbd141f7620 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.105+0000 7fbd1c390640 1 --2- 172.21.15.67:0/274662771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd140cecc0 0x7fbd14149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.105+0000 7fbd1c390640 1 -- 172.21.15.67:0/274662771 >> 172.21.15.67:0/274662771 conn(0x7fbd1408dbb0 msgr2=0x7fbd140d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:24.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.105+0000 7fbd1c390640 1 -- 172.21.15.67:0/274662771 shutdown_connections 2024-04-25T02:28:24.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.105+0000 7fbd1c390640 1 -- 172.21.15.67:0/274662771 wait complete. 2024-04-25T02:28:24.119 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T02:28:24.119 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T02:28:24.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.220+0000 7f3fb28bd640 1 Processor -- start 2024-04-25T02:28:24.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.220+0000 7f3fb28bd640 1 -- start start 2024-04-25T02:28:24.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.221+0000 7f3fb28bd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3fac15e4e0 0x7f3fac0ae930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:24.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.221+0000 7f3fb28bd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fac06e240 0x7f3fac06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:24.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.221+0000 7f3fb28bd640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fac0ad890 con 0x7f3fac0af590 2024-04-25T02:28:24.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.221+0000 7f3fb28bd640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3fac0cadf0 con 0x7f3fac06e240 2024-04-25T02:28:24.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.221+0000 7f3fb28bd640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3fac0adb70 con 0x7f3fac15e4e0 2024-04-25T02:28:24.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.221+0000 7f3fb0e5a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fac06e240 0x7f3fac06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:24.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.221+0000 7f3fb0e5a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fac06e240 0x7f3fac06e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59160/0 (socket says 172.21.15.67:59160) 2024-04-25T02:28:24.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.221+0000 7f3fab7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3fac0af590 0x7f3fac0ca6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51134/0 (socket says 172.21.15.67:51134) 2024-04-25T02:28:24.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.221+0000 7f3fb0e5a640 1 -- 172.21.15.67:0/2669384343 learned_addr learned my addr 172.21.15.67:0/2669384343 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:24.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.221+0000 7f3fabfff640 1 --2- 172.21.15.67:0/2669384343 >> v2:172.21.15.176:3300/0 conn(0x7f3fac15e4e0 0x7f3fac0ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:24.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.221+0000 7f3fb0e5a640 1 -- 172.21.15.67:0/2669384343 >> v2:172.21.15.176:3300/0 conn(0x7f3fac15e4e0 msgr2=0x7f3fac0ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:24.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.221+0000 7f3fb0e5a640 1 --2- 172.21.15.67:0/2669384343 >> v2:172.21.15.176:3300/0 conn(0x7f3fac15e4e0 0x7f3fac0ae930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.221+0000 7f3fb0e5a640 1 -- 172.21.15.67:0/2669384343 >> v1:172.21.15.67:6789/0 conn(0x7f3fac0af590 legacy=0x7f3fac0ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:24.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.221+0000 7f3fb0e5a640 1 -- 172.21.15.67:0/2669384343 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fac0ade50 con 0x7f3fac06e240 2024-04-25T02:28:24.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.222+0000 7f3fb0e5a640 1 --2- 172.21.15.67:0/2669384343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fac06e240 0x7f3fac06e6f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3fac06fd50 tx=0x7f3fa402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c625a2a68ac87f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:24.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.222+0000 7f3faaffd640 1 -- 172.21.15.67:0/2669384343 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4036070 con 0x7f3fac06e240 2024-04-25T02:28:24.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.222+0000 7f3faaffd640 1 -- 172.21.15.67:0/2669384343 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fa4031600 con 0x7f3fac06e240 2024-04-25T02:28:24.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.222+0000 7f3faaffd640 1 -- 172.21.15.67:0/2669384343 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa40319d0 con 0x7f3fac06e240 2024-04-25T02:28:24.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.223+0000 7f3fb28bd640 1 -- 172.21.15.67:0/2669384343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fac06e240 msgr2=0x7f3fac06e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:24.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.223+0000 7f3fb28bd640 1 --2- 172.21.15.67:0/2669384343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fac06e240 0x7f3fac06e6f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3fac06fd50 tx=0x7f3fa402a730 comp rx=0 tx=0).stop 2024-04-25T02:28:24.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.223+0000 7f3fb28bd640 1 -- 172.21.15.67:0/2669384343 shutdown_connections 2024-04-25T02:28:24.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.223+0000 7f3fb28bd640 1 --2- 172.21.15.67:0/2669384343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fac06e240 0x7f3fac06e6f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.223+0000 7f3fb28bd640 1 --2- 172.21.15.67:0/2669384343 >> v2:172.21.15.176:3300/0 conn(0x7f3fac15e4e0 0x7f3fac0ae930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.223+0000 7f3fb28bd640 1 -- 172.21.15.67:0/2669384343 >> 172.21.15.67:0/2669384343 conn(0x7f3fac0d0090 msgr2=0x7f3fac0d0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:24.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.223+0000 7f3fb28bd640 1 -- 172.21.15.67:0/2669384343 shutdown_connections 2024-04-25T02:28:24.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.223+0000 7f3fb28bd640 1 -- 172.21.15.67:0/2669384343 wait complete. 2024-04-25T02:28:24.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.224+0000 7f3fb28bd640 1 Processor -- start 2024-04-25T02:28:24.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.224+0000 7f3fb28bd640 1 -- start start 2024-04-25T02:28:24.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.225+0000 7f3fb28bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fac06e240 0x7f3fac09d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:24.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.225+0000 7f3fb28bd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fac0af590 0x7f3fac0b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:24.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.225+0000 7f3fb28bd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fac15e4e0 0x7f3fac0b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:24.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.225+0000 7f3fb28bd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3fac0711d0 con 0x7f3fac06e240 2024-04-25T02:28:24.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.225+0000 7f3fb28bd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3fac0ae410 con 0x7f3fac0af590 2024-04-25T02:28:24.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.225+0000 7f3fb28bd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3fac071350 con 0x7f3fac15e4e0 2024-04-25T02:28:24.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.225+0000 7f3fabfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fac06e240 0x7f3fac09d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:24.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.225+0000 7f3fabfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fac06e240 0x7f3fac09d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59162/0 (socket says 172.21.15.67:59162) 2024-04-25T02:28:24.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.225+0000 7f3fabfff640 1 -- 172.21.15.67:0/570489412 learned_addr learned my addr 172.21.15.67:0/570489412 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:24.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.225+0000 7f3fab7fe640 1 --2- 172.21.15.67:0/570489412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fac0af590 0x7f3fac0b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:24.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.225+0000 7f3fb0e5a640 1 --2- 172.21.15.67:0/570489412 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fac15e4e0 0x7f3fac0b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:24.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.225+0000 7f3fabfff640 1 -- 172.21.15.67:0/570489412 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fac15e4e0 msgr2=0x7f3fac0b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:24.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.225+0000 7f3fabfff640 1 --2- 172.21.15.67:0/570489412 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fac15e4e0 0x7f3fac0b4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.225+0000 7f3fabfff640 1 -- 172.21.15.67:0/570489412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fac0af590 msgr2=0x7f3fac0b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:24.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.225+0000 7f3fabfff640 1 --2- 172.21.15.67:0/570489412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fac0af590 0x7f3fac0b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.225+0000 7f3fabfff640 1 -- 172.21.15.67:0/570489412 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fac09db40 con 0x7f3fac06e240 2024-04-25T02:28:24.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.225+0000 7f3fabfff640 1 --2- 172.21.15.67:0/570489412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fac06e240 0x7f3fac09d600 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400d5f0 tx=0x7f3f9400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:24.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.226+0000 7f3fa8ff9640 1 -- 172.21.15.67:0/570489412 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f940125f0 con 0x7f3fac06e240 2024-04-25T02:28:24.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.226+0000 7f3fa8ff9640 1 -- 172.21.15.67:0/570489412 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f94019070 con 0x7f3fac06e240 2024-04-25T02:28:24.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.226+0000 7f3fb28bd640 1 -- 172.21.15.67:0/570489412 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fac0c8250 con 0x7f3fac06e240 2024-04-25T02:28:24.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.226+0000 7f3fa8ff9640 1 -- 172.21.15.67:0/570489412 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f940129d0 con 0x7f3fac06e240 2024-04-25T02:28:24.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.226+0000 7f3fb28bd640 1 -- 172.21.15.67:0/570489412 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fac0c8810 con 0x7f3fac06e240 2024-04-25T02:28:24.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.227+0000 7f3fb28bd640 1 -- 172.21.15.67:0/570489412 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fac069110 con 0x7f3fac06e240 2024-04-25T02:28:24.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.227+0000 7f3fa8ff9640 1 -- 172.21.15.67:0/570489412 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f94012b70 con 0x7f3fac06e240 2024-04-25T02:28:24.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.228+0000 7f3fa8ff9640 1 --2- 172.21.15.67:0/570489412 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3f8c06be60 0x7f3f8c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:24.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.228+0000 7f3fa8ff9640 1 -- 172.21.15.67:0/570489412 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f3f9408aeb0 con 0x7f3fac06e240 2024-04-25T02:28:24.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.228+0000 7f3fab7fe640 1 --2- 172.21.15.67:0/570489412 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3f8c06be60 0x7f3f8c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:24.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.228+0000 7f3fab7fe640 1 --2- 172.21.15.67:0/570489412 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3f8c06be60 0x7f3f8c06e320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3fac15db90 tx=0x7f3f9c007c80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:24.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.232+0000 7f3fa8ff9640 1 -- 172.21.15.67:0/570489412 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3f94059bc0 con 0x7f3fac06e240 2024-04-25T02:28:24.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.414+0000 7f3fb28bd640 1 -- 172.21.15.67:0/570489412 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3fac0ca9d0 con 0x7f3fac06e240 2024-04-25T02:28:24.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.802+0000 7f3fa8ff9640 1 -- 172.21.15.67:0/570489412 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f3f940594c0 con 0x7f3fac06e240 2024-04-25T02:28:24.806 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-04-25T02:28:24.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.804+0000 7f3fb28bd640 1 -- 172.21.15.67:0/570489412 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3f8c06be60 msgr2=0x7f3f8c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:24.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.805+0000 7f3fb28bd640 1 --2- 172.21.15.67:0/570489412 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3f8c06be60 0x7f3f8c06e320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3fac15db90 tx=0x7f3f9c007c80 comp rx=0 tx=0).stop 2024-04-25T02:28:24.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.805+0000 7f3fb28bd640 1 -- 172.21.15.67:0/570489412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fac06e240 msgr2=0x7f3fac09d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:24.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.805+0000 7f3fb28bd640 1 --2- 172.21.15.67:0/570489412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fac06e240 0x7f3fac09d600 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400d5f0 tx=0x7f3f9400dab0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.805+0000 7f3fb28bd640 1 -- 172.21.15.67:0/570489412 shutdown_connections 2024-04-25T02:28:24.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.805+0000 7f3fb28bd640 1 --2- 172.21.15.67:0/570489412 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3f8c06be60 0x7f3f8c06e320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.805+0000 7f3fb28bd640 1 --2- 172.21.15.67:0/570489412 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fac15e4e0 0x7f3fac0b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.805+0000 7f3fb28bd640 1 --2- 172.21.15.67:0/570489412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fac0af590 0x7f3fac0b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.805+0000 7f3fb28bd640 1 --2- 172.21.15.67:0/570489412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fac06e240 0x7f3fac09d600 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.805+0000 7f3fb28bd640 1 -- 172.21.15.67:0/570489412 >> 172.21.15.67:0/570489412 conn(0x7f3fac0d0090 msgr2=0x7f3fac06e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:24.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.805+0000 7f3fb28bd640 1 -- 172.21.15.67:0/570489412 shutdown_connections 2024-04-25T02:28:24.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.805+0000 7f3fb28bd640 1 -- 172.21.15.67:0/570489412 wait complete. 2024-04-25T02:28:24.827 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T02:28:24.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.935+0000 7fe9e0af5640 1 Processor -- start 2024-04-25T02:28:24.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.935+0000 7fe9e0af5640 1 -- start start 2024-04-25T02:28:24.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.935+0000 7fe9e0af5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe9dc15e460 0x7fe9dc162d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:24.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.935+0000 7fe9e0af5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe9dc0cfe00 0x7fe9dc0b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:24.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.935+0000 7fe9e0af5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9dc0b3850 con 0x7fe9dc162160 2024-04-25T02:28:24.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.935+0000 7fe9e0af5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe9dc0b1400 con 0x7fe9dc0cfe00 2024-04-25T02:28:24.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.935+0000 7fe9e0af5640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe9dc0d0270 con 0x7fe9dc15e460 2024-04-25T02:28:24.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.936+0000 7fe9d1d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe9dc0cfe00 0x7fe9dc0b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:24.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.936+0000 7fe9d1d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe9dc0cfe00 0x7fe9dc0b22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59176/0 (socket says 172.21.15.67:59176) 2024-04-25T02:28:24.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.936+0000 7fe9d1d9b640 1 -- 172.21.15.67:0/1102392595 learned_addr learned my addr 172.21.15.67:0/1102392595 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:24.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.936+0000 7fe9dad9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe9dc162160 0x7fe9dc162570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51148/0 (socket says 172.21.15.67:51148) 2024-04-25T02:28:24.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.936+0000 7fe9da59c640 1 --2- 172.21.15.67:0/1102392595 >> v2:172.21.15.176:3300/0 conn(0x7fe9dc15e460 0x7fe9dc162d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:24.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.936+0000 7fe9d1d9b640 1 -- 172.21.15.67:0/1102392595 >> v2:172.21.15.176:3300/0 conn(0x7fe9dc15e460 msgr2=0x7fe9dc162d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:24.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.936+0000 7fe9d1d9b640 1 --2- 172.21.15.67:0/1102392595 >> v2:172.21.15.176:3300/0 conn(0x7fe9dc15e460 0x7fe9dc162d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.936+0000 7fe9d1d9b640 1 -- 172.21.15.67:0/1102392595 >> v1:172.21.15.67:6789/0 conn(0x7fe9dc162160 legacy=0x7fe9dc162570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:24.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.936+0000 7fe9d1d9b640 1 -- 172.21.15.67:0/1102392595 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9dc0b1120 con 0x7fe9dc0cfe00 2024-04-25T02:28:24.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.936+0000 7fe9d9d9b640 1 -- 172.21.15.67:0/1102392595 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803332824 0 0) 0x7fe9dc0b3850 con 0x7fe9dc162160 2024-04-25T02:28:24.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.936+0000 7fe9da59c640 1 --2- 172.21.15.67:0/1102392595 >> v2:172.21.15.176:3300/0 conn(0x7fe9dc15e460 0x7fe9dc162d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:24.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.937+0000 7fe9d1d9b640 1 --2- 172.21.15.67:0/1102392595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9dc0cfe00 0x7fe9dc0b22c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc067e80 tx=0x7fe9c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43688b3dfb7a45aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:24.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.937+0000 7fe9d9d9b640 1 -- 172.21.15.67:0/1102392595 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4037070 con 0x7fe9dc0cfe00 2024-04-25T02:28:24.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.937+0000 7fe9d9d9b640 1 -- 172.21.15.67:0/1102392595 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c4032440 con 0x7fe9dc0cfe00 2024-04-25T02:28:24.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.937+0000 7fe9d9d9b640 1 -- 172.21.15.67:0/1102392595 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4032810 con 0x7fe9dc0cfe00 2024-04-25T02:28:24.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.937+0000 7fe9e0af5640 1 -- 172.21.15.67:0/1102392595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9dc0cfe00 msgr2=0x7fe9dc0b22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:24.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.937+0000 7fe9e0af5640 1 --2- 172.21.15.67:0/1102392595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9dc0cfe00 0x7fe9dc0b22c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc067e80 tx=0x7fe9c402a1e0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.937+0000 7fe9e0af5640 1 -- 172.21.15.67:0/1102392595 shutdown_connections 2024-04-25T02:28:24.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.937+0000 7fe9e0af5640 1 --2- 172.21.15.67:0/1102392595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9dc0cfe00 0x7fe9dc0b22c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.937+0000 7fe9e0af5640 1 --2- 172.21.15.67:0/1102392595 >> v2:172.21.15.176:3300/0 conn(0x7fe9dc15e460 0x7fe9dc162d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.937+0000 7fe9e0af5640 1 -- 172.21.15.67:0/1102392595 >> 172.21.15.67:0/1102392595 conn(0x7fe9dc09aa70 msgr2=0x7fe9dc09ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:24.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.937+0000 7fe9e0af5640 1 -- 172.21.15.67:0/1102392595 shutdown_connections 2024-04-25T02:28:24.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.937+0000 7fe9e0af5640 1 -- 172.21.15.67:0/1102392595 wait complete. 2024-04-25T02:28:24.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.939+0000 7fe9e0af5640 1 Processor -- start 2024-04-25T02:28:24.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.939+0000 7fe9e0af5640 1 -- start start 2024-04-25T02:28:24.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9e0af5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9dc0cfe00 0x7fe9dc14ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:24.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9e0af5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9dc15e460 0x7fe9dc09ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:24.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9e0af5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9dc162160 0x7fe9dc09b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:24.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9e0af5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe9dc0b2800 con 0x7fe9dc0cfe00 2024-04-25T02:28:24.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9e0af5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe9dc0b3570 con 0x7fe9dc15e460 2024-04-25T02:28:24.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9e0af5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe9dc15e840 con 0x7fe9dc162160 2024-04-25T02:28:24.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9da59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9dc0cfe00 0x7fe9dc14ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:24.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9da59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9dc0cfe00 0x7fe9dc14ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59186/0 (socket says 172.21.15.67:59186) 2024-04-25T02:28:24.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9da59c640 1 -- 172.21.15.67:0/4161579417 learned_addr learned my addr 172.21.15.67:0/4161579417 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:24.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9d1d9b640 1 --2- 172.21.15.67:0/4161579417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9dc15e460 0x7fe9dc09ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:24.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9dad9d640 1 --2- 172.21.15.67:0/4161579417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9dc162160 0x7fe9dc09b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:24.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9da59c640 1 -- 172.21.15.67:0/4161579417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9dc162160 msgr2=0x7fe9dc09b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:24.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9da59c640 1 --2- 172.21.15.67:0/4161579417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9dc162160 0x7fe9dc09b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9da59c640 1 -- 172.21.15.67:0/4161579417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9dc15e460 msgr2=0x7fe9dc09ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:24.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9da59c640 1 --2- 172.21.15.67:0/4161579417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9dc15e460 0x7fe9dc09ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:24.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9da59c640 1 -- 172.21.15.67:0/4161579417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9dc15bb90 con 0x7fe9dc0cfe00 2024-04-25T02:28:24.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9dad9d640 1 --2- 172.21.15.67:0/4161579417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9dc162160 0x7fe9dc09b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:24.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9d1d9b640 1 --2- 172.21.15.67:0/4161579417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9dc15e460 0x7fe9dc09ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:24.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9da59c640 1 --2- 172.21.15.67:0/4161579417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9dc0cfe00 0x7fe9dc14ba20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00e7e0 tx=0x7fe9cc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:24.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9d37fe640 1 -- 172.21.15.67:0/4161579417 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc00f040 con 0x7fe9dc0cfe00 2024-04-25T02:28:24.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9d37fe640 1 -- 172.21.15.67:0/4161579417 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9cc004030 con 0x7fe9dc0cfe00 2024-04-25T02:28:24.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9e0af5640 1 -- 172.21.15.67:0/4161579417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9dc15be70 con 0x7fe9dc0cfe00 2024-04-25T02:28:24.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9d37fe640 1 -- 172.21.15.67:0/4161579417 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc004400 con 0x7fe9dc0cfe00 2024-04-25T02:28:24.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.940+0000 7fe9e0af5640 1 -- 172.21.15.67:0/4161579417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9dc15ea90 con 0x7fe9dc0cfe00 2024-04-25T02:28:24.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.941+0000 7fe9e0af5640 1 -- 172.21.15.67:0/4161579417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9dc069110 con 0x7fe9dc0cfe00 2024-04-25T02:28:24.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.942+0000 7fe9d37fe640 1 -- 172.21.15.67:0/4161579417 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe9cc00c6d0 con 0x7fe9dc0cfe00 2024-04-25T02:28:24.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.942+0000 7fe9d37fe640 1 --2- 172.21.15.67:0/4161579417 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe9bc06be60 0x7fe9bc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:24.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.942+0000 7fe9d37fe640 1 -- 172.21.15.67:0/4161579417 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fe9cc08aa90 con 0x7fe9dc0cfe00 2024-04-25T02:28:24.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.942+0000 7fe9d1d9b640 1 --2- 172.21.15.67:0/4161579417 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe9bc06be60 0x7fe9bc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:24.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.943+0000 7fe9d1d9b640 1 --2- 172.21.15.67:0/4161579417 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe9bc06be60 0x7fe9bc06e320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4034000 tx=0x7fe9c402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:24.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:24.947+0000 7fe9d37fe640 1 -- 172.21.15.67:0/4161579417 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe9cc017020 con 0x7fe9dc0cfe00 2024-04-25T02:28:25.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.130+0000 7fe9e0af5640 1 -- 172.21.15.67:0/4161579417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe9dc070700 con 0x7fe9dc0cfe00 2024-04-25T02:28:25.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.808+0000 7fe9d37fe640 1 -- 172.21.15.67:0/4161579417 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7fe9cc059620 con 0x7fe9dc0cfe00 2024-04-25T02:28:25.812 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-04-25T02:28:25.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.811+0000 7fe9e0af5640 1 -- 172.21.15.67:0/4161579417 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe9bc06be60 msgr2=0x7fe9bc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:25.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.811+0000 7fe9e0af5640 1 --2- 172.21.15.67:0/4161579417 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe9bc06be60 0x7fe9bc06e320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4034000 tx=0x7fe9c402e000 comp rx=0 tx=0).stop 2024-04-25T02:28:25.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.811+0000 7fe9e0af5640 1 -- 172.21.15.67:0/4161579417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9dc0cfe00 msgr2=0x7fe9dc14ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:25.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.811+0000 7fe9e0af5640 1 --2- 172.21.15.67:0/4161579417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9dc0cfe00 0x7fe9dc14ba20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00e7e0 tx=0x7fe9cc00eca0 comp rx=0 tx=0).stop 2024-04-25T02:28:25.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.812+0000 7fe9e0af5640 1 -- 172.21.15.67:0/4161579417 shutdown_connections 2024-04-25T02:28:25.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.812+0000 7fe9e0af5640 1 --2- 172.21.15.67:0/4161579417 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe9bc06be60 0x7fe9bc06e320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:25.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.812+0000 7fe9e0af5640 1 --2- 172.21.15.67:0/4161579417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9dc162160 0x7fe9dc09b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:25.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.812+0000 7fe9e0af5640 1 --2- 172.21.15.67:0/4161579417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9dc15e460 0x7fe9dc09ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:25.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.812+0000 7fe9e0af5640 1 --2- 172.21.15.67:0/4161579417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9dc0cfe00 0x7fe9dc14ba20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:25.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.812+0000 7fe9e0af5640 1 -- 172.21.15.67:0/4161579417 >> 172.21.15.67:0/4161579417 conn(0x7fe9dc09aa70 msgr2=0x7fe9dc15cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:25.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.812+0000 7fe9e0af5640 1 -- 172.21.15.67:0/4161579417 shutdown_connections 2024-04-25T02:28:25.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.813+0000 7fe9e0af5640 1 -- 172.21.15.67:0/4161579417 wait complete. 2024-04-25T02:28:25.843 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T02:28:25.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.949+0000 7f277ec15640 1 Processor -- start 2024-04-25T02:28:25.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.950+0000 7f277ec15640 1 -- start start 2024-04-25T02:28:25.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.950+0000 7f277ec15640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f277815bfc0 0x7f27780ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:25.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.950+0000 7f277ec15640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f277815e9f0 0x7f277806d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:25.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.950+0000 7f277ec15640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f277815c3a0 con 0x7f27780d0210 2024-04-25T02:28:25.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.950+0000 7f277ec15640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f27780d0760 con 0x7f277815bfc0 2024-04-25T02:28:25.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.950+0000 7f277ec15640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f27780d0a40 con 0x7f277815e9f0 2024-04-25T02:28:25.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.951+0000 7f277c9b1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f277815bfc0 0x7f27780ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:25.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.951+0000 7f277c9b1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f277815bfc0 0x7f27780ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59200/0 (socket says 172.21.15.67:59200) 2024-04-25T02:28:25.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.951+0000 7f277c9b1640 1 -- 172.21.15.67:0/1457332371 learned_addr learned my addr 172.21.15.67:0/1457332371 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:25.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.951+0000 7f277d1b2640 1 --2- 172.21.15.67:0/1457332371 >> v2:172.21.15.176:3300/0 conn(0x7f277815e9f0 0x7f277806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:25.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.951+0000 7f277c9b1640 1 -- 172.21.15.67:0/1457332371 >> v2:172.21.15.176:3300/0 conn(0x7f277815e9f0 msgr2=0x7f277806d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:25.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.951+0000 7f277c9b1640 1 --2- 172.21.15.67:0/1457332371 >> v2:172.21.15.176:3300/0 conn(0x7f277815e9f0 0x7f277806d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:25.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.951+0000 7f277c9b1640 1 -- 172.21.15.67:0/1457332371 >> v1:172.21.15.176:6789/0 conn(0x7f27780d0210 legacy=0x7f2778161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:25.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.951+0000 7f277c9b1640 1 -- 172.21.15.67:0/1457332371 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27780d0d20 con 0x7f277815bfc0 2024-04-25T02:28:25.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.951+0000 7f277d1b2640 1 --2- 172.21.15.67:0/1457332371 >> v2:172.21.15.176:3300/0 conn(0x7f277815e9f0 0x7f277806d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:25.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.952+0000 7f277c9b1640 1 --2- 172.21.15.67:0/1457332371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f277815bfc0 0x7f27780ce750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f277806d7b0 tx=0x7f276c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c69f2978de0093 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:25.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.952+0000 7f27777fe640 1 -- 172.21.15.67:0/1457332371 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c037070 con 0x7f277815bfc0 2024-04-25T02:28:25.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.952+0000 7f27777fe640 1 -- 172.21.15.67:0/1457332371 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276c032440 con 0x7f277815bfc0 2024-04-25T02:28:25.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.952+0000 7f27777fe640 1 -- 172.21.15.67:0/1457332371 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c032810 con 0x7f277815bfc0 2024-04-25T02:28:25.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.952+0000 7f277ec15640 1 -- 172.21.15.67:0/1457332371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f277815bfc0 msgr2=0x7f27780ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:25.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.952+0000 7f277ec15640 1 --2- 172.21.15.67:0/1457332371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f277815bfc0 0x7f27780ce750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f277806d7b0 tx=0x7f276c02a270 comp rx=0 tx=0).stop 2024-04-25T02:28:25.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.952+0000 7f277ec15640 1 -- 172.21.15.67:0/1457332371 shutdown_connections 2024-04-25T02:28:25.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.952+0000 7f277ec15640 1 --2- 172.21.15.67:0/1457332371 >> v2:172.21.15.176:3300/0 conn(0x7f277815e9f0 0x7f277806d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:25.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.952+0000 7f277ec15640 1 --2- 172.21.15.67:0/1457332371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f277815bfc0 0x7f27780ce750 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:25.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.952+0000 7f277ec15640 1 -- 172.21.15.67:0/1457332371 >> 172.21.15.67:0/1457332371 conn(0x7f27780d1ed0 msgr2=0x7f27780d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:25.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.952+0000 7f277ec15640 1 -- 172.21.15.67:0/1457332371 shutdown_connections 2024-04-25T02:28:25.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.952+0000 7f277ec15640 1 -- 172.21.15.67:0/1457332371 wait complete. 2024-04-25T02:28:25.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.953+0000 7f277ec15640 1 Processor -- start 2024-04-25T02:28:25.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.954+0000 7f277ec15640 1 -- start start 2024-04-25T02:28:25.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.954+0000 7f277ec15640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27780d0210 0x7f2778150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:25.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.954+0000 7f277ec15640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f277815bfc0 0x7f27781543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:25.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.954+0000 7f277ec15640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f277815e9f0 0x7f27780afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:25.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.954+0000 7f277ec15640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f27780cf690 con 0x7f277815e9f0 2024-04-25T02:28:25.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.954+0000 7f277ec15640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f27780d12e0 con 0x7f277815bfc0 2024-04-25T02:28:25.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.955+0000 7f277ec15640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f27780cf810 con 0x7f27780d0210 2024-04-25T02:28:25.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.955+0000 7f277d1b2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f277815e9f0 0x7f27780afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:25.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.955+0000 7f277d1b2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f277815e9f0 0x7f27780afef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59210/0 (socket says 172.21.15.67:59210) 2024-04-25T02:28:25.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.955+0000 7f277d1b2640 1 -- 172.21.15.67:0/4105639796 learned_addr learned my addr 172.21.15.67:0/4105639796 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:25.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.955+0000 7f277c9b1640 1 --2- 172.21.15.67:0/4105639796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27780d0210 0x7f2778150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:25.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.955+0000 7f2777fff640 1 --2- 172.21.15.67:0/4105639796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f277815bfc0 0x7f27781543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:25.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.955+0000 7f277d1b2640 1 -- 172.21.15.67:0/4105639796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27780d0210 msgr2=0x7f2778150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:25.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.955+0000 7f277d1b2640 1 --2- 172.21.15.67:0/4105639796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27780d0210 0x7f2778150600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:25.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.955+0000 7f277d1b2640 1 -- 172.21.15.67:0/4105639796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f277815bfc0 msgr2=0x7f27781543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:25.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.955+0000 7f277d1b2640 1 --2- 172.21.15.67:0/4105639796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f277815bfc0 0x7f27781543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:25.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.955+0000 7f277d1b2640 1 -- 172.21.15.67:0/4105639796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27781570e0 con 0x7f277815e9f0 2024-04-25T02:28:25.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.955+0000 7f277d1b2640 1 --2- 172.21.15.67:0/4105639796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f277815e9f0 0x7f27780afef0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2770007df0 tx=0x7f277000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:25.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.955+0000 7f27757fa640 1 -- 172.21.15.67:0/4105639796 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277001a070 con 0x7f277815e9f0 2024-04-25T02:28:25.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.955+0000 7f27757fa640 1 -- 172.21.15.67:0/4105639796 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2770003990 con 0x7f277815e9f0 2024-04-25T02:28:25.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.955+0000 7f277ec15640 1 -- 172.21.15.67:0/4105639796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27781573c0 con 0x7f277815e9f0 2024-04-25T02:28:25.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.955+0000 7f27757fa640 1 -- 172.21.15.67:0/4105639796 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770003d80 con 0x7f277815e9f0 2024-04-25T02:28:25.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.955+0000 7f277ec15640 1 -- 172.21.15.67:0/4105639796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27780af9d0 con 0x7f277815e9f0 2024-04-25T02:28:25.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.956+0000 7f277ec15640 1 -- 172.21.15.67:0/4105639796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27780afbd0 con 0x7f277815e9f0 2024-04-25T02:28:25.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.957+0000 7f27757fa640 1 -- 172.21.15.67:0/4105639796 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f277001d070 con 0x7f277815e9f0 2024-04-25T02:28:25.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.957+0000 7f27757fa640 1 --2- 172.21.15.67:0/4105639796 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f275c06be30 0x7f275c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:25.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.957+0000 7f27757fa640 1 -- 172.21.15.67:0/4105639796 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f277008b080 con 0x7f277815e9f0 2024-04-25T02:28:25.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.957+0000 7f277c9b1640 1 --2- 172.21.15.67:0/4105639796 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f275c06be30 0x7f275c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:25.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.958+0000 7f277c9b1640 1 --2- 172.21.15.67:0/4105639796 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f275c06be30 0x7f275c06e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f276c034000 tx=0x7f276c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:25.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:25.962+0000 7f27757fa640 1 -- 172.21.15.67:0/4105639796 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2770010070 con 0x7f277815e9f0 2024-04-25T02:28:26.171 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:28:26.173 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:28:26.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.182+0000 7f277ec15640 1 -- 172.21.15.67:0/4105639796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2778069110 con 0x7f277815e9f0 2024-04-25T02:28:26.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.821+0000 7f27757fa640 1 -- 172.21.15.67:0/4105639796 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f2770059aa0 con 0x7f277815e9f0 2024-04-25T02:28:26.825 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T02:28:26.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.836+0000 7f277ec15640 1 -- 172.21.15.67:0/4105639796 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f275c06be30 msgr2=0x7f275c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:26.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.837+0000 7f277ec15640 1 --2- 172.21.15.67:0/4105639796 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f275c06be30 0x7f275c06e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f276c034000 tx=0x7f276c02e000 comp rx=0 tx=0).stop 2024-04-25T02:28:26.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.837+0000 7f277ec15640 1 -- 172.21.15.67:0/4105639796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f277815e9f0 msgr2=0x7f27780afef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:26.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.837+0000 7f277ec15640 1 --2- 172.21.15.67:0/4105639796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f277815e9f0 0x7f27780afef0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2770007df0 tx=0x7f277000d4a0 comp rx=0 tx=0).stop 2024-04-25T02:28:26.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.837+0000 7f277ec15640 1 -- 172.21.15.67:0/4105639796 shutdown_connections 2024-04-25T02:28:26.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.837+0000 7f277ec15640 1 --2- 172.21.15.67:0/4105639796 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f275c06be30 0x7f275c06e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:26.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.837+0000 7f277ec15640 1 --2- 172.21.15.67:0/4105639796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f277815e9f0 0x7f27780afef0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:26.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.837+0000 7f277ec15640 1 --2- 172.21.15.67:0/4105639796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f277815bfc0 0x7f27781543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:26.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.837+0000 7f277ec15640 1 --2- 172.21.15.67:0/4105639796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27780d0210 0x7f2778150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:26.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.837+0000 7f277ec15640 1 -- 172.21.15.67:0/4105639796 >> 172.21.15.67:0/4105639796 conn(0x7f27780d1ed0 msgr2=0x7f277815b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:26.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.840+0000 7f277ec15640 1 -- 172.21.15.67:0/4105639796 shutdown_connections 2024-04-25T02:28:26.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.841+0000 7f277ec15640 1 -- 172.21.15.67:0/4105639796 wait complete. 2024-04-25T02:28:26.858 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:26.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.964+0000 7f77c1190640 1 Processor -- start 2024-04-25T02:28:26.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.964+0000 7f77c1190640 1 -- start start 2024-04-25T02:28:26.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.965+0000 7f77c1190640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77bc15c2e0 0x7f77bc0cd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:26.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.965+0000 7f77c1190640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77bc0ce7a0 0x7f77bc0cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:26.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.965+0000 7f77c1190640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77bc0cf820 con 0x7f77bc0d29f0 2024-04-25T02:28:26.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.965+0000 7f77c1190640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f77bc0cde90 con 0x7f77bc15c2e0 2024-04-25T02:28:26.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.965+0000 7f77c1190640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f77bc0d0220 con 0x7f77bc0ce7a0 2024-04-25T02:28:26.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.965+0000 7f77bad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77bc15c2e0 0x7f77bc0cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:26.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.965+0000 7f77bad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77bc15c2e0 0x7f77bc0cd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59226/0 (socket says 172.21.15.67:59226) 2024-04-25T02:28:26.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.965+0000 7f77bad9d640 1 -- 172.21.15.67:0/2635107788 learned_addr learned my addr 172.21.15.67:0/2635107788 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:26.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.965+0000 7f77bb59e640 1 --2- 172.21.15.67:0/2635107788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77bc0ce7a0 0x7f77bc0cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:26.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.965+0000 7f77bad9d640 1 -- 172.21.15.67:0/2635107788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77bc0ce7a0 msgr2=0x7f77bc0cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:26.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.965+0000 7f77bad9d640 1 --2- 172.21.15.67:0/2635107788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77bc0ce7a0 0x7f77bc0cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:26.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.965+0000 7f77bad9d640 1 -- 172.21.15.67:0/2635107788 >> v1:172.21.15.176:6789/0 conn(0x7f77bc0d29f0 legacy=0x7f77bc0d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:26.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.965+0000 7f77bad9d640 1 -- 172.21.15.67:0/2635107788 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77bc15c6c0 con 0x7f77bc15c2e0 2024-04-25T02:28:26.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.965+0000 7f77bb59e640 1 --2- 172.21.15.67:0/2635107788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77bc0ce7a0 0x7f77bc0cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:26.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.966+0000 7f77bad9d640 1 --2- 172.21.15.67:0/2635107788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77bc15c2e0 0x7f77bc0cd580 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f77b4009870 tx=0x7f77b402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a5ff16b184ecff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:26.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.966+0000 7f77b9d9b640 1 -- 172.21.15.67:0/2635107788 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b4037070 con 0x7f77bc15c2e0 2024-04-25T02:28:26.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.966+0000 7f77b9d9b640 1 -- 172.21.15.67:0/2635107788 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b402ae10 con 0x7f77bc15c2e0 2024-04-25T02:28:26.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.966+0000 7f77b9d9b640 1 -- 172.21.15.67:0/2635107788 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b4032660 con 0x7f77bc15c2e0 2024-04-25T02:28:26.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.967+0000 7f77c1190640 1 -- 172.21.15.67:0/2635107788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77bc15c2e0 msgr2=0x7f77bc0cd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:26.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.967+0000 7f77c1190640 1 --2- 172.21.15.67:0/2635107788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77bc15c2e0 0x7f77bc0cd580 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f77b4009870 tx=0x7f77b402a100 comp rx=0 tx=0).stop 2024-04-25T02:28:26.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.967+0000 7f77c1190640 1 -- 172.21.15.67:0/2635107788 shutdown_connections 2024-04-25T02:28:26.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.967+0000 7f77c1190640 1 --2- 172.21.15.67:0/2635107788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77bc0ce7a0 0x7f77bc0cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:26.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.967+0000 7f77c1190640 1 --2- 172.21.15.67:0/2635107788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77bc15c2e0 0x7f77bc0cd580 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:26.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.967+0000 7f77c1190640 1 -- 172.21.15.67:0/2635107788 >> 172.21.15.67:0/2635107788 conn(0x7f77bc0d1ed0 msgr2=0x7f77bc0d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:26.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.967+0000 7f77c1190640 1 -- 172.21.15.67:0/2635107788 shutdown_connections 2024-04-25T02:28:26.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.967+0000 7f77c1190640 1 -- 172.21.15.67:0/2635107788 wait complete. 2024-04-25T02:28:26.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.968+0000 7f77c1190640 1 Processor -- start 2024-04-25T02:28:26.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.968+0000 7f77c1190640 1 -- start start 2024-04-25T02:28:26.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.969+0000 7f77c1190640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77bc0ce7a0 0x7f77bc1516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:26.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.969+0000 7f77c1190640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77bc0d29f0 0x7f77bc09f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:26.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.969+0000 7f77c1190640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77bc15c2e0 0x7f77bc0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:26.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.969+0000 7f77c1190640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc0cfbd0 con 0x7f77bc0ce7a0 2024-04-25T02:28:26.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.969+0000 7f77c1190640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc0cdbb0 con 0x7f77bc15c2e0 2024-04-25T02:28:26.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.969+0000 7f77c1190640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f77bc0cfeb0 con 0x7f77bc0d29f0 2024-04-25T02:28:26.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.969+0000 7f77bad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77bc0ce7a0 0x7f77bc1516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:26.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.969+0000 7f77bad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77bc0ce7a0 0x7f77bc1516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59242/0 (socket says 172.21.15.67:59242) 2024-04-25T02:28:26.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.969+0000 7f77bad9d640 1 -- 172.21.15.67:0/1844093107 learned_addr learned my addr 172.21.15.67:0/1844093107 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:26.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.969+0000 7f77ba59c640 1 --2- 172.21.15.67:0/1844093107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77bc0d29f0 0x7f77bc09f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:26.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.969+0000 7f77bb59e640 1 --2- 172.21.15.67:0/1844093107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77bc15c2e0 0x7f77bc0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:26.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.970+0000 7f77bad9d640 1 -- 172.21.15.67:0/1844093107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77bc0d29f0 msgr2=0x7f77bc09f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:26.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.970+0000 7f77bad9d640 1 --2- 172.21.15.67:0/1844093107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77bc0d29f0 0x7f77bc09f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:26.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.970+0000 7f77bad9d640 1 -- 172.21.15.67:0/1844093107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77bc15c2e0 msgr2=0x7f77bc0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:26.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.970+0000 7f77bad9d640 1 --2- 172.21.15.67:0/1844093107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77bc15c2e0 0x7f77bc0cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:26.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.970+0000 7f77bad9d640 1 -- 172.21.15.67:0/1844093107 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77bc06c300 con 0x7f77bc0ce7a0 2024-04-25T02:28:26.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.970+0000 7f77bad9d640 1 --2- 172.21.15.67:0/1844093107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77bc0ce7a0 0x7f77bc1516f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f77b4000c00 tx=0x7f77b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:26.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.970+0000 7f77b37fe640 1 -- 172.21.15.67:0/1844093107 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b4041070 con 0x7f77bc0ce7a0 2024-04-25T02:28:26.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.970+0000 7f77b37fe640 1 -- 172.21.15.67:0/1844093107 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b403c670 con 0x7f77bc0ce7a0 2024-04-25T02:28:26.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.970+0000 7f77c1190640 1 -- 172.21.15.67:0/1844093107 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77bc06c5e0 con 0x7f77bc0ce7a0 2024-04-25T02:28:26.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.970+0000 7f77b37fe640 1 -- 172.21.15.67:0/1844093107 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b4037040 con 0x7f77bc0ce7a0 2024-04-25T02:28:26.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.970+0000 7f77c1190640 1 -- 172.21.15.67:0/1844093107 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77bc06cba0 con 0x7f77bc0ce7a0 2024-04-25T02:28:26.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.971+0000 7f77c1190640 1 -- 172.21.15.67:0/1844093107 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77bc069110 con 0x7f77bc0ce7a0 2024-04-25T02:28:26.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.972+0000 7f77b37fe640 1 -- 172.21.15.67:0/1844093107 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f77b4044070 con 0x7f77bc0ce7a0 2024-04-25T02:28:26.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.972+0000 7f77b37fe640 1 --2- 172.21.15.67:0/1844093107 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f779c06be30 0x7f779c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:26.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.972+0000 7f77b37fe640 1 -- 172.21.15.67:0/1844093107 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f77b40ab570 con 0x7f77bc0ce7a0 2024-04-25T02:28:26.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.972+0000 7f77ba59c640 1 --2- 172.21.15.67:0/1844093107 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f779c06be30 0x7f779c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:26.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.973+0000 7f77ba59c640 1 --2- 172.21.15.67:0/1844093107 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f779c06be30 0x7f779c06e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0b7830 tx=0x7f77a4009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:26.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:26.976+0000 7f77b37fe640 1 -- 172.21.15.67:0/1844093107 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f77bc0cf820 con 0x7f77bc0ce7a0 2024-04-25T02:28:27.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.160+0000 7f77c1190640 1 -- 172.21.15.67:0/1844093107 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77bc0b7e50 con 0x7f77bc0ce7a0 2024-04-25T02:28:27.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.161+0000 7f77b37fe640 1 -- 172.21.15.67:0/1844093107 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16594 (secure 0 0 0) 0x7f77b4079a80 con 0x7f77bc0ce7a0 2024-04-25T02:28:27.165 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:27.165 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":19,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:26.183864+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:27.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.164+0000 7f77c1190640 1 -- 172.21.15.67:0/1844093107 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f779c06be30 msgr2=0x7f779c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:27.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.164+0000 7f77c1190640 1 --2- 172.21.15.67:0/1844093107 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f779c06be30 0x7f779c06e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0b7830 tx=0x7f77a4009060 comp rx=0 tx=0).stop 2024-04-25T02:28:27.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.164+0000 7f77c1190640 1 -- 172.21.15.67:0/1844093107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77bc0ce7a0 msgr2=0x7f77bc1516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:27.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.164+0000 7f77c1190640 1 --2- 172.21.15.67:0/1844093107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77bc0ce7a0 0x7f77bc1516f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f77b4000c00 tx=0x7f77b40046c0 comp rx=0 tx=0).stop 2024-04-25T02:28:27.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.164+0000 7f77c1190640 1 -- 172.21.15.67:0/1844093107 shutdown_connections 2024-04-25T02:28:27.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.164+0000 7f77c1190640 1 --2- 172.21.15.67:0/1844093107 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f779c06be30 0x7f779c06e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:27.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.164+0000 7f77c1190640 1 --2- 172.21.15.67:0/1844093107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77bc15c2e0 0x7f77bc0cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:27.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.164+0000 7f77c1190640 1 --2- 172.21.15.67:0/1844093107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77bc0d29f0 0x7f77bc09f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:27.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.164+0000 7f77c1190640 1 --2- 172.21.15.67:0/1844093107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77bc0ce7a0 0x7f77bc1516f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:27.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.164+0000 7f77c1190640 1 -- 172.21.15.67:0/1844093107 >> 172.21.15.67:0/1844093107 conn(0x7f77bc0d1ed0 msgr2=0x7f77bc0c5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:27.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.164+0000 7f77c1190640 1 -- 172.21.15.67:0/1844093107 shutdown_connections 2024-04-25T02:28:27.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.164+0000 7f77c1190640 1 -- 172.21.15.67:0/1844093107 wait complete. 2024-04-25T02:28:27.178 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:27.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.275+0000 7f69ad0ee640 1 Processor -- start 2024-04-25T02:28:27.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.275+0000 7f69ad0ee640 1 -- start start 2024-04-25T02:28:27.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.276+0000 7f69ad0ee640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f69a80b3cd0 0x7f69a8165fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:27.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.276+0000 7f69ad0ee640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69a815fa90 con 0x7f69a8070df0 2024-04-25T02:28:27.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.276+0000 7f69ad0ee640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69a80713d0 con 0x7f69a815b220 2024-04-25T02:28:27.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.276+0000 7f69ad0ee640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f69a80aee00 con 0x7f69a80b3cd0 2024-04-25T02:28:27.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.276+0000 7f69a759e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f69a80b3cd0 0x7f69a8165fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:27.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.276+0000 7f69a759e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f69a80b3cd0 0x7f69a8165fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59252/0 (socket says 172.21.15.67:59252) 2024-04-25T02:28:27.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.276+0000 7f69a759e640 1 -- 172.21.15.67:0/2395876934 learned_addr learned my addr 172.21.15.67:0/2395876934 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:27.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.277+0000 7f69a759e640 1 -- 172.21.15.67:0/2395876934 >> v1:172.21.15.176:6789/0 conn(0x7f69a815b220 legacy=0x7f69a815ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:27.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.277+0000 7f69a759e640 1 -- 172.21.15.67:0/2395876934 >> v1:172.21.15.67:6789/0 conn(0x7f69a8070df0 legacy=0x7f69a815f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:27.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.277+0000 7f69a759e640 1 -- 172.21.15.67:0/2395876934 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a80ae4d0 con 0x7f69a80b3cd0 2024-04-25T02:28:27.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.277+0000 7f69a759e640 1 --2- 172.21.15.67:0/2395876934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69a80b3cd0 0x7f69a8165fa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009e50 tx=0x7f69a002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59c981281192a82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:27.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.277+0000 7f69a659c640 1 -- 172.21.15.67:0/2395876934 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a0036070 con 0x7f69a80b3cd0 2024-04-25T02:28:27.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.278+0000 7f69a659c640 1 -- 172.21.15.67:0/2395876934 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a0031600 con 0x7f69a80b3cd0 2024-04-25T02:28:27.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.278+0000 7f69a659c640 1 -- 172.21.15.67:0/2395876934 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a00319d0 con 0x7f69a80b3cd0 2024-04-25T02:28:27.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.278+0000 7f69ad0ee640 1 -- 172.21.15.67:0/2395876934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69a80b3cd0 msgr2=0x7f69a8165fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:27.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.278+0000 7f69ad0ee640 1 --2- 172.21.15.67:0/2395876934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69a80b3cd0 0x7f69a8165fa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009e50 tx=0x7f69a002a6c0 comp rx=0 tx=0).stop 2024-04-25T02:28:27.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.278+0000 7f69ad0ee640 1 -- 172.21.15.67:0/2395876934 shutdown_connections 2024-04-25T02:28:27.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.278+0000 7f69ad0ee640 1 --2- 172.21.15.67:0/2395876934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69a80b3cd0 0x7f69a8165fa0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:27.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.278+0000 7f69ad0ee640 1 -- 172.21.15.67:0/2395876934 >> 172.21.15.67:0/2395876934 conn(0x7f69a80b19c0 msgr2=0x7f69a80b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:27.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.278+0000 7f69ad0ee640 1 -- 172.21.15.67:0/2395876934 shutdown_connections 2024-04-25T02:28:27.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.278+0000 7f69ad0ee640 1 -- 172.21.15.67:0/2395876934 wait complete. 2024-04-25T02:28:27.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.279+0000 7f69ad0ee640 1 Processor -- start 2024-04-25T02:28:27.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.279+0000 7f69ad0ee640 1 -- start start 2024-04-25T02:28:27.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.280+0000 7f69ad0ee640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69a8070df0 0x7f69a8147760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:27.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.280+0000 7f69ad0ee640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69a80b3cd0 0x7f69a8158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:27.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.280+0000 7f69ad0ee640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69a815b220 0x7f69a809ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:27.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.280+0000 7f69ad0ee640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f69a806eb90 con 0x7f69a815b220 2024-04-25T02:28:27.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.280+0000 7f69ad0ee640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f69a80aea90 con 0x7f69a8070df0 2024-04-25T02:28:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.280+0000 7f69ad0ee640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f69a806ed10 con 0x7f69a80b3cd0 2024-04-25T02:28:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.280+0000 7f69a759e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69a815b220 0x7f69a809ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.280+0000 7f69a759e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69a815b220 0x7f69a809ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59256/0 (socket says 172.21.15.67:59256) 2024-04-25T02:28:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.280+0000 7f69a759e640 1 -- 172.21.15.67:0/833014057 learned_addr learned my addr 172.21.15.67:0/833014057 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.280+0000 7f69a6d9d640 1 --2- 172.21.15.67:0/833014057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69a8070df0 0x7f69a8147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.280+0000 7f699ffff640 1 --2- 172.21.15.67:0/833014057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69a80b3cd0 0x7f69a8158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.281+0000 7f69a759e640 1 -- 172.21.15.67:0/833014057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69a80b3cd0 msgr2=0x7f69a8158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.281+0000 7f69a759e640 1 --2- 172.21.15.67:0/833014057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69a80b3cd0 0x7f69a8158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.281+0000 7f69a759e640 1 -- 172.21.15.67:0/833014057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69a8070df0 msgr2=0x7f69a8147760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.281+0000 7f69a759e640 1 --2- 172.21.15.67:0/833014057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69a8070df0 0x7f69a8147760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.281+0000 7f69a759e640 1 -- 172.21.15.67:0/833014057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a8147ca0 con 0x7f69a815b220 2024-04-25T02:28:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.281+0000 7f69a759e640 1 --2- 172.21.15.67:0/833014057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69a815b220 0x7f69a809ca80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f69a0034040 tx=0x7f69a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.281+0000 7f699f7fe640 1 -- 172.21.15.67:0/833014057 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a0036050 con 0x7f69a815b220 2024-04-25T02:28:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.281+0000 7f699f7fe640 1 -- 172.21.15.67:0/833014057 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a0042070 con 0x7f69a815b220 2024-04-25T02:28:27.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.281+0000 7f69ad0ee640 1 -- 172.21.15.67:0/833014057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a8157510 con 0x7f69a815b220 2024-04-25T02:28:27.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.281+0000 7f699f7fe640 1 -- 172.21.15.67:0/833014057 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a0009510 con 0x7f69a815b220 2024-04-25T02:28:27.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.281+0000 7f69ad0ee640 1 -- 172.21.15.67:0/833014057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a8157ad0 con 0x7f69a815b220 2024-04-25T02:28:27.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.282+0000 7f69ad0ee640 1 -- 172.21.15.67:0/833014057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69a8069110 con 0x7f69a815b220 2024-04-25T02:28:27.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.282+0000 7f699f7fe640 1 -- 172.21.15.67:0/833014057 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f69a0007bd0 con 0x7f69a815b220 2024-04-25T02:28:27.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.283+0000 7f699f7fe640 1 --2- 172.21.15.67:0/833014057 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f698806be30 0x7f698806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:27.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.283+0000 7f699f7fe640 1 -- 172.21.15.67:0/833014057 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f69a00abc20 con 0x7f69a815b220 2024-04-25T02:28:27.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.283+0000 7f69a6d9d640 1 --2- 172.21.15.67:0/833014057 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f698806be30 0x7f698806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:27.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.284+0000 7f69a6d9d640 1 --2- 172.21.15.67:0/833014057 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f698806be30 0x7f698806e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f69980016e0 tx=0x7f6998009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:27.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.287+0000 7f699f7fe640 1 -- 172.21.15.67:0/833014057 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f69a8147ca0 con 0x7f69a815b220 2024-04-25T02:28:27.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.470+0000 7f69ad0ee640 1 -- 172.21.15.67:0/833014057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69a815ad90 con 0x7f69a815b220 2024-04-25T02:28:27.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.471+0000 7f699f7fe640 1 -- 172.21.15.67:0/833014057 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16594 (secure 0 0 0) 0x7f69a002ae20 con 0x7f69a815b220 2024-04-25T02:28:27.475 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:27.475 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":19,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:26.183864+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:27.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.473+0000 7f69ad0ee640 1 -- 172.21.15.67:0/833014057 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f698806be30 msgr2=0x7f698806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:27.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.473+0000 7f69ad0ee640 1 --2- 172.21.15.67:0/833014057 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f698806be30 0x7f698806e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f69980016e0 tx=0x7f6998009040 comp rx=0 tx=0).stop 2024-04-25T02:28:27.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.473+0000 7f69ad0ee640 1 -- 172.21.15.67:0/833014057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69a815b220 msgr2=0x7f69a809ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:27.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.473+0000 7f69ad0ee640 1 --2- 172.21.15.67:0/833014057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69a815b220 0x7f69a809ca80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f69a0034040 tx=0x7f69a0004a40 comp rx=0 tx=0).stop 2024-04-25T02:28:27.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.473+0000 7f69ad0ee640 1 -- 172.21.15.67:0/833014057 shutdown_connections 2024-04-25T02:28:27.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.473+0000 7f69ad0ee640 1 --2- 172.21.15.67:0/833014057 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f698806be30 0x7f698806e2f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:27.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.473+0000 7f69ad0ee640 1 --2- 172.21.15.67:0/833014057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69a815b220 0x7f69a809ca80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:27.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.473+0000 7f69ad0ee640 1 --2- 172.21.15.67:0/833014057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69a80b3cd0 0x7f69a8158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:27.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.473+0000 7f69ad0ee640 1 --2- 172.21.15.67:0/833014057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69a8070df0 0x7f69a8147760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:27.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.473+0000 7f69ad0ee640 1 -- 172.21.15.67:0/833014057 >> 172.21.15.67:0/833014057 conn(0x7f69a80b19c0 msgr2=0x7f69a80b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:27.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.473+0000 7f69ad0ee640 1 -- 172.21.15.67:0/833014057 shutdown_connections 2024-04-25T02:28:27.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.473+0000 7f69ad0ee640 1 -- 172.21.15.67:0/833014057 wait complete. 2024-04-25T02:28:27.488 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T02:28:27.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.588+0000 7f9f6f7c8640 1 Processor -- start 2024-04-25T02:28:27.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.588+0000 7f9f6f7c8640 1 -- start start 2024-04-25T02:28:27.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.589+0000 7f9f6f7c8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f6815bfc0 0x7f9f680ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:27.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.589+0000 7f9f6f7c8640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9f680d0210 0x7f9f680cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:27.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.589+0000 7f9f6f7c8640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f6815c3a0 con 0x7f9f6815e9f0 2024-04-25T02:28:27.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.589+0000 7f9f6f7c8640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f9f680d0760 con 0x7f9f680d0210 2024-04-25T02:28:27.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.589+0000 7f9f6f7c8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9f680d0a40 con 0x7f9f6815bfc0 2024-04-25T02:28:27.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.589+0000 7f9f6cd63640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9f680d0210 0x7f9f680cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:27.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.589+0000 7f9f6cd63640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9f680d0210 0x7f9f680cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59264/0 (socket says 172.21.15.67:59264) 2024-04-25T02:28:27.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.589+0000 7f9f6cd63640 1 -- 172.21.15.67:0/1407290103 learned_addr learned my addr 172.21.15.67:0/1407290103 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:27.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.589+0000 7f9f6d564640 1 --2- 172.21.15.67:0/1407290103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f6815bfc0 0x7f9f680ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:27.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.589+0000 7f9f6cd63640 1 -- 172.21.15.67:0/1407290103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f6815bfc0 msgr2=0x7f9f680ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:27.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.589+0000 7f9f6cd63640 1 --2- 172.21.15.67:0/1407290103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f6815bfc0 0x7f9f680ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:27.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.589+0000 7f9f6cd63640 1 -- 172.21.15.67:0/1407290103 >> v1:172.21.15.176:6789/0 conn(0x7f9f6815e9f0 legacy=0x7f9f68161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:27.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.589+0000 7f9f6cd63640 1 -- 172.21.15.67:0/1407290103 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f680d0d20 con 0x7f9f680d0210 2024-04-25T02:28:27.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.589+0000 7f9f6d564640 1 --2- 172.21.15.67:0/1407290103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f6815bfc0 0x7f9f680ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:27.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.590+0000 7f9f6cd63640 1 --2- 172.21.15.67:0/1407290103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f680d0210 0x7f9f680cec90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009870 tx=0x7f9f5802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4893c1c896e3c0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:27.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.590+0000 7f9f5ffff640 1 -- 172.21.15.67:0/1407290103 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58037070 con 0x7f9f680d0210 2024-04-25T02:28:27.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.590+0000 7f9f5ffff640 1 -- 172.21.15.67:0/1407290103 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f58032440 con 0x7f9f680d0210 2024-04-25T02:28:27.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.590+0000 7f9f5ffff640 1 -- 172.21.15.67:0/1407290103 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58032810 con 0x7f9f680d0210 2024-04-25T02:28:27.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.591+0000 7f9f6f7c8640 1 -- 172.21.15.67:0/1407290103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f680d0210 msgr2=0x7f9f680cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:27.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.591+0000 7f9f6f7c8640 1 --2- 172.21.15.67:0/1407290103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f680d0210 0x7f9f680cec90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009870 tx=0x7f9f5802a200 comp rx=0 tx=0).stop 2024-04-25T02:28:27.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.591+0000 7f9f6f7c8640 1 -- 172.21.15.67:0/1407290103 shutdown_connections 2024-04-25T02:28:27.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.591+0000 7f9f6f7c8640 1 --2- 172.21.15.67:0/1407290103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f680d0210 0x7f9f680cec90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:27.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.591+0000 7f9f6f7c8640 1 --2- 172.21.15.67:0/1407290103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f6815bfc0 0x7f9f680ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:27.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.591+0000 7f9f6f7c8640 1 -- 172.21.15.67:0/1407290103 >> 172.21.15.67:0/1407290103 conn(0x7f9f680d1ed0 msgr2=0x7f9f680d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:27.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.591+0000 7f9f6f7c8640 1 -- 172.21.15.67:0/1407290103 shutdown_connections 2024-04-25T02:28:27.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.591+0000 7f9f6f7c8640 1 -- 172.21.15.67:0/1407290103 wait complete. 2024-04-25T02:28:27.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.592+0000 7f9f6f7c8640 1 Processor -- start 2024-04-25T02:28:27.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.592+0000 7f9f6f7c8640 1 -- start start 2024-04-25T02:28:27.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f6f7c8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f680d0210 0x7f9f681f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:27.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f6f7c8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f6815bfc0 0x7f9f680c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:27.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f6f7c8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f6815e9f0 0x7f9f68150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:27.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f6f7c8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9f680cf690 con 0x7f9f6815bfc0 2024-04-25T02:28:27.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f6f7c8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9f680d12e0 con 0x7f9f680d0210 2024-04-25T02:28:27.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f6f7c8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9f680cf810 con 0x7f9f6815e9f0 2024-04-25T02:28:27.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f6cd63640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f6815bfc0 0x7f9f680c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:27.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f6cd63640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f6815bfc0 0x7f9f680c5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59270/0 (socket says 172.21.15.67:59270) 2024-04-25T02:28:27.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f6cd63640 1 -- 172.21.15.67:0/355547202 learned_addr learned my addr 172.21.15.67:0/355547202 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:27.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f6d564640 1 --2- 172.21.15.67:0/355547202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f680d0210 0x7f9f681f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:27.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f6dd65640 1 --2- 172.21.15.67:0/355547202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f6815e9f0 0x7f9f68150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:27.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f6cd63640 1 -- 172.21.15.67:0/355547202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f6815e9f0 msgr2=0x7f9f68150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:27.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f6cd63640 1 --2- 172.21.15.67:0/355547202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f6815e9f0 0x7f9f68150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:27.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f6cd63640 1 -- 172.21.15.67:0/355547202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f680d0210 msgr2=0x7f9f681f4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:27.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f6cd63640 1 --2- 172.21.15.67:0/355547202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f680d0210 0x7f9f681f4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:27.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f6cd63640 1 -- 172.21.15.67:0/355547202 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f680c5fd0 con 0x7f9f6815bfc0 2024-04-25T02:28:27.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f6cd63640 1 --2- 172.21.15.67:0/355547202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f6815bfc0 0x7f9f680c5a90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f58000c00 tx=0x7f9f580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:27.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f5dffb640 1 -- 172.21.15.67:0/355547202 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58037040 con 0x7f9f6815bfc0 2024-04-25T02:28:27.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f5dffb640 1 -- 172.21.15.67:0/355547202 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f58042070 con 0x7f9f6815bfc0 2024-04-25T02:28:27.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f6f7c8640 1 -- 172.21.15.67:0/355547202 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f680c6270 con 0x7f9f6815bfc0 2024-04-25T02:28:27.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.593+0000 7f9f5dffb640 1 -- 172.21.15.67:0/355547202 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58030bb0 con 0x7f9f6815bfc0 2024-04-25T02:28:27.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.594+0000 7f9f6f7c8640 1 -- 172.21.15.67:0/355547202 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f680c6830 con 0x7f9f6815bfc0 2024-04-25T02:28:27.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.594+0000 7f9f6f7c8640 1 -- 172.21.15.67:0/355547202 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f68069110 con 0x7f9f6815bfc0 2024-04-25T02:28:27.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.595+0000 7f9f5dffb640 1 -- 172.21.15.67:0/355547202 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f5802ad10 con 0x7f9f6815bfc0 2024-04-25T02:28:27.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.596+0000 7f9f5dffb640 1 --2- 172.21.15.67:0/355547202 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9f4c06be30 0x7f9f4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:27.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.596+0000 7f9f5dffb640 1 -- 172.21.15.67:0/355547202 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f9f580ab7e0 con 0x7f9f6815bfc0 2024-04-25T02:28:27.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.596+0000 7f9f6d564640 1 --2- 172.21.15.67:0/355547202 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9f4c06be30 0x7f9f4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:27.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.596+0000 7f9f6d564640 1 --2- 172.21.15.67:0/355547202 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9f4c06be30 0x7f9f4c06e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000a990 tx=0x7f9f60008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:27.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.600+0000 7f9f5dffb640 1 -- 172.21.15.67:0/355547202 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9f58045360 con 0x7f9f6815bfc0 2024-04-25T02:28:27.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:27.820+0000 7f9f6f7c8640 1 -- 172.21.15.67:0/355547202 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9f680b7e50 con 0x7f9f6815bfc0 2024-04-25T02:28:28.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.821+0000 7f9f5dffb640 1 -- 172.21.15.67:0/355547202 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7f9f5807a190 con 0x7f9f6815bfc0 2024-04-25T02:28:28.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.823+0000 7f9f6f7c8640 1 -- 172.21.15.67:0/355547202 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9f4c06be30 msgr2=0x7f9f4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.823+0000 7f9f6f7c8640 1 --2- 172.21.15.67:0/355547202 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9f4c06be30 0x7f9f4c06e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000a990 tx=0x7f9f60008040 comp rx=0 tx=0).stop 2024-04-25T02:28:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.823+0000 7f9f6f7c8640 1 -- 172.21.15.67:0/355547202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f6815bfc0 msgr2=0x7f9f680c5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.823+0000 7f9f6f7c8640 1 --2- 172.21.15.67:0/355547202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f6815bfc0 0x7f9f680c5a90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f58000c00 tx=0x7f9f580046c0 comp rx=0 tx=0).stop 2024-04-25T02:28:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.823+0000 7f9f6f7c8640 1 -- 172.21.15.67:0/355547202 shutdown_connections 2024-04-25T02:28:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.823+0000 7f9f6f7c8640 1 --2- 172.21.15.67:0/355547202 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9f4c06be30 0x7f9f4c06e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.823+0000 7f9f6f7c8640 1 --2- 172.21.15.67:0/355547202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f6815e9f0 0x7f9f68150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.823+0000 7f9f6f7c8640 1 --2- 172.21.15.67:0/355547202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f6815bfc0 0x7f9f680c5a90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.823+0000 7f9f6f7c8640 1 --2- 172.21.15.67:0/355547202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f680d0210 0x7f9f681f4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.823+0000 7f9f6f7c8640 1 -- 172.21.15.67:0/355547202 >> 172.21.15.67:0/355547202 conn(0x7f9f680d1ed0 msgr2=0x7f9f6806d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.823+0000 7f9f6f7c8640 1 -- 172.21.15.67:0/355547202 shutdown_connections 2024-04-25T02:28:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.823+0000 7f9f6f7c8640 1 -- 172.21.15.67:0/355547202 wait complete. 2024-04-25T02:28:28.841 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T02:28:28.841 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T02:28:28.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.946+0000 7f3279c31640 1 Processor -- start 2024-04-25T02:28:28.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.946+0000 7f3279c31640 1 -- start start 2024-04-25T02:28:28.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.947+0000 7f3279c31640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f327415b090 0x7f327409db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:28.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.947+0000 7f3279c31640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f327406ec40 0x7f32740add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:28.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.947+0000 7f3279c31640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32740ad820 con 0x7f32740b2cc0 2024-04-25T02:28:28.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.947+0000 7f3279c31640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f32740b3260 con 0x7f327406ec40 2024-04-25T02:28:28.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.947+0000 7f3279c31640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f32740b3540 con 0x7f327415b090 2024-04-25T02:28:28.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.947+0000 7f3273fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f327406ec40 0x7f32740add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:28.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.947+0000 7f3273fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f327406ec40 0x7f32740add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59284/0 (socket says 172.21.15.67:59284) 2024-04-25T02:28:28.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.947+0000 7f3272ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f32740b2cc0 0x7f327406e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51178/0 (socket says 172.21.15.67:51178) 2024-04-25T02:28:28.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.947+0000 7f3273fff640 1 -- 172.21.15.67:0/39695635 learned_addr learned my addr 172.21.15.67:0/39695635 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:28.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.947+0000 7f32737fe640 1 --2- 172.21.15.67:0/39695635 >> v2:172.21.15.176:3300/0 conn(0x7f327415b090 0x7f327409db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:28.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.948+0000 7f3273fff640 1 -- 172.21.15.67:0/39695635 >> v2:172.21.15.176:3300/0 conn(0x7f327415b090 msgr2=0x7f327409db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:28.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.948+0000 7f3273fff640 1 --2- 172.21.15.67:0/39695635 >> v2:172.21.15.176:3300/0 conn(0x7f327415b090 0x7f327409db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:28.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.948+0000 7f3273fff640 1 -- 172.21.15.67:0/39695635 >> v1:172.21.15.67:6789/0 conn(0x7f32740b2cc0 legacy=0x7f327406e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:28.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.948+0000 7f3273fff640 1 -- 172.21.15.67:0/39695635 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32740b3820 con 0x7f327406ec40 2024-04-25T02:28:28.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.948+0000 7f32727fc640 1 -- 172.21.15.67:0/39695635 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1976513835 0 0) 0x7f32740ad820 con 0x7f32740b2cc0 2024-04-25T02:28:28.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.948+0000 7f3273fff640 1 --2- 172.21.15.67:0/39695635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f327406ec40 0x7f32740add00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f32740709b0 tx=0x7f326c02c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2ee507d8c40c2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:28.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.948+0000 7f32727fc640 1 -- 172.21.15.67:0/39695635 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c00b2e0 con 0x7f327406ec40 2024-04-25T02:28:28.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.948+0000 7f32727fc640 1 -- 172.21.15.67:0/39695635 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f326c037070 con 0x7f327406ec40 2024-04-25T02:28:28.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.948+0000 7f32727fc640 1 -- 172.21.15.67:0/39695635 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c00b480 con 0x7f327406ec40 2024-04-25T02:28:28.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.949+0000 7f3279c31640 1 -- 172.21.15.67:0/39695635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f327406ec40 msgr2=0x7f32740add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:28.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.949+0000 7f3279c31640 1 --2- 172.21.15.67:0/39695635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f327406ec40 0x7f32740add00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f32740709b0 tx=0x7f326c02c940 comp rx=0 tx=0).stop 2024-04-25T02:28:28.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.949+0000 7f3279c31640 1 -- 172.21.15.67:0/39695635 shutdown_connections 2024-04-25T02:28:28.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.949+0000 7f3279c31640 1 --2- 172.21.15.67:0/39695635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f327406ec40 0x7f32740add00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:28.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.949+0000 7f3279c31640 1 --2- 172.21.15.67:0/39695635 >> v2:172.21.15.176:3300/0 conn(0x7f327415b090 0x7f327409db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:28.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.949+0000 7f3279c31640 1 -- 172.21.15.67:0/39695635 >> 172.21.15.67:0/39695635 conn(0x7f32740b19c0 msgr2=0x7f32740b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:28.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.949+0000 7f3279c31640 1 -- 172.21.15.67:0/39695635 shutdown_connections 2024-04-25T02:28:28.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.949+0000 7f3279c31640 1 -- 172.21.15.67:0/39695635 wait complete. 2024-04-25T02:28:28.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.950+0000 7f3279c31640 1 Processor -- start 2024-04-25T02:28:28.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.950+0000 7f3279c31640 1 -- start start 2024-04-25T02:28:28.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.951+0000 7f3279c31640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f327406ec40 0x7f327409d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:28.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.951+0000 7f3279c31640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32740b2cc0 0x7f327409d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:28.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.951+0000 7f3279c31640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f327415b090 0x7f327415c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:28.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.951+0000 7f3279c31640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f327415b470 con 0x7f32740b2cc0 2024-04-25T02:28:28.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.951+0000 7f3279c31640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f32740b4f70 con 0x7f327406ec40 2024-04-25T02:28:28.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.951+0000 7f3279c31640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3274070e10 con 0x7f327415b090 2024-04-25T02:28:28.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.951+0000 7f3272ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32740b2cc0 0x7f327409d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:28.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.951+0000 7f3272ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32740b2cc0 0x7f327409d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59294/0 (socket says 172.21.15.67:59294) 2024-04-25T02:28:28.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.951+0000 7f3272ffd640 1 -- 172.21.15.67:0/1006309640 learned_addr learned my addr 172.21.15.67:0/1006309640 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:28.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.951+0000 7f3273fff640 1 --2- 172.21.15.67:0/1006309640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f327415b090 0x7f327415c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:28.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.951+0000 7f32737fe640 1 --2- 172.21.15.67:0/1006309640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f327406ec40 0x7f327409d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:28.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.952+0000 7f3272ffd640 1 -- 172.21.15.67:0/1006309640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f327415b090 msgr2=0x7f327415c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:28.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.952+0000 7f3272ffd640 1 --2- 172.21.15.67:0/1006309640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f327415b090 0x7f327415c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:28.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.952+0000 7f3272ffd640 1 -- 172.21.15.67:0/1006309640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f327406ec40 msgr2=0x7f327409d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:28.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.952+0000 7f3272ffd640 1 --2- 172.21.15.67:0/1006309640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f327406ec40 0x7f327409d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:28.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.952+0000 7f3272ffd640 1 -- 172.21.15.67:0/1006309640 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f327415d8f0 con 0x7f32740b2cc0 2024-04-25T02:28:28.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.952+0000 7f3273fff640 1 --2- 172.21.15.67:0/1006309640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f327415b090 0x7f327415c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:28.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.952+0000 7f32737fe640 1 --2- 172.21.15.67:0/1006309640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f327406ec40 0x7f327409d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:28.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.952+0000 7f3272ffd640 1 --2- 172.21.15.67:0/1006309640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32740b2cc0 0x7f327409d630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f326800c4d0 tx=0x7f326800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:28.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.952+0000 7f325bfff640 1 -- 172.21.15.67:0/1006309640 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3268018070 con 0x7f32740b2cc0 2024-04-25T02:28:28.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.952+0000 7f325bfff640 1 -- 172.21.15.67:0/1006309640 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3268007500 con 0x7f32740b2cc0 2024-04-25T02:28:28.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.952+0000 7f325bfff640 1 -- 172.21.15.67:0/1006309640 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3268004a20 con 0x7f32740b2cc0 2024-04-25T02:28:28.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.952+0000 7f3279c31640 1 -- 172.21.15.67:0/1006309640 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f327415dbd0 con 0x7f32740b2cc0 2024-04-25T02:28:28.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.952+0000 7f3279c31640 1 -- 172.21.15.67:0/1006309640 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f327413ef90 con 0x7f32740b2cc0 2024-04-25T02:28:28.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.953+0000 7f3279c31640 1 -- 172.21.15.67:0/1006309640 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f327415abf0 con 0x7f32740b2cc0 2024-04-25T02:28:28.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.953+0000 7f325bfff640 1 -- 172.21.15.67:0/1006309640 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f326801b070 con 0x7f32740b2cc0 2024-04-25T02:28:28.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.954+0000 7f325bfff640 1 --2- 172.21.15.67:0/1006309640 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f326006be30 0x7f326006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:28.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.954+0000 7f325bfff640 1 -- 172.21.15.67:0/1006309640 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f326808a1e0 con 0x7f32740b2cc0 2024-04-25T02:28:28.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.954+0000 7f32737fe640 1 --2- 172.21.15.67:0/1006309640 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f326006be30 0x7f326006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:28.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.955+0000 7f32737fe640 1 --2- 172.21.15.67:0/1006309640 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f326006be30 0x7f326006e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3264009a20 tx=0x7f3264008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:28.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:28.958+0000 7f325bfff640 1 -- 172.21.15.67:0/1006309640 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f327415abf0 con 0x7f32740b2cc0 2024-04-25T02:28:29.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.179+0000 7f3279c31640 1 -- 172.21.15.67:0/1006309640 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3274069110 con 0x7f32740b2cc0 2024-04-25T02:28:29.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.840+0000 7f325bfff640 1 -- 172.21.15.67:0/1006309640 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7f3268058b90 con 0x7f32740b2cc0 2024-04-25T02:28:29.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.843+0000 7f3279c31640 1 -- 172.21.15.67:0/1006309640 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f326006be30 msgr2=0x7f326006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:29.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.843+0000 7f3279c31640 1 --2- 172.21.15.67:0/1006309640 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f326006be30 0x7f326006e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3264009a20 tx=0x7f3264008040 comp rx=0 tx=0).stop 2024-04-25T02:28:29.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.843+0000 7f3279c31640 1 -- 172.21.15.67:0/1006309640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32740b2cc0 msgr2=0x7f327409d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:29.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.843+0000 7f3279c31640 1 --2- 172.21.15.67:0/1006309640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32740b2cc0 0x7f327409d630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f326800c4d0 tx=0x7f326800c990 comp rx=0 tx=0).stop 2024-04-25T02:28:29.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.843+0000 7f3279c31640 1 -- 172.21.15.67:0/1006309640 shutdown_connections 2024-04-25T02:28:29.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.843+0000 7f3279c31640 1 --2- 172.21.15.67:0/1006309640 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f326006be30 0x7f326006e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:29.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.843+0000 7f3279c31640 1 --2- 172.21.15.67:0/1006309640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f327415b090 0x7f327415c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:29.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.843+0000 7f3279c31640 1 --2- 172.21.15.67:0/1006309640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32740b2cc0 0x7f327409d630 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:29.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.843+0000 7f3279c31640 1 --2- 172.21.15.67:0/1006309640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f327406ec40 0x7f327409d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:29.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.843+0000 7f3279c31640 1 -- 172.21.15.67:0/1006309640 >> 172.21.15.67:0/1006309640 conn(0x7f32740b19c0 msgr2=0x7f327406da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:29.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.843+0000 7f3279c31640 1 -- 172.21.15.67:0/1006309640 shutdown_connections 2024-04-25T02:28:29.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.843+0000 7f3279c31640 1 -- 172.21.15.67:0/1006309640 wait complete. 2024-04-25T02:28:29.860 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T02:28:29.860 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:28:29.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.963+0000 7f1926d5a640 1 Processor -- start 2024-04-25T02:28:29.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.963+0000 7f1926d5a640 1 -- start start 2024-04-25T02:28:29.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.964+0000 7f1926d5a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19200ad790 0x7f19200b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:29.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.964+0000 7f1926d5a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19200b33c0 con 0x7f192015a6f0 2024-04-25T02:28:29.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.964+0000 7f1926d5a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19200b36a0 con 0x7f19200b4b70 2024-04-25T02:28:29.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.964+0000 7f1926d5a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f19200b3fd0 con 0x7f19200ad790 2024-04-25T02:28:29.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.964+0000 7f1924af6640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f192015a6f0 0x7f19200b4460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51184/0 (socket says 172.21.15.67:51184) 2024-04-25T02:28:29.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.964+0000 7f1924af6640 1 -- 172.21.15.67:0/378129100 learned_addr learned my addr 172.21.15.67:0/378129100 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:29.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.964+0000 7f19252f7640 1 --2- 172.21.15.67:0/378129100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19200ad790 0x7f19200b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:29.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.965+0000 7f191f7fe640 1 -- 172.21.15.67:0/378129100 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1903188861 0 0) 0x7f19200b33c0 con 0x7f192015a6f0 2024-04-25T02:28:29.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.965+0000 7f191f7fe640 1 -- 172.21.15.67:0/378129100 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f190c003520 con 0x7f192015a6f0 2024-04-25T02:28:29.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.965+0000 7f191f7fe640 1 -- 172.21.15.67:0/378129100 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2519966182 0 0) 0x7f19200b36a0 con 0x7f19200b4b70 2024-04-25T02:28:29.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.965+0000 7f191f7fe640 1 -- 172.21.15.67:0/378129100 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19200b33c0 con 0x7f19200b4b70 2024-04-25T02:28:29.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.965+0000 7f19252f7640 1 -- 172.21.15.67:0/378129100 >> v1:172.21.15.176:6789/0 conn(0x7f19200b4b70 legacy=0x7f19200ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:29.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.965+0000 7f191f7fe640 1 -- 172.21.15.67:0/378129100 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4218760062 0 0) 0x7f190c003520 con 0x7f192015a6f0 2024-04-25T02:28:29.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.965+0000 7f19252f7640 1 -- 172.21.15.67:0/378129100 >> v1:172.21.15.67:6789/0 conn(0x7f192015a6f0 legacy=0x7f19200b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:29.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.965+0000 7f19252f7640 1 -- 172.21.15.67:0/378129100 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19200b3980 con 0x7f19200ad790 2024-04-25T02:28:29.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.966+0000 7f19252f7640 1 --2- 172.21.15.67:0/378129100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19200ad790 0x7f19200b2cc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f19080097d0 tx=0x7f190802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88b02f7cab3cc73d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:29.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.966+0000 7f191f7fe640 1 -- 172.21.15.67:0/378129100 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908037070 con 0x7f19200ad790 2024-04-25T02:28:29.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.966+0000 7f191f7fe640 1 -- 172.21.15.67:0/378129100 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f190802ac30 con 0x7f19200ad790 2024-04-25T02:28:29.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.966+0000 7f191f7fe640 1 -- 172.21.15.67:0/378129100 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19180019f0 con 0x7f19200ad790 2024-04-25T02:28:29.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.966+0000 7f1926d5a640 1 -- 172.21.15.67:0/378129100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19200ad790 msgr2=0x7f19200b2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:29.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.966+0000 7f1926d5a640 1 --2- 172.21.15.67:0/378129100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19200ad790 0x7f19200b2cc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f19080097d0 tx=0x7f190802a1a0 comp rx=0 tx=0).stop 2024-04-25T02:28:29.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.966+0000 7f1926d5a640 1 -- 172.21.15.67:0/378129100 shutdown_connections 2024-04-25T02:28:29.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.966+0000 7f1926d5a640 1 --2- 172.21.15.67:0/378129100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19200ad790 0x7f19200b2cc0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:29.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.966+0000 7f1926d5a640 1 -- 172.21.15.67:0/378129100 >> 172.21.15.67:0/378129100 conn(0x7f19200b19c0 msgr2=0x7f19200b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:29.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.966+0000 7f1926d5a640 1 -- 172.21.15.67:0/378129100 shutdown_connections 2024-04-25T02:28:29.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.966+0000 7f1926d5a640 1 -- 172.21.15.67:0/378129100 wait complete. 2024-04-25T02:28:29.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.968+0000 7f1926d5a640 1 Processor -- start 2024-04-25T02:28:29.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.968+0000 7f1926d5a640 1 -- start start 2024-04-25T02:28:29.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.968+0000 7f1926d5a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19200ad790 0x7f192009d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:29.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.968+0000 7f1926d5a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19200b4b70 0x7f19200b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:29.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.968+0000 7f1926d5a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f192015a6f0 0x7f192015c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:29.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.968+0000 7f1926d5a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f192006e7a0 con 0x7f19200ad790 2024-04-25T02:28:29.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.968+0000 7f1926d5a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f192015aad0 con 0x7f192015a6f0 2024-04-25T02:28:29.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.968+0000 7f1926d5a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f192006e920 con 0x7f19200b4b70 2024-04-25T02:28:29.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.969+0000 7f1924af6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19200ad790 0x7f192009d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:29.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.969+0000 7f1924af6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19200ad790 0x7f192009d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59306/0 (socket says 172.21.15.67:59306) 2024-04-25T02:28:29.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.969+0000 7f1924af6640 1 -- 172.21.15.67:0/3562227262 learned_addr learned my addr 172.21.15.67:0/3562227262 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:29.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.969+0000 7f19252f7640 1 --2- 172.21.15.67:0/3562227262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f192015a6f0 0x7f192015c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:29.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.969+0000 7f191ffff640 1 --2- 172.21.15.67:0/3562227262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19200b4b70 0x7f19200b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:29.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.969+0000 7f1924af6640 1 -- 172.21.15.67:0/3562227262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19200b4b70 msgr2=0x7f19200b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:29.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.969+0000 7f1924af6640 1 --2- 172.21.15.67:0/3562227262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19200b4b70 0x7f19200b0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:29.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.969+0000 7f1924af6640 1 -- 172.21.15.67:0/3562227262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f192015a6f0 msgr2=0x7f192015c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:29.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.969+0000 7f1924af6640 1 --2- 172.21.15.67:0/3562227262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f192015a6f0 0x7f192015c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:29.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.969+0000 7f1924af6640 1 -- 172.21.15.67:0/3562227262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f192009ac10 con 0x7f19200ad790 2024-04-25T02:28:29.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.969+0000 7f1924af6640 1 --2- 172.21.15.67:0/3562227262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19200ad790 0x7f192009d500 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f191800cc10 tx=0x7f191800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:29.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.969+0000 7f191d7fa640 1 -- 172.21.15.67:0/3562227262 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1918017070 con 0x7f19200ad790 2024-04-25T02:28:29.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.969+0000 7f191d7fa640 1 -- 172.21.15.67:0/3562227262 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f191800ce20 con 0x7f19200ad790 2024-04-25T02:28:29.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.969+0000 7f1926d5a640 1 -- 172.21.15.67:0/3562227262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19200b12e0 con 0x7f19200ad790 2024-04-25T02:28:29.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.969+0000 7f191d7fa640 1 -- 172.21.15.67:0/3562227262 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1918012640 con 0x7f19200ad790 2024-04-25T02:28:29.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.969+0000 7f1926d5a640 1 -- 172.21.15.67:0/3562227262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f192009b190 con 0x7f19200ad790 2024-04-25T02:28:29.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.970+0000 7f1926d5a640 1 -- 172.21.15.67:0/3562227262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1920069110 con 0x7f19200ad790 2024-04-25T02:28:29.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.971+0000 7f191d7fa640 1 -- 172.21.15.67:0/3562227262 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f191801a070 con 0x7f19200ad790 2024-04-25T02:28:29.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.971+0000 7f191d7fa640 1 --2- 172.21.15.67:0/3562227262 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f190006be30 0x7f190006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:29.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.971+0000 7f191d7fa640 1 -- 172.21.15.67:0/3562227262 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f191808ae00 con 0x7f19200ad790 2024-04-25T02:28:29.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.971+0000 7f191ffff640 1 --2- 172.21.15.67:0/3562227262 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f190006be30 0x7f190006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:29.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.972+0000 7f191ffff640 1 --2- 172.21.15.67:0/3562227262 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f190006be30 0x7f190006e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19100010e0 tx=0x7f1910009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:29.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:29.976+0000 7f191d7fa640 1 -- 172.21.15.67:0/3562227262 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1918059730 con 0x7f19200ad790 2024-04-25T02:28:30.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.195+0000 7f1926d5a640 1 -- 172.21.15.67:0/3562227262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f192006e150 con 0x7f19200ad790 2024-04-25T02:28:30.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.195+0000 7f191d7fa640 1 -- 172.21.15.67:0/3562227262 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5172 (secure 0 0 0) 0x7f1918059030 con 0x7f19200ad790 2024-04-25T02:28:30.220 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:30.220 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1246739775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1246739775},{"type":"v1","addr":"172.21.15.67:6835","nonce":1246739775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/267757090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":267757090},{"type":"v1","addr":"172.21.15.67:6833","nonce":267757090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/90768677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":90768677},{"type":"v1","addr":"172.21.15.176:6837","nonce":90768677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:28:26.184170+0000","modified":"2024-04-25T02:28:29.181464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/1058053785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1058053785},{"type":"v1","addr":"172.21.15.176:6836","nonce":1058053785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-25T02:28:30.222 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 7 2024-04-25T02:28:30.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.197+0000 7f1926d5a640 1 -- 172.21.15.67:0/3562227262 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f190006be30 msgr2=0x7f190006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:30.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.197+0000 7f1926d5a640 1 --2- 172.21.15.67:0/3562227262 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f190006be30 0x7f190006e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19100010e0 tx=0x7f1910009040 comp rx=0 tx=0).stop 2024-04-25T02:28:30.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.197+0000 7f1926d5a640 1 -- 172.21.15.67:0/3562227262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19200ad790 msgr2=0x7f192009d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:30.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.197+0000 7f1926d5a640 1 --2- 172.21.15.67:0/3562227262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19200ad790 0x7f192009d500 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f191800cc10 tx=0x7f191800a430 comp rx=0 tx=0).stop 2024-04-25T02:28:30.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.198+0000 7f1926d5a640 1 -- 172.21.15.67:0/3562227262 shutdown_connections 2024-04-25T02:28:30.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.198+0000 7f1926d5a640 1 --2- 172.21.15.67:0/3562227262 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f190006be30 0x7f190006e2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.198+0000 7f1926d5a640 1 --2- 172.21.15.67:0/3562227262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f192015a6f0 0x7f192015c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.198+0000 7f1926d5a640 1 --2- 172.21.15.67:0/3562227262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19200b4b70 0x7f19200b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.198+0000 7f1926d5a640 1 --2- 172.21.15.67:0/3562227262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19200ad790 0x7f192009d500 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.198+0000 7f1926d5a640 1 -- 172.21.15.67:0/3562227262 >> 172.21.15.67:0/3562227262 conn(0x7f19200b19c0 msgr2=0x7f19200b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:30.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.198+0000 7f1926d5a640 1 -- 172.21.15.67:0/3562227262 shutdown_connections 2024-04-25T02:28:30.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.198+0000 7f1926d5a640 1 -- 172.21.15.67:0/3562227262 wait complete. 2024-04-25T02:28:30.223 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:30.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.320+0000 7fe4647c1640 1 Processor -- start 2024-04-25T02:28:30.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.320+0000 7fe4647c1640 1 -- start start 2024-04-25T02:28:30.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe4647c1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe45c0d0210 0x7fe45c06c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:30.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe4647c1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe45c15c3a0 con 0x7fe45c15bfc0 2024-04-25T02:28:30.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe4647c1640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe45c0d0760 con 0x7fe45c0cee60 2024-04-25T02:28:30.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe4647c1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe45c0d0a40 con 0x7fe45c0d0210 2024-04-25T02:28:30.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe46255d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe45c15bfc0 0x7fe45c0ce750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51198/0 (socket says 172.21.15.67:51198) 2024-04-25T02:28:30.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe46255d640 1 -- 172.21.15.67:0/2948939521 learned_addr learned my addr 172.21.15.67:0/2948939521 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:30.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe462d5e640 1 --2- 172.21.15.67:0/2948939521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe45c0d0210 0x7fe45c06c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:30.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe46155b640 1 -- 172.21.15.67:0/2948939521 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4002556463 0 0) 0x7fe45c15c3a0 con 0x7fe45c15bfc0 2024-04-25T02:28:30.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe46155b640 1 -- 172.21.15.67:0/2948939521 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe448003520 con 0x7fe45c15bfc0 2024-04-25T02:28:30.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe46155b640 1 -- 172.21.15.67:0/2948939521 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 299764992 0 0) 0x7fe448003520 con 0x7fe45c15bfc0 2024-04-25T02:28:30.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe46155b640 1 -- 172.21.15.67:0/2948939521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe45c0d0210 msgr2=0x7fe45c06c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:30.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe46155b640 1 --2- 172.21.15.67:0/2948939521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe45c0d0210 0x7fe45c06c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe46155b640 1 -- 172.21.15.67:0/2948939521 >> v1:172.21.15.176:6789/0 conn(0x7fe45c0cee60 legacy=0x7fe45c06c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:30.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe46155b640 1 -- 172.21.15.67:0/2948939521 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe45c0d0d20 con 0x7fe45c15bfc0 2024-04-25T02:28:30.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe46155b640 1 -- 172.21.15.67:0/2948939521 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7fe458001670 con 0x7fe45c15bfc0 2024-04-25T02:28:30.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe46155b640 1 -- 172.21.15.67:0/2948939521 >> v1:172.21.15.67:6789/0 conn(0x7fe45c15bfc0 legacy=0x7fe45c0ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:30.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe46155b640 1 --2- 172.21.15.67:0/2948939521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4480039e0 0x7fe448003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:30.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe46155b640 1 --2- 172.21.15.67:0/2948939521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe448004390 0x7fe448004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:30.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe46155b640 1 --2- 172.21.15.67:0/2948939521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe45c0d0210 0x7fe4480050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:30.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe46155b640 1 -- 172.21.15.67:0/2948939521 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c0d0a40 con 0x7fe448004390 2024-04-25T02:28:30.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe46155b640 1 -- 172.21.15.67:0/2948939521 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe44800b9f0 con 0x7fe4480039e0 2024-04-25T02:28:30.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.321+0000 7fe46155b640 1 -- 172.21.15.67:0/2948939521 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe44800bbf0 con 0x7fe45c0d0210 2024-04-25T02:28:30.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.322+0000 7fe461d5c640 1 --2- 172.21.15.67:0/2948939521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe448004390 0x7fe448004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:30.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.322+0000 7fe46255d640 1 --2- 172.21.15.67:0/2948939521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4480039e0 0x7fe448003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:30.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.322+0000 7fe462d5e640 1 --2- 172.21.15.67:0/2948939521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe45c0d0210 0x7fe4480050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:30.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.322+0000 7fe461d5c640 1 -- 172.21.15.67:0/2948939521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe45c0d0210 msgr2=0x7fe4480050f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:30.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.322+0000 7fe461d5c640 1 --2- 172.21.15.67:0/2948939521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe45c0d0210 0x7fe4480050f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.322+0000 7fe461d5c640 1 -- 172.21.15.67:0/2948939521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4480039e0 msgr2=0x7fe448003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:30.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.322+0000 7fe461d5c640 1 --2- 172.21.15.67:0/2948939521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4480039e0 0x7fe448003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.322+0000 7fe461d5c640 1 -- 172.21.15.67:0/2948939521 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe448003520 con 0x7fe448004390 2024-04-25T02:28:30.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.322+0000 7fe462d5e640 1 --2- 172.21.15.67:0/2948939521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe45c0d0210 0x7fe4480050f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:30.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.323+0000 7fe461d5c640 1 --2- 172.21.15.67:0/2948939521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe448004390 0x7fe448004860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe45c072f40 tx=0x7fe448005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd914fde27ecc1c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:30.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.323+0000 7fe46155b640 1 -- 172.21.15.67:0/2948939521 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c037070 con 0x7fe448004390 2024-04-25T02:28:30.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.323+0000 7fe46155b640 1 -- 172.21.15.67:0/2948939521 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe44c02abd0 con 0x7fe448004390 2024-04-25T02:28:30.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.323+0000 7fe46155b640 1 -- 172.21.15.67:0/2948939521 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c0014e0 con 0x7fe448004390 2024-04-25T02:28:30.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.323+0000 7fe4647c1640 1 -- 172.21.15.67:0/2948939521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe448004390 msgr2=0x7fe448004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:30.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.323+0000 7fe4647c1640 1 --2- 172.21.15.67:0/2948939521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe448004390 0x7fe448004860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe45c072f40 tx=0x7fe448005830 comp rx=0 tx=0).stop 2024-04-25T02:28:30.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.323+0000 7fe462d5e640 1 -- 172.21.15.67:0/2948939521 reap_dead start 2024-04-25T02:28:30.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.323+0000 7fe4647c1640 1 -- 172.21.15.67:0/2948939521 shutdown_connections 2024-04-25T02:28:30.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.323+0000 7fe4647c1640 1 -- 172.21.15.67:0/2948939521 >> 172.21.15.67:0/2948939521 conn(0x7fe45c0d1ed0 msgr2=0x7fe45c0d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:30.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.323+0000 7fe4647c1640 1 -- 172.21.15.67:0/2948939521 shutdown_connections 2024-04-25T02:28:30.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.323+0000 7fe4647c1640 1 -- 172.21.15.67:0/2948939521 wait complete. 2024-04-25T02:28:30.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.324+0000 7fe4647c1640 1 Processor -- start 2024-04-25T02:28:30.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.324+0000 7fe4647c1640 1 -- start start 2024-04-25T02:28:30.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.325+0000 7fe4647c1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe448004390 0x7fe45c09e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:30.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.325+0000 7fe4647c1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe45c153d10 0x7fe45c09f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:30.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.325+0000 7fe4647c1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe45c154170 0x7fe45c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:30.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.325+0000 7fe4647c1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c0cf690 con 0x7fe45c154170 2024-04-25T02:28:30.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.325+0000 7fe4647c1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c0d12e0 con 0x7fe448004390 2024-04-25T02:28:30.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.325+0000 7fe4647c1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe45c0cf810 con 0x7fe45c153d10 2024-04-25T02:28:30.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.325+0000 7fe462d5e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe45c154170 0x7fe45c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:30.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.325+0000 7fe462d5e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe45c154170 0x7fe45c0b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59316/0 (socket says 172.21.15.67:59316) 2024-04-25T02:28:30.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.325+0000 7fe462d5e640 1 -- 172.21.15.67:0/3360365498 learned_addr learned my addr 172.21.15.67:0/3360365498 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:30.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.325+0000 7fe461d5c640 1 --2- 172.21.15.67:0/3360365498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe45c153d10 0x7fe45c09f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:30.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.325+0000 7fe46255d640 1 --2- 172.21.15.67:0/3360365498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe448004390 0x7fe45c09e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:30.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.326+0000 7fe462d5e640 1 -- 172.21.15.67:0/3360365498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe45c153d10 msgr2=0x7fe45c09f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:30.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.326+0000 7fe462d5e640 1 --2- 172.21.15.67:0/3360365498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe45c153d10 0x7fe45c09f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.326+0000 7fe462d5e640 1 -- 172.21.15.67:0/3360365498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe448004390 msgr2=0x7fe45c09e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:30.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.326+0000 7fe462d5e640 1 --2- 172.21.15.67:0/3360365498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe448004390 0x7fe45c09e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.326+0000 7fe462d5e640 1 -- 172.21.15.67:0/3360365498 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe45c09d800 con 0x7fe45c154170 2024-04-25T02:28:30.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.326+0000 7fe462d5e640 1 --2- 172.21.15.67:0/3360365498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe45c154170 0x7fe45c0b5080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0720c0 tx=0x7fe454010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:30.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.326+0000 7fe452ffd640 1 -- 172.21.15.67:0/3360365498 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe454010e00 con 0x7fe45c154170 2024-04-25T02:28:30.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.326+0000 7fe452ffd640 1 -- 172.21.15.67:0/3360365498 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe454003990 con 0x7fe45c154170 2024-04-25T02:28:30.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.326+0000 7fe4647c1640 1 -- 172.21.15.67:0/3360365498 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe45c09dae0 con 0x7fe45c154170 2024-04-25T02:28:30.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.326+0000 7fe452ffd640 1 -- 172.21.15.67:0/3360365498 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe454003dc0 con 0x7fe45c154170 2024-04-25T02:28:30.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.326+0000 7fe4647c1640 1 -- 172.21.15.67:0/3360365498 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe45c09e0a0 con 0x7fe45c154170 2024-04-25T02:28:30.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.327+0000 7fe4647c1640 1 -- 172.21.15.67:0/3360365498 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe45c069110 con 0x7fe45c154170 2024-04-25T02:28:30.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.327+0000 7fe452ffd640 1 -- 172.21.15.67:0/3360365498 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe45401e020 con 0x7fe45c154170 2024-04-25T02:28:30.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.328+0000 7fe452ffd640 1 --2- 172.21.15.67:0/3360365498 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe44006be30 0x7fe44006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:30.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.328+0000 7fe452ffd640 1 -- 172.21.15.67:0/3360365498 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe45408b4f0 con 0x7fe45c154170 2024-04-25T02:28:30.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.328+0000 7fe46255d640 1 --2- 172.21.15.67:0/3360365498 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe44006be30 0x7fe44006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:30.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.329+0000 7fe46255d640 1 --2- 172.21.15.67:0/3360365498 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe44006be30 0x7fe44006e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe458000c00 tx=0x7fe458001b00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:30.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.332+0000 7fe452ffd640 1 -- 172.21.15.67:0/3360365498 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe454059e10 con 0x7fe45c154170 2024-04-25T02:28:30.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.517+0000 7fe4647c1640 1 -- 172.21.15.67:0/3360365498 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe45c0b7e50 con 0x7fe45c154170 2024-04-25T02:28:30.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.518+0000 7fe452ffd640 1 -- 172.21.15.67:0/3360365498 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7fe454059710 con 0x7fe45c154170 2024-04-25T02:28:30.522 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:30.522 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:27.819641+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:30.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.520+0000 7fe4647c1640 1 -- 172.21.15.67:0/3360365498 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe44006be30 msgr2=0x7fe44006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:30.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.520+0000 7fe4647c1640 1 --2- 172.21.15.67:0/3360365498 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe44006be30 0x7fe44006e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe458000c00 tx=0x7fe458001b00 comp rx=0 tx=0).stop 2024-04-25T02:28:30.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.520+0000 7fe4647c1640 1 -- 172.21.15.67:0/3360365498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe45c154170 msgr2=0x7fe45c0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:30.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.520+0000 7fe4647c1640 1 --2- 172.21.15.67:0/3360365498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe45c154170 0x7fe45c0b5080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0720c0 tx=0x7fe454010590 comp rx=0 tx=0).stop 2024-04-25T02:28:30.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.520+0000 7fe4647c1640 1 -- 172.21.15.67:0/3360365498 shutdown_connections 2024-04-25T02:28:30.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.520+0000 7fe4647c1640 1 --2- 172.21.15.67:0/3360365498 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe44006be30 0x7fe44006e2f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.520+0000 7fe4647c1640 1 --2- 172.21.15.67:0/3360365498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe45c154170 0x7fe45c0b5080 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.520+0000 7fe4647c1640 1 --2- 172.21.15.67:0/3360365498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe45c153d10 0x7fe45c09f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.520+0000 7fe4647c1640 1 --2- 172.21.15.67:0/3360365498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe448004390 0x7fe45c09e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.520+0000 7fe4647c1640 1 -- 172.21.15.67:0/3360365498 >> 172.21.15.67:0/3360365498 conn(0x7fe45c0d1ed0 msgr2=0x7fe45c0af120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:30.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.520+0000 7fe4647c1640 1 -- 172.21.15.67:0/3360365498 shutdown_connections 2024-04-25T02:28:30.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.520+0000 7fe4647c1640 1 -- 172.21.15.67:0/3360365498 wait complete. 2024-04-25T02:28:30.535 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T02:28:30.535 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:28:30.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.632+0000 7f8d614b3640 1 Processor -- start 2024-04-25T02:28:30.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.632+0000 7f8d614b3640 1 -- start start 2024-04-25T02:28:30.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.633+0000 7f8d614b3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d5c15ee50 0x7f8d5c0d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:30.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.633+0000 7f8d614b3640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d5c15fba0 con 0x7f8d5c0d2c00 2024-04-25T02:28:30.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.633+0000 7f8d614b3640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d5c0d4eb0 con 0x7f8d5c15f230 2024-04-25T02:28:30.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.633+0000 7f8d614b3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5c15fe40 con 0x7f8d5c15ee50 2024-04-25T02:28:30.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.633+0000 7f8d5b7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f8d5c0d2c00 0x7f8d5c160920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51210/0 (socket says 172.21.15.67:51210) 2024-04-25T02:28:30.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.633+0000 7f8d5b7fe640 1 -- 172.21.15.67:0/1788062774 learned_addr learned my addr 172.21.15.67:0/1788062774 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:30.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.633+0000 7f8d5affd640 1 --2- 172.21.15.67:0/1788062774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d5c15ee50 0x7f8d5c0d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:30.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.633+0000 7f8d59ffb640 1 -- 172.21.15.67:0/1788062774 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 655522318 0 0) 0x7f8d5c15fba0 con 0x7f8d5c0d2c00 2024-04-25T02:28:30.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.633+0000 7f8d59ffb640 1 -- 172.21.15.67:0/1788062774 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d44003520 con 0x7f8d5c0d2c00 2024-04-25T02:28:30.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.633+0000 7f8d59ffb640 1 -- 172.21.15.67:0/1788062774 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3185142999 0 0) 0x7f8d5c0d4eb0 con 0x7f8d5c15f230 2024-04-25T02:28:30.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.633+0000 7f8d59ffb640 1 -- 172.21.15.67:0/1788062774 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d5c15fba0 con 0x7f8d5c15f230 2024-04-25T02:28:30.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.633+0000 7f8d59ffb640 1 -- 172.21.15.67:0/1788062774 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 22660181 0 0) 0x7f8d44003520 con 0x7f8d5c0d2c00 2024-04-25T02:28:30.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.633+0000 7f8d59ffb640 1 -- 172.21.15.67:0/1788062774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d5c15ee50 msgr2=0x7f8d5c0d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:30.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.633+0000 7f8d59ffb640 1 --2- 172.21.15.67:0/1788062774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d5c15ee50 0x7f8d5c0d47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.633+0000 7f8d59ffb640 1 -- 172.21.15.67:0/1788062774 >> v1:172.21.15.176:6789/0 conn(0x7f8d5c15f230 legacy=0x7f8d5c0d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:30.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d59ffb640 1 -- 172.21.15.67:0/1788062774 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5c160120 con 0x7f8d5c0d2c00 2024-04-25T02:28:30.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d59ffb640 1 -- 172.21.15.67:0/1788062774 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f8d4c0019f0 con 0x7f8d5c0d2c00 2024-04-25T02:28:30.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d5affd640 1 --2- 172.21.15.67:0/1788062774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d5c15ee50 0x7f8d5c0d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:30.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d59ffb640 1 -- 172.21.15.67:0/1788062774 >> v1:172.21.15.67:6789/0 conn(0x7f8d5c0d2c00 legacy=0x7f8d5c160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:30.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d59ffb640 1 --2- 172.21.15.67:0/1788062774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d44003b70 0x7f8d44003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:30.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d59ffb640 1 --2- 172.21.15.67:0/1788062774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d44004800 0x7f8d44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:30.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d59ffb640 1 --2- 172.21.15.67:0/1788062774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d5c15ee50 0x7f8d440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:30.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d59ffb640 1 -- 172.21.15.67:0/1788062774 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c15fe40 con 0x7f8d44003b70 2024-04-25T02:28:30.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d59ffb640 1 -- 172.21.15.67:0/1788062774 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4400b9f0 con 0x7f8d44004800 2024-04-25T02:28:30.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d59ffb640 1 -- 172.21.15.67:0/1788062774 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8d4400bbf0 con 0x7f8d5c15ee50 2024-04-25T02:28:30.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d5affd640 1 --2- 172.21.15.67:0/1788062774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d44003b70 0x7f8d44003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:30.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d5a7fc640 1 --2- 172.21.15.67:0/1788062774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d44004800 0x7f8d44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:30.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d5b7fe640 1 --2- 172.21.15.67:0/1788062774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d5c15ee50 0x7f8d440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:30.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d5affd640 1 -- 172.21.15.67:0/1788062774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d5c15ee50 msgr2=0x7f8d440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:30.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d5affd640 1 --2- 172.21.15.67:0/1788062774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d5c15ee50 0x7f8d440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d5affd640 1 -- 172.21.15.67:0/1788062774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d44004800 msgr2=0x7f8d44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:30.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d5affd640 1 --2- 172.21.15.67:0/1788062774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d44004800 0x7f8d44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d5affd640 1 -- 172.21.15.67:0/1788062774 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d44003520 con 0x7f8d44003b70 2024-04-25T02:28:30.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.634+0000 7f8d5b7fe640 1 --2- 172.21.15.67:0/1788062774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d5c15ee50 0x7f8d440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:30.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.635+0000 7f8d5affd640 1 --2- 172.21.15.67:0/1788062774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d44003b70 0x7f8d44003f70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009c60 tx=0x7f8d44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67280f18514f56fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:30.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.635+0000 7f8d59ffb640 1 -- 172.21.15.67:0/1788062774 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54036070 con 0x7f8d44003b70 2024-04-25T02:28:30.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.635+0000 7f8d59ffb640 1 -- 172.21.15.67:0/1788062774 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d54031400 con 0x7f8d44003b70 2024-04-25T02:28:30.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.635+0000 7f8d59ffb640 1 -- 172.21.15.67:0/1788062774 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54009860 con 0x7f8d44003b70 2024-04-25T02:28:30.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.635+0000 7f8d614b3640 1 -- 172.21.15.67:0/1788062774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d44003b70 msgr2=0x7f8d44003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:30.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.635+0000 7f8d614b3640 1 --2- 172.21.15.67:0/1788062774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d44003b70 0x7f8d44003f70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009c60 tx=0x7f8d44005830 comp rx=0 tx=0).stop 2024-04-25T02:28:30.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.635+0000 7f8d5b7fe640 1 -- 172.21.15.67:0/1788062774 reap_dead start 2024-04-25T02:28:30.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.635+0000 7f8d614b3640 1 -- 172.21.15.67:0/1788062774 shutdown_connections 2024-04-25T02:28:30.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.635+0000 7f8d614b3640 1 -- 172.21.15.67:0/1788062774 >> 172.21.15.67:0/1788062774 conn(0x7f8d5c09d450 msgr2=0x7f8d5c0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:30.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.635+0000 7f8d614b3640 1 -- 172.21.15.67:0/1788062774 shutdown_connections 2024-04-25T02:28:30.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.635+0000 7f8d614b3640 1 -- 172.21.15.67:0/1788062774 wait complete. 2024-04-25T02:28:30.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.637+0000 7f8d614b3640 1 Processor -- start 2024-04-25T02:28:30.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.637+0000 7f8d614b3640 1 -- start start 2024-04-25T02:28:30.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.637+0000 7f8d614b3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d44003b70 0x7f8d5c15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:30.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.637+0000 7f8d614b3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d5c15afe0 0x7f8d5c158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:30.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.637+0000 7f8d614b3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d5c0b8370 0x7f8d5c1f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:30.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.637+0000 7f8d614b3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c15f810 con 0x7f8d44003b70 2024-04-25T02:28:30.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.637+0000 7f8d614b3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c15f690 con 0x7f8d5c15afe0 2024-04-25T02:28:30.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.637+0000 7f8d614b3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5c0d47b0 con 0x7f8d5c0b8370 2024-04-25T02:28:30.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.637+0000 7f8d5affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d44003b70 0x7f8d5c15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:30.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.637+0000 7f8d5affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d44003b70 0x7f8d5c15d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59336/0 (socket says 172.21.15.67:59336) 2024-04-25T02:28:30.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.637+0000 7f8d5affd640 1 -- 172.21.15.67:0/303989925 learned_addr learned my addr 172.21.15.67:0/303989925 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:30.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.638+0000 7f8d5affd640 1 -- 172.21.15.67:0/303989925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d5c0b8370 msgr2=0x7f8d5c1f7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:30.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.638+0000 7f8d5affd640 1 --2- 172.21.15.67:0/303989925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d5c0b8370 0x7f8d5c1f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.638+0000 7f8d5affd640 1 -- 172.21.15.67:0/303989925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d5c15afe0 msgr2=0x7f8d5c158910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:30.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.638+0000 7f8d5affd640 1 --2- 172.21.15.67:0/303989925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d5c15afe0 0x7f8d5c158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.638+0000 7f8d5affd640 1 -- 172.21.15.67:0/303989925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5c15ddb0 con 0x7f8d44003b70 2024-04-25T02:28:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.638+0000 7f8d5affd640 1 --2- 172.21.15.67:0/303989925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d44003b70 0x7f8d5c15d6d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009d80 tx=0x7f8d54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.638+0000 7f8d437fe640 1 -- 172.21.15.67:0/303989925 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54040020 con 0x7f8d44003b70 2024-04-25T02:28:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.638+0000 7f8d437fe640 1 -- 172.21.15.67:0/303989925 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d540093e0 con 0x7f8d44003b70 2024-04-25T02:28:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.638+0000 7f8d614b3640 1 -- 172.21.15.67:0/303989925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5c15e090 con 0x7f8d44003b70 2024-04-25T02:28:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.638+0000 7f8d437fe640 1 -- 172.21.15.67:0/303989925 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54036040 con 0x7f8d44003b70 2024-04-25T02:28:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.638+0000 7f8d614b3640 1 -- 172.21.15.67:0/303989925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d5c15e650 con 0x7f8d44003b70 2024-04-25T02:28:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.639+0000 7f8d614b3640 1 -- 172.21.15.67:0/303989925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d5c069110 con 0x7f8d44003b70 2024-04-25T02:28:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.640+0000 7f8d437fe640 1 -- 172.21.15.67:0/303989925 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d54043020 con 0x7f8d44003b70 2024-04-25T02:28:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.640+0000 7f8d437fe640 1 --2- 172.21.15.67:0/303989925 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8d4806be30 0x7f8d4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.640+0000 7f8d437fe640 1 -- 172.21.15.67:0/303989925 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8d540ab410 con 0x7f8d44003b70 2024-04-25T02:28:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.640+0000 7f8d5a7fc640 1 --2- 172.21.15.67:0/303989925 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8d4806be30 0x7f8d4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.641+0000 7f8d5a7fc640 1 --2- 172.21.15.67:0/303989925 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8d4806be30 0x7f8d4806e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0ca560 tx=0x7f8d50009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:30.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.644+0000 7f8d437fe640 1 -- 172.21.15.67:0/303989925 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8d5404a030 con 0x7f8d44003b70 2024-04-25T02:28:30.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.826+0000 7f8d614b3640 1 -- 172.21.15.67:0/303989925 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d5c0d1800 con 0x7f8d4806be30 2024-04-25T02:28:30.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.834+0000 7f8d437fe640 1 -- 172.21.15.67:0/303989925 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251946 (secure 0 0 0) 0x7f8d5c0d1800 con 0x7f8d4806be30 2024-04-25T02:28:30.841 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:30.842 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-25T02:28:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.837+0000 7f8d614b3640 1 -- 172.21.15.67:0/303989925 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8d4806be30 msgr2=0x7f8d4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.837+0000 7f8d614b3640 1 --2- 172.21.15.67:0/303989925 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8d4806be30 0x7f8d4806e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0ca560 tx=0x7f8d50009040 comp rx=0 tx=0).stop 2024-04-25T02:28:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.837+0000 7f8d614b3640 1 -- 172.21.15.67:0/303989925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d44003b70 msgr2=0x7f8d5c15d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.837+0000 7f8d614b3640 1 --2- 172.21.15.67:0/303989925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d44003b70 0x7f8d5c15d6d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009d80 tx=0x7f8d54004730 comp rx=0 tx=0).stop 2024-04-25T02:28:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.837+0000 7f8d614b3640 1 -- 172.21.15.67:0/303989925 shutdown_connections 2024-04-25T02:28:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.837+0000 7f8d614b3640 1 --2- 172.21.15.67:0/303989925 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8d4806be30 0x7f8d4806e2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.837+0000 7f8d614b3640 1 --2- 172.21.15.67:0/303989925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d5c0b8370 0x7f8d5c1f7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.837+0000 7f8d614b3640 1 --2- 172.21.15.67:0/303989925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d5c15afe0 0x7f8d5c158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.837+0000 7f8d614b3640 1 --2- 172.21.15.67:0/303989925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d44003b70 0x7f8d5c15d6d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.837+0000 7f8d614b3640 1 -- 172.21.15.67:0/303989925 >> 172.21.15.67:0/303989925 conn(0x7f8d5c09d450 msgr2=0x7f8d5c0cf6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.837+0000 7f8d614b3640 1 -- 172.21.15.67:0/303989925 shutdown_connections 2024-04-25T02:28:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.837+0000 7f8d614b3640 1 -- 172.21.15.67:0/303989925 wait complete. 2024-04-25T02:28:30.852 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-25T02:28:30.330813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218924,"kb_used_data":2752,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755796,"statfs":{"total":773094113280,"available":772869935104,"internally_reserved":0,"allocated":2818048,"data_stored":1715228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.526756"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266478+0000","last_change":"2024-04-25T02:28:26.842721+0000","last_active":"2024-04-25T02:28:28.266478+0000","last_peered":"2024-04-25T02:28:28.266478+0000","last_clean":"2024-04-25T02:28:28.266478+0000","last_became_active":"2024-04-25T02:28:26.842458+0000","last_became_peered":"2024-04-25T02:28:26.842458+0000","last_unstale":"2024-04-25T02:28:28.266478+0000","last_undegraded":"2024-04-25T02:28:28.266478+0000","last_fullsized":"2024-04-25T02:28:28.266478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:17.268811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.823036+0000","last_change":"2024-04-25T02:28:26.837624+0000","last_active":"2024-04-25T02:28:27.823036+0000","last_peered":"2024-04-25T02:28:27.823036+0000","last_clean":"2024-04-25T02:28:27.823036+0000","last_became_active":"2024-04-25T02:28:26.837058+0000","last_became_peered":"2024-04-25T02:28:26.837058+0000","last_unstale":"2024-04-25T02:28:27.823036+0000","last_undegraded":"2024-04-25T02:28:27.823036+0000","last_fullsized":"2024-04-25T02:28:27.823036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:35.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266185+0000","last_change":"2024-04-25T02:28:26.826784+0000","last_active":"2024-04-25T02:28:28.266185+0000","last_peered":"2024-04-25T02:28:28.266185+0000","last_clean":"2024-04-25T02:28:28.266185+0000","last_became_active":"2024-04-25T02:28:26.825536+0000","last_became_peered":"2024-04-25T02:28:26.825536+0000","last_unstale":"2024-04-25T02:28:28.266185+0000","last_undegraded":"2024-04-25T02:28:28.266185+0000","last_fullsized":"2024-04-25T02:28:28.266185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:12.142773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826216+0000","last_change":"2024-04-25T02:28:26.831333+0000","last_active":"2024-04-25T02:28:27.826216+0000","last_peered":"2024-04-25T02:28:27.826216+0000","last_clean":"2024-04-25T02:28:27.826216+0000","last_became_active":"2024-04-25T02:28:26.831046+0000","last_became_peered":"2024-04-25T02:28:26.831046+0000","last_unstale":"2024-04-25T02:28:27.826216+0000","last_undegraded":"2024-04-25T02:28:27.826216+0000","last_fullsized":"2024-04-25T02:28:27.826216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266136+0000","last_change":"2024-04-25T02:28:26.835027+0000","last_active":"2024-04-25T02:28:28.266136+0000","last_peered":"2024-04-25T02:28:28.266136+0000","last_clean":"2024-04-25T02:28:28.266136+0000","last_became_active":"2024-04-25T02:28:26.834736+0000","last_became_peered":"2024-04-25T02:28:26.834736+0000","last_unstale":"2024-04-25T02:28:28.266136+0000","last_undegraded":"2024-04-25T02:28:28.266136+0000","last_fullsized":"2024-04-25T02:28:28.266136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:05.955540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826676+0000","last_change":"2024-04-25T02:28:26.832120+0000","last_active":"2024-04-25T02:28:27.826676+0000","last_peered":"2024-04-25T02:28:27.826676+0000","last_clean":"2024-04-25T02:28:27.826676+0000","last_became_active":"2024-04-25T02:28:26.831833+0000","last_became_peered":"2024-04-25T02:28:26.831833+0000","last_unstale":"2024-04-25T02:28:27.826676+0000","last_undegraded":"2024-04-25T02:28:27.826676+0000","last_fullsized":"2024-04-25T02:28:27.826676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:21.146249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266243+0000","last_change":"2024-04-25T02:28:26.837402+0000","last_active":"2024-04-25T02:28:28.266243+0000","last_peered":"2024-04-25T02:28:28.266243+0000","last_clean":"2024-04-25T02:28:28.266243+0000","last_became_active":"2024-04-25T02:28:26.836964+0000","last_became_peered":"2024-04-25T02:28:26.836964+0000","last_unstale":"2024-04-25T02:28:28.266243+0000","last_undegraded":"2024-04-25T02:28:28.266243+0000","last_fullsized":"2024-04-25T02:28:28.266243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:26.305868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266771+0000","last_change":"2024-04-25T02:28:26.838251+0000","last_active":"2024-04-25T02:28:28.266771+0000","last_peered":"2024-04-25T02:28:28.266771+0000","last_clean":"2024-04-25T02:28:28.266771+0000","last_became_active":"2024-04-25T02:28:26.837980+0000","last_became_peered":"2024-04-25T02:28:26.837980+0000","last_unstale":"2024-04-25T02:28:28.266771+0000","last_undegraded":"2024-04-25T02:28:28.266771+0000","last_fullsized":"2024-04-25T02:28:28.266771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:12.142773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266517+0000","last_change":"2024-04-25T02:28:26.843536+0000","last_active":"2024-04-25T02:28:28.266517+0000","last_peered":"2024-04-25T02:28:28.266517+0000","last_clean":"2024-04-25T02:28:28.266517+0000","last_became_active":"2024-04-25T02:28:26.841986+0000","last_became_peered":"2024-04-25T02:28:26.841986+0000","last_unstale":"2024-04-25T02:28:28.266517+0000","last_undegraded":"2024-04-25T02:28:28.266517+0000","last_fullsized":"2024-04-25T02:28:28.266517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:08.277396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829942+0000","last_change":"2024-04-25T02:28:26.835526+0000","last_active":"2024-04-25T02:28:27.829942+0000","last_peered":"2024-04-25T02:28:27.829942+0000","last_clean":"2024-04-25T02:28:27.829942+0000","last_became_active":"2024-04-25T02:28:26.835228+0000","last_became_peered":"2024-04-25T02:28:26.835228+0000","last_unstale":"2024-04-25T02:28:27.829942+0000","last_undegraded":"2024-04-25T02:28:27.829942+0000","last_fullsized":"2024-04-25T02:28:27.829942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829950+0000","last_change":"2024-04-25T02:28:26.836024+0000","last_active":"2024-04-25T02:28:27.829950+0000","last_peered":"2024-04-25T02:28:27.829950+0000","last_clean":"2024-04-25T02:28:27.829950+0000","last_became_active":"2024-04-25T02:28:26.835757+0000","last_became_peered":"2024-04-25T02:28:26.835757+0000","last_unstale":"2024-04-25T02:28:27.829950+0000","last_undegraded":"2024-04-25T02:28:27.829950+0000","last_fullsized":"2024-04-25T02:28:27.829950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826663+0000","last_change":"2024-04-25T02:28:26.833151+0000","last_active":"2024-04-25T02:28:27.826663+0000","last_peered":"2024-04-25T02:28:27.826663+0000","last_clean":"2024-04-25T02:28:27.826663+0000","last_became_active":"2024-04-25T02:28:26.832420+0000","last_became_peered":"2024-04-25T02:28:26.832420+0000","last_unstale":"2024-04-25T02:28:27.826663+0000","last_undegraded":"2024-04-25T02:28:27.826663+0000","last_fullsized":"2024-04-25T02:28:27.826663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:11.788886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266446+0000","last_change":"2024-04-25T02:28:26.827208+0000","last_active":"2024-04-25T02:28:28.266446+0000","last_peered":"2024-04-25T02:28:28.266446+0000","last_clean":"2024-04-25T02:28:28.266446+0000","last_became_active":"2024-04-25T02:28:26.826926+0000","last_became_peered":"2024-04-25T02:28:26.826926+0000","last_unstale":"2024-04-25T02:28:28.266446+0000","last_undegraded":"2024-04-25T02:28:28.266446+0000","last_fullsized":"2024-04-25T02:28:28.266446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:14.690953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265726+0000","last_change":"2024-04-25T02:28:26.833942+0000","last_active":"2024-04-25T02:28:28.265726+0000","last_peered":"2024-04-25T02:28:28.265726+0000","last_clean":"2024-04-25T02:28:28.265726+0000","last_became_active":"2024-04-25T02:28:26.833059+0000","last_became_peered":"2024-04-25T02:28:26.833059+0000","last_unstale":"2024-04-25T02:28:28.265726+0000","last_undegraded":"2024-04-25T02:28:28.265726+0000","last_fullsized":"2024-04-25T02:28:28.265726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:19:26.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822826+0000","last_change":"2024-04-25T02:28:26.841353+0000","last_active":"2024-04-25T02:28:27.822826+0000","last_peered":"2024-04-25T02:28:27.822826+0000","last_clean":"2024-04-25T02:28:27.822826+0000","last_became_active":"2024-04-25T02:28:26.841024+0000","last_became_peered":"2024-04-25T02:28:26.841024+0000","last_unstale":"2024-04-25T02:28:27.822826+0000","last_undegraded":"2024-04-25T02:28:27.822826+0000","last_fullsized":"2024-04-25T02:28:27.822826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:09.762419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826145+0000","last_change":"2024-04-25T02:28:26.831558+0000","last_active":"2024-04-25T02:28:27.826145+0000","last_peered":"2024-04-25T02:28:27.826145+0000","last_clean":"2024-04-25T02:28:27.826145+0000","last_became_active":"2024-04-25T02:28:26.831124+0000","last_became_peered":"2024-04-25T02:28:26.831124+0000","last_unstale":"2024-04-25T02:28:27.826145+0000","last_undegraded":"2024-04-25T02:28:27.826145+0000","last_fullsized":"2024-04-25T02:28:27.826145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827300+0000","last_change":"2024-04-25T02:28:26.833767+0000","last_active":"2024-04-25T02:28:27.827300+0000","last_peered":"2024-04-25T02:28:27.827300+0000","last_clean":"2024-04-25T02:28:27.827300+0000","last_became_active":"2024-04-25T02:28:26.833261+0000","last_became_peered":"2024-04-25T02:28:26.833261+0000","last_unstale":"2024-04-25T02:28:27.827300+0000","last_undegraded":"2024-04-25T02:28:27.827300+0000","last_fullsized":"2024-04-25T02:28:27.827300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:17.268811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266709+0000","last_change":"2024-04-25T02:28:26.829506+0000","last_active":"2024-04-25T02:28:28.266709+0000","last_peered":"2024-04-25T02:28:28.266709+0000","last_clean":"2024-04-25T02:28:28.266709+0000","last_became_active":"2024-04-25T02:28:26.829220+0000","last_became_peered":"2024-04-25T02:28:26.829220+0000","last_unstale":"2024-04-25T02:28:28.266709+0000","last_undegraded":"2024-04-25T02:28:28.266709+0000","last_fullsized":"2024-04-25T02:28:28.266709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:54.957406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266478+0000","last_change":"2024-04-25T02:28:26.836463+0000","last_active":"2024-04-25T02:28:28.266478+0000","last_peered":"2024-04-25T02:28:28.266478+0000","last_clean":"2024-04-25T02:28:28.266478+0000","last_became_active":"2024-04-25T02:28:26.836202+0000","last_became_peered":"2024-04-25T02:28:26.836202+0000","last_unstale":"2024-04-25T02:28:28.266478+0000","last_undegraded":"2024-04-25T02:28:28.266478+0000","last_fullsized":"2024-04-25T02:28:28.266478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:19.911809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829840+0000","last_change":"2024-04-25T02:28:26.826332+0000","last_active":"2024-04-25T02:28:27.829840+0000","last_peered":"2024-04-25T02:28:27.829840+0000","last_clean":"2024-04-25T02:28:27.829840+0000","last_became_active":"2024-04-25T02:28:26.825996+0000","last_became_peered":"2024-04-25T02:28:26.825996+0000","last_unstale":"2024-04-25T02:28:27.829840+0000","last_undegraded":"2024-04-25T02:28:27.829840+0000","last_fullsized":"2024-04-25T02:28:27.829840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:14.690953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266099+0000","last_change":"2024-04-25T02:28:26.832851+0000","last_active":"2024-04-25T02:28:28.266099+0000","last_peered":"2024-04-25T02:28:28.266099+0000","last_clean":"2024-04-25T02:28:28.266099+0000","last_became_active":"2024-04-25T02:28:26.830932+0000","last_became_peered":"2024-04-25T02:28:26.830932+0000","last_unstale":"2024-04-25T02:28:28.266099+0000","last_undegraded":"2024-04-25T02:28:28.266099+0000","last_fullsized":"2024-04-25T02:28:28.266099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:27.737871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826827+0000","last_change":"2024-04-25T02:28:26.833872+0000","last_active":"2024-04-25T02:28:27.826827+0000","last_peered":"2024-04-25T02:28:27.826827+0000","last_clean":"2024-04-25T02:28:27.826827+0000","last_became_active":"2024-04-25T02:28:26.833622+0000","last_became_peered":"2024-04-25T02:28:26.833622+0000","last_unstale":"2024-04-25T02:28:27.826827+0000","last_undegraded":"2024-04-25T02:28:27.826827+0000","last_fullsized":"2024-04-25T02:28:27.826827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:41.798312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266222+0000","last_change":"2024-04-25T02:28:26.839712+0000","last_active":"2024-04-25T02:28:28.266222+0000","last_peered":"2024-04-25T02:28:28.266222+0000","last_clean":"2024-04-25T02:28:28.266222+0000","last_became_active":"2024-04-25T02:28:26.839411+0000","last_became_peered":"2024-04-25T02:28:26.839411+0000","last_unstale":"2024-04-25T02:28:28.266222+0000","last_undegraded":"2024-04-25T02:28:28.266222+0000","last_fullsized":"2024-04-25T02:28:28.266222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826301+0000","last_change":"2024-04-25T02:28:26.831405+0000","last_active":"2024-04-25T02:28:27.826301+0000","last_peered":"2024-04-25T02:28:27.826301+0000","last_clean":"2024-04-25T02:28:27.826301+0000","last_became_active":"2024-04-25T02:28:26.830794+0000","last_became_peered":"2024-04-25T02:28:26.830794+0000","last_unstale":"2024-04-25T02:28:27.826301+0000","last_undegraded":"2024-04-25T02:28:27.826301+0000","last_fullsized":"2024-04-25T02:28:27.826301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:35.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266665+0000","last_change":"2024-04-25T02:28:26.839008+0000","last_active":"2024-04-25T02:28:28.266665+0000","last_peered":"2024-04-25T02:28:28.266665+0000","last_clean":"2024-04-25T02:28:28.266665+0000","last_became_active":"2024-04-25T02:28:26.838644+0000","last_became_peered":"2024-04-25T02:28:26.838644+0000","last_unstale":"2024-04-25T02:28:28.266665+0000","last_undegraded":"2024-04-25T02:28:28.266665+0000","last_fullsized":"2024-04-25T02:28:28.266665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829981+0000","last_change":"2024-04-25T02:28:26.831816+0000","last_active":"2024-04-25T02:28:27.829981+0000","last_peered":"2024-04-25T02:28:27.829981+0000","last_clean":"2024-04-25T02:28:27.829981+0000","last_became_active":"2024-04-25T02:28:26.831553+0000","last_became_peered":"2024-04-25T02:28:26.831553+0000","last_unstale":"2024-04-25T02:28:27.829981+0000","last_undegraded":"2024-04-25T02:28:27.829981+0000","last_fullsized":"2024-04-25T02:28:27.829981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:35.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822894+0000","last_change":"2024-04-25T02:28:26.839750+0000","last_active":"2024-04-25T02:28:27.822894+0000","last_peered":"2024-04-25T02:28:27.822894+0000","last_clean":"2024-04-25T02:28:27.822894+0000","last_became_active":"2024-04-25T02:28:26.839465+0000","last_became_peered":"2024-04-25T02:28:26.839465+0000","last_unstale":"2024-04-25T02:28:27.822894+0000","last_undegraded":"2024-04-25T02:28:27.822894+0000","last_fullsized":"2024-04-25T02:28:27.822894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:14.690953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266891+0000","last_change":"2024-04-25T02:28:26.841574+0000","last_active":"2024-04-25T02:28:28.266891+0000","last_peered":"2024-04-25T02:28:28.266891+0000","last_clean":"2024-04-25T02:28:28.266891+0000","last_became_active":"2024-04-25T02:28:26.841294+0000","last_became_peered":"2024-04-25T02:28:26.841294+0000","last_unstale":"2024-04-25T02:28:28.266891+0000","last_undegraded":"2024-04-25T02:28:28.266891+0000","last_fullsized":"2024-04-25T02:28:28.266891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:05.955540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266251+0000","last_change":"2024-04-25T02:28:26.826424+0000","last_active":"2024-04-25T02:28:28.266251+0000","last_peered":"2024-04-25T02:28:28.266251+0000","last_clean":"2024-04-25T02:28:28.266251+0000","last_became_active":"2024-04-25T02:28:26.826110+0000","last_became_peered":"2024-04-25T02:28:26.826110+0000","last_unstale":"2024-04-25T02:28:28.266251+0000","last_undegraded":"2024-04-25T02:28:28.266251+0000","last_fullsized":"2024-04-25T02:28:28.266251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827064+0000","last_change":"2024-04-25T02:28:26.827830+0000","last_active":"2024-04-25T02:28:27.827064+0000","last_peered":"2024-04-25T02:28:27.827064+0000","last_clean":"2024-04-25T02:28:27.827064+0000","last_became_active":"2024-04-25T02:28:26.827580+0000","last_became_peered":"2024-04-25T02:28:26.827580+0000","last_unstale":"2024-04-25T02:28:27.827064+0000","last_undegraded":"2024-04-25T02:28:27.827064+0000","last_fullsized":"2024-04-25T02:28:27.827064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:26.897425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266587+0000","last_change":"2024-04-25T02:28:26.835685+0000","last_active":"2024-04-25T02:28:28.266587+0000","last_peered":"2024-04-25T02:28:28.266587+0000","last_clean":"2024-04-25T02:28:28.266587+0000","last_became_active":"2024-04-25T02:28:26.835362+0000","last_became_peered":"2024-04-25T02:28:26.835362+0000","last_unstale":"2024-04-25T02:28:28.266587+0000","last_undegraded":"2024-04-25T02:28:28.266587+0000","last_fullsized":"2024-04-25T02:28:28.266587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:23.832987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829554+0000","last_change":"2024-04-25T02:28:26.829119+0000","last_active":"2024-04-25T02:28:27.829554+0000","last_peered":"2024-04-25T02:28:27.829554+0000","last_clean":"2024-04-25T02:28:27.829554+0000","last_became_active":"2024-04-25T02:28:26.828611+0000","last_became_peered":"2024-04-25T02:28:26.828611+0000","last_unstale":"2024-04-25T02:28:27.829554+0000","last_undegraded":"2024-04-25T02:28:27.829554+0000","last_fullsized":"2024-04-25T02:28:27.829554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826257+0000","last_change":"2024-04-25T02:28:26.836988+0000","last_active":"2024-04-25T02:28:27.826257+0000","last_peered":"2024-04-25T02:28:27.826257+0000","last_clean":"2024-04-25T02:28:27.826257+0000","last_became_active":"2024-04-25T02:28:26.836475+0000","last_became_peered":"2024-04-25T02:28:26.836475+0000","last_unstale":"2024-04-25T02:28:27.826257+0000","last_undegraded":"2024-04-25T02:28:27.826257+0000","last_fullsized":"2024-04-25T02:28:27.826257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:33.827773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266723+0000","last_change":"2024-04-25T02:28:25.831862+0000","last_active":"2024-04-25T02:28:28.266723+0000","last_peered":"2024-04-25T02:28:28.266723+0000","last_clean":"2024-04-25T02:28:28.266723+0000","last_became_active":"2024-04-25T02:28:25.831543+0000","last_became_peered":"2024-04-25T02:28:25.831543+0000","last_unstale":"2024-04-25T02:28:28.266723+0000","last_undegraded":"2024-04-25T02:28:28.266723+0000","last_fullsized":"2024-04-25T02:28:28.266723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266403+0000","last_change":"2024-04-25T02:28:26.824999+0000","last_active":"2024-04-25T02:28:28.266403+0000","last_peered":"2024-04-25T02:28:28.266403+0000","last_clean":"2024-04-25T02:28:28.266403+0000","last_became_active":"2024-04-25T02:28:26.824688+0000","last_became_peered":"2024-04-25T02:28:26.824688+0000","last_unstale":"2024-04-25T02:28:28.266403+0000","last_undegraded":"2024-04-25T02:28:28.266403+0000","last_fullsized":"2024-04-25T02:28:28.266403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:14.690953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829683+0000","last_change":"2024-04-25T02:28:25.821131+0000","last_active":"2024-04-25T02:28:27.829683+0000","last_peered":"2024-04-25T02:28:27.829683+0000","last_clean":"2024-04-25T02:28:27.829683+0000","last_became_active":"2024-04-25T02:28:25.820867+0000","last_became_peered":"2024-04-25T02:28:25.820867+0000","last_unstale":"2024-04-25T02:28:27.829683+0000","last_undegraded":"2024-04-25T02:28:27.829683+0000","last_fullsized":"2024-04-25T02:28:27.829683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:10.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266380+0000","last_change":"2024-04-25T02:28:25.830948+0000","last_active":"2024-04-25T02:28:28.266380+0000","last_peered":"2024-04-25T02:28:28.266380+0000","last_clean":"2024-04-25T02:28:28.266380+0000","last_became_active":"2024-04-25T02:28:25.830638+0000","last_became_peered":"2024-04-25T02:28:25.830638+0000","last_unstale":"2024-04-25T02:28:28.266380+0000","last_undegraded":"2024-04-25T02:28:28.266380+0000","last_fullsized":"2024-04-25T02:28:28.266380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:48.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266977+0000","last_change":"2024-04-25T02:28:26.828838+0000","last_active":"2024-04-25T02:28:28.266977+0000","last_peered":"2024-04-25T02:28:28.266977+0000","last_clean":"2024-04-25T02:28:28.266977+0000","last_became_active":"2024-04-25T02:28:26.827915+0000","last_became_peered":"2024-04-25T02:28:26.827915+0000","last_unstale":"2024-04-25T02:28:28.266977+0000","last_undegraded":"2024-04-25T02:28:28.266977+0000","last_fullsized":"2024-04-25T02:28:28.266977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:21.146249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826399+0000","last_change":"2024-04-25T02:28:25.819425+0000","last_active":"2024-04-25T02:28:27.826399+0000","last_peered":"2024-04-25T02:28:27.826399+0000","last_clean":"2024-04-25T02:28:27.826399+0000","last_became_active":"2024-04-25T02:28:25.819124+0000","last_became_peered":"2024-04-25T02:28:25.819124+0000","last_unstale":"2024-04-25T02:28:27.826399+0000","last_undegraded":"2024-04-25T02:28:27.826399+0000","last_fullsized":"2024-04-25T02:28:27.826399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:32.823247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822908+0000","last_change":"2024-04-25T02:28:26.840249+0000","last_active":"2024-04-25T02:28:27.822908+0000","last_peered":"2024-04-25T02:28:27.822908+0000","last_clean":"2024-04-25T02:28:27.822908+0000","last_became_active":"2024-04-25T02:28:26.839935+0000","last_became_peered":"2024-04-25T02:28:26.839935+0000","last_unstale":"2024-04-25T02:28:27.822908+0000","last_undegraded":"2024-04-25T02:28:27.822908+0000","last_fullsized":"2024-04-25T02:28:27.822908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829936+0000","last_change":"2024-04-25T02:28:25.827094+0000","last_active":"2024-04-25T02:28:27.829936+0000","last_peered":"2024-04-25T02:28:27.829936+0000","last_clean":"2024-04-25T02:28:27.829936+0000","last_became_active":"2024-04-25T02:28:25.826833+0000","last_became_peered":"2024-04-25T02:28:25.826833+0000","last_unstale":"2024-04-25T02:28:27.829936+0000","last_undegraded":"2024-04-25T02:28:27.829936+0000","last_fullsized":"2024-04-25T02:28:27.829936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:48.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826933+0000","last_change":"2024-04-25T02:28:26.830006+0000","last_active":"2024-04-25T02:28:27.826933+0000","last_peered":"2024-04-25T02:28:27.826933+0000","last_clean":"2024-04-25T02:28:27.826933+0000","last_became_active":"2024-04-25T02:28:26.829703+0000","last_became_peered":"2024-04-25T02:28:26.829703+0000","last_unstale":"2024-04-25T02:28:27.826933+0000","last_undegraded":"2024-04-25T02:28:27.826933+0000","last_fullsized":"2024-04-25T02:28:27.826933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:26.305868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826920+0000","last_change":"2024-04-25T02:28:25.824029+0000","last_active":"2024-04-25T02:28:27.826920+0000","last_peered":"2024-04-25T02:28:27.826920+0000","last_clean":"2024-04-25T02:28:27.826920+0000","last_became_active":"2024-04-25T02:28:25.823734+0000","last_became_peered":"2024-04-25T02:28:25.823734+0000","last_unstale":"2024-04-25T02:28:27.826920+0000","last_undegraded":"2024-04-25T02:28:27.826920+0000","last_fullsized":"2024-04-25T02:28:27.826920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:22.828461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266445+0000","last_change":"2024-04-25T02:28:26.833144+0000","last_active":"2024-04-25T02:28:28.266445+0000","last_peered":"2024-04-25T02:28:28.266445+0000","last_clean":"2024-04-25T02:28:28.266445+0000","last_became_active":"2024-04-25T02:28:26.832578+0000","last_became_peered":"2024-04-25T02:28:26.832578+0000","last_unstale":"2024-04-25T02:28:28.266445+0000","last_undegraded":"2024-04-25T02:28:28.266445+0000","last_fullsized":"2024-04-25T02:28:28.266445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822999+0000","last_change":"2024-04-25T02:28:25.827731+0000","last_active":"2024-04-25T02:28:27.822999+0000","last_peered":"2024-04-25T02:28:27.822999+0000","last_clean":"2024-04-25T02:28:27.822999+0000","last_became_active":"2024-04-25T02:28:25.827415+0000","last_became_peered":"2024-04-25T02:28:25.827415+0000","last_unstale":"2024-04-25T02:28:27.822999+0000","last_undegraded":"2024-04-25T02:28:27.822999+0000","last_fullsized":"2024-04-25T02:28:27.822999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826897+0000","last_change":"2024-04-25T02:28:26.833382+0000","last_active":"2024-04-25T02:28:27.826897+0000","last_peered":"2024-04-25T02:28:27.826897+0000","last_clean":"2024-04-25T02:28:27.826897+0000","last_became_active":"2024-04-25T02:28:26.832896+0000","last_became_peered":"2024-04-25T02:28:26.832896+0000","last_unstale":"2024-04-25T02:28:27.826897+0000","last_undegraded":"2024-04-25T02:28:27.826897+0000","last_fullsized":"2024-04-25T02:28:27.826897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:23.832987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829943+0000","last_change":"2024-04-25T02:28:25.831322+0000","last_active":"2024-04-25T02:28:27.829943+0000","last_peered":"2024-04-25T02:28:27.829943+0000","last_clean":"2024-04-25T02:28:27.829943+0000","last_became_active":"2024-04-25T02:28:25.831024+0000","last_became_peered":"2024-04-25T02:28:25.831024+0000","last_unstale":"2024-04-25T02:28:27.829943+0000","last_undegraded":"2024-04-25T02:28:27.829943+0000","last_fullsized":"2024-04-25T02:28:27.829943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:22.828461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266281+0000","last_change":"2024-04-25T02:28:26.837505+0000","last_active":"2024-04-25T02:28:28.266281+0000","last_peered":"2024-04-25T02:28:28.266281+0000","last_clean":"2024-04-25T02:28:28.266281+0000","last_became_active":"2024-04-25T02:28:26.836986+0000","last_became_peered":"2024-04-25T02:28:26.836986+0000","last_unstale":"2024-04-25T02:28:28.266281+0000","last_undegraded":"2024-04-25T02:28:28.266281+0000","last_fullsized":"2024-04-25T02:28:28.266281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:26.897425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266515+0000","last_change":"2024-04-25T02:28:25.830714+0000","last_active":"2024-04-25T02:28:28.266515+0000","last_peered":"2024-04-25T02:28:28.266515+0000","last_clean":"2024-04-25T02:28:28.266515+0000","last_became_active":"2024-04-25T02:28:25.830407+0000","last_became_peered":"2024-04-25T02:28:25.830407+0000","last_unstale":"2024-04-25T02:28:28.266515+0000","last_undegraded":"2024-04-25T02:28:28.266515+0000","last_fullsized":"2024-04-25T02:28:28.266515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:15.170784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265782+0000","last_change":"2024-04-25T02:28:26.830192+0000","last_active":"2024-04-25T02:28:28.265782+0000","last_peered":"2024-04-25T02:28:28.265782+0000","last_clean":"2024-04-25T02:28:28.265782+0000","last_became_active":"2024-04-25T02:28:26.829820+0000","last_became_peered":"2024-04-25T02:28:26.829820+0000","last_unstale":"2024-04-25T02:28:28.265782+0000","last_undegraded":"2024-04-25T02:28:28.265782+0000","last_fullsized":"2024-04-25T02:28:28.265782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:29.495511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826919+0000","last_change":"2024-04-25T02:28:25.826726+0000","last_active":"2024-04-25T02:28:27.826919+0000","last_peered":"2024-04-25T02:28:27.826919+0000","last_clean":"2024-04-25T02:28:27.826919+0000","last_became_active":"2024-04-25T02:28:25.826427+0000","last_became_peered":"2024-04-25T02:28:25.826427+0000","last_unstale":"2024-04-25T02:28:27.826919+0000","last_undegraded":"2024-04-25T02:28:27.826919+0000","last_fullsized":"2024-04-25T02:28:27.826919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266162+0000","last_change":"2024-04-25T02:28:26.842107+0000","last_active":"2024-04-25T02:28:28.266162+0000","last_peered":"2024-04-25T02:28:28.266162+0000","last_clean":"2024-04-25T02:28:28.266162+0000","last_became_active":"2024-04-25T02:28:26.841784+0000","last_became_peered":"2024-04-25T02:28:26.841784+0000","last_unstale":"2024-04-25T02:28:28.266162+0000","last_undegraded":"2024-04-25T02:28:28.266162+0000","last_fullsized":"2024-04-25T02:28:28.266162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:21.146249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829509+0000","last_change":"2024-04-25T02:28:25.822245+0000","last_active":"2024-04-25T02:28:27.829509+0000","last_peered":"2024-04-25T02:28:27.829509+0000","last_clean":"2024-04-25T02:28:27.829509+0000","last_became_active":"2024-04-25T02:28:25.821961+0000","last_became_peered":"2024-04-25T02:28:25.821961+0000","last_unstale":"2024-04-25T02:28:27.829509+0000","last_undegraded":"2024-04-25T02:28:27.829509+0000","last_fullsized":"2024-04-25T02:28:27.829509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829553+0000","last_change":"2024-04-25T02:28:26.828898+0000","last_active":"2024-04-25T02:28:27.829553+0000","last_peered":"2024-04-25T02:28:27.829553+0000","last_clean":"2024-04-25T02:28:27.829553+0000","last_became_active":"2024-04-25T02:28:26.828274+0000","last_became_peered":"2024-04-25T02:28:26.828274+0000","last_unstale":"2024-04-25T02:28:27.829553+0000","last_undegraded":"2024-04-25T02:28:27.829553+0000","last_fullsized":"2024-04-25T02:28:27.829553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:12.142773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266835+0000","last_change":"2024-04-25T02:28:25.820968+0000","last_active":"2024-04-25T02:28:28.266835+0000","last_peered":"2024-04-25T02:28:28.266835+0000","last_clean":"2024-04-25T02:28:28.266835+0000","last_became_active":"2024-04-25T02:28:25.820583+0000","last_became_peered":"2024-04-25T02:28:25.820583+0000","last_unstale":"2024-04-25T02:28:28.266835+0000","last_undegraded":"2024-04-25T02:28:28.266835+0000","last_fullsized":"2024-04-25T02:28:28.266835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:17:36.734690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266094+0000","last_change":"2024-04-25T02:28:26.839360+0000","last_active":"2024-04-25T02:28:28.266094+0000","last_peered":"2024-04-25T02:28:28.266094+0000","last_clean":"2024-04-25T02:28:28.266094+0000","last_became_active":"2024-04-25T02:28:26.839071+0000","last_became_peered":"2024-04-25T02:28:26.839071+0000","last_unstale":"2024-04-25T02:28:28.266094+0000","last_undegraded":"2024-04-25T02:28:28.266094+0000","last_fullsized":"2024-04-25T02:28:28.266094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:52.300089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826544+0000","last_change":"2024-04-25T02:28:25.831348+0000","last_active":"2024-04-25T02:28:27.826544+0000","last_peered":"2024-04-25T02:28:27.826544+0000","last_clean":"2024-04-25T02:28:27.826544+0000","last_became_active":"2024-04-25T02:28:25.830958+0000","last_became_peered":"2024-04-25T02:28:25.830958+0000","last_unstale":"2024-04-25T02:28:27.826544+0000","last_undegraded":"2024-04-25T02:28:27.826544+0000","last_fullsized":"2024-04-25T02:28:27.826544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:14:28.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266367+0000","last_change":"2024-04-25T02:28:26.843465+0000","last_active":"2024-04-25T02:28:28.266367+0000","last_peered":"2024-04-25T02:28:28.266367+0000","last_clean":"2024-04-25T02:28:28.266367+0000","last_became_active":"2024-04-25T02:28:26.843147+0000","last_became_peered":"2024-04-25T02:28:26.843147+0000","last_unstale":"2024-04-25T02:28:28.266367+0000","last_undegraded":"2024-04-25T02:28:28.266367+0000","last_fullsized":"2024-04-25T02:28:28.266367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:28:45.463626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266818+0000","last_change":"2024-04-25T02:28:25.822767+0000","last_active":"2024-04-25T02:28:28.266818+0000","last_peered":"2024-04-25T02:28:28.266818+0000","last_clean":"2024-04-25T02:28:28.266818+0000","last_became_active":"2024-04-25T02:28:25.822396+0000","last_became_peered":"2024-04-25T02:28:25.822396+0000","last_unstale":"2024-04-25T02:28:28.266818+0000","last_undegraded":"2024-04-25T02:28:28.266818+0000","last_fullsized":"2024-04-25T02:28:28.266818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266583+0000","last_change":"2024-04-25T02:28:26.840019+0000","last_active":"2024-04-25T02:28:28.266583+0000","last_peered":"2024-04-25T02:28:28.266583+0000","last_clean":"2024-04-25T02:28:28.266583+0000","last_became_active":"2024-04-25T02:28:26.839739+0000","last_became_peered":"2024-04-25T02:28:26.839739+0000","last_unstale":"2024-04-25T02:28:28.266583+0000","last_undegraded":"2024-04-25T02:28:28.266583+0000","last_fullsized":"2024-04-25T02:28:28.266583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:31.847102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.823098+0000","last_change":"2024-04-25T02:28:25.819880+0000","last_active":"2024-04-25T02:28:27.823098+0000","last_peered":"2024-04-25T02:28:27.823098+0000","last_clean":"2024-04-25T02:28:27.823098+0000","last_became_active":"2024-04-25T02:28:25.819487+0000","last_became_peered":"2024-04-25T02:28:25.819487+0000","last_unstale":"2024-04-25T02:28:27.823098+0000","last_undegraded":"2024-04-25T02:28:27.823098+0000","last_fullsized":"2024-04-25T02:28:27.823098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:32.823247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826504+0000","last_change":"2024-04-25T02:28:26.830885+0000","last_active":"2024-04-25T02:28:27.826504+0000","last_peered":"2024-04-25T02:28:27.826504+0000","last_clean":"2024-04-25T02:28:27.826504+0000","last_became_active":"2024-04-25T02:28:26.830454+0000","last_became_peered":"2024-04-25T02:28:26.830454+0000","last_unstale":"2024-04-25T02:28:27.826504+0000","last_undegraded":"2024-04-25T02:28:27.826504+0000","last_fullsized":"2024-04-25T02:28:27.826504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:05.955540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266514+0000","last_change":"2024-04-25T02:28:25.820969+0000","last_active":"2024-04-25T02:28:28.266514+0000","last_peered":"2024-04-25T02:28:28.266514+0000","last_clean":"2024-04-25T02:28:28.266514+0000","last_became_active":"2024-04-25T02:28:25.820594+0000","last_became_peered":"2024-04-25T02:28:25.820594+0000","last_unstale":"2024-04-25T02:28:28.266514+0000","last_undegraded":"2024-04-25T02:28:28.266514+0000","last_fullsized":"2024-04-25T02:28:28.266514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:48.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266206+0000","last_change":"2024-04-25T02:28:26.843856+0000","last_active":"2024-04-25T02:28:28.266206+0000","last_peered":"2024-04-25T02:28:28.266206+0000","last_clean":"2024-04-25T02:28:28.266206+0000","last_became_active":"2024-04-25T02:28:26.841671+0000","last_became_peered":"2024-04-25T02:28:26.841671+0000","last_unstale":"2024-04-25T02:28:28.266206+0000","last_undegraded":"2024-04-25T02:28:28.266206+0000","last_fullsized":"2024-04-25T02:28:28.266206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:41.798312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265929+0000","last_change":"2024-04-25T02:28:15.520345+0000","last_active":"2024-04-25T02:28:28.265929+0000","last_peered":"2024-04-25T02:28:28.265929+0000","last_clean":"2024-04-25T02:28:28.265929+0000","last_became_active":"2024-04-25T02:28:15.519317+0000","last_became_peered":"2024-04-25T02:28:15.519317+0000","last_unstale":"2024-04-25T02:28:28.265929+0000","last_undegraded":"2024-04-25T02:28:28.265929+0000","last_fullsized":"2024-04-25T02:28:28.265929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_clean_scrub_stamp":"2024-04-25T02:28:14.374327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:20.125523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826154+0000","last_change":"2024-04-25T02:28:25.821889+0000","last_active":"2024-04-25T02:28:27.826154+0000","last_peered":"2024-04-25T02:28:27.826154+0000","last_clean":"2024-04-25T02:28:27.826154+0000","last_became_active":"2024-04-25T02:28:25.821633+0000","last_became_peered":"2024-04-25T02:28:25.821633+0000","last_unstale":"2024-04-25T02:28:27.826154+0000","last_undegraded":"2024-04-25T02:28:27.826154+0000","last_fullsized":"2024-04-25T02:28:27.826154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:48.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266206+0000","last_change":"2024-04-25T02:28:26.839035+0000","last_active":"2024-04-25T02:28:28.266206+0000","last_peered":"2024-04-25T02:28:28.266206+0000","last_clean":"2024-04-25T02:28:28.266206+0000","last_became_active":"2024-04-25T02:28:26.838759+0000","last_became_peered":"2024-04-25T02:28:26.838759+0000","last_unstale":"2024-04-25T02:28:28.266206+0000","last_undegraded":"2024-04-25T02:28:28.266206+0000","last_fullsized":"2024-04-25T02:28:28.266206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:09.762419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265862+0000","last_change":"2024-04-25T02:28:25.833571+0000","last_active":"2024-04-25T02:28:28.265862+0000","last_peered":"2024-04-25T02:28:28.265862+0000","last_clean":"2024-04-25T02:28:28.265862+0000","last_became_active":"2024-04-25T02:28:25.833379+0000","last_became_peered":"2024-04-25T02:28:25.833379+0000","last_unstale":"2024-04-25T02:28:28.265862+0000","last_undegraded":"2024-04-25T02:28:28.265862+0000","last_fullsized":"2024-04-25T02:28:28.265862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:32.823247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265668+0000","last_change":"2024-04-25T02:28:26.833450+0000","last_active":"2024-04-25T02:28:28.265668+0000","last_peered":"2024-04-25T02:28:28.265668+0000","last_clean":"2024-04-25T02:28:28.265668+0000","last_became_active":"2024-04-25T02:28:26.833117+0000","last_became_peered":"2024-04-25T02:28:26.833117+0000","last_unstale":"2024-04-25T02:28:28.265668+0000","last_undegraded":"2024-04-25T02:28:28.265668+0000","last_fullsized":"2024-04-25T02:28:28.265668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:20.271750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266705+0000","last_change":"2024-04-25T02:28:25.823596+0000","last_active":"2024-04-25T02:28:28.266705+0000","last_peered":"2024-04-25T02:28:28.266705+0000","last_clean":"2024-04-25T02:28:28.266705+0000","last_became_active":"2024-04-25T02:28:25.822949+0000","last_became_peered":"2024-04-25T02:28:25.822949+0000","last_unstale":"2024-04-25T02:28:28.266705+0000","last_undegraded":"2024-04-25T02:28:28.266705+0000","last_fullsized":"2024-04-25T02:28:28.266705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:47.613148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822846+0000","last_change":"2024-04-25T02:28:26.830075+0000","last_active":"2024-04-25T02:28:27.822846+0000","last_peered":"2024-04-25T02:28:27.822846+0000","last_clean":"2024-04-25T02:28:27.822846+0000","last_became_active":"2024-04-25T02:28:26.829526+0000","last_became_peered":"2024-04-25T02:28:26.829526+0000","last_unstale":"2024-04-25T02:28:27.822846+0000","last_undegraded":"2024-04-25T02:28:27.822846+0000","last_fullsized":"2024-04-25T02:28:27.822846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827031+0000","last_change":"2024-04-25T02:28:25.820913+0000","last_active":"2024-04-25T02:28:27.827031+0000","last_peered":"2024-04-25T02:28:27.827031+0000","last_clean":"2024-04-25T02:28:27.827031+0000","last_became_active":"2024-04-25T02:28:25.820531+0000","last_became_peered":"2024-04-25T02:28:25.820531+0000","last_unstale":"2024-04-25T02:28:27.827031+0000","last_undegraded":"2024-04-25T02:28:27.827031+0000","last_fullsized":"2024-04-25T02:28:27.827031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:10.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827117+0000","last_change":"2024-04-25T02:28:26.835487+0000","last_active":"2024-04-25T02:28:27.827117+0000","last_peered":"2024-04-25T02:28:27.827117+0000","last_clean":"2024-04-25T02:28:27.827117+0000","last_became_active":"2024-04-25T02:28:26.834842+0000","last_became_peered":"2024-04-25T02:28:26.834842+0000","last_unstale":"2024-04-25T02:28:27.827117+0000","last_undegraded":"2024-04-25T02:28:27.827117+0000","last_fullsized":"2024-04-25T02:28:27.827117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:54.957406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.823008+0000","last_change":"2024-04-25T02:28:25.831205+0000","last_active":"2024-04-25T02:28:27.823008+0000","last_peered":"2024-04-25T02:28:27.823008+0000","last_clean":"2024-04-25T02:28:27.823008+0000","last_became_active":"2024-04-25T02:28:25.830910+0000","last_became_peered":"2024-04-25T02:28:25.830910+0000","last_unstale":"2024-04-25T02:28:27.823008+0000","last_undegraded":"2024-04-25T02:28:27.823008+0000","last_fullsized":"2024-04-25T02:28:27.823008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:22.828461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827217+0000","last_change":"2024-04-25T02:28:26.830467+0000","last_active":"2024-04-25T02:28:27.827217+0000","last_peered":"2024-04-25T02:28:27.827217+0000","last_clean":"2024-04-25T02:28:27.827217+0000","last_became_active":"2024-04-25T02:28:26.830219+0000","last_became_peered":"2024-04-25T02:28:26.830219+0000","last_unstale":"2024-04-25T02:28:27.827217+0000","last_undegraded":"2024-04-25T02:28:27.827217+0000","last_fullsized":"2024-04-25T02:28:27.827217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:19.911809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266442+0000","last_change":"2024-04-25T02:28:25.831653+0000","last_active":"2024-04-25T02:28:28.266442+0000","last_peered":"2024-04-25T02:28:28.266442+0000","last_clean":"2024-04-25T02:28:28.266442+0000","last_became_active":"2024-04-25T02:28:25.831318+0000","last_became_peered":"2024-04-25T02:28:25.831318+0000","last_unstale":"2024-04-25T02:28:28.266442+0000","last_undegraded":"2024-04-25T02:28:28.266442+0000","last_fullsized":"2024-04-25T02:28:28.266442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:53.952880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822899+0000","last_change":"2024-04-25T02:28:26.832413+0000","last_active":"2024-04-25T02:28:27.822899+0000","last_peered":"2024-04-25T02:28:27.822899+0000","last_clean":"2024-04-25T02:28:27.822899+0000","last_became_active":"2024-04-25T02:28:26.832081+0000","last_became_peered":"2024-04-25T02:28:26.832081+0000","last_unstale":"2024-04-25T02:28:27.822899+0000","last_undegraded":"2024-04-25T02:28:27.822899+0000","last_fullsized":"2024-04-25T02:28:27.822899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829103+0000","last_change":"2024-04-25T02:28:25.824355+0000","last_active":"2024-04-25T02:28:27.829103+0000","last_peered":"2024-04-25T02:28:27.829103+0000","last_clean":"2024-04-25T02:28:27.829103+0000","last_became_active":"2024-04-25T02:28:25.824048+0000","last_became_peered":"2024-04-25T02:28:25.824048+0000","last_unstale":"2024-04-25T02:28:27.829103+0000","last_undegraded":"2024-04-25T02:28:27.829103+0000","last_fullsized":"2024-04-25T02:28:27.829103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:53.952880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266822+0000","last_change":"2024-04-25T02:28:26.831460+0000","last_active":"2024-04-25T02:28:28.266822+0000","last_peered":"2024-04-25T02:28:28.266822+0000","last_clean":"2024-04-25T02:28:28.266822+0000","last_became_active":"2024-04-25T02:28:26.831127+0000","last_became_peered":"2024-04-25T02:28:26.831127+0000","last_unstale":"2024-04-25T02:28:28.266822+0000","last_undegraded":"2024-04-25T02:28:28.266822+0000","last_fullsized":"2024-04-25T02:28:28.266822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:52.300089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.830022+0000","last_change":"2024-04-25T02:28:25.824264+0000","last_active":"2024-04-25T02:28:27.830022+0000","last_peered":"2024-04-25T02:28:27.830022+0000","last_clean":"2024-04-25T02:28:27.830022+0000","last_became_active":"2024-04-25T02:28:25.823953+0000","last_became_peered":"2024-04-25T02:28:25.823953+0000","last_unstale":"2024-04-25T02:28:27.830022+0000","last_undegraded":"2024-04-25T02:28:27.830022+0000","last_fullsized":"2024-04-25T02:28:27.830022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:32.823247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266650+0000","last_change":"2024-04-25T02:28:26.827330+0000","last_active":"2024-04-25T02:28:28.266650+0000","last_peered":"2024-04-25T02:28:28.266650+0000","last_clean":"2024-04-25T02:28:28.266650+0000","last_became_active":"2024-04-25T02:28:26.826944+0000","last_became_peered":"2024-04-25T02:28:26.826944+0000","last_unstale":"2024-04-25T02:28:28.266650+0000","last_undegraded":"2024-04-25T02:28:28.266650+0000","last_fullsized":"2024-04-25T02:28:28.266650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265859+0000","last_change":"2024-04-25T02:28:25.831605+0000","last_active":"2024-04-25T02:28:28.265859+0000","last_peered":"2024-04-25T02:28:28.265859+0000","last_clean":"2024-04-25T02:28:28.265859+0000","last_became_active":"2024-04-25T02:28:25.831328+0000","last_became_peered":"2024-04-25T02:28:25.831328+0000","last_unstale":"2024-04-25T02:28:28.265859+0000","last_undegraded":"2024-04-25T02:28:28.265859+0000","last_fullsized":"2024-04-25T02:28:28.265859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:04:33.145269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827334+0000","last_change":"2024-04-25T02:28:26.834040+0000","last_active":"2024-04-25T02:28:27.827334+0000","last_peered":"2024-04-25T02:28:27.827334+0000","last_clean":"2024-04-25T02:28:27.827334+0000","last_became_active":"2024-04-25T02:28:26.833740+0000","last_became_peered":"2024-04-25T02:28:26.833740+0000","last_unstale":"2024-04-25T02:28:27.827334+0000","last_undegraded":"2024-04-25T02:28:27.827334+0000","last_fullsized":"2024-04-25T02:28:27.827334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:04:34.149794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822940+0000","last_change":"2024-04-25T02:28:25.825296+0000","last_active":"2024-04-25T02:28:27.822940+0000","last_peered":"2024-04-25T02:28:27.822940+0000","last_clean":"2024-04-25T02:28:27.822940+0000","last_became_active":"2024-04-25T02:28:25.824989+0000","last_became_peered":"2024-04-25T02:28:25.824989+0000","last_unstale":"2024-04-25T02:28:27.822940+0000","last_undegraded":"2024-04-25T02:28:27.822940+0000","last_fullsized":"2024-04-25T02:28:27.822940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:10.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.267019+0000","last_change":"2024-04-25T02:28:26.831540+0000","last_active":"2024-04-25T02:28:28.267019+0000","last_peered":"2024-04-25T02:28:28.267019+0000","last_clean":"2024-04-25T02:28:28.267019+0000","last_became_active":"2024-04-25T02:28:26.831020+0000","last_became_peered":"2024-04-25T02:28:26.831020+0000","last_unstale":"2024-04-25T02:28:28.267019+0000","last_undegraded":"2024-04-25T02:28:28.267019+0000","last_fullsized":"2024-04-25T02:28:28.267019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:41.798312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.823029+0000","last_change":"2024-04-25T02:28:25.827630+0000","last_active":"2024-04-25T02:28:27.823029+0000","last_peered":"2024-04-25T02:28:27.823029+0000","last_clean":"2024-04-25T02:28:27.823029+0000","last_became_active":"2024-04-25T02:28:25.827277+0000","last_became_peered":"2024-04-25T02:28:25.827277+0000","last_unstale":"2024-04-25T02:28:27.823029+0000","last_undegraded":"2024-04-25T02:28:27.823029+0000","last_fullsized":"2024-04-25T02:28:27.823029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:04:33.145269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266602+0000","last_change":"2024-04-25T02:28:26.828333+0000","last_active":"2024-04-25T02:28:28.266602+0000","last_peered":"2024-04-25T02:28:28.266602+0000","last_clean":"2024-04-25T02:28:28.266602+0000","last_became_active":"2024-04-25T02:28:26.828026+0000","last_became_peered":"2024-04-25T02:28:26.828026+0000","last_unstale":"2024-04-25T02:28:28.266602+0000","last_undegraded":"2024-04-25T02:28:28.266602+0000","last_fullsized":"2024-04-25T02:28:28.266602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266350+0000","last_change":"2024-04-25T02:28:25.830120+0000","last_active":"2024-04-25T02:28:28.266350+0000","last_peered":"2024-04-25T02:28:28.266350+0000","last_clean":"2024-04-25T02:28:28.266350+0000","last_became_active":"2024-04-25T02:28:25.829808+0000","last_became_peered":"2024-04-25T02:28:25.829808+0000","last_unstale":"2024-04-25T02:28:28.266350+0000","last_undegraded":"2024-04-25T02:28:28.266350+0000","last_fullsized":"2024-04-25T02:28:28.266350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:37.081003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829555+0000","last_change":"2024-04-25T02:28:26.825705+0000","last_active":"2024-04-25T02:28:27.829555+0000","last_peered":"2024-04-25T02:28:27.829555+0000","last_clean":"2024-04-25T02:28:27.829555+0000","last_became_active":"2024-04-25T02:28:26.825382+0000","last_became_peered":"2024-04-25T02:28:26.825382+0000","last_unstale":"2024-04-25T02:28:27.829555+0000","last_undegraded":"2024-04-25T02:28:27.829555+0000","last_fullsized":"2024-04-25T02:28:27.829555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:09.762419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827064+0000","last_change":"2024-04-25T02:28:26.832976+0000","last_active":"2024-04-25T02:28:27.827064+0000","last_peered":"2024-04-25T02:28:27.827064+0000","last_clean":"2024-04-25T02:28:27.827064+0000","last_became_active":"2024-04-25T02:28:26.832717+0000","last_became_peered":"2024-04-25T02:28:26.832717+0000","last_unstale":"2024-04-25T02:28:27.827064+0000","last_undegraded":"2024-04-25T02:28:27.827064+0000","last_fullsized":"2024-04-25T02:28:27.827064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:28:45.463626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266302+0000","last_change":"2024-04-25T02:28:25.830578+0000","last_active":"2024-04-25T02:28:28.266302+0000","last_peered":"2024-04-25T02:28:28.266302+0000","last_clean":"2024-04-25T02:28:28.266302+0000","last_became_active":"2024-04-25T02:28:25.829878+0000","last_became_peered":"2024-04-25T02:28:25.829878+0000","last_unstale":"2024-04-25T02:28:28.266302+0000","last_undegraded":"2024-04-25T02:28:28.266302+0000","last_fullsized":"2024-04-25T02:28:28.266302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:10.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826362+0000","last_change":"2024-04-25T02:28:26.824909+0000","last_active":"2024-04-25T02:28:27.826362+0000","last_peered":"2024-04-25T02:28:27.826362+0000","last_clean":"2024-04-25T02:28:27.826362+0000","last_became_active":"2024-04-25T02:28:26.824570+0000","last_became_peered":"2024-04-25T02:28:26.824570+0000","last_unstale":"2024-04-25T02:28:27.826362+0000","last_undegraded":"2024-04-25T02:28:27.826362+0000","last_fullsized":"2024-04-25T02:28:27.826362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:52.300089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266326+0000","last_change":"2024-04-25T02:28:25.830311+0000","last_active":"2024-04-25T02:28:28.266326+0000","last_peered":"2024-04-25T02:28:28.266326+0000","last_clean":"2024-04-25T02:28:28.266326+0000","last_became_active":"2024-04-25T02:28:25.830025+0000","last_became_peered":"2024-04-25T02:28:25.830025+0000","last_unstale":"2024-04-25T02:28:28.266326+0000","last_undegraded":"2024-04-25T02:28:28.266326+0000","last_fullsized":"2024-04-25T02:28:28.266326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:22.828461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266204+0000","last_change":"2024-04-25T02:28:26.832875+0000","last_active":"2024-04-25T02:28:28.266204+0000","last_peered":"2024-04-25T02:28:28.266204+0000","last_clean":"2024-04-25T02:28:28.266204+0000","last_became_active":"2024-04-25T02:28:26.832208+0000","last_became_peered":"2024-04-25T02:28:26.832208+0000","last_unstale":"2024-04-25T02:28:28.266204+0000","last_undegraded":"2024-04-25T02:28:28.266204+0000","last_fullsized":"2024-04-25T02:28:28.266204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:09.762419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266877+0000","last_change":"2024-04-25T02:28:25.829350+0000","last_active":"2024-04-25T02:28:28.266877+0000","last_peered":"2024-04-25T02:28:28.266877+0000","last_clean":"2024-04-25T02:28:28.266877+0000","last_became_active":"2024-04-25T02:28:25.829072+0000","last_became_peered":"2024-04-25T02:28:25.829072+0000","last_unstale":"2024-04-25T02:28:28.266877+0000","last_undegraded":"2024-04-25T02:28:28.266877+0000","last_fullsized":"2024-04-25T02:28:28.266877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:17:36.734690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266692+0000","last_change":"2024-04-25T02:28:26.827282+0000","last_active":"2024-04-25T02:28:28.266692+0000","last_peered":"2024-04-25T02:28:28.266692+0000","last_clean":"2024-04-25T02:28:28.266692+0000","last_became_active":"2024-04-25T02:28:26.826977+0000","last_became_peered":"2024-04-25T02:28:26.826977+0000","last_unstale":"2024-04-25T02:28:28.266692+0000","last_undegraded":"2024-04-25T02:28:28.266692+0000","last_fullsized":"2024-04-25T02:28:28.266692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:35.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.267016+0000","last_change":"2024-04-25T02:28:25.829686+0000","last_active":"2024-04-25T02:28:28.267016+0000","last_peered":"2024-04-25T02:28:28.267016+0000","last_clean":"2024-04-25T02:28:28.267016+0000","last_became_active":"2024-04-25T02:28:25.829226+0000","last_became_peered":"2024-04-25T02:28:25.829226+0000","last_unstale":"2024-04-25T02:28:28.267016+0000","last_undegraded":"2024-04-25T02:28:28.267016+0000","last_fullsized":"2024-04-25T02:28:28.267016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:18.405319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":64794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:28:30.857 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:28:30.932 INFO:tasks.ceph.mds.d.smithi176.stderr:2024-04-25T02:28:30.928+0000 7f2335dd3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:28:30.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.989+0000 7fc8dbea5640 1 Processor -- start 2024-04-25T02:28:30.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.989+0000 7fc8dbea5640 1 -- start start 2024-04-25T02:28:30.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.990+0000 7fc8dbea5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc8d40d4bc0 0x7fc8d40cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:30.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.990+0000 7fc8dbea5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8d40d2200 con 0x7fc8d40d2d90 2024-04-25T02:28:30.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.990+0000 7fc8dbea5640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8d40b3740 con 0x7fc8d415e3b0 2024-04-25T02:28:30.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.990+0000 7fc8dbea5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc8d40b3a20 con 0x7fc8d40d4bc0 2024-04-25T02:28:30.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.990+0000 7fc8da442640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc8d40d4bc0 0x7fc8d40cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.990+0000 7fc8da442640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc8d40d4bc0 0x7fc8d40cf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59342/0 (socket says 172.21.15.67:59342) 2024-04-25T02:28:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.990+0000 7fc8da442640 1 -- 172.21.15.67:0/975760336 learned_addr learned my addr 172.21.15.67:0/975760336 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.990+0000 7fc8d9440640 1 --1- 172.21.15.67:0/975760336 >> v1:172.21.15.67:6789/0 conn(0x7fc8d40d2d90 0x7fc8d40cec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51212/0 (socket says 172.21.15.67:51212) 2024-04-25T02:28:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.991+0000 7fc8da442640 1 -- 172.21.15.67:0/975760336 >> v1:172.21.15.176:6789/0 conn(0x7fc8d415e3b0 legacy=0x7fc8d40d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.991+0000 7fc8da442640 1 -- 172.21.15.67:0/975760336 >> v1:172.21.15.67:6789/0 conn(0x7fc8d40d2d90 legacy=0x7fc8d40cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.991+0000 7fc8da442640 1 -- 172.21.15.67:0/975760336 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d40b3d00 con 0x7fc8d40d4bc0 2024-04-25T02:28:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.991+0000 7fc8d8c3f640 1 -- 172.21.15.67:0/975760336 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3833531848 0 0) 0x7fc8d40d2200 con 0x7fc8d40d2d90 2024-04-25T02:28:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.991+0000 7fc8da442640 1 --2- 172.21.15.67:0/975760336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8d40d4bc0 0x7fc8d40cf350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009870 tx=0x7fc8d002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de03a022080165b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.992+0000 7fc8d8c3f640 1 -- 172.21.15.67:0/975760336 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0037070 con 0x7fc8d40d4bc0 2024-04-25T02:28:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.992+0000 7fc8d8c3f640 1 -- 172.21.15.67:0/975760336 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8d0032440 con 0x7fc8d40d4bc0 2024-04-25T02:28:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.992+0000 7fc8d8c3f640 1 -- 172.21.15.67:0/975760336 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0032810 con 0x7fc8d40d4bc0 2024-04-25T02:28:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.992+0000 7fc8dbea5640 1 -- 172.21.15.67:0/975760336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8d40d4bc0 msgr2=0x7fc8d40cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.992+0000 7fc8dbea5640 1 --2- 172.21.15.67:0/975760336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8d40d4bc0 0x7fc8d40cf350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009870 tx=0x7fc8d002a2a0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.992+0000 7fc8dbea5640 1 -- 172.21.15.67:0/975760336 shutdown_connections 2024-04-25T02:28:30.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.992+0000 7fc8dbea5640 1 --2- 172.21.15.67:0/975760336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8d40d4bc0 0x7fc8d40cf350 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:30.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.992+0000 7fc8dbea5640 1 -- 172.21.15.67:0/975760336 >> 172.21.15.67:0/975760336 conn(0x7fc8d40d40a0 msgr2=0x7fc8d40d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:30.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.992+0000 7fc8dbea5640 1 -- 172.21.15.67:0/975760336 shutdown_connections 2024-04-25T02:28:30.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.992+0000 7fc8dbea5640 1 -- 172.21.15.67:0/975760336 wait complete. 2024-04-25T02:28:31.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.993+0000 7fc8dbea5640 1 Processor -- start 2024-04-25T02:28:31.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.993+0000 7fc8dbea5640 1 -- start start 2024-04-25T02:28:31.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.994+0000 7fc8dbea5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d40d2d90 0x7fc8d40c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:31.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.994+0000 7fc8dbea5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8d40d4bc0 0x7fc8d415ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:31.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.994+0000 7fc8dbea5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8d415e3b0 0x7fc8d40cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:31.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.994+0000 7fc8dbea5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d415e910 con 0x7fc8d415e3b0 2024-04-25T02:28:31.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.994+0000 7fc8dbea5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d415e790 con 0x7fc8d40d4bc0 2024-04-25T02:28:31.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.994+0000 7fc8dbea5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc8d40b5230 con 0x7fc8d40d2d90 2024-04-25T02:28:31.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.994+0000 7fc8da442640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8d415e3b0 0x7fc8d40cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:31.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.994+0000 7fc8da442640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8d415e3b0 0x7fc8d40cca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59344/0 (socket says 172.21.15.67:59344) 2024-04-25T02:28:31.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.994+0000 7fc8da442640 1 -- 172.21.15.67:0/838563564 learned_addr learned my addr 172.21.15.67:0/838563564 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:31.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.994+0000 7fc8d9c41640 1 --2- 172.21.15.67:0/838563564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d40d2d90 0x7fc8d40c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:31.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.994+0000 7fc8d9440640 1 --2- 172.21.15.67:0/838563564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8d40d4bc0 0x7fc8d415ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:31.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.995+0000 7fc8da442640 1 -- 172.21.15.67:0/838563564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d40d2d90 msgr2=0x7fc8d40c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:31.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.995+0000 7fc8da442640 1 --2- 172.21.15.67:0/838563564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d40d2d90 0x7fc8d40c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.995+0000 7fc8da442640 1 -- 172.21.15.67:0/838563564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8d40d4bc0 msgr2=0x7fc8d415ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:31.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.995+0000 7fc8da442640 1 --2- 172.21.15.67:0/838563564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8d40d4bc0 0x7fc8d415ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.995+0000 7fc8da442640 1 -- 172.21.15.67:0/838563564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d40c7d30 con 0x7fc8d415e3b0 2024-04-25T02:28:31.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.995+0000 7fc8d9440640 1 --2- 172.21.15.67:0/838563564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8d40d4bc0 0x7fc8d415ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:31.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.995+0000 7fc8da442640 1 --2- 172.21.15.67:0/838563564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8d415e3b0 0x7fc8d40cca50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc8d002a2e0 tx=0x7fc8d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:31.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.995+0000 7fc8ca7fc640 1 -- 172.21.15.67:0/838563564 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0041070 con 0x7fc8d415e3b0 2024-04-25T02:28:31.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.995+0000 7fc8ca7fc640 1 -- 172.21.15.67:0/838563564 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8d003c950 con 0x7fc8d415e3b0 2024-04-25T02:28:31.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.995+0000 7fc8dbea5640 1 -- 172.21.15.67:0/838563564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d40cd280 con 0x7fc8d415e3b0 2024-04-25T02:28:31.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.995+0000 7fc8ca7fc640 1 -- 172.21.15.67:0/838563564 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0037040 con 0x7fc8d415e3b0 2024-04-25T02:28:31.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.995+0000 7fc8dbea5640 1 -- 172.21.15.67:0/838563564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d40ccf90 con 0x7fc8d415e3b0 2024-04-25T02:28:31.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.996+0000 7fc8dbea5640 1 -- 172.21.15.67:0/838563564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d40681f0 con 0x7fc8d415e3b0 2024-04-25T02:28:31.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.996+0000 7fc8ca7fc640 1 -- 172.21.15.67:0/838563564 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc8d0044070 con 0x7fc8d415e3b0 2024-04-25T02:28:31.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.997+0000 7fc8ca7fc640 1 --2- 172.21.15.67:0/838563564 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc8b806be30 0x7fc8b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:31.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.997+0000 7fc8ca7fc640 1 -- 172.21.15.67:0/838563564 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc8d00ab770 con 0x7fc8d415e3b0 2024-04-25T02:28:31.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.997+0000 7fc8d9c41640 1 --2- 172.21.15.67:0/838563564 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc8b806be30 0x7fc8b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:31.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:30.997+0000 7fc8d9c41640 1 --2- 172.21.15.67:0/838563564 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc8b806be30 0x7fc8b806e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00b450 tx=0x7fc8cc00d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:31.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.001+0000 7fc8ca7fc640 1 -- 172.21.15.67:0/838563564 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc8d0079b60 con 0x7fc8d415e3b0 2024-04-25T02:28:31.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.179+0000 7fc8dbea5640 1 -- 172.21.15.67:0/838563564 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc8d40c7850 con 0x7fc8b806be30 2024-04-25T02:28:31.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.186+0000 7fc8ca7fc640 1 -- 172.21.15.67:0/838563564 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251946 (secure 0 0 0) 0x7fc8d40c7850 con 0x7fc8b806be30 2024-04-25T02:28:31.193 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:31.194 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-25T02:28:31.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.188+0000 7fc8dbea5640 1 -- 172.21.15.67:0/838563564 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc8b806be30 msgr2=0x7fc8b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:31.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.188+0000 7fc8dbea5640 1 --2- 172.21.15.67:0/838563564 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc8b806be30 0x7fc8b806e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00b450 tx=0x7fc8cc00d040 comp rx=0 tx=0).stop 2024-04-25T02:28:31.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.188+0000 7fc8dbea5640 1 -- 172.21.15.67:0/838563564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8d415e3b0 msgr2=0x7fc8d40cca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:31.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.188+0000 7fc8dbea5640 1 --2- 172.21.15.67:0/838563564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8d415e3b0 0x7fc8d40cca50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc8d002a2e0 tx=0x7fc8d00046c0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.188+0000 7fc8dbea5640 1 -- 172.21.15.67:0/838563564 shutdown_connections 2024-04-25T02:28:31.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.188+0000 7fc8dbea5640 1 --2- 172.21.15.67:0/838563564 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc8b806be30 0x7fc8b806e2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.188+0000 7fc8dbea5640 1 --2- 172.21.15.67:0/838563564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8d415e3b0 0x7fc8d40cca50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.188+0000 7fc8dbea5640 1 --2- 172.21.15.67:0/838563564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8d40d4bc0 0x7fc8d415ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.188+0000 7fc8dbea5640 1 --2- 172.21.15.67:0/838563564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d40d2d90 0x7fc8d40c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.188+0000 7fc8dbea5640 1 -- 172.21.15.67:0/838563564 >> 172.21.15.67:0/838563564 conn(0x7fc8d40d40a0 msgr2=0x7fc8d40cfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:31.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.188+0000 7fc8dbea5640 1 -- 172.21.15.67:0/838563564 shutdown_connections 2024-04-25T02:28:31.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.188+0000 7fc8dbea5640 1 -- 172.21.15.67:0/838563564 wait complete. 2024-04-25T02:28:31.203 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-25T02:28:30.330813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218924,"kb_used_data":2752,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755796,"statfs":{"total":773094113280,"available":772869935104,"internally_reserved":0,"allocated":2818048,"data_stored":1715228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.526756"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266478+0000","last_change":"2024-04-25T02:28:26.842721+0000","last_active":"2024-04-25T02:28:28.266478+0000","last_peered":"2024-04-25T02:28:28.266478+0000","last_clean":"2024-04-25T02:28:28.266478+0000","last_became_active":"2024-04-25T02:28:26.842458+0000","last_became_peered":"2024-04-25T02:28:26.842458+0000","last_unstale":"2024-04-25T02:28:28.266478+0000","last_undegraded":"2024-04-25T02:28:28.266478+0000","last_fullsized":"2024-04-25T02:28:28.266478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:17.268811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.823036+0000","last_change":"2024-04-25T02:28:26.837624+0000","last_active":"2024-04-25T02:28:27.823036+0000","last_peered":"2024-04-25T02:28:27.823036+0000","last_clean":"2024-04-25T02:28:27.823036+0000","last_became_active":"2024-04-25T02:28:26.837058+0000","last_became_peered":"2024-04-25T02:28:26.837058+0000","last_unstale":"2024-04-25T02:28:27.823036+0000","last_undegraded":"2024-04-25T02:28:27.823036+0000","last_fullsized":"2024-04-25T02:28:27.823036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:35.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266185+0000","last_change":"2024-04-25T02:28:26.826784+0000","last_active":"2024-04-25T02:28:28.266185+0000","last_peered":"2024-04-25T02:28:28.266185+0000","last_clean":"2024-04-25T02:28:28.266185+0000","last_became_active":"2024-04-25T02:28:26.825536+0000","last_became_peered":"2024-04-25T02:28:26.825536+0000","last_unstale":"2024-04-25T02:28:28.266185+0000","last_undegraded":"2024-04-25T02:28:28.266185+0000","last_fullsized":"2024-04-25T02:28:28.266185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:12.142773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826216+0000","last_change":"2024-04-25T02:28:26.831333+0000","last_active":"2024-04-25T02:28:27.826216+0000","last_peered":"2024-04-25T02:28:27.826216+0000","last_clean":"2024-04-25T02:28:27.826216+0000","last_became_active":"2024-04-25T02:28:26.831046+0000","last_became_peered":"2024-04-25T02:28:26.831046+0000","last_unstale":"2024-04-25T02:28:27.826216+0000","last_undegraded":"2024-04-25T02:28:27.826216+0000","last_fullsized":"2024-04-25T02:28:27.826216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266136+0000","last_change":"2024-04-25T02:28:26.835027+0000","last_active":"2024-04-25T02:28:28.266136+0000","last_peered":"2024-04-25T02:28:28.266136+0000","last_clean":"2024-04-25T02:28:28.266136+0000","last_became_active":"2024-04-25T02:28:26.834736+0000","last_became_peered":"2024-04-25T02:28:26.834736+0000","last_unstale":"2024-04-25T02:28:28.266136+0000","last_undegraded":"2024-04-25T02:28:28.266136+0000","last_fullsized":"2024-04-25T02:28:28.266136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:05.955540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826676+0000","last_change":"2024-04-25T02:28:26.832120+0000","last_active":"2024-04-25T02:28:27.826676+0000","last_peered":"2024-04-25T02:28:27.826676+0000","last_clean":"2024-04-25T02:28:27.826676+0000","last_became_active":"2024-04-25T02:28:26.831833+0000","last_became_peered":"2024-04-25T02:28:26.831833+0000","last_unstale":"2024-04-25T02:28:27.826676+0000","last_undegraded":"2024-04-25T02:28:27.826676+0000","last_fullsized":"2024-04-25T02:28:27.826676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:21.146249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266243+0000","last_change":"2024-04-25T02:28:26.837402+0000","last_active":"2024-04-25T02:28:28.266243+0000","last_peered":"2024-04-25T02:28:28.266243+0000","last_clean":"2024-04-25T02:28:28.266243+0000","last_became_active":"2024-04-25T02:28:26.836964+0000","last_became_peered":"2024-04-25T02:28:26.836964+0000","last_unstale":"2024-04-25T02:28:28.266243+0000","last_undegraded":"2024-04-25T02:28:28.266243+0000","last_fullsized":"2024-04-25T02:28:28.266243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:26.305868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266771+0000","last_change":"2024-04-25T02:28:26.838251+0000","last_active":"2024-04-25T02:28:28.266771+0000","last_peered":"2024-04-25T02:28:28.266771+0000","last_clean":"2024-04-25T02:28:28.266771+0000","last_became_active":"2024-04-25T02:28:26.837980+0000","last_became_peered":"2024-04-25T02:28:26.837980+0000","last_unstale":"2024-04-25T02:28:28.266771+0000","last_undegraded":"2024-04-25T02:28:28.266771+0000","last_fullsized":"2024-04-25T02:28:28.266771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:12.142773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266517+0000","last_change":"2024-04-25T02:28:26.843536+0000","last_active":"2024-04-25T02:28:28.266517+0000","last_peered":"2024-04-25T02:28:28.266517+0000","last_clean":"2024-04-25T02:28:28.266517+0000","last_became_active":"2024-04-25T02:28:26.841986+0000","last_became_peered":"2024-04-25T02:28:26.841986+0000","last_unstale":"2024-04-25T02:28:28.266517+0000","last_undegraded":"2024-04-25T02:28:28.266517+0000","last_fullsized":"2024-04-25T02:28:28.266517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:08.277396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829942+0000","last_change":"2024-04-25T02:28:26.835526+0000","last_active":"2024-04-25T02:28:27.829942+0000","last_peered":"2024-04-25T02:28:27.829942+0000","last_clean":"2024-04-25T02:28:27.829942+0000","last_became_active":"2024-04-25T02:28:26.835228+0000","last_became_peered":"2024-04-25T02:28:26.835228+0000","last_unstale":"2024-04-25T02:28:27.829942+0000","last_undegraded":"2024-04-25T02:28:27.829942+0000","last_fullsized":"2024-04-25T02:28:27.829942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829950+0000","last_change":"2024-04-25T02:28:26.836024+0000","last_active":"2024-04-25T02:28:27.829950+0000","last_peered":"2024-04-25T02:28:27.829950+0000","last_clean":"2024-04-25T02:28:27.829950+0000","last_became_active":"2024-04-25T02:28:26.835757+0000","last_became_peered":"2024-04-25T02:28:26.835757+0000","last_unstale":"2024-04-25T02:28:27.829950+0000","last_undegraded":"2024-04-25T02:28:27.829950+0000","last_fullsized":"2024-04-25T02:28:27.829950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826663+0000","last_change":"2024-04-25T02:28:26.833151+0000","last_active":"2024-04-25T02:28:27.826663+0000","last_peered":"2024-04-25T02:28:27.826663+0000","last_clean":"2024-04-25T02:28:27.826663+0000","last_became_active":"2024-04-25T02:28:26.832420+0000","last_became_peered":"2024-04-25T02:28:26.832420+0000","last_unstale":"2024-04-25T02:28:27.826663+0000","last_undegraded":"2024-04-25T02:28:27.826663+0000","last_fullsized":"2024-04-25T02:28:27.826663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:11.788886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266446+0000","last_change":"2024-04-25T02:28:26.827208+0000","last_active":"2024-04-25T02:28:28.266446+0000","last_peered":"2024-04-25T02:28:28.266446+0000","last_clean":"2024-04-25T02:28:28.266446+0000","last_became_active":"2024-04-25T02:28:26.826926+0000","last_became_peered":"2024-04-25T02:28:26.826926+0000","last_unstale":"2024-04-25T02:28:28.266446+0000","last_undegraded":"2024-04-25T02:28:28.266446+0000","last_fullsized":"2024-04-25T02:28:28.266446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:14.690953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265726+0000","last_change":"2024-04-25T02:28:26.833942+0000","last_active":"2024-04-25T02:28:28.265726+0000","last_peered":"2024-04-25T02:28:28.265726+0000","last_clean":"2024-04-25T02:28:28.265726+0000","last_became_active":"2024-04-25T02:28:26.833059+0000","last_became_peered":"2024-04-25T02:28:26.833059+0000","last_unstale":"2024-04-25T02:28:28.265726+0000","last_undegraded":"2024-04-25T02:28:28.265726+0000","last_fullsized":"2024-04-25T02:28:28.265726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:19:26.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822826+0000","last_change":"2024-04-25T02:28:26.841353+0000","last_active":"2024-04-25T02:28:27.822826+0000","last_peered":"2024-04-25T02:28:27.822826+0000","last_clean":"2024-04-25T02:28:27.822826+0000","last_became_active":"2024-04-25T02:28:26.841024+0000","last_became_peered":"2024-04-25T02:28:26.841024+0000","last_unstale":"2024-04-25T02:28:27.822826+0000","last_undegraded":"2024-04-25T02:28:27.822826+0000","last_fullsized":"2024-04-25T02:28:27.822826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:09.762419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826145+0000","last_change":"2024-04-25T02:28:26.831558+0000","last_active":"2024-04-25T02:28:27.826145+0000","last_peered":"2024-04-25T02:28:27.826145+0000","last_clean":"2024-04-25T02:28:27.826145+0000","last_became_active":"2024-04-25T02:28:26.831124+0000","last_became_peered":"2024-04-25T02:28:26.831124+0000","last_unstale":"2024-04-25T02:28:27.826145+0000","last_undegraded":"2024-04-25T02:28:27.826145+0000","last_fullsized":"2024-04-25T02:28:27.826145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827300+0000","last_change":"2024-04-25T02:28:26.833767+0000","last_active":"2024-04-25T02:28:27.827300+0000","last_peered":"2024-04-25T02:28:27.827300+0000","last_clean":"2024-04-25T02:28:27.827300+0000","last_became_active":"2024-04-25T02:28:26.833261+0000","last_became_peered":"2024-04-25T02:28:26.833261+0000","last_unstale":"2024-04-25T02:28:27.827300+0000","last_undegraded":"2024-04-25T02:28:27.827300+0000","last_fullsized":"2024-04-25T02:28:27.827300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:17.268811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266709+0000","last_change":"2024-04-25T02:28:26.829506+0000","last_active":"2024-04-25T02:28:28.266709+0000","last_peered":"2024-04-25T02:28:28.266709+0000","last_clean":"2024-04-25T02:28:28.266709+0000","last_became_active":"2024-04-25T02:28:26.829220+0000","last_became_peered":"2024-04-25T02:28:26.829220+0000","last_unstale":"2024-04-25T02:28:28.266709+0000","last_undegraded":"2024-04-25T02:28:28.266709+0000","last_fullsized":"2024-04-25T02:28:28.266709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:54.957406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266478+0000","last_change":"2024-04-25T02:28:26.836463+0000","last_active":"2024-04-25T02:28:28.266478+0000","last_peered":"2024-04-25T02:28:28.266478+0000","last_clean":"2024-04-25T02:28:28.266478+0000","last_became_active":"2024-04-25T02:28:26.836202+0000","last_became_peered":"2024-04-25T02:28:26.836202+0000","last_unstale":"2024-04-25T02:28:28.266478+0000","last_undegraded":"2024-04-25T02:28:28.266478+0000","last_fullsized":"2024-04-25T02:28:28.266478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:19.911809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829840+0000","last_change":"2024-04-25T02:28:26.826332+0000","last_active":"2024-04-25T02:28:27.829840+0000","last_peered":"2024-04-25T02:28:27.829840+0000","last_clean":"2024-04-25T02:28:27.829840+0000","last_became_active":"2024-04-25T02:28:26.825996+0000","last_became_peered":"2024-04-25T02:28:26.825996+0000","last_unstale":"2024-04-25T02:28:27.829840+0000","last_undegraded":"2024-04-25T02:28:27.829840+0000","last_fullsized":"2024-04-25T02:28:27.829840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:14.690953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266099+0000","last_change":"2024-04-25T02:28:26.832851+0000","last_active":"2024-04-25T02:28:28.266099+0000","last_peered":"2024-04-25T02:28:28.266099+0000","last_clean":"2024-04-25T02:28:28.266099+0000","last_became_active":"2024-04-25T02:28:26.830932+0000","last_became_peered":"2024-04-25T02:28:26.830932+0000","last_unstale":"2024-04-25T02:28:28.266099+0000","last_undegraded":"2024-04-25T02:28:28.266099+0000","last_fullsized":"2024-04-25T02:28:28.266099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:27.737871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826827+0000","last_change":"2024-04-25T02:28:26.833872+0000","last_active":"2024-04-25T02:28:27.826827+0000","last_peered":"2024-04-25T02:28:27.826827+0000","last_clean":"2024-04-25T02:28:27.826827+0000","last_became_active":"2024-04-25T02:28:26.833622+0000","last_became_peered":"2024-04-25T02:28:26.833622+0000","last_unstale":"2024-04-25T02:28:27.826827+0000","last_undegraded":"2024-04-25T02:28:27.826827+0000","last_fullsized":"2024-04-25T02:28:27.826827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:41.798312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266222+0000","last_change":"2024-04-25T02:28:26.839712+0000","last_active":"2024-04-25T02:28:28.266222+0000","last_peered":"2024-04-25T02:28:28.266222+0000","last_clean":"2024-04-25T02:28:28.266222+0000","last_became_active":"2024-04-25T02:28:26.839411+0000","last_became_peered":"2024-04-25T02:28:26.839411+0000","last_unstale":"2024-04-25T02:28:28.266222+0000","last_undegraded":"2024-04-25T02:28:28.266222+0000","last_fullsized":"2024-04-25T02:28:28.266222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826301+0000","last_change":"2024-04-25T02:28:26.831405+0000","last_active":"2024-04-25T02:28:27.826301+0000","last_peered":"2024-04-25T02:28:27.826301+0000","last_clean":"2024-04-25T02:28:27.826301+0000","last_became_active":"2024-04-25T02:28:26.830794+0000","last_became_peered":"2024-04-25T02:28:26.830794+0000","last_unstale":"2024-04-25T02:28:27.826301+0000","last_undegraded":"2024-04-25T02:28:27.826301+0000","last_fullsized":"2024-04-25T02:28:27.826301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:35.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266665+0000","last_change":"2024-04-25T02:28:26.839008+0000","last_active":"2024-04-25T02:28:28.266665+0000","last_peered":"2024-04-25T02:28:28.266665+0000","last_clean":"2024-04-25T02:28:28.266665+0000","last_became_active":"2024-04-25T02:28:26.838644+0000","last_became_peered":"2024-04-25T02:28:26.838644+0000","last_unstale":"2024-04-25T02:28:28.266665+0000","last_undegraded":"2024-04-25T02:28:28.266665+0000","last_fullsized":"2024-04-25T02:28:28.266665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829981+0000","last_change":"2024-04-25T02:28:26.831816+0000","last_active":"2024-04-25T02:28:27.829981+0000","last_peered":"2024-04-25T02:28:27.829981+0000","last_clean":"2024-04-25T02:28:27.829981+0000","last_became_active":"2024-04-25T02:28:26.831553+0000","last_became_peered":"2024-04-25T02:28:26.831553+0000","last_unstale":"2024-04-25T02:28:27.829981+0000","last_undegraded":"2024-04-25T02:28:27.829981+0000","last_fullsized":"2024-04-25T02:28:27.829981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:35.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822894+0000","last_change":"2024-04-25T02:28:26.839750+0000","last_active":"2024-04-25T02:28:27.822894+0000","last_peered":"2024-04-25T02:28:27.822894+0000","last_clean":"2024-04-25T02:28:27.822894+0000","last_became_active":"2024-04-25T02:28:26.839465+0000","last_became_peered":"2024-04-25T02:28:26.839465+0000","last_unstale":"2024-04-25T02:28:27.822894+0000","last_undegraded":"2024-04-25T02:28:27.822894+0000","last_fullsized":"2024-04-25T02:28:27.822894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:14.690953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266891+0000","last_change":"2024-04-25T02:28:26.841574+0000","last_active":"2024-04-25T02:28:28.266891+0000","last_peered":"2024-04-25T02:28:28.266891+0000","last_clean":"2024-04-25T02:28:28.266891+0000","last_became_active":"2024-04-25T02:28:26.841294+0000","last_became_peered":"2024-04-25T02:28:26.841294+0000","last_unstale":"2024-04-25T02:28:28.266891+0000","last_undegraded":"2024-04-25T02:28:28.266891+0000","last_fullsized":"2024-04-25T02:28:28.266891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:05.955540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266251+0000","last_change":"2024-04-25T02:28:26.826424+0000","last_active":"2024-04-25T02:28:28.266251+0000","last_peered":"2024-04-25T02:28:28.266251+0000","last_clean":"2024-04-25T02:28:28.266251+0000","last_became_active":"2024-04-25T02:28:26.826110+0000","last_became_peered":"2024-04-25T02:28:26.826110+0000","last_unstale":"2024-04-25T02:28:28.266251+0000","last_undegraded":"2024-04-25T02:28:28.266251+0000","last_fullsized":"2024-04-25T02:28:28.266251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827064+0000","last_change":"2024-04-25T02:28:26.827830+0000","last_active":"2024-04-25T02:28:27.827064+0000","last_peered":"2024-04-25T02:28:27.827064+0000","last_clean":"2024-04-25T02:28:27.827064+0000","last_became_active":"2024-04-25T02:28:26.827580+0000","last_became_peered":"2024-04-25T02:28:26.827580+0000","last_unstale":"2024-04-25T02:28:27.827064+0000","last_undegraded":"2024-04-25T02:28:27.827064+0000","last_fullsized":"2024-04-25T02:28:27.827064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:26.897425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266587+0000","last_change":"2024-04-25T02:28:26.835685+0000","last_active":"2024-04-25T02:28:28.266587+0000","last_peered":"2024-04-25T02:28:28.266587+0000","last_clean":"2024-04-25T02:28:28.266587+0000","last_became_active":"2024-04-25T02:28:26.835362+0000","last_became_peered":"2024-04-25T02:28:26.835362+0000","last_unstale":"2024-04-25T02:28:28.266587+0000","last_undegraded":"2024-04-25T02:28:28.266587+0000","last_fullsized":"2024-04-25T02:28:28.266587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:23.832987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829554+0000","last_change":"2024-04-25T02:28:26.829119+0000","last_active":"2024-04-25T02:28:27.829554+0000","last_peered":"2024-04-25T02:28:27.829554+0000","last_clean":"2024-04-25T02:28:27.829554+0000","last_became_active":"2024-04-25T02:28:26.828611+0000","last_became_peered":"2024-04-25T02:28:26.828611+0000","last_unstale":"2024-04-25T02:28:27.829554+0000","last_undegraded":"2024-04-25T02:28:27.829554+0000","last_fullsized":"2024-04-25T02:28:27.829554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826257+0000","last_change":"2024-04-25T02:28:26.836988+0000","last_active":"2024-04-25T02:28:27.826257+0000","last_peered":"2024-04-25T02:28:27.826257+0000","last_clean":"2024-04-25T02:28:27.826257+0000","last_became_active":"2024-04-25T02:28:26.836475+0000","last_became_peered":"2024-04-25T02:28:26.836475+0000","last_unstale":"2024-04-25T02:28:27.826257+0000","last_undegraded":"2024-04-25T02:28:27.826257+0000","last_fullsized":"2024-04-25T02:28:27.826257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:33.827773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266723+0000","last_change":"2024-04-25T02:28:25.831862+0000","last_active":"2024-04-25T02:28:28.266723+0000","last_peered":"2024-04-25T02:28:28.266723+0000","last_clean":"2024-04-25T02:28:28.266723+0000","last_became_active":"2024-04-25T02:28:25.831543+0000","last_became_peered":"2024-04-25T02:28:25.831543+0000","last_unstale":"2024-04-25T02:28:28.266723+0000","last_undegraded":"2024-04-25T02:28:28.266723+0000","last_fullsized":"2024-04-25T02:28:28.266723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266403+0000","last_change":"2024-04-25T02:28:26.824999+0000","last_active":"2024-04-25T02:28:28.266403+0000","last_peered":"2024-04-25T02:28:28.266403+0000","last_clean":"2024-04-25T02:28:28.266403+0000","last_became_active":"2024-04-25T02:28:26.824688+0000","last_became_peered":"2024-04-25T02:28:26.824688+0000","last_unstale":"2024-04-25T02:28:28.266403+0000","last_undegraded":"2024-04-25T02:28:28.266403+0000","last_fullsized":"2024-04-25T02:28:28.266403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:14.690953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829683+0000","last_change":"2024-04-25T02:28:25.821131+0000","last_active":"2024-04-25T02:28:27.829683+0000","last_peered":"2024-04-25T02:28:27.829683+0000","last_clean":"2024-04-25T02:28:27.829683+0000","last_became_active":"2024-04-25T02:28:25.820867+0000","last_became_peered":"2024-04-25T02:28:25.820867+0000","last_unstale":"2024-04-25T02:28:27.829683+0000","last_undegraded":"2024-04-25T02:28:27.829683+0000","last_fullsized":"2024-04-25T02:28:27.829683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:10.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266380+0000","last_change":"2024-04-25T02:28:25.830948+0000","last_active":"2024-04-25T02:28:28.266380+0000","last_peered":"2024-04-25T02:28:28.266380+0000","last_clean":"2024-04-25T02:28:28.266380+0000","last_became_active":"2024-04-25T02:28:25.830638+0000","last_became_peered":"2024-04-25T02:28:25.830638+0000","last_unstale":"2024-04-25T02:28:28.266380+0000","last_undegraded":"2024-04-25T02:28:28.266380+0000","last_fullsized":"2024-04-25T02:28:28.266380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:48.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266977+0000","last_change":"2024-04-25T02:28:26.828838+0000","last_active":"2024-04-25T02:28:28.266977+0000","last_peered":"2024-04-25T02:28:28.266977+0000","last_clean":"2024-04-25T02:28:28.266977+0000","last_became_active":"2024-04-25T02:28:26.827915+0000","last_became_peered":"2024-04-25T02:28:26.827915+0000","last_unstale":"2024-04-25T02:28:28.266977+0000","last_undegraded":"2024-04-25T02:28:28.266977+0000","last_fullsized":"2024-04-25T02:28:28.266977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:21.146249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826399+0000","last_change":"2024-04-25T02:28:25.819425+0000","last_active":"2024-04-25T02:28:27.826399+0000","last_peered":"2024-04-25T02:28:27.826399+0000","last_clean":"2024-04-25T02:28:27.826399+0000","last_became_active":"2024-04-25T02:28:25.819124+0000","last_became_peered":"2024-04-25T02:28:25.819124+0000","last_unstale":"2024-04-25T02:28:27.826399+0000","last_undegraded":"2024-04-25T02:28:27.826399+0000","last_fullsized":"2024-04-25T02:28:27.826399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:32.823247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822908+0000","last_change":"2024-04-25T02:28:26.840249+0000","last_active":"2024-04-25T02:28:27.822908+0000","last_peered":"2024-04-25T02:28:27.822908+0000","last_clean":"2024-04-25T02:28:27.822908+0000","last_became_active":"2024-04-25T02:28:26.839935+0000","last_became_peered":"2024-04-25T02:28:26.839935+0000","last_unstale":"2024-04-25T02:28:27.822908+0000","last_undegraded":"2024-04-25T02:28:27.822908+0000","last_fullsized":"2024-04-25T02:28:27.822908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829936+0000","last_change":"2024-04-25T02:28:25.827094+0000","last_active":"2024-04-25T02:28:27.829936+0000","last_peered":"2024-04-25T02:28:27.829936+0000","last_clean":"2024-04-25T02:28:27.829936+0000","last_became_active":"2024-04-25T02:28:25.826833+0000","last_became_peered":"2024-04-25T02:28:25.826833+0000","last_unstale":"2024-04-25T02:28:27.829936+0000","last_undegraded":"2024-04-25T02:28:27.829936+0000","last_fullsized":"2024-04-25T02:28:27.829936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:48.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826933+0000","last_change":"2024-04-25T02:28:26.830006+0000","last_active":"2024-04-25T02:28:27.826933+0000","last_peered":"2024-04-25T02:28:27.826933+0000","last_clean":"2024-04-25T02:28:27.826933+0000","last_became_active":"2024-04-25T02:28:26.829703+0000","last_became_peered":"2024-04-25T02:28:26.829703+0000","last_unstale":"2024-04-25T02:28:27.826933+0000","last_undegraded":"2024-04-25T02:28:27.826933+0000","last_fullsized":"2024-04-25T02:28:27.826933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:26.305868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826920+0000","last_change":"2024-04-25T02:28:25.824029+0000","last_active":"2024-04-25T02:28:27.826920+0000","last_peered":"2024-04-25T02:28:27.826920+0000","last_clean":"2024-04-25T02:28:27.826920+0000","last_became_active":"2024-04-25T02:28:25.823734+0000","last_became_peered":"2024-04-25T02:28:25.823734+0000","last_unstale":"2024-04-25T02:28:27.826920+0000","last_undegraded":"2024-04-25T02:28:27.826920+0000","last_fullsized":"2024-04-25T02:28:27.826920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:22.828461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266445+0000","last_change":"2024-04-25T02:28:26.833144+0000","last_active":"2024-04-25T02:28:28.266445+0000","last_peered":"2024-04-25T02:28:28.266445+0000","last_clean":"2024-04-25T02:28:28.266445+0000","last_became_active":"2024-04-25T02:28:26.832578+0000","last_became_peered":"2024-04-25T02:28:26.832578+0000","last_unstale":"2024-04-25T02:28:28.266445+0000","last_undegraded":"2024-04-25T02:28:28.266445+0000","last_fullsized":"2024-04-25T02:28:28.266445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822999+0000","last_change":"2024-04-25T02:28:25.827731+0000","last_active":"2024-04-25T02:28:27.822999+0000","last_peered":"2024-04-25T02:28:27.822999+0000","last_clean":"2024-04-25T02:28:27.822999+0000","last_became_active":"2024-04-25T02:28:25.827415+0000","last_became_peered":"2024-04-25T02:28:25.827415+0000","last_unstale":"2024-04-25T02:28:27.822999+0000","last_undegraded":"2024-04-25T02:28:27.822999+0000","last_fullsized":"2024-04-25T02:28:27.822999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826897+0000","last_change":"2024-04-25T02:28:26.833382+0000","last_active":"2024-04-25T02:28:27.826897+0000","last_peered":"2024-04-25T02:28:27.826897+0000","last_clean":"2024-04-25T02:28:27.826897+0000","last_became_active":"2024-04-25T02:28:26.832896+0000","last_became_peered":"2024-04-25T02:28:26.832896+0000","last_unstale":"2024-04-25T02:28:27.826897+0000","last_undegraded":"2024-04-25T02:28:27.826897+0000","last_fullsized":"2024-04-25T02:28:27.826897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:23.832987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829943+0000","last_change":"2024-04-25T02:28:25.831322+0000","last_active":"2024-04-25T02:28:27.829943+0000","last_peered":"2024-04-25T02:28:27.829943+0000","last_clean":"2024-04-25T02:28:27.829943+0000","last_became_active":"2024-04-25T02:28:25.831024+0000","last_became_peered":"2024-04-25T02:28:25.831024+0000","last_unstale":"2024-04-25T02:28:27.829943+0000","last_undegraded":"2024-04-25T02:28:27.829943+0000","last_fullsized":"2024-04-25T02:28:27.829943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:22.828461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266281+0000","last_change":"2024-04-25T02:28:26.837505+0000","last_active":"2024-04-25T02:28:28.266281+0000","last_peered":"2024-04-25T02:28:28.266281+0000","last_clean":"2024-04-25T02:28:28.266281+0000","last_became_active":"2024-04-25T02:28:26.836986+0000","last_became_peered":"2024-04-25T02:28:26.836986+0000","last_unstale":"2024-04-25T02:28:28.266281+0000","last_undegraded":"2024-04-25T02:28:28.266281+0000","last_fullsized":"2024-04-25T02:28:28.266281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:26.897425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266515+0000","last_change":"2024-04-25T02:28:25.830714+0000","last_active":"2024-04-25T02:28:28.266515+0000","last_peered":"2024-04-25T02:28:28.266515+0000","last_clean":"2024-04-25T02:28:28.266515+0000","last_became_active":"2024-04-25T02:28:25.830407+0000","last_became_peered":"2024-04-25T02:28:25.830407+0000","last_unstale":"2024-04-25T02:28:28.266515+0000","last_undegraded":"2024-04-25T02:28:28.266515+0000","last_fullsized":"2024-04-25T02:28:28.266515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:15.170784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265782+0000","last_change":"2024-04-25T02:28:26.830192+0000","last_active":"2024-04-25T02:28:28.265782+0000","last_peered":"2024-04-25T02:28:28.265782+0000","last_clean":"2024-04-25T02:28:28.265782+0000","last_became_active":"2024-04-25T02:28:26.829820+0000","last_became_peered":"2024-04-25T02:28:26.829820+0000","last_unstale":"2024-04-25T02:28:28.265782+0000","last_undegraded":"2024-04-25T02:28:28.265782+0000","last_fullsized":"2024-04-25T02:28:28.265782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:29.495511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826919+0000","last_change":"2024-04-25T02:28:25.826726+0000","last_active":"2024-04-25T02:28:27.826919+0000","last_peered":"2024-04-25T02:28:27.826919+0000","last_clean":"2024-04-25T02:28:27.826919+0000","last_became_active":"2024-04-25T02:28:25.826427+0000","last_became_peered":"2024-04-25T02:28:25.826427+0000","last_unstale":"2024-04-25T02:28:27.826919+0000","last_undegraded":"2024-04-25T02:28:27.826919+0000","last_fullsized":"2024-04-25T02:28:27.826919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266162+0000","last_change":"2024-04-25T02:28:26.842107+0000","last_active":"2024-04-25T02:28:28.266162+0000","last_peered":"2024-04-25T02:28:28.266162+0000","last_clean":"2024-04-25T02:28:28.266162+0000","last_became_active":"2024-04-25T02:28:26.841784+0000","last_became_peered":"2024-04-25T02:28:26.841784+0000","last_unstale":"2024-04-25T02:28:28.266162+0000","last_undegraded":"2024-04-25T02:28:28.266162+0000","last_fullsized":"2024-04-25T02:28:28.266162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:21.146249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829509+0000","last_change":"2024-04-25T02:28:25.822245+0000","last_active":"2024-04-25T02:28:27.829509+0000","last_peered":"2024-04-25T02:28:27.829509+0000","last_clean":"2024-04-25T02:28:27.829509+0000","last_became_active":"2024-04-25T02:28:25.821961+0000","last_became_peered":"2024-04-25T02:28:25.821961+0000","last_unstale":"2024-04-25T02:28:27.829509+0000","last_undegraded":"2024-04-25T02:28:27.829509+0000","last_fullsized":"2024-04-25T02:28:27.829509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829553+0000","last_change":"2024-04-25T02:28:26.828898+0000","last_active":"2024-04-25T02:28:27.829553+0000","last_peered":"2024-04-25T02:28:27.829553+0000","last_clean":"2024-04-25T02:28:27.829553+0000","last_became_active":"2024-04-25T02:28:26.828274+0000","last_became_peered":"2024-04-25T02:28:26.828274+0000","last_unstale":"2024-04-25T02:28:27.829553+0000","last_undegraded":"2024-04-25T02:28:27.829553+0000","last_fullsized":"2024-04-25T02:28:27.829553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:12.142773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266835+0000","last_change":"2024-04-25T02:28:25.820968+0000","last_active":"2024-04-25T02:28:28.266835+0000","last_peered":"2024-04-25T02:28:28.266835+0000","last_clean":"2024-04-25T02:28:28.266835+0000","last_became_active":"2024-04-25T02:28:25.820583+0000","last_became_peered":"2024-04-25T02:28:25.820583+0000","last_unstale":"2024-04-25T02:28:28.266835+0000","last_undegraded":"2024-04-25T02:28:28.266835+0000","last_fullsized":"2024-04-25T02:28:28.266835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:17:36.734690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266094+0000","last_change":"2024-04-25T02:28:26.839360+0000","last_active":"2024-04-25T02:28:28.266094+0000","last_peered":"2024-04-25T02:28:28.266094+0000","last_clean":"2024-04-25T02:28:28.266094+0000","last_became_active":"2024-04-25T02:28:26.839071+0000","last_became_peered":"2024-04-25T02:28:26.839071+0000","last_unstale":"2024-04-25T02:28:28.266094+0000","last_undegraded":"2024-04-25T02:28:28.266094+0000","last_fullsized":"2024-04-25T02:28:28.266094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:52.300089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826544+0000","last_change":"2024-04-25T02:28:25.831348+0000","last_active":"2024-04-25T02:28:27.826544+0000","last_peered":"2024-04-25T02:28:27.826544+0000","last_clean":"2024-04-25T02:28:27.826544+0000","last_became_active":"2024-04-25T02:28:25.830958+0000","last_became_peered":"2024-04-25T02:28:25.830958+0000","last_unstale":"2024-04-25T02:28:27.826544+0000","last_undegraded":"2024-04-25T02:28:27.826544+0000","last_fullsized":"2024-04-25T02:28:27.826544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:14:28.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266367+0000","last_change":"2024-04-25T02:28:26.843465+0000","last_active":"2024-04-25T02:28:28.266367+0000","last_peered":"2024-04-25T02:28:28.266367+0000","last_clean":"2024-04-25T02:28:28.266367+0000","last_became_active":"2024-04-25T02:28:26.843147+0000","last_became_peered":"2024-04-25T02:28:26.843147+0000","last_unstale":"2024-04-25T02:28:28.266367+0000","last_undegraded":"2024-04-25T02:28:28.266367+0000","last_fullsized":"2024-04-25T02:28:28.266367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:28:45.463626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266818+0000","last_change":"2024-04-25T02:28:25.822767+0000","last_active":"2024-04-25T02:28:28.266818+0000","last_peered":"2024-04-25T02:28:28.266818+0000","last_clean":"2024-04-25T02:28:28.266818+0000","last_became_active":"2024-04-25T02:28:25.822396+0000","last_became_peered":"2024-04-25T02:28:25.822396+0000","last_unstale":"2024-04-25T02:28:28.266818+0000","last_undegraded":"2024-04-25T02:28:28.266818+0000","last_fullsized":"2024-04-25T02:28:28.266818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266583+0000","last_change":"2024-04-25T02:28:26.840019+0000","last_active":"2024-04-25T02:28:28.266583+0000","last_peered":"2024-04-25T02:28:28.266583+0000","last_clean":"2024-04-25T02:28:28.266583+0000","last_became_active":"2024-04-25T02:28:26.839739+0000","last_became_peered":"2024-04-25T02:28:26.839739+0000","last_unstale":"2024-04-25T02:28:28.266583+0000","last_undegraded":"2024-04-25T02:28:28.266583+0000","last_fullsized":"2024-04-25T02:28:28.266583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:31.847102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.823098+0000","last_change":"2024-04-25T02:28:25.819880+0000","last_active":"2024-04-25T02:28:27.823098+0000","last_peered":"2024-04-25T02:28:27.823098+0000","last_clean":"2024-04-25T02:28:27.823098+0000","last_became_active":"2024-04-25T02:28:25.819487+0000","last_became_peered":"2024-04-25T02:28:25.819487+0000","last_unstale":"2024-04-25T02:28:27.823098+0000","last_undegraded":"2024-04-25T02:28:27.823098+0000","last_fullsized":"2024-04-25T02:28:27.823098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:32.823247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826504+0000","last_change":"2024-04-25T02:28:26.830885+0000","last_active":"2024-04-25T02:28:27.826504+0000","last_peered":"2024-04-25T02:28:27.826504+0000","last_clean":"2024-04-25T02:28:27.826504+0000","last_became_active":"2024-04-25T02:28:26.830454+0000","last_became_peered":"2024-04-25T02:28:26.830454+0000","last_unstale":"2024-04-25T02:28:27.826504+0000","last_undegraded":"2024-04-25T02:28:27.826504+0000","last_fullsized":"2024-04-25T02:28:27.826504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:05.955540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266514+0000","last_change":"2024-04-25T02:28:25.820969+0000","last_active":"2024-04-25T02:28:28.266514+0000","last_peered":"2024-04-25T02:28:28.266514+0000","last_clean":"2024-04-25T02:28:28.266514+0000","last_became_active":"2024-04-25T02:28:25.820594+0000","last_became_peered":"2024-04-25T02:28:25.820594+0000","last_unstale":"2024-04-25T02:28:28.266514+0000","last_undegraded":"2024-04-25T02:28:28.266514+0000","last_fullsized":"2024-04-25T02:28:28.266514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:48.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266206+0000","last_change":"2024-04-25T02:28:26.843856+0000","last_active":"2024-04-25T02:28:28.266206+0000","last_peered":"2024-04-25T02:28:28.266206+0000","last_clean":"2024-04-25T02:28:28.266206+0000","last_became_active":"2024-04-25T02:28:26.841671+0000","last_became_peered":"2024-04-25T02:28:26.841671+0000","last_unstale":"2024-04-25T02:28:28.266206+0000","last_undegraded":"2024-04-25T02:28:28.266206+0000","last_fullsized":"2024-04-25T02:28:28.266206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:41.798312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265929+0000","last_change":"2024-04-25T02:28:15.520345+0000","last_active":"2024-04-25T02:28:28.265929+0000","last_peered":"2024-04-25T02:28:28.265929+0000","last_clean":"2024-04-25T02:28:28.265929+0000","last_became_active":"2024-04-25T02:28:15.519317+0000","last_became_peered":"2024-04-25T02:28:15.519317+0000","last_unstale":"2024-04-25T02:28:28.265929+0000","last_undegraded":"2024-04-25T02:28:28.265929+0000","last_fullsized":"2024-04-25T02:28:28.265929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_clean_scrub_stamp":"2024-04-25T02:28:14.374327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:20.125523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826154+0000","last_change":"2024-04-25T02:28:25.821889+0000","last_active":"2024-04-25T02:28:27.826154+0000","last_peered":"2024-04-25T02:28:27.826154+0000","last_clean":"2024-04-25T02:28:27.826154+0000","last_became_active":"2024-04-25T02:28:25.821633+0000","last_became_peered":"2024-04-25T02:28:25.821633+0000","last_unstale":"2024-04-25T02:28:27.826154+0000","last_undegraded":"2024-04-25T02:28:27.826154+0000","last_fullsized":"2024-04-25T02:28:27.826154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:48.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266206+0000","last_change":"2024-04-25T02:28:26.839035+0000","last_active":"2024-04-25T02:28:28.266206+0000","last_peered":"2024-04-25T02:28:28.266206+0000","last_clean":"2024-04-25T02:28:28.266206+0000","last_became_active":"2024-04-25T02:28:26.838759+0000","last_became_peered":"2024-04-25T02:28:26.838759+0000","last_unstale":"2024-04-25T02:28:28.266206+0000","last_undegraded":"2024-04-25T02:28:28.266206+0000","last_fullsized":"2024-04-25T02:28:28.266206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:09.762419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265862+0000","last_change":"2024-04-25T02:28:25.833571+0000","last_active":"2024-04-25T02:28:28.265862+0000","last_peered":"2024-04-25T02:28:28.265862+0000","last_clean":"2024-04-25T02:28:28.265862+0000","last_became_active":"2024-04-25T02:28:25.833379+0000","last_became_peered":"2024-04-25T02:28:25.833379+0000","last_unstale":"2024-04-25T02:28:28.265862+0000","last_undegraded":"2024-04-25T02:28:28.265862+0000","last_fullsized":"2024-04-25T02:28:28.265862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:32.823247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265668+0000","last_change":"2024-04-25T02:28:26.833450+0000","last_active":"2024-04-25T02:28:28.265668+0000","last_peered":"2024-04-25T02:28:28.265668+0000","last_clean":"2024-04-25T02:28:28.265668+0000","last_became_active":"2024-04-25T02:28:26.833117+0000","last_became_peered":"2024-04-25T02:28:26.833117+0000","last_unstale":"2024-04-25T02:28:28.265668+0000","last_undegraded":"2024-04-25T02:28:28.265668+0000","last_fullsized":"2024-04-25T02:28:28.265668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:20.271750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266705+0000","last_change":"2024-04-25T02:28:25.823596+0000","last_active":"2024-04-25T02:28:28.266705+0000","last_peered":"2024-04-25T02:28:28.266705+0000","last_clean":"2024-04-25T02:28:28.266705+0000","last_became_active":"2024-04-25T02:28:25.822949+0000","last_became_peered":"2024-04-25T02:28:25.822949+0000","last_unstale":"2024-04-25T02:28:28.266705+0000","last_undegraded":"2024-04-25T02:28:28.266705+0000","last_fullsized":"2024-04-25T02:28:28.266705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:47.613148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822846+0000","last_change":"2024-04-25T02:28:26.830075+0000","last_active":"2024-04-25T02:28:27.822846+0000","last_peered":"2024-04-25T02:28:27.822846+0000","last_clean":"2024-04-25T02:28:27.822846+0000","last_became_active":"2024-04-25T02:28:26.829526+0000","last_became_peered":"2024-04-25T02:28:26.829526+0000","last_unstale":"2024-04-25T02:28:27.822846+0000","last_undegraded":"2024-04-25T02:28:27.822846+0000","last_fullsized":"2024-04-25T02:28:27.822846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827031+0000","last_change":"2024-04-25T02:28:25.820913+0000","last_active":"2024-04-25T02:28:27.827031+0000","last_peered":"2024-04-25T02:28:27.827031+0000","last_clean":"2024-04-25T02:28:27.827031+0000","last_became_active":"2024-04-25T02:28:25.820531+0000","last_became_peered":"2024-04-25T02:28:25.820531+0000","last_unstale":"2024-04-25T02:28:27.827031+0000","last_undegraded":"2024-04-25T02:28:27.827031+0000","last_fullsized":"2024-04-25T02:28:27.827031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:10.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827117+0000","last_change":"2024-04-25T02:28:26.835487+0000","last_active":"2024-04-25T02:28:27.827117+0000","last_peered":"2024-04-25T02:28:27.827117+0000","last_clean":"2024-04-25T02:28:27.827117+0000","last_became_active":"2024-04-25T02:28:26.834842+0000","last_became_peered":"2024-04-25T02:28:26.834842+0000","last_unstale":"2024-04-25T02:28:27.827117+0000","last_undegraded":"2024-04-25T02:28:27.827117+0000","last_fullsized":"2024-04-25T02:28:27.827117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:54.957406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.823008+0000","last_change":"2024-04-25T02:28:25.831205+0000","last_active":"2024-04-25T02:28:27.823008+0000","last_peered":"2024-04-25T02:28:27.823008+0000","last_clean":"2024-04-25T02:28:27.823008+0000","last_became_active":"2024-04-25T02:28:25.830910+0000","last_became_peered":"2024-04-25T02:28:25.830910+0000","last_unstale":"2024-04-25T02:28:27.823008+0000","last_undegraded":"2024-04-25T02:28:27.823008+0000","last_fullsized":"2024-04-25T02:28:27.823008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:22.828461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827217+0000","last_change":"2024-04-25T02:28:26.830467+0000","last_active":"2024-04-25T02:28:27.827217+0000","last_peered":"2024-04-25T02:28:27.827217+0000","last_clean":"2024-04-25T02:28:27.827217+0000","last_became_active":"2024-04-25T02:28:26.830219+0000","last_became_peered":"2024-04-25T02:28:26.830219+0000","last_unstale":"2024-04-25T02:28:27.827217+0000","last_undegraded":"2024-04-25T02:28:27.827217+0000","last_fullsized":"2024-04-25T02:28:27.827217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:19.911809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266442+0000","last_change":"2024-04-25T02:28:25.831653+0000","last_active":"2024-04-25T02:28:28.266442+0000","last_peered":"2024-04-25T02:28:28.266442+0000","last_clean":"2024-04-25T02:28:28.266442+0000","last_became_active":"2024-04-25T02:28:25.831318+0000","last_became_peered":"2024-04-25T02:28:25.831318+0000","last_unstale":"2024-04-25T02:28:28.266442+0000","last_undegraded":"2024-04-25T02:28:28.266442+0000","last_fullsized":"2024-04-25T02:28:28.266442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:53.952880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822899+0000","last_change":"2024-04-25T02:28:26.832413+0000","last_active":"2024-04-25T02:28:27.822899+0000","last_peered":"2024-04-25T02:28:27.822899+0000","last_clean":"2024-04-25T02:28:27.822899+0000","last_became_active":"2024-04-25T02:28:26.832081+0000","last_became_peered":"2024-04-25T02:28:26.832081+0000","last_unstale":"2024-04-25T02:28:27.822899+0000","last_undegraded":"2024-04-25T02:28:27.822899+0000","last_fullsized":"2024-04-25T02:28:27.822899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829103+0000","last_change":"2024-04-25T02:28:25.824355+0000","last_active":"2024-04-25T02:28:27.829103+0000","last_peered":"2024-04-25T02:28:27.829103+0000","last_clean":"2024-04-25T02:28:27.829103+0000","last_became_active":"2024-04-25T02:28:25.824048+0000","last_became_peered":"2024-04-25T02:28:25.824048+0000","last_unstale":"2024-04-25T02:28:27.829103+0000","last_undegraded":"2024-04-25T02:28:27.829103+0000","last_fullsized":"2024-04-25T02:28:27.829103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:53.952880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266822+0000","last_change":"2024-04-25T02:28:26.831460+0000","last_active":"2024-04-25T02:28:28.266822+0000","last_peered":"2024-04-25T02:28:28.266822+0000","last_clean":"2024-04-25T02:28:28.266822+0000","last_became_active":"2024-04-25T02:28:26.831127+0000","last_became_peered":"2024-04-25T02:28:26.831127+0000","last_unstale":"2024-04-25T02:28:28.266822+0000","last_undegraded":"2024-04-25T02:28:28.266822+0000","last_fullsized":"2024-04-25T02:28:28.266822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:52.300089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.830022+0000","last_change":"2024-04-25T02:28:25.824264+0000","last_active":"2024-04-25T02:28:27.830022+0000","last_peered":"2024-04-25T02:28:27.830022+0000","last_clean":"2024-04-25T02:28:27.830022+0000","last_became_active":"2024-04-25T02:28:25.823953+0000","last_became_peered":"2024-04-25T02:28:25.823953+0000","last_unstale":"2024-04-25T02:28:27.830022+0000","last_undegraded":"2024-04-25T02:28:27.830022+0000","last_fullsized":"2024-04-25T02:28:27.830022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:32.823247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266650+0000","last_change":"2024-04-25T02:28:26.827330+0000","last_active":"2024-04-25T02:28:28.266650+0000","last_peered":"2024-04-25T02:28:28.266650+0000","last_clean":"2024-04-25T02:28:28.266650+0000","last_became_active":"2024-04-25T02:28:26.826944+0000","last_became_peered":"2024-04-25T02:28:26.826944+0000","last_unstale":"2024-04-25T02:28:28.266650+0000","last_undegraded":"2024-04-25T02:28:28.266650+0000","last_fullsized":"2024-04-25T02:28:28.266650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265859+0000","last_change":"2024-04-25T02:28:25.831605+0000","last_active":"2024-04-25T02:28:28.265859+0000","last_peered":"2024-04-25T02:28:28.265859+0000","last_clean":"2024-04-25T02:28:28.265859+0000","last_became_active":"2024-04-25T02:28:25.831328+0000","last_became_peered":"2024-04-25T02:28:25.831328+0000","last_unstale":"2024-04-25T02:28:28.265859+0000","last_undegraded":"2024-04-25T02:28:28.265859+0000","last_fullsized":"2024-04-25T02:28:28.265859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:04:33.145269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827334+0000","last_change":"2024-04-25T02:28:26.834040+0000","last_active":"2024-04-25T02:28:27.827334+0000","last_peered":"2024-04-25T02:28:27.827334+0000","last_clean":"2024-04-25T02:28:27.827334+0000","last_became_active":"2024-04-25T02:28:26.833740+0000","last_became_peered":"2024-04-25T02:28:26.833740+0000","last_unstale":"2024-04-25T02:28:27.827334+0000","last_undegraded":"2024-04-25T02:28:27.827334+0000","last_fullsized":"2024-04-25T02:28:27.827334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:04:34.149794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822940+0000","last_change":"2024-04-25T02:28:25.825296+0000","last_active":"2024-04-25T02:28:27.822940+0000","last_peered":"2024-04-25T02:28:27.822940+0000","last_clean":"2024-04-25T02:28:27.822940+0000","last_became_active":"2024-04-25T02:28:25.824989+0000","last_became_peered":"2024-04-25T02:28:25.824989+0000","last_unstale":"2024-04-25T02:28:27.822940+0000","last_undegraded":"2024-04-25T02:28:27.822940+0000","last_fullsized":"2024-04-25T02:28:27.822940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:10.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.267019+0000","last_change":"2024-04-25T02:28:26.831540+0000","last_active":"2024-04-25T02:28:28.267019+0000","last_peered":"2024-04-25T02:28:28.267019+0000","last_clean":"2024-04-25T02:28:28.267019+0000","last_became_active":"2024-04-25T02:28:26.831020+0000","last_became_peered":"2024-04-25T02:28:26.831020+0000","last_unstale":"2024-04-25T02:28:28.267019+0000","last_undegraded":"2024-04-25T02:28:28.267019+0000","last_fullsized":"2024-04-25T02:28:28.267019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:41.798312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.823029+0000","last_change":"2024-04-25T02:28:25.827630+0000","last_active":"2024-04-25T02:28:27.823029+0000","last_peered":"2024-04-25T02:28:27.823029+0000","last_clean":"2024-04-25T02:28:27.823029+0000","last_became_active":"2024-04-25T02:28:25.827277+0000","last_became_peered":"2024-04-25T02:28:25.827277+0000","last_unstale":"2024-04-25T02:28:27.823029+0000","last_undegraded":"2024-04-25T02:28:27.823029+0000","last_fullsized":"2024-04-25T02:28:27.823029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:04:33.145269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266602+0000","last_change":"2024-04-25T02:28:26.828333+0000","last_active":"2024-04-25T02:28:28.266602+0000","last_peered":"2024-04-25T02:28:28.266602+0000","last_clean":"2024-04-25T02:28:28.266602+0000","last_became_active":"2024-04-25T02:28:26.828026+0000","last_became_peered":"2024-04-25T02:28:26.828026+0000","last_unstale":"2024-04-25T02:28:28.266602+0000","last_undegraded":"2024-04-25T02:28:28.266602+0000","last_fullsized":"2024-04-25T02:28:28.266602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266350+0000","last_change":"2024-04-25T02:28:25.830120+0000","last_active":"2024-04-25T02:28:28.266350+0000","last_peered":"2024-04-25T02:28:28.266350+0000","last_clean":"2024-04-25T02:28:28.266350+0000","last_became_active":"2024-04-25T02:28:25.829808+0000","last_became_peered":"2024-04-25T02:28:25.829808+0000","last_unstale":"2024-04-25T02:28:28.266350+0000","last_undegraded":"2024-04-25T02:28:28.266350+0000","last_fullsized":"2024-04-25T02:28:28.266350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:37.081003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829555+0000","last_change":"2024-04-25T02:28:26.825705+0000","last_active":"2024-04-25T02:28:27.829555+0000","last_peered":"2024-04-25T02:28:27.829555+0000","last_clean":"2024-04-25T02:28:27.829555+0000","last_became_active":"2024-04-25T02:28:26.825382+0000","last_became_peered":"2024-04-25T02:28:26.825382+0000","last_unstale":"2024-04-25T02:28:27.829555+0000","last_undegraded":"2024-04-25T02:28:27.829555+0000","last_fullsized":"2024-04-25T02:28:27.829555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:09.762419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827064+0000","last_change":"2024-04-25T02:28:26.832976+0000","last_active":"2024-04-25T02:28:27.827064+0000","last_peered":"2024-04-25T02:28:27.827064+0000","last_clean":"2024-04-25T02:28:27.827064+0000","last_became_active":"2024-04-25T02:28:26.832717+0000","last_became_peered":"2024-04-25T02:28:26.832717+0000","last_unstale":"2024-04-25T02:28:27.827064+0000","last_undegraded":"2024-04-25T02:28:27.827064+0000","last_fullsized":"2024-04-25T02:28:27.827064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:28:45.463626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266302+0000","last_change":"2024-04-25T02:28:25.830578+0000","last_active":"2024-04-25T02:28:28.266302+0000","last_peered":"2024-04-25T02:28:28.266302+0000","last_clean":"2024-04-25T02:28:28.266302+0000","last_became_active":"2024-04-25T02:28:25.829878+0000","last_became_peered":"2024-04-25T02:28:25.829878+0000","last_unstale":"2024-04-25T02:28:28.266302+0000","last_undegraded":"2024-04-25T02:28:28.266302+0000","last_fullsized":"2024-04-25T02:28:28.266302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:10.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826362+0000","last_change":"2024-04-25T02:28:26.824909+0000","last_active":"2024-04-25T02:28:27.826362+0000","last_peered":"2024-04-25T02:28:27.826362+0000","last_clean":"2024-04-25T02:28:27.826362+0000","last_became_active":"2024-04-25T02:28:26.824570+0000","last_became_peered":"2024-04-25T02:28:26.824570+0000","last_unstale":"2024-04-25T02:28:27.826362+0000","last_undegraded":"2024-04-25T02:28:27.826362+0000","last_fullsized":"2024-04-25T02:28:27.826362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:52.300089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266326+0000","last_change":"2024-04-25T02:28:25.830311+0000","last_active":"2024-04-25T02:28:28.266326+0000","last_peered":"2024-04-25T02:28:28.266326+0000","last_clean":"2024-04-25T02:28:28.266326+0000","last_became_active":"2024-04-25T02:28:25.830025+0000","last_became_peered":"2024-04-25T02:28:25.830025+0000","last_unstale":"2024-04-25T02:28:28.266326+0000","last_undegraded":"2024-04-25T02:28:28.266326+0000","last_fullsized":"2024-04-25T02:28:28.266326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:22.828461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266204+0000","last_change":"2024-04-25T02:28:26.832875+0000","last_active":"2024-04-25T02:28:28.266204+0000","last_peered":"2024-04-25T02:28:28.266204+0000","last_clean":"2024-04-25T02:28:28.266204+0000","last_became_active":"2024-04-25T02:28:26.832208+0000","last_became_peered":"2024-04-25T02:28:26.832208+0000","last_unstale":"2024-04-25T02:28:28.266204+0000","last_undegraded":"2024-04-25T02:28:28.266204+0000","last_fullsized":"2024-04-25T02:28:28.266204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:09.762419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266877+0000","last_change":"2024-04-25T02:28:25.829350+0000","last_active":"2024-04-25T02:28:28.266877+0000","last_peered":"2024-04-25T02:28:28.266877+0000","last_clean":"2024-04-25T02:28:28.266877+0000","last_became_active":"2024-04-25T02:28:25.829072+0000","last_became_peered":"2024-04-25T02:28:25.829072+0000","last_unstale":"2024-04-25T02:28:28.266877+0000","last_undegraded":"2024-04-25T02:28:28.266877+0000","last_fullsized":"2024-04-25T02:28:28.266877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:17:36.734690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266692+0000","last_change":"2024-04-25T02:28:26.827282+0000","last_active":"2024-04-25T02:28:28.266692+0000","last_peered":"2024-04-25T02:28:28.266692+0000","last_clean":"2024-04-25T02:28:28.266692+0000","last_became_active":"2024-04-25T02:28:26.826977+0000","last_became_peered":"2024-04-25T02:28:26.826977+0000","last_unstale":"2024-04-25T02:28:28.266692+0000","last_undegraded":"2024-04-25T02:28:28.266692+0000","last_fullsized":"2024-04-25T02:28:28.266692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:35.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.267016+0000","last_change":"2024-04-25T02:28:25.829686+0000","last_active":"2024-04-25T02:28:28.267016+0000","last_peered":"2024-04-25T02:28:28.267016+0000","last_clean":"2024-04-25T02:28:28.267016+0000","last_became_active":"2024-04-25T02:28:25.829226+0000","last_became_peered":"2024-04-25T02:28:25.829226+0000","last_unstale":"2024-04-25T02:28:28.267016+0000","last_undegraded":"2024-04-25T02:28:28.267016+0000","last_fullsized":"2024-04-25T02:28:28.267016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:18.405319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":64794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:28:31.207 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T02:28:31.207 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T02:28:31.207 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T02:28:31.208 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T02:28:31.208 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T02:28:31.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.340+0000 7fd3a0970640 1 Processor -- start 2024-04-25T02:28:31.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.340+0000 7fd3a0970640 1 -- start start 2024-04-25T02:28:31.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.341+0000 7fd3a0970640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd39c0cee60 0x7fd39c06c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:31.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.341+0000 7fd3a0970640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd39c0d0210 0x7fd39c06c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:31.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.341+0000 7fd3a0970640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd39c15c3a0 con 0x7fd39c15bfc0 2024-04-25T02:28:31.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.341+0000 7fd3a0970640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd39c0d0760 con 0x7fd39c0cee60 2024-04-25T02:28:31.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.341+0000 7fd3a0970640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd39c0d0a40 con 0x7fd39c0d0210 2024-04-25T02:28:31.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.341+0000 7fd39a59c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd39c15bfc0 0x7fd39c0ce750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51222/0 (socket says 172.21.15.67:51222) 2024-04-25T02:28:31.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.341+0000 7fd39a59c640 1 -- 172.21.15.67:0/80147660 learned_addr learned my addr 172.21.15.67:0/80147660 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:31.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.341+0000 7fd399d9b640 1 --2- 172.21.15.67:0/80147660 >> v2:172.21.15.67:3300/0 conn(0x7fd39c0cee60 0x7fd39c06c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:31.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.341+0000 7fd399d9b640 1 -- 172.21.15.67:0/80147660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd39c0d0210 msgr2=0x7fd39c06c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:31.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.341+0000 7fd399d9b640 1 --2- 172.21.15.67:0/80147660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd39c0d0210 0x7fd39c06c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.341+0000 7fd399d9b640 1 -- 172.21.15.67:0/80147660 >> v1:172.21.15.67:6789/0 conn(0x7fd39c15bfc0 legacy=0x7fd39c0ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:31.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.341+0000 7fd399d9b640 1 -- 172.21.15.67:0/80147660 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39c0d0d20 con 0x7fd39c0cee60 2024-04-25T02:28:31.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.342+0000 7fd399d9b640 1 --2- 172.21.15.67:0/80147660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd39c0cee60 0x7fd39c06c260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd3840097d0 tx=0x7fd38402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4a0a4026a810eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:31.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.342+0000 7fd39959a640 1 -- 172.21.15.67:0/80147660 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd384037070 con 0x7fd39c0cee60 2024-04-25T02:28:31.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.342+0000 7fd39959a640 1 -- 172.21.15.67:0/80147660 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd384032440 con 0x7fd39c0cee60 2024-04-25T02:28:31.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.342+0000 7fd39959a640 1 -- 172.21.15.67:0/80147660 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd384032810 con 0x7fd39c0cee60 2024-04-25T02:28:31.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.343+0000 7fd3a0970640 1 -- 172.21.15.67:0/80147660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd39c0cee60 msgr2=0x7fd39c06c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:31.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.343+0000 7fd3a0970640 1 --2- 172.21.15.67:0/80147660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd39c0cee60 0x7fd39c06c260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd3840097d0 tx=0x7fd38402a1c0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.343+0000 7fd3a0970640 1 -- 172.21.15.67:0/80147660 shutdown_connections 2024-04-25T02:28:31.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.343+0000 7fd3a0970640 1 --2- 172.21.15.67:0/80147660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd39c0d0210 0x7fd39c06c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.343+0000 7fd3a0970640 1 --2- 172.21.15.67:0/80147660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd39c0cee60 0x7fd39c06c260 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.343+0000 7fd3a0970640 1 -- 172.21.15.67:0/80147660 >> 172.21.15.67:0/80147660 conn(0x7fd39c0d1ed0 msgr2=0x7fd39c0d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:31.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.343+0000 7fd3a0970640 1 -- 172.21.15.67:0/80147660 shutdown_connections 2024-04-25T02:28:31.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.343+0000 7fd3a0970640 1 -- 172.21.15.67:0/80147660 wait complete. 2024-04-25T02:28:31.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.344+0000 7fd3a0970640 1 Processor -- start 2024-04-25T02:28:31.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.344+0000 7fd3a0970640 1 -- start start 2024-04-25T02:28:31.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd3a0970640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd39c0cee60 0x7fd39c150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:31.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd3a0970640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd39c0d0210 0x7fd39c0b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:31.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd3a0970640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd39c15bfc0 0x7fd39c0b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:31.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd3a0970640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd39c0cf690 con 0x7fd39c15bfc0 2024-04-25T02:28:31.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd3a0970640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd39c0d12e0 con 0x7fd39c0cee60 2024-04-25T02:28:31.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd3a0970640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd39c0cf810 con 0x7fd39c0d0210 2024-04-25T02:28:31.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd39ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd39c15bfc0 0x7fd39c0b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:31.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd39ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd39c15bfc0 0x7fd39c0b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59362/0 (socket says 172.21.15.67:59362) 2024-04-25T02:28:31.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd39ad9d640 1 -- 172.21.15.67:0/1983944278 learned_addr learned my addr 172.21.15.67:0/1983944278 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:31.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd39a59c640 1 --2- 172.21.15.67:0/1983944278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd39c0cee60 0x7fd39c150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:31.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd399d9b640 1 --2- 172.21.15.67:0/1983944278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd39c0d0210 0x7fd39c0b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:31.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd39ad9d640 1 -- 172.21.15.67:0/1983944278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd39c0d0210 msgr2=0x7fd39c0b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:31.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd39ad9d640 1 --2- 172.21.15.67:0/1983944278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd39c0d0210 0x7fd39c0b39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd39ad9d640 1 -- 172.21.15.67:0/1983944278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd39c0cee60 msgr2=0x7fd39c150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:31.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd39ad9d640 1 --2- 172.21.15.67:0/1983944278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd39c0cee60 0x7fd39c150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd39ad9d640 1 -- 172.21.15.67:0/1983944278 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39c0b4530 con 0x7fd39c15bfc0 2024-04-25T02:28:31.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd399d9b640 1 --2- 172.21.15.67:0/1983944278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd39c0d0210 0x7fd39c0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:31.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd39a59c640 1 --2- 172.21.15.67:0/1983944278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd39c0cee60 0x7fd39c150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:31.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.345+0000 7fd39ad9d640 1 --2- 172.21.15.67:0/1983944278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd39c15bfc0 0x7fd39c0b3f00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00b9a0 tx=0x7fd38c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:31.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.346+0000 7fd392ffd640 1 -- 172.21.15.67:0/1983944278 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c019070 con 0x7fd39c15bfc0 2024-04-25T02:28:31.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.346+0000 7fd392ffd640 1 -- 172.21.15.67:0/1983944278 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38c00cbc0 con 0x7fd39c15bfc0 2024-04-25T02:28:31.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.346+0000 7fd3a0970640 1 -- 172.21.15.67:0/1983944278 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39c0b4810 con 0x7fd39c15bfc0 2024-04-25T02:28:31.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.346+0000 7fd392ffd640 1 -- 172.21.15.67:0/1983944278 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c014440 con 0x7fd39c15bfc0 2024-04-25T02:28:31.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.346+0000 7fd3a0970640 1 -- 172.21.15.67:0/1983944278 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd39c0b4dd0 con 0x7fd39c15bfc0 2024-04-25T02:28:31.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.347+0000 7fd3a0970640 1 -- 172.21.15.67:0/1983944278 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd39c069110 con 0x7fd39c15bfc0 2024-04-25T02:28:31.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.347+0000 7fd392ffd640 1 -- 172.21.15.67:0/1983944278 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd38c01c070 con 0x7fd39c15bfc0 2024-04-25T02:28:31.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.347+0000 7fd392ffd640 1 --2- 172.21.15.67:0/1983944278 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd37c06be30 0x7fd37c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:31.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.348+0000 7fd392ffd640 1 -- 172.21.15.67:0/1983944278 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd38c08abb0 con 0x7fd39c15bfc0 2024-04-25T02:28:31.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.348+0000 7fd39a59c640 1 --2- 172.21.15.67:0/1983944278 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd37c06be30 0x7fd37c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:31.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.348+0000 7fd39a59c640 1 --2- 172.21.15.67:0/1983944278 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd37c06be30 0x7fd37c06e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd394000f60 tx=0x7fd394009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:31.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.352+0000 7fd392ffd640 1 -- 172.21.15.67:0/1983944278 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd38c059560 con 0x7fd39c15bfc0 2024-04-25T02:28:31.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.586+0000 7fd3a0970640 1 -- 172.21.15.67:0/1983944278 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fd39c0b7e50 con 0x7fd39c15bfc0 2024-04-25T02:28:31.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.589+0000 7fd392ffd640 1 -- 172.21.15.67:0/1983944278 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172941 (secure 0 0 0) 0x7fd38c058e60 con 0x7fd39c15bfc0 2024-04-25T02:28:31.596 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:31.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.592+0000 7fd3a0970640 1 -- 172.21.15.67:0/1983944278 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd37c06be30 msgr2=0x7fd37c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:31.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.592+0000 7fd3a0970640 1 --2- 172.21.15.67:0/1983944278 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd37c06be30 0x7fd37c06e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd394000f60 tx=0x7fd394009040 comp rx=0 tx=0).stop 2024-04-25T02:28:31.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.592+0000 7fd3a0970640 1 -- 172.21.15.67:0/1983944278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd39c15bfc0 msgr2=0x7fd39c0b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:31.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.592+0000 7fd3a0970640 1 --2- 172.21.15.67:0/1983944278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd39c15bfc0 0x7fd39c0b3f00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00b9a0 tx=0x7fd38c00be60 comp rx=0 tx=0).stop 2024-04-25T02:28:31.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.592+0000 7fd3a0970640 1 -- 172.21.15.67:0/1983944278 shutdown_connections 2024-04-25T02:28:31.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.592+0000 7fd3a0970640 1 --2- 172.21.15.67:0/1983944278 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd37c06be30 0x7fd37c06e2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.592+0000 7fd3a0970640 1 --2- 172.21.15.67:0/1983944278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd39c15bfc0 0x7fd39c0b3f00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.592+0000 7fd3a0970640 1 --2- 172.21.15.67:0/1983944278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd39c0d0210 0x7fd39c0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.592+0000 7fd3a0970640 1 --2- 172.21.15.67:0/1983944278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd39c0cee60 0x7fd39c150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.592+0000 7fd3a0970640 1 -- 172.21.15.67:0/1983944278 >> 172.21.15.67:0/1983944278 conn(0x7fd39c0d1ed0 msgr2=0x7fd39c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:31.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.592+0000 7fd3a0970640 1 -- 172.21.15.67:0/1983944278 shutdown_connections 2024-04-25T02:28:31.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.592+0000 7fd3a0970640 1 -- 172.21.15.67:0/1983944278 wait complete. 2024-04-25T02:28:31.607 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":5,"flags":0,"active_gid":4111,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":641694317},{"type":"v1","addr":"172.21.15.176:6833","nonce":641694317}]},"active_addr":"172.21.15.176:6833/641694317","active_change":"2024-04-25T02:28:06.316677+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":1653669402}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":80674820}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":3235069821}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":3703719612}]}]} 2024-04-25T02:28:31.610 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T02:28:31.610 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T02:28:31.610 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:31.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.708+0000 7f23d5509640 1 Processor -- start 2024-04-25T02:28:31.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.708+0000 7f23d5509640 1 -- start start 2024-04-25T02:28:31.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.708+0000 7f23d5509640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f23d015e630 0x7f23d00b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:31.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.708+0000 7f23d5509640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d00b3020 0x7f23d00cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:31.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.708+0000 7f23d5509640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f23d015ea10 0x7f23d009aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:31.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.708+0000 7f23d5509640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f23d006ca00 con 0x7f23d015ea10 2024-04-25T02:28:31.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.708+0000 7f23d5509640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f23d00b49e0 con 0x7f23d015e630 2024-04-25T02:28:31.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.708+0000 7f23d5509640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f23d00d0a10 con 0x7f23d00b3020 2024-04-25T02:28:31.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.709+0000 7f23cf7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f23d015ea10 0x7f23d009aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:31.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.709+0000 7f23cf7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f23d015ea10 0x7f23d009aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54178/0 (socket says 172.21.15.67:54178) 2024-04-25T02:28:31.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.709+0000 7f23cf7fe640 1 -- 172.21.15.67:0/3250954384 learned_addr learned my addr 172.21.15.67:0/3250954384 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:31.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.709+0000 7f23ce7fc640 1 --2- 172.21.15.67:0/3250954384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d00b3020 0x7f23d00cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:31.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.709+0000 7f23ceffd640 1 --2- 172.21.15.67:0/3250954384 >> v2:172.21.15.176:3300/0 conn(0x7f23d015e630 0x7f23d00b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:31.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.709+0000 7f23cf7fe640 1 -- 172.21.15.67:0/3250954384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d00b3020 msgr2=0x7f23d00cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:31.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.709+0000 7f23cf7fe640 1 --2- 172.21.15.67:0/3250954384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d00b3020 0x7f23d00cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.709+0000 7f23cf7fe640 1 -- 172.21.15.67:0/3250954384 >> v2:172.21.15.176:3300/0 conn(0x7f23d015e630 msgr2=0x7f23d00b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:31.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.709+0000 7f23cf7fe640 1 --2- 172.21.15.67:0/3250954384 >> v2:172.21.15.176:3300/0 conn(0x7f23d015e630 0x7f23d00b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.709+0000 7f23cf7fe640 1 -- 172.21.15.67:0/3250954384 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d00d0cf0 con 0x7f23d015ea10 2024-04-25T02:28:31.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.710+0000 7f23cf7fe640 1 --2- 172.21.15.67:0/3250954384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d015ea10 0x7f23d009aa70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f23d006ea00 tx=0x7f23c002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1172d19fcc75cbcd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:31.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.710+0000 7f23cdffb640 1 -- 172.21.15.67:0/3250954384 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c0036070 con 0x7f23d015ea10 2024-04-25T02:28:31.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.710+0000 7f23cdffb640 1 -- 172.21.15.67:0/3250954384 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c0031600 con 0x7f23d015ea10 2024-04-25T02:28:31.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.710+0000 7f23cdffb640 1 -- 172.21.15.67:0/3250954384 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c00319d0 con 0x7f23d015ea10 2024-04-25T02:28:31.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.710+0000 7f23d5509640 1 -- 172.21.15.67:0/3250954384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d015ea10 msgr2=0x7f23d009aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:31.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.710+0000 7f23d5509640 1 --2- 172.21.15.67:0/3250954384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d015ea10 0x7f23d009aa70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f23d006ea00 tx=0x7f23c002a610 comp rx=0 tx=0).stop 2024-04-25T02:28:31.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.710+0000 7f23d5509640 1 -- 172.21.15.67:0/3250954384 shutdown_connections 2024-04-25T02:28:31.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.710+0000 7f23d5509640 1 --2- 172.21.15.67:0/3250954384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d015ea10 0x7f23d009aa70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.710+0000 7f23d5509640 1 --2- 172.21.15.67:0/3250954384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d00b3020 0x7f23d00cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.710+0000 7f23d5509640 1 --2- 172.21.15.67:0/3250954384 >> v2:172.21.15.176:3300/0 conn(0x7f23d015e630 0x7f23d00b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.710+0000 7f23d5509640 1 -- 172.21.15.67:0/3250954384 >> 172.21.15.67:0/3250954384 conn(0x7f23d00b3ae0 msgr2=0x7f23d00b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:31.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.710+0000 7f23d5509640 1 -- 172.21.15.67:0/3250954384 shutdown_connections 2024-04-25T02:28:31.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.710+0000 7f23d5509640 1 -- 172.21.15.67:0/3250954384 wait complete. 2024-04-25T02:28:31.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.712+0000 7f23d5509640 1 Processor -- start 2024-04-25T02:28:31.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.712+0000 7f23d5509640 1 -- start start 2024-04-25T02:28:31.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.712+0000 7f23d5509640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d00b3020 0x7f23d0148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:31.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.712+0000 7f23d5509640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23d015e630 0x7f23d015c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:31.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.712+0000 7f23d5509640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d015ea10 0x7f23d015ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:31.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.712+0000 7f23d5509640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f23d00d1150 con 0x7f23d00b3020 2024-04-25T02:28:31.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.712+0000 7f23d5509640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f23d00d0fd0 con 0x7f23d015e630 2024-04-25T02:28:31.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.712+0000 7f23d5509640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f23d009afb0 con 0x7f23d015ea10 2024-04-25T02:28:31.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.712+0000 7f23ceffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d00b3020 0x7f23d0148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:31.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.712+0000 7f23ceffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d00b3020 0x7f23d0148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54188/0 (socket says 172.21.15.67:54188) 2024-04-25T02:28:31.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.712+0000 7f23ceffd640 1 -- 172.21.15.67:0/2689648393 learned_addr learned my addr 172.21.15.67:0/2689648393 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:31.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.712+0000 7f23cf7fe640 1 --2- 172.21.15.67:0/2689648393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d015ea10 0x7f23d015ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:31.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.713+0000 7f23ce7fc640 1 --2- 172.21.15.67:0/2689648393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23d015e630 0x7f23d015c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:31.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.713+0000 7f23ceffd640 1 -- 172.21.15.67:0/2689648393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d015ea10 msgr2=0x7f23d015ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:31.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.713+0000 7f23ceffd640 1 --2- 172.21.15.67:0/2689648393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d015ea10 0x7f23d015ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.713+0000 7f23ceffd640 1 -- 172.21.15.67:0/2689648393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23d015e630 msgr2=0x7f23d015c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:31.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.713+0000 7f23ceffd640 1 --2- 172.21.15.67:0/2689648393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23d015e630 0x7f23d015c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.713+0000 7f23ceffd640 1 -- 172.21.15.67:0/2689648393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d01f88c0 con 0x7f23d00b3020 2024-04-25T02:28:31.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.713+0000 7f23cf7fe640 1 --2- 172.21.15.67:0/2689648393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d015ea10 0x7f23d015ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:31.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.713+0000 7f23ceffd640 1 --2- 172.21.15.67:0/2689648393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d00b3020 0x7f23d0148d60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f23c800d800 tx=0x7f23c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:31.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.713+0000 7f23c77fe640 1 -- 172.21.15.67:0/2689648393 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c800b6c0 con 0x7f23d00b3020 2024-04-25T02:28:31.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.713+0000 7f23c77fe640 1 -- 172.21.15.67:0/2689648393 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c8019070 con 0x7f23d00b3020 2024-04-25T02:28:31.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.713+0000 7f23d5509640 1 -- 172.21.15.67:0/2689648393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d01492a0 con 0x7f23d00b3020 2024-04-25T02:28:31.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.713+0000 7f23c77fe640 1 -- 172.21.15.67:0/2689648393 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c800ba80 con 0x7f23d00b3020 2024-04-25T02:28:31.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.713+0000 7f23d5509640 1 -- 172.21.15.67:0/2689648393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d01f7de0 con 0x7f23d00b3020 2024-04-25T02:28:31.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.714+0000 7f23d5509640 1 -- 172.21.15.67:0/2689648393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d0069110 con 0x7f23d00b3020 2024-04-25T02:28:31.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.714+0000 7f23c77fe640 1 -- 172.21.15.67:0/2689648393 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f23c800bc20 con 0x7f23d00b3020 2024-04-25T02:28:31.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.715+0000 7f23c77fe640 1 --2- 172.21.15.67:0/2689648393 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f23b006be30 0x7f23b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:31.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.715+0000 7f23c77fe640 1 -- 172.21.15.67:0/2689648393 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f23c808b330 con 0x7f23d00b3020 2024-04-25T02:28:31.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.715+0000 7f23ce7fc640 1 --2- 172.21.15.67:0/2689648393 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f23b006be30 0x7f23b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:31.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.716+0000 7f23ce7fc640 1 --2- 172.21.15.67:0/2689648393 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f23b006be30 0x7f23b006e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f23b8006fd0 tx=0x7f23b8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:31.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.719+0000 7f23c77fe640 1 -- 172.21.15.67:0/2689648393 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f23c801c360 con 0x7f23d00b3020 2024-04-25T02:28:31.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.902+0000 7f23d5509640 1 -- 172.21.15.67:0/2689648393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23d006df10 con 0x7f23d00b3020 2024-04-25T02:28:31.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.903+0000 7f23c77fe640 1 -- 172.21.15.67:0/2689648393 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f23c8059ce0 con 0x7f23d00b3020 2024-04-25T02:28:31.907 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:31.907 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:27.819641+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:31.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.905+0000 7f23d5509640 1 -- 172.21.15.67:0/2689648393 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f23b006be30 msgr2=0x7f23b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:31.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.905+0000 7f23d5509640 1 --2- 172.21.15.67:0/2689648393 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f23b006be30 0x7f23b006e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f23b8006fd0 tx=0x7f23b8008040 comp rx=0 tx=0).stop 2024-04-25T02:28:31.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.905+0000 7f23d5509640 1 -- 172.21.15.67:0/2689648393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d00b3020 msgr2=0x7f23d0148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:31.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.905+0000 7f23d5509640 1 --2- 172.21.15.67:0/2689648393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d00b3020 0x7f23d0148d60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f23c800d800 tx=0x7f23c800dcc0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.905+0000 7f23d5509640 1 -- 172.21.15.67:0/2689648393 shutdown_connections 2024-04-25T02:28:31.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.905+0000 7f23d5509640 1 --2- 172.21.15.67:0/2689648393 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f23b006be30 0x7f23b006e2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.905+0000 7f23d5509640 1 --2- 172.21.15.67:0/2689648393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d015ea10 0x7f23d015ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.905+0000 7f23d5509640 1 --2- 172.21.15.67:0/2689648393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23d015e630 0x7f23d015c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.905+0000 7f23d5509640 1 --2- 172.21.15.67:0/2689648393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d00b3020 0x7f23d0148d60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:31.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.905+0000 7f23d5509640 1 -- 172.21.15.67:0/2689648393 >> 172.21.15.67:0/2689648393 conn(0x7f23d00b3ae0 msgr2=0x7f23d00cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:31.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.905+0000 7f23d5509640 1 -- 172.21.15.67:0/2689648393 shutdown_connections 2024-04-25T02:28:31.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:31.905+0000 7f23d5509640 1 -- 172.21.15.67:0/2689648393 wait complete. 2024-04-25T02:28:31.920 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T02:28:31.920 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:32.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.016+0000 7f407ce9a640 1 Processor -- start 2024-04-25T02:28:32.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.016+0000 7f407ce9a640 1 -- start start 2024-04-25T02:28:32.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.017+0000 7f407ce9a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f40780d1010 0x7f40780d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.017+0000 7f407ce9a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f407806dc40 0x7f407806e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.017+0000 7f407ce9a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40780b4470 con 0x7f4078147040 2024-04-25T02:28:32.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.017+0000 7f407ce9a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f40781628c0 con 0x7f40780d1010 2024-04-25T02:28:32.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.017+0000 7f407ce9a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4078161f90 con 0x7f407806dc40 2024-04-25T02:28:32.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.017+0000 7f407659c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f4078147040 0x7f40780b3d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49316/0 (socket says 172.21.15.67:49316) 2024-04-25T02:28:32.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.017+0000 7f407659c640 1 -- 172.21.15.67:0/2930696741 learned_addr learned my addr 172.21.15.67:0/2930696741 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:32.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.017+0000 7f4075d9b640 1 --2- 172.21.15.67:0/2930696741 >> v2:172.21.15.67:3300/0 conn(0x7f40780d1010 0x7f40780d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.017+0000 7f4076d9d640 1 --2- 172.21.15.67:0/2930696741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f407806dc40 0x7f407806e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.017+0000 7f4075d9b640 1 -- 172.21.15.67:0/2930696741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f407806dc40 msgr2=0x7f407806e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.017+0000 7f4075d9b640 1 --2- 172.21.15.67:0/2930696741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f407806dc40 0x7f407806e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.018+0000 7f4075d9b640 1 -- 172.21.15.67:0/2930696741 >> v1:172.21.15.67:6789/0 conn(0x7f4078147040 legacy=0x7f40780b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.018+0000 7f407559a640 1 -- 172.21.15.67:0/2930696741 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4012087424 0 0) 0x7f40780b4470 con 0x7f4078147040 2024-04-25T02:28:32.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.018+0000 7f4075d9b640 1 -- 172.21.15.67:0/2930696741 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4078162270 con 0x7f40780d1010 2024-04-25T02:28:32.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.018+0000 7f4076d9d640 1 --2- 172.21.15.67:0/2930696741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f407806dc40 0x7f407806e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:32.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.018+0000 7f4075d9b640 1 --2- 172.21.15.67:0/2930696741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40780d1010 0x7f40780d14a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f406c0097a0 tx=0x7f406c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeaa0d2881e6478f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.018+0000 7f407559a640 1 -- 172.21.15.67:0/2930696741 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c037070 con 0x7f40780d1010 2024-04-25T02:28:32.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.018+0000 7f407559a640 1 -- 172.21.15.67:0/2930696741 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f406c02ae50 con 0x7f40780d1010 2024-04-25T02:28:32.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.018+0000 7f407559a640 1 -- 172.21.15.67:0/2930696741 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c032660 con 0x7f40780d1010 2024-04-25T02:28:32.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.019+0000 7f407ce9a640 1 -- 172.21.15.67:0/2930696741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40780d1010 msgr2=0x7f40780d14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.019+0000 7f407ce9a640 1 --2- 172.21.15.67:0/2930696741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40780d1010 0x7f40780d14a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f406c0097a0 tx=0x7f406c02a100 comp rx=0 tx=0).stop 2024-04-25T02:28:32.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.019+0000 7f407ce9a640 1 -- 172.21.15.67:0/2930696741 shutdown_connections 2024-04-25T02:28:32.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.019+0000 7f407ce9a640 1 --2- 172.21.15.67:0/2930696741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f407806dc40 0x7f407806e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.019+0000 7f407ce9a640 1 --2- 172.21.15.67:0/2930696741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40780d1010 0x7f40780d14a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.019+0000 7f407ce9a640 1 -- 172.21.15.67:0/2930696741 >> 172.21.15.67:0/2930696741 conn(0x7f407806c3b0 msgr2=0x7f407806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.019+0000 7f407ce9a640 1 -- 172.21.15.67:0/2930696741 shutdown_connections 2024-04-25T02:28:32.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.019+0000 7f407ce9a640 1 -- 172.21.15.67:0/2930696741 wait complete. 2024-04-25T02:28:32.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.020+0000 7f407ce9a640 1 Processor -- start 2024-04-25T02:28:32.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.020+0000 7f407ce9a640 1 -- start start 2024-04-25T02:28:32.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.021+0000 7f407ce9a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f407806dc40 0x7f40780b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.021+0000 7f407ce9a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40780d1010 0x7f40781f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.021+0000 7f407ce9a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4078147040 0x7f4078141890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.021+0000 7f407ce9a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f40780b4740 con 0x7f407806dc40 2024-04-25T02:28:32.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.021+0000 7f407ce9a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4078162d50 con 0x7f40780d1010 2024-04-25T02:28:32.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.021+0000 7f407ce9a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f40780b5eb0 con 0x7f4078147040 2024-04-25T02:28:32.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.021+0000 7f407659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f407806dc40 0x7f40780b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.021+0000 7f407659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f407806dc40 0x7f40780b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54200/0 (socket says 172.21.15.67:54200) 2024-04-25T02:28:32.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.021+0000 7f407659c640 1 -- 172.21.15.67:0/3710912315 learned_addr learned my addr 172.21.15.67:0/3710912315 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.021+0000 7f4076d9d640 1 --2- 172.21.15.67:0/3710912315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4078147040 0x7f4078141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.021+0000 7f4075d9b640 1 --2- 172.21.15.67:0/3710912315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40780d1010 0x7f40781f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.021+0000 7f407659c640 1 -- 172.21.15.67:0/3710912315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4078147040 msgr2=0x7f4078141890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.021+0000 7f407659c640 1 --2- 172.21.15.67:0/3710912315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4078147040 0x7f4078141890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.021+0000 7f407659c640 1 -- 172.21.15.67:0/3710912315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40780d1010 msgr2=0x7f40781f75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.021+0000 7f407659c640 1 --2- 172.21.15.67:0/3710912315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40780d1010 0x7f40781f75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.021+0000 7f407659c640 1 -- 172.21.15.67:0/3710912315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40781f3fa0 con 0x7f407806dc40 2024-04-25T02:28:32.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.022+0000 7f407659c640 1 --2- 172.21.15.67:0/3710912315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f407806dc40 0x7f40780b2350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f406800c4d0 tx=0x7f406800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.022+0000 7f4066ffd640 1 -- 172.21.15.67:0/3710912315 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068018070 con 0x7f407806dc40 2024-04-25T02:28:32.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.022+0000 7f4066ffd640 1 -- 172.21.15.67:0/3710912315 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4068007500 con 0x7f407806dc40 2024-04-25T02:28:32.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.022+0000 7f407ce9a640 1 -- 172.21.15.67:0/3710912315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40781f7cf0 con 0x7f407806dc40 2024-04-25T02:28:32.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.022+0000 7f4066ffd640 1 -- 172.21.15.67:0/3710912315 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068004a20 con 0x7f407806dc40 2024-04-25T02:28:32.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.022+0000 7f407ce9a640 1 -- 172.21.15.67:0/3710912315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40781f82b0 con 0x7f407806dc40 2024-04-25T02:28:32.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.023+0000 7f407ce9a640 1 -- 172.21.15.67:0/3710912315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40781f84f0 con 0x7f407806dc40 2024-04-25T02:28:32.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.023+0000 7f4066ffd640 1 -- 172.21.15.67:0/3710912315 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f406801b070 con 0x7f407806dc40 2024-04-25T02:28:32.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.024+0000 7f4066ffd640 1 --2- 172.21.15.67:0/3710912315 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f405806be30 0x7f405806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.024+0000 7f4066ffd640 1 -- 172.21.15.67:0/3710912315 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f406808a1b0 con 0x7f407806dc40 2024-04-25T02:28:32.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.024+0000 7f4075d9b640 1 --2- 172.21.15.67:0/3710912315 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f405806be30 0x7f405806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.024+0000 7f4075d9b640 1 --2- 172.21.15.67:0/3710912315 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f405806be30 0x7f405806e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f406c034000 tx=0x7f406c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.028+0000 7f4066ffd640 1 -- 172.21.15.67:0/3710912315 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f40781f84f0 con 0x7f407806dc40 2024-04-25T02:28:32.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.213+0000 7f407ce9a640 1 -- 172.21.15.67:0/3710912315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4078069110 con 0x7f407806dc40 2024-04-25T02:28:32.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.215+0000 7f4066ffd640 1 -- 172.21.15.67:0/3710912315 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f4068058b60 con 0x7f407806dc40 2024-04-25T02:28:32.219 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:32.219 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:27.819641+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.216+0000 7f407ce9a640 1 -- 172.21.15.67:0/3710912315 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f405806be30 msgr2=0x7f405806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.216+0000 7f407ce9a640 1 --2- 172.21.15.67:0/3710912315 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f405806be30 0x7f405806e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f406c034000 tx=0x7f406c02e000 comp rx=0 tx=0).stop 2024-04-25T02:28:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.217+0000 7f407ce9a640 1 -- 172.21.15.67:0/3710912315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f407806dc40 msgr2=0x7f40780b2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.217+0000 7f407ce9a640 1 --2- 172.21.15.67:0/3710912315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f407806dc40 0x7f40780b2350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f406800c4d0 tx=0x7f406800c990 comp rx=0 tx=0).stop 2024-04-25T02:28:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.217+0000 7f407ce9a640 1 -- 172.21.15.67:0/3710912315 shutdown_connections 2024-04-25T02:28:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.217+0000 7f407ce9a640 1 --2- 172.21.15.67:0/3710912315 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f405806be30 0x7f405806e2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.217+0000 7f407ce9a640 1 --2- 172.21.15.67:0/3710912315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4078147040 0x7f4078141890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.217+0000 7f407ce9a640 1 --2- 172.21.15.67:0/3710912315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40780d1010 0x7f40781f75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.217+0000 7f407ce9a640 1 --2- 172.21.15.67:0/3710912315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f407806dc40 0x7f40780b2350 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.217+0000 7f407ce9a640 1 -- 172.21.15.67:0/3710912315 >> 172.21.15.67:0/3710912315 conn(0x7f407806c3b0 msgr2=0x7f407806f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.217+0000 7f407ce9a640 1 -- 172.21.15.67:0/3710912315 shutdown_connections 2024-04-25T02:28:32.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.217+0000 7f407ce9a640 1 -- 172.21.15.67:0/3710912315 wait complete. 2024-04-25T02:28:32.232 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T02:28:32.232 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T02:28:32.233 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T02:28:32.233 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T02:28:32.234 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T02:28:32.234 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T02:28:32.234 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T02:28:32.235 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T02:28:32.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.402+0000 7f72e8c5a640 1 Processor -- start 2024-04-25T02:28:32.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.402+0000 7f72e8c5a640 1 -- start start 2024-04-25T02:28:32.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.402+0000 7f72e8c5a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72dc04fc10 0x7f72dc051770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.403+0000 7f72e8c5a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f72dc0548b0 0x7f72dc0f1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.403+0000 7f72e2ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f72dc0081d0 0x7f72dc04fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49320/0 (socket says 172.21.15.67:49320) 2024-04-25T02:28:32.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.403+0000 7f72e2ffd640 1 -- 172.21.15.67:0/3511675223 learned_addr learned my addr 172.21.15.67:0/3511675223 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:32.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.403+0000 7f72e8c5a640 1 -- 172.21.15.67:0/3511675223 --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72dc048520 con 0x7f72dc0081d0 2024-04-25T02:28:32.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.403+0000 7f72e8c5a640 1 -- 172.21.15.67:0/3511675223 --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f72dc0487c0 con 0x7f72dc0548b0 2024-04-25T02:28:32.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.403+0000 7f72e8c5a640 1 -- 172.21.15.67:0/3511675223 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc048a80 con 0x7f72dc04fc10 2024-04-25T02:28:32.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.403+0000 7f72e37fe640 1 --2- 172.21.15.67:0/3511675223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72dc04fc10 0x7f72dc051770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.403+0000 7f72e3fff640 1 --2- 172.21.15.67:0/3511675223 >> v2:172.21.15.176:3300/0 conn(0x7f72dc0548b0 0x7f72dc0f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.403+0000 7f72e27fc640 1 -- 172.21.15.67:0/3511675223 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3213467640 0 0) 0x7f72dc048520 con 0x7f72dc0081d0 2024-04-25T02:28:32.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.403+0000 7f72e27fc640 1 -- 172.21.15.67:0/3511675223 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72d4003520 con 0x7f72dc0081d0 2024-04-25T02:28:32.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.404+0000 7f72e37fe640 1 -- 172.21.15.67:0/3511675223 >> v2:172.21.15.176:3300/0 conn(0x7f72dc0548b0 msgr2=0x7f72dc0f1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.404+0000 7f72e27fc640 1 -- 172.21.15.67:0/3511675223 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3443073907 0 0) 0x7f72d4003520 con 0x7f72dc0081d0 2024-04-25T02:28:32.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.404+0000 7f72e37fe640 1 --2- 172.21.15.67:0/3511675223 >> v2:172.21.15.176:3300/0 conn(0x7f72dc0548b0 0x7f72dc0f1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.404+0000 7f72e37fe640 1 -- 172.21.15.67:0/3511675223 >> v1:172.21.15.67:6789/0 conn(0x7f72dc0081d0 legacy=0x7f72dc04fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.404+0000 7f72e37fe640 1 -- 172.21.15.67:0/3511675223 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc0530a0 con 0x7f72dc04fc10 2024-04-25T02:28:32.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.405+0000 7f1e7eea7640 1 Processor -- start 2024-04-25T02:28:32.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.405+0000 7fa06ceb3640 1 Processor -- start 2024-04-25T02:28:32.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.405+0000 7f72e37fe640 1 --2- 172.21.15.67:0/3511675223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72dc04fc10 0x7f72dc051770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f72d80097a0 tx=0x7f72d802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba8e44fb3a6f6fc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.405+0000 7f72e27fc640 1 -- 172.21.15.67:0/3511675223 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d8037070 con 0x7f72dc04fc10 2024-04-25T02:28:32.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.405+0000 7f72e27fc640 1 -- 172.21.15.67:0/3511675223 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d802aba0 con 0x7f72dc04fc10 2024-04-25T02:28:32.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.405+0000 7f72e27fc640 1 -- 172.21.15.67:0/3511675223 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d8037070 con 0x7f72dc04fc10 2024-04-25T02:28:32.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.405+0000 7fa06ceb3640 1 -- start start 2024-04-25T02:28:32.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.406+0000 7f1e7eea7640 1 -- start start 2024-04-25T02:28:32.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.406+0000 7efff3012640 1 Processor -- start 2024-04-25T02:28:32.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.406+0000 7f72e8c5a640 1 -- 172.21.15.67:0/3511675223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72dc04fc10 msgr2=0x7f72dc051770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.406+0000 7f72e8c5a640 1 --2- 172.21.15.67:0/3511675223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72dc04fc10 0x7f72dc051770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f72d80097a0 tx=0x7f72d802a110 comp rx=0 tx=0).stop 2024-04-25T02:28:32.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7f72e8c5a640 1 -- 172.21.15.67:0/3511675223 shutdown_connections 2024-04-25T02:28:32.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7efff3012640 1 -- start start 2024-04-25T02:28:32.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7f72e8c5a640 1 --2- 172.21.15.67:0/3511675223 >> v2:172.21.15.176:3300/0 conn(0x7f72dc0548b0 0x7f72dc0f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7f72e8c5a640 1 --2- 172.21.15.67:0/3511675223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72dc04fc10 0x7f72dc051770 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7fa06ceb3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa06815e940 0x7fa06815a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7f72e8c5a640 1 -- 172.21.15.67:0/3511675223 >> 172.21.15.67:0/3511675223 conn(0x7f72dc055350 msgr2=0x7f72dc055760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7fa06ceb3640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0680ad4b0 con 0x7fa0680b24b0 2024-04-25T02:28:32.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7f9f3759e640 1 Processor -- start 2024-04-25T02:28:32.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7f72e8c5a640 1 -- 172.21.15.67:0/3511675223 shutdown_connections 2024-04-25T02:28:32.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7f72e8c5a640 1 -- 172.21.15.67:0/3511675223 wait complete. 2024-04-25T02:28:32.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7fa06ceb3640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0680b3530 con 0x7fa0680716e0 2024-04-25T02:28:32.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7fa06ceb3640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa0680b32e0 con 0x7fa06815e940 2024-04-25T02:28:32.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7fa06659c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa0680b24b0 0x7fa0680acda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49328/0 (socket says 172.21.15.67:49328) 2024-04-25T02:28:32.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7f1e7eea7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1e700df6f0 0x7f1e70054cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7fa06659c640 1 -- 172.21.15.67:0/396043288 learned_addr learned my addr 172.21.15.67:0/396043288 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:32.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7f6e9b59e640 1 Processor -- start 2024-04-25T02:28:32.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7f6e9b59e640 1 -- start start 2024-04-25T02:28:32.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7fa065d9b640 1 --2- 172.21.15.67:0/396043288 >> v2:172.21.15.67:3300/0 conn(0x7fa06815e940 0x7fa06815a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7f1e7eea7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e70050090 0x7f1e700504c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f1e7eea7640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e70053c30 con 0x7f1e7003ad50 2024-04-25T02:28:32.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7fa06559a640 1 -- 172.21.15.67:0/396043288 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76573249 0 0) 0x7fa0680b3530 con 0x7fa0680716e0 2024-04-25T02:28:32.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7fa06559a640 1 -- 172.21.15.67:0/396043288 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa050003420 con 0x7fa0680716e0 2024-04-25T02:28:32.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f1e7eea7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1e70050a00 con 0x7f1e700df6f0 2024-04-25T02:28:32.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f1e7eea7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1e70053f10 con 0x7f1e70050090 2024-04-25T02:28:32.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f1e7d6a4640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f1e7003ad50 0x7f1e70053400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:42412/0 (socket says 172.21.15.67:42412) 2024-04-25T02:28:32.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f1e7d6a4640 1 -- 172.21.15.67:0/16432794 learned_addr learned my addr 172.21.15.67:0/16432794 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:32.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f1e7dea5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1e700df6f0 0x7f1e70054cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f1e7e6a6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e70050090 0x7f1e700504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f1e7cea3640 1 -- 172.21.15.67:0/16432794 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1918731480 0 0) 0x7f1e70053c30 con 0x7f1e7003ad50 2024-04-25T02:28:32.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f1e7cea3640 1 -- 172.21.15.67:0/16432794 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e64003520 con 0x7f1e7003ad50 2024-04-25T02:28:32.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7fa06559a640 1 -- 172.21.15.67:0/396043288 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4048917178 0 0) 0x7fa050003420 con 0x7fa0680716e0 2024-04-25T02:28:32.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7fa06559a640 1 -- 172.21.15.67:0/396043288 >> v2:172.21.15.67:3300/0 conn(0x7fa06815e940 msgr2=0x7fa06815a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7efff3012640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7effec15af70 0x7effec0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.407+0000 7f9f3759e640 1 -- start start 2024-04-25T02:28:32.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f9f3759e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f3003e840 0x7f9f30053bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f9f3759e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9f30054130 0x7f9f300068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f9f3759e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f30058570 con 0x7f9f300e30c0 2024-04-25T02:28:32.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f9f3759e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f9f30058850 con 0x7f9f30054130 2024-04-25T02:28:32.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f1e7cea3640 1 -- 172.21.15.67:0/16432794 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 963327553 0 0) 0x7f1e64003520 con 0x7f1e7003ad50 2024-04-25T02:28:32.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f1e7cea3640 1 -- 172.21.15.67:0/16432794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e70050090 msgr2=0x7f1e700504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f1e7cea3640 1 --2- 172.21.15.67:0/16432794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e70050090 0x7f1e700504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f1e7cea3640 1 -- 172.21.15.67:0/16432794 >> v2:172.21.15.67:3300/0 conn(0x7f1e700df6f0 msgr2=0x7f1e70054cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f1e7cea3640 1 --2- 172.21.15.67:0/16432794 >> v2:172.21.15.67:3300/0 conn(0x7f1e700df6f0 0x7f1e70054cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f1e7cea3640 1 -- 172.21.15.67:0/16432794 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e700541f0 con 0x7f1e7003ad50 2024-04-25T02:28:32.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f1e7cea3640 1 -- 172.21.15.67:0/16432794 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f1e68001670 con 0x7f1e7003ad50 2024-04-25T02:28:32.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f1e7cea3640 1 -- 172.21.15.67:0/16432794 >> v1:172.21.15.176:6789/0 conn(0x7f1e7003ad50 legacy=0x7f1e70053400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f1e7cea3640 1 --2- 172.21.15.67:0/16432794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e640039b0 0x7f1e64003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f1e7cea3640 1 --2- 172.21.15.67:0/16432794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e64004800 0x7f1e64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f1e7cea3640 1 --2- 172.21.15.67:0/16432794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e70050090 0x7f1e640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f1e7cea3640 1 -- 172.21.15.67:0/16432794 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1e70050a00 con 0x7f1e640039b0 2024-04-25T02:28:32.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f1e7cea3640 1 -- 172.21.15.67:0/16432794 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1e70053f10 con 0x7f1e64004800 2024-04-25T02:28:32.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f1e7cea3640 1 -- 172.21.15.67:0/16432794 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1e6400baa0 con 0x7f1e70050090 2024-04-25T02:28:32.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7efff0dae640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7effec15af70 0x7effec0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7f9f3759e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9f30058b30 con 0x7f9f3003e840 2024-04-25T02:28:32.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f6e9b59e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9c1628e0 0x7f6e9c0c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f6e9b59e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6e9c0ce2c0 0x7f6e9c0c3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f6e9b59e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6e9c0cad00 0x7f6e9c0cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f6e9b59e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6e9c06fb70 con 0x7f6e9c0ce2c0 2024-04-25T02:28:32.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f6e9b59e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6e9c0ca870 con 0x7f6e9c0cad00 2024-04-25T02:28:32.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f6e9b59e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9c0cdbe0 con 0x7f6e9c1628e0 2024-04-25T02:28:32.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7fa06559a640 1 --2- 172.21.15.67:0/396043288 >> v2:172.21.15.67:3300/0 conn(0x7fa06815e940 0x7fa06815a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7fa06559a640 1 -- 172.21.15.67:0/396043288 >> v1:172.21.15.67:6789/0 conn(0x7fa0680b24b0 legacy=0x7fa0680acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7fa06559a640 1 -- 172.21.15.67:0/396043288 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0680b3810 con 0x7fa0680716e0 2024-04-25T02:28:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7fa06559a640 1 -- 172.21.15.67:0/396043288 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7fa05c001650 con 0x7fa0680716e0 2024-04-25T02:28:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7fa06559a640 1 -- 172.21.15.67:0/396043288 >> v1:172.21.15.176:6789/0 conn(0x7fa0680716e0 legacy=0x7fa06815dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7fa06559a640 1 --2- 172.21.15.67:0/396043288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa050004a90 0x7fa050004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7fa06559a640 1 --2- 172.21.15.67:0/396043288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0500036a0 0x7fa050003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7fa06559a640 1 --2- 172.21.15.67:0/396043288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa050007740 0x7fa050007bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7fa06559a640 1 -- 172.21.15.67:0/396043288 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa0680b32e0 con 0x7fa050004a90 2024-04-25T02:28:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7fa06559a640 1 -- 172.21.15.67:0/396043288 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa050008100 con 0x7fa050007740 2024-04-25T02:28:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.408+0000 7fa06559a640 1 -- 172.21.15.67:0/396043288 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa050008300 con 0x7fa0500036a0 2024-04-25T02:28:32.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7fa066d9d640 1 --2- 172.21.15.67:0/396043288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa050007740 0x7fa050007bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f1e7d6a4640 1 --2- 172.21.15.67:0/16432794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e64004800 0x7f1e64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f72e8c5a640 1 Processor -- start 2024-04-25T02:28:32.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7efff3012640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7effec0ae4c0 0x7effec06fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7efff3012640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effec15b350 con 0x7effec15f4c0 2024-04-25T02:28:32.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7efff3012640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7effec06f590 con 0x7effec15af70 2024-04-25T02:28:32.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7efff0dae640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7effec15af70 0x7effec0b3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54224/0 (socket says 172.21.15.67:54224) 2024-04-25T02:28:32.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7efff0dae640 1 -- 172.21.15.67:0/2022933988 learned_addr learned my addr 172.21.15.67:0/2022933988 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7efff3012640 1 -- 172.21.15.67:0/2022933988 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7effec15f9c0 con 0x7effec0ae4c0 2024-04-25T02:28:32.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f1e7d6a4640 1 -- 172.21.15.67:0/16432794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e70050090 msgr2=0x7f1e640051c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:28:32.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f1e7d6a4640 1 --2- 172.21.15.67:0/16432794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e70050090 0x7f1e640051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f1e7d6a4640 1 -- 172.21.15.67:0/16432794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e640039b0 msgr2=0x7f1e64003dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:28:32.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f1e7d6a4640 1 --2- 172.21.15.67:0/16432794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e640039b0 0x7f1e64003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f72e8c5a640 1 -- start start 2024-04-25T02:28:32.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f1e7d6a4640 1 -- 172.21.15.67:0/16432794 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e700541f0 con 0x7f1e64004800 2024-04-25T02:28:32.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f29b3cbd640 1 Processor -- start 2024-04-25T02:28:32.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7efff15af640 1 --2- 172.21.15.67:0/2022933988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7effec0ae4c0 0x7effec06fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7fa065d9b640 1 --2- 172.21.15.67:0/396043288 >> v2:172.21.15.67:3300/0 conn(0x7fa06815e940 0x7fa06815a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:32.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7fa066d9d640 1 -- 172.21.15.67:0/396043288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0500036a0 msgr2=0x7fa050003b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:28:32.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7fa066d9d640 1 --2- 172.21.15.67:0/396043288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0500036a0 0x7fa050003b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7fa066d9d640 1 -- 172.21.15.67:0/396043288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa050004a90 msgr2=0x7fa050004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7fa066d9d640 1 --2- 172.21.15.67:0/396043288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa050004a90 0x7fa050004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7fa066d9d640 1 -- 172.21.15.67:0/396043288 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0680b3810 con 0x7fa050007740 2024-04-25T02:28:32.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7effeb7fe640 1 -- 172.21.15.67:0/2022933988 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3455487742 0 0) 0x7effec15b350 con 0x7effec15f4c0 2024-04-25T02:28:32.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7effeb7fe640 1 -- 172.21.15.67:0/2022933988 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effd4003520 con 0x7effec15f4c0 2024-04-25T02:28:32.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f29b3cbd640 1 -- start start 2024-04-25T02:28:32.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7efff15af640 1 -- 172.21.15.67:0/2022933988 >> v2:172.21.15.67:3300/0 conn(0x7effec15af70 msgr2=0x7effec0b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7efff15af640 1 --2- 172.21.15.67:0/2022933988 >> v2:172.21.15.67:3300/0 conn(0x7effec15af70 0x7effec0b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7efff15af640 1 -- 172.21.15.67:0/2022933988 >> v1:172.21.15.176:6789/0 conn(0x7effec15f4c0 legacy=0x7effec0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7efff15af640 1 -- 172.21.15.67:0/2022933988 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effec06ec60 con 0x7effec0ae4c0 2024-04-25T02:28:32.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f6e9ad9d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6e9c0cad00 0x7f6e9c0cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f9f3659c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9f300e30c0 0x7f9f30057d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49344/0 (socket says 172.21.15.67:49344) 2024-04-25T02:28:32.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f6e9ad9d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6e9c0cad00 0x7f6e9c0cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:53774/0 (socket says 172.21.15.67:53774) 2024-04-25T02:28:32.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f6e9ad9d640 1 -- 172.21.15.67:0/3908386065 learned_addr learned my addr 172.21.15.67:0/3908386065 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f6e99d9b640 1 --2- 172.21.15.67:0/3908386065 >> v2:172.21.15.67:3300/0 conn(0x7f6e9c0ce2c0 0x7f6e9c0c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f6e9a59c640 1 --2- 172.21.15.67:0/3908386065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9c1628e0 0x7f6e9c0c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7fa066d9d640 1 -- 172.21.15.67:0/396043288 reap_dead start 2024-04-25T02:28:32.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f9f3659c640 1 -- 172.21.15.67:0/2467298498 learned_addr learned my addr 172.21.15.67:0/2467298498 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:32.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f6e9ad9d640 1 -- 172.21.15.67:0/3908386065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9c1628e0 msgr2=0x7f6e9c0c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f6e9ad9d640 1 --2- 172.21.15.67:0/3908386065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9c1628e0 0x7f6e9c0c2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f1e7d6a4640 1 --2- 172.21.15.67:0/16432794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e64004800 0x7f1e64004c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1e68001eb0 tx=0x7f1e64005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1bceea92ec0cf11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f6e9ad9d640 1 -- 172.21.15.67:0/3908386065 >> v2:172.21.15.67:3300/0 conn(0x7f6e9c0ce2c0 msgr2=0x7f6e9c0c3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f6e9ad9d640 1 --2- 172.21.15.67:0/3908386065 >> v2:172.21.15.67:3300/0 conn(0x7f6e9c0ce2c0 0x7f6e9c0c3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f9f35d9b640 1 --2- 172.21.15.67:0/2467298498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f3003e840 0x7f9f30053bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f6e9ad9d640 1 -- 172.21.15.67:0/3908386065 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9c0cf220 con 0x7f6e9c0cad00 2024-04-25T02:28:32.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f72e8c5a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72dc0081d0 0x7f72dc0d73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f72e8c5a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72dc04fc10 0x7f72dc04a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f6e9a59c640 1 --2- 172.21.15.67:0/3908386065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9c1628e0 0x7f6e9c0c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:32.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f1e7cea3640 1 -- 172.21.15.67:0/16432794 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e68007db0 con 0x7f1e64004800 2024-04-25T02:28:32.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f72e8c5a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72dc0548b0 0x7f72dc04ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f9f3559a640 1 -- 172.21.15.67:0/2467298498 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4025965425 0 0) 0x7f9f30058570 con 0x7f9f300e30c0 2024-04-25T02:28:32.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f1e7cea3640 1 -- 172.21.15.67:0/16432794 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e68005ad0 con 0x7f1e64004800 2024-04-25T02:28:32.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7fa066d9d640 1 --2- 172.21.15.67:0/396043288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa050007740 0x7fa050007bc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00c110 tx=0x7fa050004720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dad4f92a3d1436be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f72e2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72dc04fc10 0x7f72dc04a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f1e7cea3640 1 -- 172.21.15.67:0/16432794 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e68007070 con 0x7f1e64004800 2024-04-25T02:28:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f72e2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72dc04fc10 0x7f72dc04a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54276/0 (socket says 172.21.15.67:54276) 2024-04-25T02:28:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f29b3cbd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29ac0d1d30 0x7f29ac0d2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f72e3fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72dc0548b0 0x7f72dc04ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.409+0000 7f9f3559a640 1 -- 172.21.15.67:0/2467298498 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f20003520 con 0x7f9f300e30c0 2024-04-25T02:28:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f9f36d9d640 1 --2- 172.21.15.67:0/2467298498 >> v2:172.21.15.67:3300/0 conn(0x7f9f30054130 0x7f9f300068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f9f3559a640 1 -- 172.21.15.67:0/2467298498 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2227774349 0 0) 0x7f9f20003520 con 0x7f9f300e30c0 2024-04-25T02:28:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f9f3559a640 1 -- 172.21.15.67:0/2467298498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f3003e840 msgr2=0x7f9f30053bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f9f3559a640 1 --2- 172.21.15.67:0/2467298498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f3003e840 0x7f9f30053bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f9f3559a640 1 -- 172.21.15.67:0/2467298498 >> v2:172.21.15.67:3300/0 conn(0x7f9f30054130 msgr2=0x7f9f300068d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f9f3559a640 1 --2- 172.21.15.67:0/2467298498 >> v2:172.21.15.67:3300/0 conn(0x7f9f30054130 0x7f9f300068d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f9f3559a640 1 -- 172.21.15.67:0/2467298498 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f300063b0 con 0x7f9f300e30c0 2024-04-25T02:28:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f9f3559a640 1 -- 172.21.15.67:0/2467298498 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f9f3804fd50 con 0x7f9f300e30c0 2024-04-25T02:28:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f9f3559a640 1 -- 172.21.15.67:0/2467298498 >> v1:172.21.15.67:6789/0 conn(0x7f9f300e30c0 legacy=0x7f9f30057d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f9f3559a640 1 --2- 172.21.15.67:0/2467298498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f200039b0 0x7f9f20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f9f3559a640 1 --2- 172.21.15.67:0/2467298498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f20004350 0x7f9f20004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f9f3559a640 1 --2- 172.21.15.67:0/2467298498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f20005010 0x7f9f2001c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f9f3559a640 1 -- 172.21.15.67:0/2467298498 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9f30058850 con 0x7f9f20005010 2024-04-25T02:28:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f9f3559a640 1 -- 172.21.15.67:0/2467298498 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9f30058b30 con 0x7f9f20004350 2024-04-25T02:28:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f9f3559a640 1 -- 172.21.15.67:0/2467298498 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2001cfc0 con 0x7f9f200039b0 2024-04-25T02:28:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f9f36d9d640 1 --2- 172.21.15.67:0/2467298498 >> v2:172.21.15.67:3300/0 conn(0x7f9f30054130 0x7f9f300068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.410+0000 7f9f3659c640 1 --2- 172.21.15.67:0/2467298498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f200039b0 0x7f9f20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f9f36d9d640 1 --2- 172.21.15.67:0/2467298498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f20005010 0x7f9f2001c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f9f3659c640 1 -- 172.21.15.67:0/2467298498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f20004350 msgr2=0x7f9f20004820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:28:32.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f9f3659c640 1 --2- 172.21.15.67:0/2467298498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f20004350 0x7f9f20004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f9f3659c640 1 -- 172.21.15.67:0/2467298498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f20005010 msgr2=0x7f9f2001c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f9f3659c640 1 --2- 172.21.15.67:0/2467298498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f20005010 0x7f9f2001c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f9f3659c640 1 -- 172.21.15.67:0/2467298498 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f300063b0 con 0x7f9f200039b0 2024-04-25T02:28:32.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f29b3cbd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f29ac15d4a0 0x7f29ac15dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7efff15af640 1 --2- 172.21.15.67:0/2022933988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7effec0ae4c0 0x7effec06fa20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7effe4009d90 tx=0x7effe402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd005ff57339c03c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f72e3fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72dc0548b0 0x7f72dc04ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:47008/0 (socket says 172.21.15.67:47008) 2024-04-25T02:28:32.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7effeb7fe640 1 -- 172.21.15.67:0/2022933988 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe4007740 con 0x7effec0ae4c0 2024-04-25T02:28:32.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f29b1a59640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29ac0d1d30 0x7f29ac0d2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f29b1258640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f29ac15c3d0 0x7f29ac0d0350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:42440/0 (socket says 172.21.15.67:42440) 2024-04-25T02:28:32.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f29b1a59640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29ac0d1d30 0x7f29ac0d2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:47016/0 (socket says 172.21.15.67:47016) 2024-04-25T02:28:32.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f29b1258640 1 -- 172.21.15.67:0/3062468635 learned_addr learned my addr 172.21.15.67:0/3062468635 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:32.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.411+0000 7f29b3cbd640 1 -- 172.21.15.67:0/3062468635 --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29ac0d2650 con 0x7f29ac15c3d0 2024-04-25T02:28:32.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7f29b3cbd640 1 -- 172.21.15.67:0/3062468635 --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f29ac06f800 con 0x7f29ac15d4a0 2024-04-25T02:28:32.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7f29b3cbd640 1 -- 172.21.15.67:0/3062468635 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f29ac0d0a60 con 0x7f29ac0d1d30 2024-04-25T02:28:32.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7effeb7fe640 1 -- 172.21.15.67:0/2022933988 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe40078e0 con 0x7effec0ae4c0 2024-04-25T02:28:32.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7effeb7fe640 1 -- 172.21.15.67:0/2022933988 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe4007cb0 con 0x7effec0ae4c0 2024-04-25T02:28:32.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7f72e8c5a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc0f16b0 con 0x7f72dc04fc10 2024-04-25T02:28:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7f29b225a640 1 --2- 172.21.15.67:0/3062468635 >> v2:172.21.15.67:3300/0 conn(0x7f29ac15d4a0 0x7f29ac15dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7fa06559a640 1 -- 172.21.15.67:0/396043288 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c007be0 con 0x7fa050007740 2024-04-25T02:28:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7fa06559a640 1 -- 172.21.15.67:0/396043288 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05c005290 con 0x7fa050007740 2024-04-25T02:28:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7f6e9ad9d640 1 --2- 172.21.15.67:0/3908386065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e9c0cad00 0x7f6e9c0cb190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0cdb20 tx=0x7f6e9402a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e17e5c08d7a9db9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7f1e7eea7640 1 -- 172.21.15.67:0/16432794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e64004800 msgr2=0x7f1e64004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7f29b0a57640 1 -- 172.21.15.67:0/3062468635 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2917835624 0 0) 0x7f29ac0d2650 con 0x7f29ac15c3d0 2024-04-25T02:28:32.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7f29b0a57640 1 -- 172.21.15.67:0/3062468635 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2998007930 con 0x7f29ac15c3d0 2024-04-25T02:28:32.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7f1e7eea7640 1 --2- 172.21.15.67:0/16432794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e64004800 0x7f1e64004c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1e68001eb0 tx=0x7f1e64005830 comp rx=0 tx=0).stop 2024-04-25T02:28:32.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7f1e7e6a6640 1 -- 172.21.15.67:0/16432794 reap_dead start 2024-04-25T02:28:32.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7fa06559a640 1 -- 172.21.15.67:0/396043288 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c003830 con 0x7fa050007740 2024-04-25T02:28:32.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7f1e7eea7640 1 -- 172.21.15.67:0/16432794 shutdown_connections 2024-04-25T02:28:32.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7f1e7eea7640 1 -- 172.21.15.67:0/16432794 >> 172.21.15.67:0/16432794 conn(0x7f1e70055350 msgr2=0x7f1e70055760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7f9f3659c640 1 --2- 172.21.15.67:0/2467298498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f200039b0 0x7f9f20003dd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9f3806a010 tx=0x7f9f20005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2797aefe1065beb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7f6e9959a640 1 -- 172.21.15.67:0/3908386065 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e94036070 con 0x7f6e9c0cad00 2024-04-25T02:28:32.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7f72e8c5a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc050700 con 0x7f72dc0081d0 2024-04-25T02:28:32.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7f72e8c5a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc0f1830 con 0x7f72dc0548b0 2024-04-25T02:28:32.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.412+0000 7f72e2ffd640 1 -- 172.21.15.67:0/4263077874 learned_addr learned my addr 172.21.15.67:0/4263077874 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f72e37fe640 1 --2- 172.21.15.67:0/4263077874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72dc0081d0 0x7f72dc0d73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f72e2ffd640 1 -- 172.21.15.67:0/4263077874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72dc0548b0 msgr2=0x7f72dc04ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f72e2ffd640 1 --2- 172.21.15.67:0/4263077874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72dc0548b0 0x7f72dc04ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f72e2ffd640 1 -- 172.21.15.67:0/4263077874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72dc0081d0 msgr2=0x7f72dc0d73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f72e2ffd640 1 --2- 172.21.15.67:0/4263077874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72dc0081d0 0x7f72dc0d73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f72e2ffd640 1 -- 172.21.15.67:0/4263077874 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc0d8800 con 0x7f72dc04fc10 2024-04-25T02:28:32.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f72e3fff640 1 --2- 172.21.15.67:0/4263077874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72dc0548b0 0x7f72dc04ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-25T02:28:32.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f6e9959a640 1 -- 172.21.15.67:0/3908386065 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e94031600 con 0x7f6e9c0cad00 2024-04-25T02:28:32.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f6e9959a640 1 -- 172.21.15.67:0/3908386065 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e940319d0 con 0x7f6e9c0cad00 2024-04-25T02:28:32.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7efff3012640 1 -- 172.21.15.67:0/2022933988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7effec0ae4c0 msgr2=0x7effec06fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7efff3012640 1 --2- 172.21.15.67:0/2022933988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7effec0ae4c0 0x7effec06fa20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7effe4009d90 tx=0x7effe402a660 comp rx=0 tx=0).stop 2024-04-25T02:28:32.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7efff3012640 1 -- 172.21.15.67:0/2022933988 shutdown_connections 2024-04-25T02:28:32.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7efff3012640 1 --2- 172.21.15.67:0/2022933988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7effec0ae4c0 0x7effec06fa20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7efff3012640 1 --2- 172.21.15.67:0/2022933988 >> v2:172.21.15.67:3300/0 conn(0x7effec15af70 0x7effec0b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7efff3012640 1 -- 172.21.15.67:0/2022933988 >> 172.21.15.67:0/2022933988 conn(0x7effec0d0e00 msgr2=0x7effec0d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f29b1a59640 1 -- 172.21.15.67:0/3062468635 >> v2:172.21.15.67:3300/0 conn(0x7f29ac15d4a0 msgr2=0x7f29ac15dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f29b1a59640 1 --2- 172.21.15.67:0/3062468635 >> v2:172.21.15.67:3300/0 conn(0x7f29ac15d4a0 0x7f29ac15dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f29b1a59640 1 -- 172.21.15.67:0/3062468635 >> v1:172.21.15.176:6789/0 conn(0x7f29ac15c3d0 legacy=0x7f29ac0d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f29b1a59640 1 -- 172.21.15.67:0/3062468635 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ac06fa50 con 0x7f29ac0d1d30 2024-04-25T02:28:32.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f29b0a57640 1 -- 172.21.15.67:0/3062468635 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 789706506 0 0) 0x7f2998007930 con 0x7f29ac15c3d0 2024-04-25T02:28:32.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7efff3012640 1 -- 172.21.15.67:0/2022933988 shutdown_connections 2024-04-25T02:28:32.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7efff3012640 1 -- 172.21.15.67:0/2022933988 wait complete. 2024-04-25T02:28:32.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f1e7eea7640 1 -- 172.21.15.67:0/16432794 shutdown_connections 2024-04-25T02:28:32.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f1e7eea7640 1 -- 172.21.15.67:0/16432794 wait complete. 2024-04-25T02:28:32.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f72e2ffd640 1 --2- 172.21.15.67:0/4263077874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72dc04fc10 0x7f72dc04a8d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f72d000cac0 tx=0x7f72d000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7fa06ceb3640 1 -- 172.21.15.67:0/396043288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa050007740 msgr2=0x7fa050007bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7fa06ceb3640 1 --2- 172.21.15.67:0/396043288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa050007740 0x7fa050007bc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00c110 tx=0x7fa050004720 comp rx=0 tx=0).stop 2024-04-25T02:28:32.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7fa06ceb3640 1 -- 172.21.15.67:0/396043288 shutdown_connections 2024-04-25T02:28:32.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7fa06ceb3640 1 --2- 172.21.15.67:0/396043288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa050007740 0x7fa050007bc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7fa06ceb3640 1 -- 172.21.15.67:0/396043288 >> 172.21.15.67:0/396043288 conn(0x7fa0680b19c0 msgr2=0x7fa0680b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7fa06ceb3640 1 -- 172.21.15.67:0/396043288 shutdown_connections 2024-04-25T02:28:32.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f72cffff640 1 -- 172.21.15.67:0/4263077874 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d0017070 con 0x7f72dc04fc10 2024-04-25T02:28:32.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f72cffff640 1 -- 172.21.15.67:0/4263077874 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d0005ce0 con 0x7f72dc04fc10 2024-04-25T02:28:32.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f72cffff640 1 -- 172.21.15.67:0/4263077874 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d0007270 con 0x7f72dc04fc10 2024-04-25T02:28:32.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7f72e8c5a640 1 -- 172.21.15.67:0/4263077874 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72dc0e0dd0 con 0x7f72dc04fc10 2024-04-25T02:28:32.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.414+0000 7fe81eef5640 1 Processor -- start 2024-04-25T02:28:32.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.414+0000 7fe81eef5640 1 -- start start 2024-04-25T02:28:32.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.414+0000 7f9f3559a640 1 -- 172.21.15.67:0/2467298498 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f380b3070 con 0x7f9f200039b0 2024-04-25T02:28:32.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.414+0000 7f9f3559a640 1 -- 172.21.15.67:0/2467298498 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f380a6c10 con 0x7f9f200039b0 2024-04-25T02:28:32.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.414+0000 7f9f3559a640 1 -- 172.21.15.67:0/2467298498 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f38069110 con 0x7f9f200039b0 2024-04-25T02:28:32.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.414+0000 7f6e9b59e640 1 -- 172.21.15.67:0/3908386065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e9c0cad00 msgr2=0x7f6e9c0cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.414+0000 7f6e9b59e640 1 --2- 172.21.15.67:0/3908386065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e9c0cad00 0x7f6e9c0cb190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0cdb20 tx=0x7f6e9402a6a0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.414+0000 7f6e9b59e640 1 -- 172.21.15.67:0/3908386065 shutdown_connections 2024-04-25T02:28:32.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.414+0000 7f6e9b59e640 1 --2- 172.21.15.67:0/3908386065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e9c0cad00 0x7f6e9c0cb190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.414+0000 7f6e9b59e640 1 --2- 172.21.15.67:0/3908386065 >> v2:172.21.15.67:3300/0 conn(0x7f6e9c0ce2c0 0x7f6e9c0c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.414+0000 7f6e9b59e640 1 --2- 172.21.15.67:0/3908386065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9c1628e0 0x7f6e9c0c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.414+0000 7f6e9b59e640 1 -- 172.21.15.67:0/3908386065 >> 172.21.15.67:0/3908386065 conn(0x7f6e9c0d0010 msgr2=0x7f6e9c0d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.414+0000 7f6e9b59e640 1 -- 172.21.15.67:0/3908386065 shutdown_connections 2024-04-25T02:28:32.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.414+0000 7f6e9b59e640 1 -- 172.21.15.67:0/3908386065 wait complete. 2024-04-25T02:28:32.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.415+0000 7f9f3759e640 1 -- 172.21.15.67:0/2467298498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f200039b0 msgr2=0x7f9f20003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.415+0000 7f9f3759e640 1 --2- 172.21.15.67:0/2467298498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f200039b0 0x7f9f20003dd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9f3806a010 tx=0x7f9f20005830 comp rx=0 tx=0).stop 2024-04-25T02:28:32.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.413+0000 7fa06ceb3640 1 -- 172.21.15.67:0/396043288 wait complete. 2024-04-25T02:28:32.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.415+0000 7f1e7eea7640 1 Processor -- start 2024-04-25T02:28:32.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.415+0000 7fe81eef5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe81003c100 0x7fe81003aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.415+0000 7efff3012640 1 Processor -- start 2024-04-25T02:28:32.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.415+0000 7fa06ceb3640 1 Processor -- start 2024-04-25T02:28:32.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.415+0000 7f9f36d9d640 1 -- 172.21.15.67:0/2467298498 reap_dead start 2024-04-25T02:28:32.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.415+0000 7f9f3759e640 1 -- 172.21.15.67:0/2467298498 shutdown_connections 2024-04-25T02:28:32.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.415+0000 7f9f3759e640 1 -- 172.21.15.67:0/2467298498 >> 172.21.15.67:0/2467298498 conn(0x7f9f300559e0 msgr2=0x7f9f30055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.415+0000 7efff3012640 1 -- start start 2024-04-25T02:28:32.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.415+0000 7fa06ceb3640 1 -- start start 2024-04-25T02:28:32.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.415+0000 7fe81cc91640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fe8100e3390 0x7fe810006210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:42452/0 (socket says 172.21.15.67:42452) 2024-04-25T02:28:32.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.415+0000 7f29b1a59640 1 --2- 172.21.15.67:0/3062468635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29ac0d1d30 0x7f29ac0d2110 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f299c0097a0 tx=0x7f299c02a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7e80660e4594b77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.416+0000 7f9f3759e640 1 -- 172.21.15.67:0/2467298498 shutdown_connections 2024-04-25T02:28:32.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.416+0000 7f9f3759e640 1 -- 172.21.15.67:0/2467298498 wait complete. 2024-04-25T02:28:32.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.416+0000 7f29b0a57640 1 -- 172.21.15.67:0/3062468635 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c037070 con 0x7f29ac0d1d30 2024-04-25T02:28:32.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.416+0000 7f29b0a57640 1 -- 172.21.15.67:0/3062468635 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f299c02ab10 con 0x7f29ac0d1d30 2024-04-25T02:28:32.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.416+0000 7f29b0a57640 1 -- 172.21.15.67:0/3062468635 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a40019f0 con 0x7f29ac0d1d30 2024-04-25T02:28:32.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.416+0000 7f6e9b59e640 1 Processor -- start 2024-04-25T02:28:32.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fa06ceb3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa050007740 0x7fa068146870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fa06ceb3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0681f0fb0 0x7fa06809aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fa06ceb3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa06809afb0 0x7fa06815da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fa065d9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0681f0fb0 0x7fa06809aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fa065d9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0681f0fb0 0x7fa06809aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:53786/0 (socket says 172.21.15.67:53786) 2024-04-25T02:28:32.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fa06ceb3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa0680b3dd0 con 0x7fa050007740 2024-04-25T02:28:32.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fa065d9b640 1 -- 172.21.15.67:0/2712832343 learned_addr learned my addr 172.21.15.67:0/2712832343 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fa06ceb3640 1 -- 172.21.15.67:0/2712832343 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa0680b4140 con 0x7fa0681f0fb0 2024-04-25T02:28:32.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fa06ceb3640 1 -- 172.21.15.67:0/2712832343 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa06815a2b0 con 0x7fa06809afb0 2024-04-25T02:28:32.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7efff3012640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7effec0ae4c0 0x7effec137780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7f29b3cbd640 1 -- 172.21.15.67:0/3062468635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29ac0d1d30 msgr2=0x7f29ac0d2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7f29b3cbd640 1 --2- 172.21.15.67:0/3062468635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29ac0d1d30 0x7f29ac0d2110 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f299c0097a0 tx=0x7f299c02a080 comp rx=0 tx=0).stop 2024-04-25T02:28:32.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fa066d9d640 1 --2- 172.21.15.67:0/2712832343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa06809afb0 0x7fa06815da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.416+0000 7f1e7eea7640 1 -- start start 2024-04-25T02:28:32.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7f1e7eea7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e700da8b0 0x7f1e7004c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7f1e7eea7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e700dac90 0x7f1e7017dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7f1e7eea7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e700e2290 0x7f1e7004e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7f1e7eea7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1e700504c0 con 0x7f1e700dac90 2024-04-25T02:28:32.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7f1e7eea7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1e700547b0 con 0x7f1e700e2290 2024-04-25T02:28:32.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7f1e7eea7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1e70050640 con 0x7f1e700da8b0 2024-04-25T02:28:32.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fa065d9b640 1 -- 172.21.15.67:0/2712832343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa06809afb0 msgr2=0x7fa06815da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fa06659c640 1 --2- 172.21.15.67:0/2712832343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa050007740 0x7fa068146870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fa065d9b640 1 --2- 172.21.15.67:0/2712832343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa06809afb0 0x7fa06815da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fa065d9b640 1 -- 172.21.15.67:0/2712832343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa050007740 msgr2=0x7fa068146870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7efff3012640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7effec15af70 0x7effec14f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.416+0000 7f72e8c5a640 1 -- 172.21.15.67:0/4263077874 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72dc0d8d80 con 0x7f72dc04fc10 2024-04-25T02:28:32.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7f72cdffb640 1 -- 172.21.15.67:0/4263077874 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f72dc0057e0 con 0x7f72dc04fc10 2024-04-25T02:28:32.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fa065d9b640 1 --2- 172.21.15.67:0/2712832343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa050007740 0x7fa068146870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fa065d9b640 1 -- 172.21.15.67:0/2712832343 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06809b510 con 0x7fa0681f0fb0 2024-04-25T02:28:32.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.416+0000 7f6e9b59e640 1 -- start start 2024-04-25T02:28:32.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f6e9b59e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e9c0cad00 0x7f6e9c1faf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7fa06659c640 1 --2- 172.21.15.67:0/2712832343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa050007740 0x7fa068146870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:32.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f29b3cbd640 1 -- 172.21.15.67:0/3062468635 shutdown_connections 2024-04-25T02:28:32.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f29b3cbd640 1 --2- 172.21.15.67:0/3062468635 >> v2:172.21.15.67:3300/0 conn(0x7f29ac15d4a0 0x7f29ac15dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f29b3cbd640 1 --2- 172.21.15.67:0/3062468635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29ac0d1d30 0x7f29ac0d2110 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f29b3cbd640 1 -- 172.21.15.67:0/3062468635 >> 172.21.15.67:0/3062468635 conn(0x7f29ac09aa70 msgr2=0x7f29ac09ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7efff0dae640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7effec0ae4c0 0x7effec137780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f6e9b59e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9c0ce2c0 0x7f6e9c162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f1e7d6a4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e700dac90 0x7f1e7017dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f1e7d6a4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e700dac90 0x7f1e7017dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54308/0 (socket says 172.21.15.67:54308) 2024-04-25T02:28:32.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f1e7d6a4640 1 -- 172.21.15.67:0/3923255065 learned_addr learned my addr 172.21.15.67:0/3923255065 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f29b3cbd640 1 -- 172.21.15.67:0/3062468635 shutdown_connections 2024-04-25T02:28:32.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f6e9b59e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e9c1628e0 0x7f6e9c163510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7efff0dae640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7effec0ae4c0 0x7effec137780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:47048/0 (socket says 172.21.15.67:47048) 2024-04-25T02:28:32.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f9f3759e640 1 Processor -- start 2024-04-25T02:28:32.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7efff0dae640 1 -- 172.21.15.67:0/581566145 learned_addr learned my addr 172.21.15.67:0/581566145 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f1e7e6a6640 1 --2- 172.21.15.67:0/3923255065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e700e2290 0x7f1e7004e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f6e99d9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9c0ce2c0 0x7f6e9c162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f6e99d9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9c0ce2c0 0x7f6e9c162fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:47058/0 (socket says 172.21.15.67:47058) 2024-04-25T02:28:32.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f6e99d9b640 1 -- 172.21.15.67:0/2852778629 learned_addr learned my addr 172.21.15.67:0/2852778629 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f1e7dea5640 1 --2- 172.21.15.67:0/3923255065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e700da8b0 0x7f1e7004c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7efff3012640 1 --2- 172.21.15.67:0/581566145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effec15f4c0 0x7effec14ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f9f3759e640 1 -- start start 2024-04-25T02:28:32.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f6e9b59e640 1 -- 172.21.15.67:0/2852778629 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c0cb6d0 con 0x7f6e9c0cad00 2024-04-25T02:28:32.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f6e9ad9d640 1 --2- 172.21.15.67:0/2852778629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e9c1628e0 0x7f6e9c163510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f6e9b59e640 1 -- 172.21.15.67:0/2852778629 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c0cdea0 con 0x7f6e9c1628e0 2024-04-25T02:28:32.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7effebfff640 1 --2- 172.21.15.67:0/581566145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7effec15af70 0x7effec14f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f72cffff640 1 -- 172.21.15.67:0/4263077874 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72d001a070 con 0x7f72dc04fc10 2024-04-25T02:28:32.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f6e9a59c640 1 --2- 172.21.15.67:0/2852778629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e9c0cad00 0x7f6e9c1faf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7efff3012640 1 -- 172.21.15.67:0/581566145 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7effec0b4310 con 0x7effec15f4c0 2024-04-25T02:28:32.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f6e9b59e640 1 -- 172.21.15.67:0/2852778629 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9c0cb850 con 0x7f6e9c0ce2c0 2024-04-25T02:28:32.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7efff3012640 1 -- 172.21.15.67:0/581566145 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7effec06f220 con 0x7effec15af70 2024-04-25T02:28:32.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7fa065d9b640 1 --2- 172.21.15.67:0/2712832343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0681f0fb0 0x7fa06809aa70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa05800e930 tx=0x7fa05800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7efff3012640 1 -- 172.21.15.67:0/581566145 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7effec0b4490 con 0x7effec0ae4c0 2024-04-25T02:28:32.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.415+0000 7fe81d492640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe81003e9f0 0x7fe810057cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49360/0 (socket says 172.21.15.67:49360) 2024-04-25T02:28:32.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.416+0000 7fe81cc91640 1 -- 172.21.15.67:0/1881961096 learned_addr learned my addr 172.21.15.67:0/1881961096 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:32.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.416+0000 7fe81eef5640 1 -- 172.21.15.67:0/1881961096 --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe810006b10 con 0x7fe81003e9f0 2024-04-25T02:28:32.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.416+0000 7fe81eef5640 1 -- 172.21.15.67:0/1881961096 --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe810006df0 con 0x7fe8100e3390 2024-04-25T02:28:32.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.416+0000 7fe81eef5640 1 -- 172.21.15.67:0/1881961096 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe810057830 con 0x7fe81003c100 2024-04-25T02:28:32.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.416+0000 7fe8177fe640 1 -- 172.21.15.67:0/1881961096 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3023527457 0 0) 0x7fe810006df0 con 0x7fe8100e3390 2024-04-25T02:28:32.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.416+0000 7fe8177fe640 1 -- 172.21.15.67:0/1881961096 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe808003520 con 0x7fe8100e3390 2024-04-25T02:28:32.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fe8177fe640 1 -- 172.21.15.67:0/1881961096 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1024004729 0 0) 0x7fe810006b10 con 0x7fe81003e9f0 2024-04-25T02:28:32.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fe8177fe640 1 -- 172.21.15.67:0/1881961096 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe810006df0 con 0x7fe81003e9f0 2024-04-25T02:28:32.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fe8177fe640 1 -- 172.21.15.67:0/1881961096 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1043221761 0 0) 0x7fe808003520 con 0x7fe8100e3390 2024-04-25T02:28:32.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fe8177fe640 1 -- 172.21.15.67:0/1881961096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe81003c100 msgr2=0x7fe81003aa90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T02:28:32.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fe8177fe640 1 --2- 172.21.15.67:0/1881961096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe81003c100 0x7fe81003aa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fe8177fe640 1 -- 172.21.15.67:0/1881961096 >> v1:172.21.15.67:6789/0 conn(0x7fe81003e9f0 legacy=0x7fe810057cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fe8177fe640 1 -- 172.21.15.67:0/1881961096 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8100070d0 con 0x7fe8100e3390 2024-04-25T02:28:32.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fe8177fe640 1 -- 172.21.15.67:0/1881961096 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7fe80c0015f0 con 0x7fe8100e3390 2024-04-25T02:28:32.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fe8177fe640 1 -- 172.21.15.67:0/1881961096 >> v1:172.21.15.176:6789/0 conn(0x7fe8100e3390 legacy=0x7fe810006210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fe8177fe640 1 --2- 172.21.15.67:0/1881961096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe808003b40 0x7fe808003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fe8177fe640 1 --2- 172.21.15.67:0/1881961096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe808004800 0x7fe808004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fe8177fe640 1 --2- 172.21.15.67:0/1881961096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8080051c0 0x7fe80800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fe81cc91640 1 --2- 172.21.15.67:0/1881961096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe808003b40 0x7fe808003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fe8177fe640 1 -- 172.21.15.67:0/1881961096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe810057830 con 0x7fe8080051c0 2024-04-25T02:28:32.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fe8177fe640 1 -- 172.21.15.67:0/1881961096 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe80800c000 con 0x7fe808003b40 2024-04-25T02:28:32.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f1e7e6a6640 1 -- 172.21.15.67:0/3923255065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e700da8b0 msgr2=0x7f1e7004c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f1e7e6a6640 1 --2- 172.21.15.67:0/3923255065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e700da8b0 0x7f1e7004c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f1e7e6a6640 1 -- 172.21.15.67:0/3923255065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e700dac90 msgr2=0x7f1e7017dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f1e7e6a6640 1 --2- 172.21.15.67:0/3923255065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e700dac90 0x7f1e7017dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f1e7e6a6640 1 -- 172.21.15.67:0/3923255065 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e7004c960 con 0x7f1e700e2290 2024-04-25T02:28:32.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.417+0000 7fe8177fe640 1 -- 172.21.15.67:0/1881961096 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe80800c1b0 con 0x7fe808004800 2024-04-25T02:28:32.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7fe81d492640 1 --2- 172.21.15.67:0/1881961096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8080051c0 0x7fe80800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7fe81cc91640 1 -- 172.21.15.67:0/1881961096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe808004800 msgr2=0x7fe808004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:28:32.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7fe81cc91640 1 --2- 172.21.15.67:0/1881961096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe808004800 0x7fe808004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7fe81cc91640 1 -- 172.21.15.67:0/1881961096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8080051c0 msgr2=0x7fe80800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7fe81cc91640 1 --2- 172.21.15.67:0/1881961096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8080051c0 0x7fe80800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7fe81cc91640 1 -- 172.21.15.67:0/1881961096 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe808003520 con 0x7fe808003b40 2024-04-25T02:28:32.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f29b3cbd640 1 -- 172.21.15.67:0/3062468635 wait complete. 2024-04-25T02:28:32.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f6e99d9b640 1 -- 172.21.15.67:0/2852778629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e9c1628e0 msgr2=0x7f6e9c163510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f6e99d9b640 1 --2- 172.21.15.67:0/2852778629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e9c1628e0 0x7f6e9c163510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f6e99d9b640 1 -- 172.21.15.67:0/2852778629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e9c0cad00 msgr2=0x7f6e9c1faf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f6e99d9b640 1 --2- 172.21.15.67:0/2852778629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e9c0cad00 0x7f6e9c1faf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f6e99d9b640 1 -- 172.21.15.67:0/2852778629 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9c0b0920 con 0x7f6e9c0ce2c0 2024-04-25T02:28:32.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.418+0000 7f72cffff640 1 --2- 172.21.15.67:0/4263077874 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f72c806bf00 0x7f72c806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f72cffff640 1 -- 172.21.15.67:0/4263077874 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f72d008f060 con 0x7f72dc04fc10 2024-04-25T02:28:32.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f72cffff640 1 --2- 172.21.15.67:0/4263077874 >> [v2:172.21.15.67:6808/3238175451,v1:172.21.15.67:6809/3238175451] conn(0x7f72c8074120 0x7f72c8076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f72cffff640 1 -- 172.21.15.67:0/4263077874 --> [v2:172.21.15.67:6808/3238175451,v1:172.21.15.67:6809/3238175451] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72d000de50 con 0x7f72c8074120 2024-04-25T02:28:32.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f72cffff640 1 -- 172.21.15.67:0/4263077874 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f72d008a530 con 0x7f72dc04fc10 2024-04-25T02:28:32.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f6e9a59c640 1 --2- 172.21.15.67:0/2852778629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e9c0cad00 0x7f6e9c1faf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:32.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7efff15af640 1 --2- 172.21.15.67:0/581566145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effec15f4c0 0x7effec14ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7effebfff640 1 -- 172.21.15.67:0/581566145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7effec0ae4c0 msgr2=0x7effec137780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7effebfff640 1 --2- 172.21.15.67:0/581566145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7effec0ae4c0 0x7effec137780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7effebfff640 1 -- 172.21.15.67:0/581566145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effec15f4c0 msgr2=0x7effec14ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f72e3fff640 1 --2- 172.21.15.67:0/4263077874 >> [v2:172.21.15.67:6808/3238175451,v1:172.21.15.67:6809/3238175451] conn(0x7f72c8074120 0x7f72c8076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7fa056ffd640 1 -- 172.21.15.67:0/2712832343 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058017070 con 0x7fa0681f0fb0 2024-04-25T02:28:32.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f6e99d9b640 1 --2- 172.21.15.67:0/2852778629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9c0ce2c0 0x7f6e9c162fd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00e8c0 tx=0x7f6e8c00ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f72e37fe640 1 --2- 172.21.15.67:0/4263077874 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f72c806bf00 0x7f72c806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7fa06ceb3640 1 -- 172.21.15.67:0/2712832343 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa06809b7f0 con 0x7fa0681f0fb0 2024-04-25T02:28:32.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7effebfff640 1 --2- 172.21.15.67:0/581566145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effec15f4c0 0x7effec14ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7effebfff640 1 -- 172.21.15.67:0/581566145 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effec137cc0 con 0x7effec15af70 2024-04-25T02:28:32.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7efff15af640 1 --2- 172.21.15.67:0/581566145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effec15f4c0 0x7effec14ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:32.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f6e92ffd640 1 -- 172.21.15.67:0/2852778629 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c017070 con 0x7f6e9c0ce2c0 2024-04-25T02:28:32.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7fa06ceb3640 1 -- 172.21.15.67:0/2712832343 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0681f1430 con 0x7fa0681f0fb0 2024-04-25T02:28:32.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f6e92ffd640 1 -- 172.21.15.67:0/2852778629 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e8c00c940 con 0x7f6e9c0ce2c0 2024-04-25T02:28:32.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f6e92ffd640 1 -- 172.21.15.67:0/2852778629 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c00cd10 con 0x7f6e9c0ce2c0 2024-04-25T02:28:32.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.419+0000 7f6e9b59e640 1 -- 172.21.15.67:0/2852778629 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e9c0b0c00 con 0x7f6e9c0ce2c0 2024-04-25T02:28:32.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.420+0000 7f6e9b59e640 1 -- 172.21.15.67:0/2852778629 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e9c0b11c0 con 0x7f6e9c0ce2c0 2024-04-25T02:28:32.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.420+0000 7f9f3759e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f300d5000 0x7f9f300daed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.420+0000 7f72e3fff640 1 --2- 172.21.15.67:0/4263077874 >> [v2:172.21.15.67:6808/3238175451,v1:172.21.15.67:6809/3238175451] conn(0x7f72c8074120 0x7f72c8076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.420+0000 7f9f3659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f300d5000 0x7f9f300daed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.420+0000 7f9f3659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f300d5000 0x7f9f300daed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54340/0 (socket says 172.21.15.67:54340) 2024-04-25T02:28:32.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.420+0000 7f9f3659c640 1 -- 172.21.15.67:0/522642313 learned_addr learned my addr 172.21.15.67:0/522642313 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.420+0000 7f72e37fe640 1 --2- 172.21.15.67:0/4263077874 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f72c806bf00 0x7f72c806e3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f72d8034000 tx=0x7f72d802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.420+0000 7f9f3759e640 1 --2- 172.21.15.67:0/522642313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f30051b40 0x7f9f300de880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.420+0000 7f9f3759e640 1 --2- 172.21.15.67:0/522642313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f300db410 0x7f9f300dedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.420+0000 7f9f3759e640 1 -- 172.21.15.67:0/522642313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9f30053bf0 con 0x7f9f300d5000 2024-04-25T02:28:32.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.420+0000 7f9f3759e640 1 -- 172.21.15.67:0/522642313 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9f300e34a0 con 0x7f9f30051b40 2024-04-25T02:28:32.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.420+0000 7f9f3759e640 1 -- 172.21.15.67:0/522642313 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9f30053d70 con 0x7f9f300db410 2024-04-25T02:28:32.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.420+0000 7fa056ffd640 1 -- 172.21.15.67:0/2712832343 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05800c940 con 0x7fa0681f0fb0 2024-04-25T02:28:32.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.420+0000 7fa056ffd640 1 -- 172.21.15.67:0/2712832343 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05800cd30 con 0x7fa0681f0fb0 2024-04-25T02:28:32.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7f9f36d9d640 1 --2- 172.21.15.67:0/522642313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f300db410 0x7f9f300dedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.420+0000 7f1e7e6a6640 1 --2- 172.21.15.67:0/3923255065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e700e2290 0x7f1e7004e410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1e780502b0 tx=0x7f1e78073730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.420+0000 7fe81cc91640 1 --2- 172.21.15.67:0/1881961096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe808003b40 0x7fe808003f40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe80c02e120 tx=0x7fe808005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f420ba35d0c34229 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7fe8177fe640 1 -- 172.21.15.67:0/1881961096 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c007c40 con 0x7fe808003b40 2024-04-25T02:28:32.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.420+0000 7effebfff640 1 --2- 172.21.15.67:0/581566145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7effec15af70 0x7effec14f9e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7effe000c3c0 tx=0x7effe000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7f72cffff640 1 -- 172.21.15.67:0/4263077874 <== osd.2 v2:172.21.15.67:6808/3238175451 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f72d000de50 con 0x7f72c8074120 2024-04-25T02:28:32.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7f1e6e7fc640 1 -- 172.21.15.67:0/3923255065 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e78096430 con 0x7f1e700e2290 2024-04-25T02:28:32.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7effe97fa640 1 -- 172.21.15.67:0/581566145 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0017070 con 0x7effec15af70 2024-04-25T02:28:32.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7effe97fa640 1 -- 172.21.15.67:0/581566145 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe00052f0 con 0x7effec15af70 2024-04-25T02:28:32.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7fe8177fe640 1 -- 172.21.15.67:0/1881961096 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe80c050070 con 0x7fe808003b40 2024-04-25T02:28:32.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7fe8177fe640 1 -- 172.21.15.67:0/1881961096 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c005db0 con 0x7fe808003b40 2024-04-25T02:28:32.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7f9f35d9b640 1 --2- 172.21.15.67:0/522642313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f30051b40 0x7f9f300de880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7f9f3659c640 1 -- 172.21.15.67:0/522642313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f300db410 msgr2=0x7f9f300dedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7f9f3659c640 1 --2- 172.21.15.67:0/522642313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f300db410 0x7f9f300dedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7f9f3659c640 1 -- 172.21.15.67:0/522642313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f30051b40 msgr2=0x7f9f300de880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7f9f3659c640 1 --2- 172.21.15.67:0/522642313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f30051b40 0x7f9f300de880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7f9f3659c640 1 -- 172.21.15.67:0/522642313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f300d53e0 con 0x7f9f300d5000 2024-04-25T02:28:32.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7f9f35d9b640 1 --2- 172.21.15.67:0/522642313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f30051b40 0x7f9f300de880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:32.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7f9f3659c640 1 --2- 172.21.15.67:0/522642313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f300d5000 0x7f9f300daed0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9f3802d700 tx=0x7f9f380754c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.422+0000 7f9f26ffd640 1 -- 172.21.15.67:0/522642313 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f380bc070 con 0x7f9f300d5000 2024-04-25T02:28:32.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.422+0000 7f9f26ffd640 1 -- 172.21.15.67:0/522642313 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f380a69b0 con 0x7f9f300d5000 2024-04-25T02:28:32.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7f1e7eea7640 1 -- 172.21.15.67:0/3923255065 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e7017dff0 con 0x7f1e700e2290 2024-04-25T02:28:32.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7f1e7eea7640 1 -- 172.21.15.67:0/3923255065 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e700dfd20 con 0x7f1e700e2290 2024-04-25T02:28:32.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7f1e6e7fc640 1 -- 172.21.15.67:0/3923255065 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e780965d0 con 0x7f1e700e2290 2024-04-25T02:28:32.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7fa06ceb3640 1 -- 172.21.15.67:0/2712832343 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa068069110 con 0x7fa0681f0fb0 2024-04-25T02:28:32.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.422+0000 7fa056ffd640 1 -- 172.21.15.67:0/2712832343 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa05801a070 con 0x7fa0681f0fb0 2024-04-25T02:28:32.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.422+0000 7effe97fa640 1 -- 172.21.15.67:0/581566145 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0003830 con 0x7effec15af70 2024-04-25T02:28:32.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.422+0000 7efff3012640 1 -- 172.21.15.67:0/581566145 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effec150520 con 0x7effec15af70 2024-04-25T02:28:32.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7f29b3cbd640 1 Processor -- start 2024-04-25T02:28:32.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7f29b3cbd640 1 -- start start 2024-04-25T02:28:32.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.422+0000 7fe81eef5640 1 -- 172.21.15.67:0/1881961096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe808003b40 msgr2=0x7fe808003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.422+0000 7fe81eef5640 1 --2- 172.21.15.67:0/1881961096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe808003b40 0x7fe808003f40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe80c02e120 tx=0x7fe808005830 comp rx=0 tx=0).stop 2024-04-25T02:28:32.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.422+0000 7fe81d492640 1 -- 172.21.15.67:0/1881961096 reap_dead start 2024-04-25T02:28:32.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.422+0000 7fe81eef5640 1 -- 172.21.15.67:0/1881961096 shutdown_connections 2024-04-25T02:28:32.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.422+0000 7fe81eef5640 1 -- 172.21.15.67:0/1881961096 >> 172.21.15.67:0/1881961096 conn(0x7fe810059010 msgr2=0x7fe8100593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.422+0000 7efff3012640 1 -- 172.21.15.67:0/581566145 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effec150ae0 con 0x7effec15af70 2024-04-25T02:28:32.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.422+0000 7fe81eef5640 1 -- 172.21.15.67:0/1881961096 shutdown_connections 2024-04-25T02:28:32.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.422+0000 7fe81eef5640 1 -- 172.21.15.67:0/1881961096 wait complete. 2024-04-25T02:28:32.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.422+0000 7f1e6e7fc640 1 -- 172.21.15.67:0/3923255065 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e780969c0 con 0x7f1e700e2290 2024-04-25T02:28:32.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.422+0000 7fa056ffd640 1 --2- 172.21.15.67:0/2712832343 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa04806bf00 0x7fa04806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.421+0000 7f6e9b59e640 1 -- 172.21.15.67:0/2852778629 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6e9c0b06d0 con 0x7f6e9c0ce2c0 2024-04-25T02:28:32.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.422+0000 7f9f26ffd640 1 -- 172.21.15.67:0/522642313 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f380b3040 con 0x7f9f300d5000 2024-04-25T02:28:32.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.423+0000 7f9f3759e640 1 -- 172.21.15.67:0/522642313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f30050ae0 con 0x7f9f300d5000 2024-04-25T02:28:32.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.423+0000 7f9f3759e640 1 -- 172.21.15.67:0/522642313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f30051060 con 0x7f9f300d5000 2024-04-25T02:28:32.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.423+0000 7f1e7eea7640 1 -- 172.21.15.67:0/3923255065 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1e60001030 con 0x7f1e700e2290 2024-04-25T02:28:32.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.423+0000 7fa056ffd640 1 -- 172.21.15.67:0/2712832343 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa05808b200 con 0x7fa0681f0fb0 2024-04-25T02:28:32.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.423+0000 7fa056ffd640 1 --2- 172.21.15.67:0/2712832343 >> [v2:172.21.15.176:6800/660324040,v1:172.21.15.176:6801/660324040] conn(0x7fa0480740a0 0x7fa0480764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.423+0000 7fa056ffd640 1 -- 172.21.15.67:0/2712832343 --> [v2:172.21.15.176:6800/660324040,v1:172.21.15.176:6801/660324040] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa048076b70 con 0x7fa0480740a0 2024-04-25T02:28:32.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.423+0000 7fa056ffd640 1 -- 172.21.15.67:0/2712832343 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa058092050 con 0x7fa0681f0fb0 2024-04-25T02:28:32.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.423+0000 7fa06659c640 1 --2- 172.21.15.67:0/2712832343 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa04806bf00 0x7fa04806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.423+0000 7f29b3cbd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29ac0d1d30 0x7f29ac1efba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.423+0000 7f29b3cbd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29ac15c3d0 0x7f29ac0c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.423+0000 7f29b3cbd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29ac15d4a0 0x7f29ac14e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.423+0000 7f29b3cbd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac0702f0 con 0x7f29ac15c3d0 2024-04-25T02:28:32.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.424+0000 7f9f24ff9640 1 -- 172.21.15.67:0/522642313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9f300057e0 con 0x7f9f300d5000 2024-04-25T02:28:32.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.423+0000 7f29b3cbd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac070010 con 0x7f29ac15d4a0 2024-04-25T02:28:32.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.423+0000 7f29b3cbd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f29ac15e020 con 0x7f29ac0d1d30 2024-04-25T02:28:32.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.424+0000 7f29b1a59640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29ac0d1d30 0x7f29ac1efba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.424+0000 7efff3012640 1 -- 172.21.15.67:0/581566145 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7effec0681f0 con 0x7effec15af70 2024-04-25T02:28:32.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.423+0000 7f6e92ffd640 1 -- 172.21.15.67:0/2852778629 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e8c01a070 con 0x7f6e9c0ce2c0 2024-04-25T02:28:32.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.424+0000 7f6e92ffd640 1 --2- 172.21.15.67:0/2852778629 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6e7c06bf00 0x7f6e7c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.424+0000 7fa066d9d640 1 --2- 172.21.15.67:0/2712832343 >> [v2:172.21.15.176:6800/660324040,v1:172.21.15.176:6801/660324040] conn(0x7fa0480740a0 0x7fa0480764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.424+0000 7f29b1a59640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29ac0d1d30 0x7f29ac1efba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:47070/0 (socket says 172.21.15.67:47070) 2024-04-25T02:28:32.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.424+0000 7f29b1a59640 1 -- 172.21.15.67:0/4160019343 learned_addr learned my addr 172.21.15.67:0/4160019343 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.424+0000 7f6e92ffd640 1 -- 172.21.15.67:0/2852778629 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6e8c08b320 con 0x7f6e9c0ce2c0 2024-04-25T02:28:32.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.424+0000 7fe81eef5640 1 Processor -- start 2024-04-25T02:28:32.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.424+0000 7f6e92ffd640 1 --2- 172.21.15.67:0/2852778629 >> [v2:172.21.15.67:6824/611839856,v1:172.21.15.67:6825/611839856] conn(0x7f6e7c074120 0x7f6e7c076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.424+0000 7f6e92ffd640 1 -- 172.21.15.67:0/2852778629 --> [v2:172.21.15.67:6824/611839856,v1:172.21.15.67:6825/611839856] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e8c01fe70 con 0x7f6e7c074120 2024-04-25T02:28:32.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.424+0000 7f6e92ffd640 1 -- 172.21.15.67:0/2852778629 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6e8c08b710 con 0x7f6e9c0ce2c0 2024-04-25T02:28:32.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.424+0000 7f6e9a59c640 1 --2- 172.21.15.67:0/2852778629 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6e7c06bf00 0x7f6e7c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.425+0000 7fe81eef5640 1 -- start start 2024-04-25T02:28:32.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.425+0000 7effe97fa640 1 -- 172.21.15.67:0/581566145 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7effe001a070 con 0x7effec15af70 2024-04-25T02:28:32.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.425+0000 7f1e6e7fc640 1 -- 172.21.15.67:0/3923255065 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e780b65d0 con 0x7f1e700e2290 2024-04-25T02:28:32.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.425+0000 7fa06659c640 1 --2- 172.21.15.67:0/2712832343 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa04806bf00 0x7fa04806e3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa060004bf0 tx=0x7fa060009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.425+0000 7f6e9ad9d640 1 --2- 172.21.15.67:0/2852778629 >> [v2:172.21.15.67:6824/611839856,v1:172.21.15.67:6825/611839856] conn(0x7f6e7c074120 0x7f6e7c076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.424+0000 7f29b1258640 1 --2- 172.21.15.67:0/4160019343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29ac15c3d0 0x7f29ac0c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.425+0000 7f29b1258640 1 -- 172.21.15.67:0/4160019343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29ac0d1d30 msgr2=0x7f29ac1efba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.425+0000 7f29b1258640 1 --2- 172.21.15.67:0/4160019343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29ac0d1d30 0x7f29ac1efba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.425+0000 7f29b1258640 1 -- 172.21.15.67:0/4160019343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29ac15d4a0 msgr2=0x7f29ac14e360 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T02:28:32.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.425+0000 7f29b1258640 1 --2- 172.21.15.67:0/4160019343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29ac15d4a0 0x7f29ac14e360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.425+0000 7f29b1258640 1 -- 172.21.15.67:0/4160019343 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ac159d00 con 0x7f29ac15c3d0 2024-04-25T02:28:32.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.425+0000 7fa066d9d640 1 --2- 172.21.15.67:0/2712832343 >> [v2:172.21.15.176:6800/660324040,v1:172.21.15.176:6801/660324040] conn(0x7fa0480740a0 0x7fa0480764c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.425+0000 7f1e6e7fc640 1 --2- 172.21.15.67:0/3923255065 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f1e5c06be80 0x7f1e5c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.425+0000 7effe97fa640 1 --2- 172.21.15.67:0/581566145 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7effd806bf30 0x7effd806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.425+0000 7f9f26ffd640 1 -- 172.21.15.67:0/522642313 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f380b8410 con 0x7f9f300d5000 2024-04-25T02:28:32.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.425+0000 7f6e9a59c640 1 --2- 172.21.15.67:0/2852778629 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6e7c06bf00 0x7f6e7c06e3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c073180 tx=0x7f6e84008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.425+0000 7f6e9ad9d640 1 --2- 172.21.15.67:0/2852778629 >> [v2:172.21.15.67:6824/611839856,v1:172.21.15.67:6825/611839856] conn(0x7f6e7c074120 0x7f6e7c076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7f1e6e7fc640 1 -- 172.21.15.67:0/3923255065 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1e781068d0 con 0x7f1e700e2290 2024-04-25T02:28:32.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7efff0dae640 1 --2- 172.21.15.67:0/581566145 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7effd806bf30 0x7effd806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7f1e7dea5640 1 --2- 172.21.15.67:0/3923255065 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f1e5c06be80 0x7f1e5c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7f1e6e7fc640 1 --2- 172.21.15.67:0/3923255065 >> [v2:172.21.15.176:6818/828255462,v1:172.21.15.176:6819/828255462] conn(0x7f1e5c0740a0 0x7f1e5c0764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7effe97fa640 1 -- 172.21.15.67:0/581566145 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7effe008a070 con 0x7effec15af70 2024-04-25T02:28:32.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7f1e6e7fc640 1 -- 172.21.15.67:0/3923255065 --> [v2:172.21.15.176:6818/828255462,v1:172.21.15.176:6819/828255462] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e780965d0 con 0x7f1e5c0740a0 2024-04-25T02:28:32.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7f1e6e7fc640 1 -- 172.21.15.67:0/3923255065 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1e78106db0 con 0x7f1e700e2290 2024-04-25T02:28:32.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.425+0000 7f29b1258640 1 --2- 172.21.15.67:0/4160019343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29ac15c3d0 0x7f29ac0c8340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f29a40012e0 tx=0x7f29a400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7fe81eef5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8100d6800 0x7fe810174e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7f1e7d6a4640 1 --2- 172.21.15.67:0/3923255065 >> [v2:172.21.15.176:6818/828255462,v1:172.21.15.176:6819/828255462] conn(0x7f1e5c0740a0 0x7f1e5c0764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7effe97fa640 1 --2- 172.21.15.67:0/581566145 >> [v2:172.21.15.176:6808/4103155408,v1:172.21.15.176:6809/4103155408] conn(0x7effd80741b0 0x7effd80765d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7efff0dae640 1 --2- 172.21.15.67:0/581566145 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7effd806bf30 0x7effd806e3f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7effdc0094a0 tx=0x7effdc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7f29a27fc640 1 -- 172.21.15.67:0/4160019343 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a4017070 con 0x7f29ac15c3d0 2024-04-25T02:28:32.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7f29a27fc640 1 -- 172.21.15.67:0/4160019343 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a400ce10 con 0x7f29ac15c3d0 2024-04-25T02:28:32.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7f29a27fc640 1 -- 172.21.15.67:0/4160019343 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a4012600 con 0x7f29ac15c3d0 2024-04-25T02:28:32.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7f9f26ffd640 1 --2- 172.21.15.67:0/522642313 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9f1806be80 0x7f9f1806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7effe97fa640 1 -- 172.21.15.67:0/581566145 --> [v2:172.21.15.176:6808/4103155408,v1:172.21.15.176:6809/4103155408] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7effe0015e70 con 0x7effd80741b0 2024-04-25T02:28:32.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7fa056ffd640 1 -- 172.21.15.67:0/2712832343 <== osd.5 v2:172.21.15.176:6800/660324040 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa048076b70 con 0x7fa0480740a0 2024-04-25T02:28:32.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7f9f26ffd640 1 -- 172.21.15.67:0/522642313 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9f38126470 con 0x7f9f300d5000 2024-04-25T02:28:32.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7effe97fa640 1 -- 172.21.15.67:0/581566145 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7effe0091050 con 0x7effec15af70 2024-04-25T02:28:32.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7f9f35d9b640 1 --2- 172.21.15.67:0/522642313 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9f1806be80 0x7f9f1806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7f9f26ffd640 1 --2- 172.21.15.67:0/522642313 >> [v2:172.21.15.67:6800/2616951131,v1:172.21.15.67:6801/2616951131] conn(0x7f9f180740a0 0x7f9f180764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7f9f26ffd640 1 -- 172.21.15.67:0/522642313 --> [v2:172.21.15.67:6800/2616951131,v1:172.21.15.67:6801/2616951131] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f380a6c10 con 0x7f9f180740a0 2024-04-25T02:28:32.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7f9f26ffd640 1 -- 172.21.15.67:0/522642313 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9f3812d050 con 0x7f9f300d5000 2024-04-25T02:28:32.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7efff15af640 1 --2- 172.21.15.67:0/581566145 >> [v2:172.21.15.176:6808/4103155408,v1:172.21.15.176:6809/4103155408] conn(0x7effd80741b0 0x7effd80765d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7f1e7dea5640 1 --2- 172.21.15.67:0/3923255065 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f1e5c06be80 0x7f1e5c06e340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1e700e21c0 tx=0x7f1e74009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7fe81eef5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8101753c0 0x7fe8100dca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7fe81eef5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8100dcfa0 0x7fe8100d4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7fe81eef5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe810058550 con 0x7fe8100d6800 2024-04-25T02:28:32.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7fe81eef5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe8100583d0 con 0x7fe8101753c0 2024-04-25T02:28:32.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7fe81eef5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe8100586d0 con 0x7fe8100dcfa0 2024-04-25T02:28:32.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7fe81cc91640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8100d6800 0x7fe810174e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7f6e92ffd640 1 -- 172.21.15.67:0/2852778629 <== osd.3 v2:172.21.15.67:6824/611839856 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6e8c01fe70 con 0x7f6e7c074120 2024-04-25T02:28:32.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7fe81cc91640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8100d6800 0x7fe810174e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54364/0 (socket says 172.21.15.67:54364) 2024-04-25T02:28:32.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7fe81cc91640 1 -- 172.21.15.67:0/3748528568 learned_addr learned my addr 172.21.15.67:0/3748528568 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7f9f36d9d640 1 --2- 172.21.15.67:0/522642313 >> [v2:172.21.15.67:6800/2616951131,v1:172.21.15.67:6801/2616951131] conn(0x7f9f180740a0 0x7f9f180764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7fe81d492640 1 --2- 172.21.15.67:0/3748528568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8100dcfa0 0x7fe8100d4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7fe817fff640 1 --2- 172.21.15.67:0/3748528568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8101753c0 0x7fe8100dca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7fe81cc91640 1 -- 172.21.15.67:0/3748528568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8100dcfa0 msgr2=0x7fe8100d4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7fe81cc91640 1 --2- 172.21.15.67:0/3748528568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8100dcfa0 0x7fe8100d4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7fe81cc91640 1 -- 172.21.15.67:0/3748528568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8101753c0 msgr2=0x7fe8100dca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7fe81cc91640 1 --2- 172.21.15.67:0/3748528568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8101753c0 0x7fe8100dca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7fe81cc91640 1 -- 172.21.15.67:0/3748528568 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8100d6be0 con 0x7fe8100d6800 2024-04-25T02:28:32.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7fe817fff640 1 --2- 172.21.15.67:0/3748528568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8101753c0 0x7fe8100dca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:32.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.426+0000 7f29b3cbd640 1 -- 172.21.15.67:0/4160019343 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29ac0b5c80 con 0x7f29ac15c3d0 2024-04-25T02:28:32.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.428+0000 7fe81cc91640 1 --2- 172.21.15.67:0/3748528568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8100d6800 0x7fe810174e80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe80c02e210 tx=0x7fe80c0018f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7f9f35d9b640 1 --2- 172.21.15.67:0/522642313 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9f1806be80 0x7f9f1806e340 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f30178880 tx=0x7f9f28008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.428+0000 7f9f36d9d640 1 --2- 172.21.15.67:0/522642313 >> [v2:172.21.15.67:6800/2616951131,v1:172.21.15.67:6801/2616951131] conn(0x7f9f180740a0 0x7f9f180764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.428+0000 7efff15af640 1 --2- 172.21.15.67:0/581566145 >> [v2:172.21.15.176:6808/4103155408,v1:172.21.15.176:6809/4103155408] conn(0x7effd80741b0 0x7effd80765d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.427+0000 7f29b3cbd640 1 -- 172.21.15.67:0/4160019343 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29ac0b5f20 con 0x7f29ac15c3d0 2024-04-25T02:28:32.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.428+0000 7f1e7d6a4640 1 --2- 172.21.15.67:0/3923255065 >> [v2:172.21.15.176:6818/828255462,v1:172.21.15.176:6819/828255462] conn(0x7f1e5c0740a0 0x7f1e5c0764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.428+0000 7f29b3cbd640 1 -- 172.21.15.67:0/4160019343 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f29ac0b68b0 con 0x7f29ac15c3d0 2024-04-25T02:28:32.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.428+0000 7effe97fa640 1 -- 172.21.15.67:0/581566145 <== osd.6 v2:172.21.15.176:6808/4103155408 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7effe0015e70 con 0x7effd80741b0 2024-04-25T02:28:32.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.429+0000 7f9f26ffd640 1 -- 172.21.15.67:0/522642313 <== osd.1 v2:172.21.15.67:6800/2616951131 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9f380a6c10 con 0x7f9f180740a0 2024-04-25T02:28:32.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.429+0000 7f1e6e7fc640 1 -- 172.21.15.67:0/3923255065 <== osd.4 v2:172.21.15.176:6818/828255462 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1e780965d0 con 0x7f1e5c0740a0 2024-04-25T02:28:32.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.429+0000 7fe8157fa640 1 -- 172.21.15.67:0/3748528568 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c007c40 con 0x7fe8100d6800 2024-04-25T02:28:32.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.429+0000 7fe8157fa640 1 -- 172.21.15.67:0/3748528568 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe80c007280 con 0x7fe8100d6800 2024-04-25T02:28:32.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.429+0000 7fe8157fa640 1 -- 172.21.15.67:0/3748528568 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c007650 con 0x7fe8100d6800 2024-04-25T02:28:32.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.429+0000 7fe81eef5640 1 -- 172.21.15.67:0/3748528568 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8100d5a80 con 0x7fe8100d6800 2024-04-25T02:28:32.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.429+0000 7fe81eef5640 1 -- 172.21.15.67:0/3748528568 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe810052130 con 0x7fe8100d6800 2024-04-25T02:28:32.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.430+0000 7fe802ffd640 1 -- 172.21.15.67:0/3748528568 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe7f0001030 con 0x7fe8100d6800 2024-04-25T02:28:32.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.432+0000 7fe8157fa640 1 -- 172.21.15.67:0/3748528568 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe80c055470 con 0x7fe8100d6800 2024-04-25T02:28:32.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.432+0000 7fe8157fa640 1 --2- 172.21.15.67:0/3748528568 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe7fc06bf30 0x7fe7fc06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.432+0000 7fe8157fa640 1 -- 172.21.15.67:0/3748528568 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe80c0cce20 con 0x7fe8100d6800 2024-04-25T02:28:32.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.433+0000 7fe8157fa640 1 --2- 172.21.15.67:0/3748528568 >> [v2:172.21.15.67:6810/4042772984,v1:172.21.15.67:6812/4042772984] conn(0x7fe7fc074130 0x7fe7fc076550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.433+0000 7fe8157fa640 1 -- 172.21.15.67:0/3748528568 --> [v2:172.21.15.67:6810/4042772984,v1:172.21.15.67:6812/4042772984] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe80c056e80 con 0x7fe7fc074130 2024-04-25T02:28:32.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.433+0000 7fe8157fa640 1 -- 172.21.15.67:0/3748528568 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe80c097350 con 0x7fe8100d6800 2024-04-25T02:28:32.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.433+0000 7fe81d492640 1 --2- 172.21.15.67:0/3748528568 >> [v2:172.21.15.67:6810/4042772984,v1:172.21.15.67:6812/4042772984] conn(0x7fe7fc074130 0x7fe7fc076550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.433+0000 7fe81d492640 1 --2- 172.21.15.67:0/3748528568 >> [v2:172.21.15.67:6810/4042772984,v1:172.21.15.67:6812/4042772984] conn(0x7fe7fc074130 0x7fe7fc076550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.431+0000 7f29a27fc640 1 -- 172.21.15.67:0/4160019343 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29a401a070 con 0x7f29ac15c3d0 2024-04-25T02:28:32.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.432+0000 7f29a27fc640 1 --2- 172.21.15.67:0/4160019343 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f299006be30 0x7f299006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.432+0000 7f29a27fc640 1 -- 172.21.15.67:0/4160019343 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f29a408b830 con 0x7f29ac15c3d0 2024-04-25T02:28:32.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.432+0000 7f29a27fc640 1 --2- 172.21.15.67:0/4160019343 >> [v2:172.21.15.176:6816/1381219465,v1:172.21.15.176:6817/1381219465] conn(0x7f29900740b0 0x7f29900764d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.432+0000 7f29a27fc640 1 -- 172.21.15.67:0/4160019343 --> [v2:172.21.15.176:6816/1381219465,v1:172.21.15.176:6817/1381219465] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2990076b80 con 0x7f29900740b0 2024-04-25T02:28:32.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.432+0000 7f29a27fc640 1 -- 172.21.15.67:0/4160019343 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f29a408bc20 con 0x7f29ac15c3d0 2024-04-25T02:28:32.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.433+0000 7f29b1a59640 1 --2- 172.21.15.67:0/4160019343 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f299006be30 0x7f299006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.433+0000 7f29b225a640 1 --2- 172.21.15.67:0/4160019343 >> [v2:172.21.15.176:6816/1381219465,v1:172.21.15.176:6817/1381219465] conn(0x7f29900740b0 0x7f29900764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.433+0000 7fe817fff640 1 --2- 172.21.15.67:0/3748528568 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe7fc06bf30 0x7fe7fc06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.434+0000 7f29b225a640 1 --2- 172.21.15.67:0/4160019343 >> [v2:172.21.15.176:6816/1381219465,v1:172.21.15.176:6817/1381219465] conn(0x7f29900740b0 0x7f29900764d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.434+0000 7fe817fff640 1 --2- 172.21.15.67:0/3748528568 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe7fc06bf30 0x7fe7fc06e3f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe810050000 tx=0x7fe804008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.435+0000 7fe8157fa640 1 -- 172.21.15.67:0/3748528568 <== osd.0 v2:172.21.15.67:6810/4042772984 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe80c056e80 con 0x7fe7fc074130 2024-04-25T02:28:32.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.435+0000 7f29b1a59640 1 --2- 172.21.15.67:0/4160019343 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f299006be30 0x7f299006e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f299c009560 tx=0x7f299c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.435+0000 7f29a27fc640 1 -- 172.21.15.67:0/4160019343 <== osd.7 v2:172.21.15.176:6816/1381219465 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2990076b80 con 0x7f29900740b0 2024-04-25T02:28:32.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.457+0000 7f6e9b59e640 1 -- 172.21.15.67:0/2852778629 --> [v2:172.21.15.67:6824/611839856,v1:172.21.15.67:6825/611839856] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6e9c0756b0 con 0x7f6e7c074120 2024-04-25T02:28:32.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.458+0000 7f72cdffb640 1 -- 172.21.15.67:0/4263077874 --> [v2:172.21.15.67:6808/3238175451,v1:172.21.15.67:6809/3238175451] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f72dc04a3b0 con 0x7f72c8074120 2024-04-25T02:28:32.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.458+0000 7f6e92ffd640 1 -- 172.21.15.67:0/2852778629 <== osd.3 v2:172.21.15.67:6824/611839856 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6e9c0756b0 con 0x7f6e7c074120 2024-04-25T02:28:32.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.458+0000 7f72cffff640 1 -- 172.21.15.67:0/4263077874 <== osd.2 v2:172.21.15.67:6808/3238175451 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f72dc04a3b0 con 0x7f72c8074120 2024-04-25T02:28:32.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.459+0000 7f72cdffb640 1 -- 172.21.15.67:0/4263077874 >> [v2:172.21.15.67:6808/3238175451,v1:172.21.15.67:6809/3238175451] conn(0x7f72c8074120 msgr2=0x7f72c8076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.459+0000 7f72cdffb640 1 --2- 172.21.15.67:0/4263077874 >> [v2:172.21.15.67:6808/3238175451,v1:172.21.15.67:6809/3238175451] conn(0x7f72c8074120 0x7f72c8076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.459+0000 7f6e90ff9640 1 -- 172.21.15.67:0/2852778629 >> [v2:172.21.15.67:6824/611839856,v1:172.21.15.67:6825/611839856] conn(0x7f6e7c074120 msgr2=0x7f6e7c076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.459+0000 7f6e90ff9640 1 --2- 172.21.15.67:0/2852778629 >> [v2:172.21.15.67:6824/611839856,v1:172.21.15.67:6825/611839856] conn(0x7f6e7c074120 0x7f6e7c076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.459+0000 7f6e90ff9640 1 -- 172.21.15.67:0/2852778629 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6e7c06bf00 msgr2=0x7f6e7c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.459+0000 7f6e90ff9640 1 --2- 172.21.15.67:0/2852778629 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6e7c06bf00 0x7f6e7c06e3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c073180 tx=0x7f6e84008040 comp rx=0 tx=0).stop 2024-04-25T02:28:32.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.459+0000 7f6e90ff9640 1 -- 172.21.15.67:0/2852778629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9c0ce2c0 msgr2=0x7f6e9c162fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.459+0000 7f6e90ff9640 1 --2- 172.21.15.67:0/2852778629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9c0ce2c0 0x7f6e9c162fd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00e8c0 tx=0x7f6e8c00ed80 comp rx=0 tx=0).stop 2024-04-25T02:28:32.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.459+0000 7f6e9ad9d640 1 -- 172.21.15.67:0/2852778629 reap_dead start 2024-04-25T02:28:32.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.459+0000 7f72cdffb640 1 -- 172.21.15.67:0/4263077874 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f72c806bf00 msgr2=0x7f72c806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.459+0000 7f72cdffb640 1 --2- 172.21.15.67:0/4263077874 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f72c806bf00 0x7f72c806e3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f72d8034000 tx=0x7f72d802e000 comp rx=0 tx=0).stop 2024-04-25T02:28:32.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.459+0000 7f72cdffb640 1 -- 172.21.15.67:0/4263077874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72dc04fc10 msgr2=0x7f72dc04a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.459+0000 7f72cdffb640 1 --2- 172.21.15.67:0/4263077874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72dc04fc10 0x7f72dc04a8d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f72d000cac0 tx=0x7f72d000cf80 comp rx=0 tx=0).stop 2024-04-25T02:28:32.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.459+0000 7f6e90ff9640 1 -- 172.21.15.67:0/2852778629 shutdown_connections 2024-04-25T02:28:32.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.459+0000 7f6e90ff9640 1 -- 172.21.15.67:0/2852778629 >> 172.21.15.67:0/2852778629 conn(0x7f6e9c0d0010 msgr2=0x7f6e9c161e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.459+0000 7f72e3fff640 1 -- 172.21.15.67:0/4263077874 reap_dead start 2024-04-25T02:28:32.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.460+0000 7f6e90ff9640 1 -- 172.21.15.67:0/2852778629 shutdown_connections 2024-04-25T02:28:32.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.460+0000 7f72cdffb640 1 -- 172.21.15.67:0/4263077874 shutdown_connections 2024-04-25T02:28:32.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.460+0000 7f72cdffb640 1 -- 172.21.15.67:0/4263077874 >> 172.21.15.67:0/4263077874 conn(0x7f72dc055350 msgr2=0x7f72dc04fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.460+0000 7f6e90ff9640 1 -- 172.21.15.67:0/2852778629 wait complete. 2024-04-25T02:28:32.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.460+0000 7f72cdffb640 1 -- 172.21.15.67:0/4263077874 shutdown_connections 2024-04-25T02:28:32.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.460+0000 7f72cdffb640 1 -- 172.21.15.67:0/4263077874 wait complete. 2024-04-25T02:28:32.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.462+0000 7f9f24ff9640 1 -- 172.21.15.67:0/522642313 --> [v2:172.21.15.67:6800/2616951131,v1:172.21.15.67:6801/2616951131] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9f300e7b40 con 0x7f9f180740a0 2024-04-25T02:28:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.462+0000 7fa06ceb3640 1 -- 172.21.15.67:0/2712832343 --> [v2:172.21.15.176:6800/660324040,v1:172.21.15.176:6801/660324040] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa06809bd10 con 0x7fa0480740a0 2024-04-25T02:28:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.462+0000 7efff3012640 1 -- 172.21.15.67:0/581566145 --> [v2:172.21.15.176:6808/4103155408,v1:172.21.15.176:6809/4103155408] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7effec0d1c70 con 0x7effd80741b0 2024-04-25T02:28:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.462+0000 7f1e7eea7640 1 -- 172.21.15.67:0/3923255065 --> [v2:172.21.15.176:6818/828255462,v1:172.21.15.176:6819/828255462] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1e60002d50 con 0x7f1e5c0740a0 2024-04-25T02:28:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.463+0000 7f9f26ffd640 1 -- 172.21.15.67:0/522642313 <== osd.1 v2:172.21.15.67:6800/2616951131 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9f300e7b40 con 0x7f9f180740a0 2024-04-25T02:28:32.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.463+0000 7effe97fa640 1 -- 172.21.15.67:0/581566145 <== osd.6 v2:172.21.15.176:6808/4103155408 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7effec0d1c70 con 0x7effd80741b0 2024-04-25T02:28:32.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.463+0000 7f1e6e7fc640 1 -- 172.21.15.67:0/3923255065 <== osd.4 v2:172.21.15.176:6818/828255462 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1e60002d50 con 0x7f1e5c0740a0 2024-04-25T02:28:32.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.463+0000 7f9f24ff9640 1 -- 172.21.15.67:0/522642313 >> [v2:172.21.15.67:6800/2616951131,v1:172.21.15.67:6801/2616951131] conn(0x7f9f180740a0 msgr2=0x7f9f180764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.463+0000 7f9f24ff9640 1 --2- 172.21.15.67:0/522642313 >> [v2:172.21.15.67:6800/2616951131,v1:172.21.15.67:6801/2616951131] conn(0x7f9f180740a0 0x7f9f180764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.463+0000 7f9f24ff9640 1 -- 172.21.15.67:0/522642313 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9f1806be80 msgr2=0x7f9f1806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.463+0000 7f9f24ff9640 1 --2- 172.21.15.67:0/522642313 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9f1806be80 0x7f9f1806e340 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f30178880 tx=0x7f9f28008040 comp rx=0 tx=0).stop 2024-04-25T02:28:32.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.464+0000 7f9f24ff9640 1 -- 172.21.15.67:0/522642313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f300d5000 msgr2=0x7f9f300daed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.464+0000 7f9f24ff9640 1 --2- 172.21.15.67:0/522642313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f300d5000 0x7f9f300daed0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9f3802d700 tx=0x7f9f380754c0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.464+0000 7f9f36d9d640 1 -- 172.21.15.67:0/522642313 reap_dead start 2024-04-25T02:28:32.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.464+0000 7effd2ffd640 1 -- 172.21.15.67:0/581566145 >> [v2:172.21.15.176:6808/4103155408,v1:172.21.15.176:6809/4103155408] conn(0x7effd80741b0 msgr2=0x7effd80765d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.464+0000 7f9f24ff9640 1 -- 172.21.15.67:0/522642313 shutdown_connections 2024-04-25T02:28:32.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.464+0000 7f9f24ff9640 1 -- 172.21.15.67:0/522642313 >> 172.21.15.67:0/522642313 conn(0x7f9f300559e0 msgr2=0x7f9f300e0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.464+0000 7effd2ffd640 1 --2- 172.21.15.67:0/581566145 >> [v2:172.21.15.176:6808/4103155408,v1:172.21.15.176:6809/4103155408] conn(0x7effd80741b0 0x7effd80765d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.464+0000 7f9f24ff9640 1 -- 172.21.15.67:0/522642313 shutdown_connections 2024-04-25T02:28:32.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.464+0000 7f9f24ff9640 1 -- 172.21.15.67:0/522642313 wait complete. 2024-04-25T02:28:32.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.464+0000 7f1e7eea7640 1 -- 172.21.15.67:0/3923255065 >> [v2:172.21.15.176:6818/828255462,v1:172.21.15.176:6819/828255462] conn(0x7f1e5c0740a0 msgr2=0x7f1e5c0764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.464+0000 7f1e7eea7640 1 --2- 172.21.15.67:0/3923255065 >> [v2:172.21.15.176:6818/828255462,v1:172.21.15.176:6819/828255462] conn(0x7f1e5c0740a0 0x7f1e5c0764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.464+0000 7fa056ffd640 1 -- 172.21.15.67:0/2712832343 <== osd.5 v2:172.21.15.176:6800/660324040 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa06809bd10 con 0x7fa0480740a0 2024-04-25T02:28:32.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.464+0000 7effd2ffd640 1 -- 172.21.15.67:0/581566145 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7effd806bf30 msgr2=0x7effd806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.464+0000 7effd2ffd640 1 --2- 172.21.15.67:0/581566145 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7effd806bf30 0x7effd806e3f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7effdc0094a0 tx=0x7effdc008040 comp rx=0 tx=0).stop 2024-04-25T02:28:32.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.464+0000 7effd2ffd640 1 -- 172.21.15.67:0/581566145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7effec15af70 msgr2=0x7effec14f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.464+0000 7effd2ffd640 1 --2- 172.21.15.67:0/581566145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7effec15af70 0x7effec14f9e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7effe000c3c0 tx=0x7effe000c880 comp rx=0 tx=0).stop 2024-04-25T02:28:32.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.464+0000 7efff15af640 1 -- 172.21.15.67:0/581566145 reap_dead start 2024-04-25T02:28:32.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7f1e7eea7640 1 -- 172.21.15.67:0/3923255065 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f1e5c06be80 msgr2=0x7f1e5c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7f1e7eea7640 1 --2- 172.21.15.67:0/3923255065 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f1e5c06be80 0x7f1e5c06e340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1e700e21c0 tx=0x7f1e74009190 comp rx=0 tx=0).stop 2024-04-25T02:28:32.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7f1e7eea7640 1 -- 172.21.15.67:0/3923255065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e700e2290 msgr2=0x7f1e7004e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7f1e7eea7640 1 --2- 172.21.15.67:0/3923255065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e700e2290 0x7f1e7004e410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1e780502b0 tx=0x7f1e78073730 comp rx=0 tx=0).stop 2024-04-25T02:28:32.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7f1e7e6a6640 1 -- 172.21.15.67:0/3923255065 reap_dead start 2024-04-25T02:28:32.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7f1e7eea7640 1 -- 172.21.15.67:0/3923255065 shutdown_connections 2024-04-25T02:28:32.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7f1e7eea7640 1 -- 172.21.15.67:0/3923255065 >> 172.21.15.67:0/3923255065 conn(0x7f1e70055350 msgr2=0x7f1e700dd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7fa06ceb3640 1 -- 172.21.15.67:0/2712832343 >> [v2:172.21.15.176:6800/660324040,v1:172.21.15.176:6801/660324040] conn(0x7fa0480740a0 msgr2=0x7fa0480764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7effd2ffd640 1 -- 172.21.15.67:0/581566145 shutdown_connections 2024-04-25T02:28:32.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7effd2ffd640 1 -- 172.21.15.67:0/581566145 >> 172.21.15.67:0/581566145 conn(0x7effec0d0e00 msgr2=0x7effec0af970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7fa06ceb3640 1 --2- 172.21.15.67:0/2712832343 >> [v2:172.21.15.176:6800/660324040,v1:172.21.15.176:6801/660324040] conn(0x7fa0480740a0 0x7fa0480764c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7effd2ffd640 1 -- 172.21.15.67:0/581566145 shutdown_connections 2024-04-25T02:28:32.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7effd2ffd640 1 -- 172.21.15.67:0/581566145 wait complete. 2024-04-25T02:28:32.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7fa06ceb3640 1 -- 172.21.15.67:0/2712832343 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa04806bf00 msgr2=0x7fa04806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7fa06ceb3640 1 --2- 172.21.15.67:0/2712832343 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa04806bf00 0x7fa04806e3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa060004bf0 tx=0x7fa060009040 comp rx=0 tx=0).stop 2024-04-25T02:28:32.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7fa06ceb3640 1 -- 172.21.15.67:0/2712832343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0681f0fb0 msgr2=0x7fa06809aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7fa06ceb3640 1 --2- 172.21.15.67:0/2712832343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0681f0fb0 0x7fa06809aa70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa05800e930 tx=0x7fa05800edf0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7fa066d9d640 1 -- 172.21.15.67:0/2712832343 reap_dead start 2024-04-25T02:28:32.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7f1e7eea7640 1 -- 172.21.15.67:0/3923255065 shutdown_connections 2024-04-25T02:28:32.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7f1e7eea7640 1 -- 172.21.15.67:0/3923255065 wait complete. 2024-04-25T02:28:32.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.465+0000 7fa06ceb3640 1 -- 172.21.15.67:0/2712832343 shutdown_connections 2024-04-25T02:28:32.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.466+0000 7fa06ceb3640 1 -- 172.21.15.67:0/2712832343 >> 172.21.15.67:0/2712832343 conn(0x7fa0680b19c0 msgr2=0x7fa0680b45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.466+0000 7fa06ceb3640 1 -- 172.21.15.67:0/2712832343 shutdown_connections 2024-04-25T02:28:32.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.466+0000 7fa06ceb3640 1 -- 172.21.15.67:0/2712832343 wait complete. 2024-04-25T02:28:32.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.466+0000 7fe802ffd640 1 -- 172.21.15.67:0/3748528568 --> [v2:172.21.15.67:6810/4042772984,v1:172.21.15.67:6812/4042772984] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe7f0002dd0 con 0x7fe7fc074130 2024-04-25T02:28:32.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.467+0000 7fe8157fa640 1 -- 172.21.15.67:0/3748528568 <== osd.0 v2:172.21.15.67:6810/4042772984 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe7f0002dd0 con 0x7fe7fc074130 2024-04-25T02:28:32.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.467+0000 7fe802ffd640 1 -- 172.21.15.67:0/3748528568 >> [v2:172.21.15.67:6810/4042772984,v1:172.21.15.67:6812/4042772984] conn(0x7fe7fc074130 msgr2=0x7fe7fc076550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.467+0000 7fe802ffd640 1 --2- 172.21.15.67:0/3748528568 >> [v2:172.21.15.67:6810/4042772984,v1:172.21.15.67:6812/4042772984] conn(0x7fe7fc074130 0x7fe7fc076550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.468+0000 7f29b3cbd640 1 -- 172.21.15.67:0/4160019343 --> [v2:172.21.15.176:6816/1381219465,v1:172.21.15.176:6817/1381219465] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f29ac075750 con 0x7f29900740b0 2024-04-25T02:28:32.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.468+0000 7fe802ffd640 1 -- 172.21.15.67:0/3748528568 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe7fc06bf30 msgr2=0x7fe7fc06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.468+0000 7fe802ffd640 1 --2- 172.21.15.67:0/3748528568 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe7fc06bf30 0x7fe7fc06e3f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe810050000 tx=0x7fe804008040 comp rx=0 tx=0).stop 2024-04-25T02:28:32.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.468+0000 7fe802ffd640 1 -- 172.21.15.67:0/3748528568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8100d6800 msgr2=0x7fe810174e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.468+0000 7fe802ffd640 1 --2- 172.21.15.67:0/3748528568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8100d6800 0x7fe810174e80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe80c02e210 tx=0x7fe80c0018f0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.468+0000 7fe81d492640 1 -- 172.21.15.67:0/3748528568 reap_dead start 2024-04-25T02:28:32.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.468+0000 7fe802ffd640 1 -- 172.21.15.67:0/3748528568 shutdown_connections 2024-04-25T02:28:32.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.468+0000 7fe802ffd640 1 -- 172.21.15.67:0/3748528568 >> 172.21.15.67:0/3748528568 conn(0x7fe810059010 msgr2=0x7fe8100e5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.468+0000 7fe802ffd640 1 -- 172.21.15.67:0/3748528568 shutdown_connections 2024-04-25T02:28:32.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.469+0000 7f29a27fc640 1 -- 172.21.15.67:0/4160019343 <== osd.7 v2:172.21.15.176:6816/1381219465 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f29ac075750 con 0x7f29900740b0 2024-04-25T02:28:32.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.469+0000 7fe802ffd640 1 -- 172.21.15.67:0/3748528568 wait complete. 2024-04-25T02:28:32.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.469+0000 7f29b3cbd640 1 -- 172.21.15.67:0/4160019343 >> [v2:172.21.15.176:6816/1381219465,v1:172.21.15.176:6817/1381219465] conn(0x7f29900740b0 msgr2=0x7f29900764d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.469+0000 7f29b3cbd640 1 --2- 172.21.15.67:0/4160019343 >> [v2:172.21.15.176:6816/1381219465,v1:172.21.15.176:6817/1381219465] conn(0x7f29900740b0 0x7f29900764d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.470+0000 7f29b3cbd640 1 -- 172.21.15.67:0/4160019343 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f299006be30 msgr2=0x7f299006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.470+0000 7f29b3cbd640 1 --2- 172.21.15.67:0/4160019343 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f299006be30 0x7f299006e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f299c009560 tx=0x7f299c02e000 comp rx=0 tx=0).stop 2024-04-25T02:28:32.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.470+0000 7f29b3cbd640 1 -- 172.21.15.67:0/4160019343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29ac15c3d0 msgr2=0x7f29ac0c8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.470+0000 7f29b3cbd640 1 --2- 172.21.15.67:0/4160019343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29ac15c3d0 0x7f29ac0c8340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f29a40012e0 tx=0x7f29a400a430 comp rx=0 tx=0).stop 2024-04-25T02:28:32.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.470+0000 7f29b225a640 1 -- 172.21.15.67:0/4160019343 reap_dead start 2024-04-25T02:28:32.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.470+0000 7f29b3cbd640 1 -- 172.21.15.67:0/4160019343 shutdown_connections 2024-04-25T02:28:32.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.470+0000 7f29b3cbd640 1 -- 172.21.15.67:0/4160019343 >> 172.21.15.67:0/4160019343 conn(0x7f29ac09aa70 msgr2=0x7f29ac09ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.471+0000 7f29b3cbd640 1 -- 172.21.15.67:0/4160019343 shutdown_connections 2024-04-25T02:28:32.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.471+0000 7f29b3cbd640 1 -- 172.21.15.67:0/4160019343 wait complete. 2024-04-25T02:28:32.538 INFO:teuthology.orchestra.run.smithi067.stdout:55834574855 2024-04-25T02:28:32.539 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:28:32.540 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2024-04-25T02:28:32.540 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:28:32.541 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2024-04-25T02:28:32.541 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:28:32.541 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2024-04-25T02:28:32.542 INFO:teuthology.orchestra.run.smithi067.stdout:55834574855 2024-04-25T02:28:32.542 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T02:28:32.543 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T02:28:32.544 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2024-04-25T02:28:32.544 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T02:28:32.545 INFO:teuthology.orchestra.run.smithi067.stdout:55834574853 2024-04-25T02:28:32.545 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T02:28:32.546 INFO:teuthology.orchestra.run.smithi067.stdout:55834574855 2024-04-25T02:28:32.546 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:28:32.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.748+0000 7fa38359e640 1 Processor -- start 2024-04-25T02:28:32.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.748+0000 7fa38359e640 1 -- start start 2024-04-25T02:28:32.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.748+0000 7f3094b48640 1 Processor -- start 2024-04-25T02:28:32.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.749+0000 7fa38359e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa38406dc70 0x7fa38416b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.749+0000 7f3094b48640 1 -- start start 2024-04-25T02:28:32.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.750+0000 7f3094b48640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f30900ca430 0x7f30900ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.750+0000 7f3094b48640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f309013fbd0 0x7f3090140000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.750+0000 7f3094b48640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f309015a590 con 0x7f309015b3b0 2024-04-25T02:28:32.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.750+0000 7f3094b48640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f30900cae00 con 0x7f309013fbd0 2024-04-25T02:28:32.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.750+0000 7f3094b48640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3090140900 con 0x7f30900ca430 2024-04-25T02:28:32.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.750+0000 7fa38259c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa38406dc70 0x7fa38416b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.750+0000 7fa38259c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa38406dc70 0x7fa38416b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54366/0 (socket says 172.21.15.67:54366) 2024-04-25T02:28:32.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.750+0000 7f308e59c640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f309015b3b0 0x7f30900cd820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:42474/0 (socket says 172.21.15.67:42474) 2024-04-25T02:28:32.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.750+0000 7f308e59c640 1 -- 172.21.15.67:0/837492956 learned_addr learned my addr 172.21.15.67:0/837492956 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:32.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.750+0000 7f308ed9d640 1 --2- 172.21.15.67:0/837492956 >> v2:172.21.15.67:3300/0 conn(0x7f309013fbd0 0x7f3090140000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.750+0000 7fa38259c640 1 -- 172.21.15.67:0/2058312952 learned_addr learned my addr 172.21.15.67:0/2058312952 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.750+0000 7fa38359e640 1 -- 172.21.15.67:0/2058312952 --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa38416bed0 con 0x7fa38416f110 2024-04-25T02:28:32.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.750+0000 7fa38359e640 1 -- 172.21.15.67:0/2058312952 --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa38416c1b0 con 0x7fa38406e450 2024-04-25T02:28:32.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.750+0000 7fa38359e640 1 -- 172.21.15.67:0/2058312952 --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa38416b9c0 con 0x7fa38406dc70 2024-04-25T02:28:32.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.750+0000 7fa38259c640 1 -- 172.21.15.67:0/2058312952 >> v1:172.21.15.176:6789/0 conn(0x7fa38406e450 legacy=0x7fa384161e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T02:28:32.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.750+0000 7fa38259c640 1 -- 172.21.15.67:0/2058312952 >> v1:172.21.15.67:6789/0 conn(0x7fa38416f110 legacy=0x7fa38406cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:28:32.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.751+0000 7f308d59a640 1 -- 172.21.15.67:0/837492956 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3050146923 0 0) 0x7f309015a590 con 0x7f309015b3b0 2024-04-25T02:28:32.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.751+0000 7f308d59a640 1 -- 172.21.15.67:0/837492956 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3078003520 con 0x7f309015b3b0 2024-04-25T02:28:32.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.751+0000 7f308ed9d640 1 -- 172.21.15.67:0/837492956 >> v2:172.21.15.176:3300/0 conn(0x7f30900ca430 msgr2=0x7f30900ca8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T02:28:32.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.751+0000 7f308ed9d640 1 --2- 172.21.15.67:0/837492956 >> v2:172.21.15.176:3300/0 conn(0x7f30900ca430 0x7f30900ca8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.751+0000 7f308ed9d640 1 -- 172.21.15.67:0/837492956 >> v1:172.21.15.176:6789/0 conn(0x7f309015b3b0 legacy=0x7f30900cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.751+0000 7f308ed9d640 1 -- 172.21.15.67:0/837492956 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309006caa0 con 0x7f309013fbd0 2024-04-25T02:28:32.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.751+0000 7fa38259c640 1 -- 172.21.15.67:0/2058312952 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38416ebf0 con 0x7fa38406dc70 2024-04-25T02:28:32.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.752+0000 7f922f2f5640 1 Processor -- start 2024-04-25T02:28:32.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.752+0000 7fa38259c640 1 --2- 172.21.15.67:0/2058312952 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa38406dc70 0x7fa38416b480 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0098b0 tx=0x7fa37c02a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55bf2dcd9db4c474 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.752+0000 7f922f2f5640 1 -- start start 2024-04-25T02:28:32.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.752+0000 7f308ed9d640 1 --2- 172.21.15.67:0/837492956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f309013fbd0 0x7f3090140000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f30900af780 tx=0x7f308002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39c84f5634a82d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.753+0000 7f308d59a640 1 -- 172.21.15.67:0/837492956 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3080037070 con 0x7f309013fbd0 2024-04-25T02:28:32.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.753+0000 7f308d59a640 1 -- 172.21.15.67:0/837492956 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3080032440 con 0x7f309013fbd0 2024-04-25T02:28:32.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.753+0000 7f308d59a640 1 -- 172.21.15.67:0/837492956 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3080032810 con 0x7f309013fbd0 2024-04-25T02:28:32.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.753+0000 7f91e5bf9640 1 Processor -- start 2024-04-25T02:28:32.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.753+0000 7f91e5bf9640 1 -- start start 2024-04-25T02:28:32.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.752+0000 7fa38159a640 1 -- 172.21.15.67:0/2058312952 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c036070 con 0x7fa38406dc70 2024-04-25T02:28:32.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.753+0000 7fa38159a640 1 -- 172.21.15.67:0/2058312952 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa37c0077d0 con 0x7fa38406dc70 2024-04-25T02:28:32.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.753+0000 7fa38159a640 1 -- 172.21.15.67:0/2058312952 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c007ba0 con 0x7fa38406dc70 2024-04-25T02:28:32.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.753+0000 7f67dd81c640 1 Processor -- start 2024-04-25T02:28:32.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.753+0000 7f67dd81c640 1 -- start start 2024-04-25T02:28:32.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.753+0000 7f922f2f5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f922004b3c0 0x7f9220034020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.753+0000 7f922f2f5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f922004f4d0 0x7f922004f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.753+0000 7f922f2f5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f922004fe90 0x7f92200eb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.753+0000 7f922f2f5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f92200062e0 con 0x7f922004b3c0 2024-04-25T02:28:32.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.753+0000 7f922f2f5640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9220054c10 con 0x7f922004f4d0 2024-04-25T02:28:32.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.753+0000 7f922f2f5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9220053a50 con 0x7f922004fe90 2024-04-25T02:28:32.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.753+0000 7fa38359e640 1 -- 172.21.15.67:0/2058312952 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa38406dc70 msgr2=0x7fa38416b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.753+0000 7fa38359e640 1 --2- 172.21.15.67:0/2058312952 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa38406dc70 0x7fa38416b480 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0098b0 tx=0x7fa37c02a7b0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.754+0000 7f922d892640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f922004fe90 0x7f92200eb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.754+0000 7f922d091640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f922004b3c0 0x7f9220034020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.754+0000 7f922c890640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f922004f4d0 0x7f922004f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.754+0000 7fa38359e640 1 -- 172.21.15.67:0/2058312952 shutdown_connections 2024-04-25T02:28:32.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.754+0000 7fa38359e640 1 --2- 172.21.15.67:0/2058312952 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa38406dc70 0x7fa38416b480 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.754+0000 7fa38359e640 1 -- 172.21.15.67:0/2058312952 >> 172.21.15.67:0/2058312952 conn(0x7fa3840b1ac0 msgr2=0x7fa3840b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.754+0000 7fa38359e640 1 -- 172.21.15.67:0/2058312952 shutdown_connections 2024-04-25T02:28:32.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.754+0000 7fa38359e640 1 -- 172.21.15.67:0/2058312952 wait complete. 2024-04-25T02:28:32.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.754+0000 7f922d892640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f922004fe90 0x7f92200eb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:47082/0 (socket says 172.21.15.67:47082) 2024-04-25T02:28:32.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.754+0000 7f922d892640 1 -- 172.21.15.67:0/1800992252 learned_addr learned my addr 172.21.15.67:0/1800992252 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7fadee8ff640 1 Processor -- start 2024-04-25T02:28:32.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7f91e5bf9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f91e015d0c0 0x7f91e006de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7f91e5bf9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91e006e370 0x7f91e006b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7f91e5bf9640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e006f690 con 0x7f91e0145800 2024-04-25T02:28:32.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7f67dd81c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67d806b0c0 0x7f67d806b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7f91e5bf9640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f91e006f970 con 0x7f91e015d0c0 2024-04-25T02:28:32.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7f91e5bf9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f91e006fc50 con 0x7f91e006e370 2024-04-25T02:28:32.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7f91deffd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f91e015d0c0 0x7f91e006de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7f91dffff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91e006e370 0x7f91e006b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7f91deffd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f91e015d0c0 0x7f91e006de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:53874/0 (socket says 172.21.15.67:53874) 2024-04-25T02:28:32.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7f91deffd640 1 -- 172.21.15.67:0/4104358177 learned_addr learned my addr 172.21.15.67:0/4104358177 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7f67dd81c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d806f690 con 0x7f67d815d0c0 2024-04-25T02:28:32.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7f67dd81c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d806f970 con 0x7f67d8145800 2024-04-25T02:28:32.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7f67dd81c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f67d806fc50 con 0x7f67d806b0c0 2024-04-25T02:28:32.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7f91deffd640 1 -- 172.21.15.67:0/4104358177 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91e006e370 msgr2=0x7f91e006b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7f91deffd640 1 --2- 172.21.15.67:0/4104358177 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91e006e370 0x7f91e006b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7f91deffd640 1 -- 172.21.15.67:0/4104358177 >> v1:172.21.15.176:6789/0 conn(0x7f91e0145800 legacy=0x7f91e00c72a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:28:32.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f3094b48640 1 -- 172.21.15.67:0/837492956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f309013fbd0 msgr2=0x7f3090140000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f3094b48640 1 --2- 172.21.15.67:0/837492956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f309013fbd0 0x7f3090140000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f30900af780 tx=0x7f308002a1c0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f3094b48640 1 -- 172.21.15.67:0/837492956 shutdown_connections 2024-04-25T02:28:32.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f3094b48640 1 --2- 172.21.15.67:0/837492956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f309013fbd0 0x7f3090140000 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f3094b48640 1 --2- 172.21.15.67:0/837492956 >> v2:172.21.15.176:3300/0 conn(0x7f30900ca430 0x7f30900ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f3094b48640 1 -- 172.21.15.67:0/837492956 >> 172.21.15.67:0/837492956 conn(0x7f30900cfc50 msgr2=0x7f30900d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7fadee8ff640 1 -- start start 2024-04-25T02:28:32.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f67d6ffd640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f67d8145800 0x7f67d80c72a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:42482/0 (socket says 172.21.15.67:42482) 2024-04-25T02:28:32.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f67d6ffd640 1 -- 172.21.15.67:0/688407568 learned_addr learned my addr 172.21.15.67:0/688407568 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:32.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f67d77fe640 1 --2- 172.21.15.67:0/688407568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67d806b0c0 0x7f67d806b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f67d5ffb640 1 -- 172.21.15.67:0/688407568 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3190805942 0 0) 0x7f67d806f970 con 0x7f67d8145800 2024-04-25T02:28:32.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f062ce6d640 1 Processor -- start 2024-04-25T02:28:32.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.754+0000 7f922d892640 1 -- 172.21.15.67:0/1800992252 >> v2:172.21.15.176:3300/0 conn(0x7f922004f4d0 msgr2=0x7f922004f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.754+0000 7f922d892640 1 --2- 172.21.15.67:0/1800992252 >> v2:172.21.15.176:3300/0 conn(0x7f922004f4d0 0x7f922004f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.754+0000 7f922d892640 1 -- 172.21.15.67:0/1800992252 >> v2:172.21.15.67:3300/0 conn(0x7f922004b3c0 msgr2=0x7f9220034020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.754+0000 7f922d892640 1 --2- 172.21.15.67:0/1800992252 >> v2:172.21.15.67:3300/0 conn(0x7f922004b3c0 0x7f9220034020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.754+0000 7f922d892640 1 -- 172.21.15.67:0/1800992252 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9220053d30 con 0x7f922004fe90 2024-04-25T02:28:32.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f922c890640 1 --2- 172.21.15.67:0/1800992252 >> v2:172.21.15.176:3300/0 conn(0x7f922004f4d0 0x7f922004f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:32.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f922d892640 1 --2- 172.21.15.67:0/1800992252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f922004fe90 0x7f92200eb260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f92200487d0 tx=0x7f921802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c87cce1dd1900b2a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.755+0000 7f91deffd640 1 -- 172.21.15.67:0/4104358177 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e015fb60 con 0x7f91e015d0c0 2024-04-25T02:28:32.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7fa38359e640 1 Processor -- start 2024-04-25T02:28:32.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f67d5ffb640 1 -- 172.21.15.67:0/688407568 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67c0003520 con 0x7f67d8145800 2024-04-25T02:28:32.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7fa38359e640 1 -- start start 2024-04-25T02:28:32.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7fadee8ff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fade806e5a0 0x7fade80cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7fadee8ff640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade80cf890 con 0x7fade80ccaa0 2024-04-25T02:28:32.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7fadee8ff640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade8166600 con 0x7fade806e1c0 2024-04-25T02:28:32.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7fadee8ff640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fade81663b0 con 0x7fade806e5a0 2024-04-25T02:28:32.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f062ce6d640 1 -- start start 2024-04-25T02:28:32.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f91deffd640 1 --2- 172.21.15.67:0/4104358177 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e015d0c0 0x7f91e006de30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f91d400f9e0 tx=0x7f91d402e530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d29dfdd5ba934a64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.757+0000 7fadee0fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fade80ccaa0 0x7fade8071d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49372/0 (socket says 172.21.15.67:49372) 2024-04-25T02:28:32.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.757+0000 7faded0fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fade806e5a0 0x7fade80cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.757+0000 7fadee0fe640 1 -- 172.21.15.67:0/4217539956 learned_addr learned my addr 172.21.15.67:0/4217539956 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:32.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f67d77fe640 1 -- 172.21.15.67:0/688407568 >> v1:172.21.15.176:6789/0 conn(0x7f67d8145800 legacy=0x7f67d80c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f67d77fe640 1 -- 172.21.15.67:0/688407568 >> v1:172.21.15.67:6789/0 conn(0x7f67d815d0c0 legacy=0x7f67d806de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.756+0000 7f67d77fe640 1 -- 172.21.15.67:0/688407568 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d815fb60 con 0x7f67d806b0c0 2024-04-25T02:28:32.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.757+0000 7f921ffff640 1 -- 172.21.15.67:0/1800992252 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218037070 con 0x7f922004fe90 2024-04-25T02:28:32.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.757+0000 7f921ffff640 1 -- 172.21.15.67:0/1800992252 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9218032440 con 0x7f922004fe90 2024-04-25T02:28:32.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.757+0000 7f921ffff640 1 -- 172.21.15.67:0/1800992252 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92180327f0 con 0x7f922004fe90 2024-04-25T02:28:32.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.757+0000 7f91de7fc640 1 -- 172.21.15.67:0/4104358177 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d403a070 con 0x7f91e015d0c0 2024-04-25T02:28:32.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.757+0000 7f91de7fc640 1 -- 172.21.15.67:0/4104358177 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d4033710 con 0x7f91e015d0c0 2024-04-25T02:28:32.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.757+0000 7f91de7fc640 1 -- 172.21.15.67:0/4104358177 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d4033ae0 con 0x7f91e015d0c0 2024-04-25T02:28:32.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.757+0000 7faded0fc640 1 -- 172.21.15.67:0/4217539956 >> v1:172.21.15.176:6789/0 conn(0x7fade806e1c0 legacy=0x7fade80cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.757+0000 7faded0fc640 1 -- 172.21.15.67:0/4217539956 >> v1:172.21.15.67:6789/0 conn(0x7fade80ccaa0 legacy=0x7fade8071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.757+0000 7f3094b48640 1 -- 172.21.15.67:0/837492956 shutdown_connections 2024-04-25T02:28:32.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.757+0000 7faded0fc640 1 -- 172.21.15.67:0/4217539956 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade81668e0 con 0x7fade806e5a0 2024-04-25T02:28:32.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f3094b48640 1 -- 172.21.15.67:0/837492956 wait complete. 2024-04-25T02:28:32.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f062ce6d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f062815af70 0x7f06280b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f062ce6d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f062815f4c0 0x7f06280addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f922f2f5640 1 -- 172.21.15.67:0/1800992252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f922004fe90 msgr2=0x7f92200eb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f922f2f5640 1 --2- 172.21.15.67:0/1800992252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f922004fe90 0x7f92200eb260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f92200487d0 tx=0x7f921802a210 comp rx=0 tx=0).stop 2024-04-25T02:28:32.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f91e5bf9640 1 -- 172.21.15.67:0/4104358177 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e015d0c0 msgr2=0x7f91e006de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f91e5bf9640 1 --2- 172.21.15.67:0/4104358177 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e015d0c0 0x7f91e006de30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f91d400f9e0 tx=0x7f91d402e530 comp rx=0 tx=0).stop 2024-04-25T02:28:32.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f062659c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f062815af70 0x7f06280b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f062659c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f062815af70 0x7f06280b3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:53886/0 (socket says 172.21.15.67:53886) 2024-04-25T02:28:32.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f062659c640 1 -- 172.21.15.67:0/3274002159 learned_addr learned my addr 172.21.15.67:0/3274002159 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f062ce6d640 1 --2- 172.21.15.67:0/3274002159 >> v2:172.21.15.67:3300/0 conn(0x7f06280b5ee0 0x7f06280ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f922f2f5640 1 -- 172.21.15.67:0/1800992252 shutdown_connections 2024-04-25T02:28:32.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f922f2f5640 1 --2- 172.21.15.67:0/1800992252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f922004fe90 0x7f92200eb260 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f922f2f5640 1 --2- 172.21.15.67:0/1800992252 >> v2:172.21.15.176:3300/0 conn(0x7f922004f4d0 0x7f922004f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f922f2f5640 1 --2- 172.21.15.67:0/1800992252 >> v2:172.21.15.67:3300/0 conn(0x7f922004b3c0 0x7f9220034020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f922f2f5640 1 -- 172.21.15.67:0/1800992252 >> 172.21.15.67:0/1800992252 conn(0x7f922000a400 msgr2=0x7f922000a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f062ce6d640 1 -- 172.21.15.67:0/3274002159 --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f062806f590 con 0x7f06280b5ee0 2024-04-25T02:28:32.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f91e5bf9640 1 -- 172.21.15.67:0/4104358177 shutdown_connections 2024-04-25T02:28:32.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f91e5bf9640 1 --2- 172.21.15.67:0/4104358177 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91e006e370 0x7f91e006b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f91e5bf9640 1 --2- 172.21.15.67:0/4104358177 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e015d0c0 0x7f91e006de30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f91e5bf9640 1 -- 172.21.15.67:0/4104358177 >> 172.21.15.67:0/4104358177 conn(0x7f91e00b2850 msgr2=0x7f91e00b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f062ce6d640 1 -- 172.21.15.67:0/3274002159 --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f062815b350 con 0x7f062815af70 2024-04-25T02:28:32.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f062ce6d640 1 -- 172.21.15.67:0/3274002159 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f062815f9c0 con 0x7f062815f4c0 2024-04-25T02:28:32.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f91e5bf9640 1 -- 172.21.15.67:0/4104358177 shutdown_connections 2024-04-25T02:28:32.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f0626d9d640 1 --2- 172.21.15.67:0/3274002159 >> v2:172.21.15.67:3300/0 conn(0x7f06280b5ee0 0x7f06280ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f922f2f5640 1 -- 172.21.15.67:0/1800992252 shutdown_connections 2024-04-25T02:28:32.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f91e5bf9640 1 -- 172.21.15.67:0/4104358177 wait complete. 2024-04-25T02:28:32.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7faded0fc640 1 --2- 172.21.15.67:0/4217539956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fade806e5a0 0x7fade80cc560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fade40097a0 tx=0x7fade402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a7bdaa228d99b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f67d77fe640 1 --2- 172.21.15.67:0/688407568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67d806b0c0 0x7f67d806b550 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009800 tx=0x7f67c802a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15cab27e05ee6a6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f0625d9b640 1 --2- 172.21.15.67:0/3274002159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f062815f4c0 0x7f06280addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.759+0000 7f6fd4190640 1 Processor -- start 2024-04-25T02:28:32.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.759+0000 7f67d5ffb640 1 -- 172.21.15.67:0/688407568 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c8037070 con 0x7f67d806b0c0 2024-04-25T02:28:32.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.759+0000 7f0626d9d640 1 -- 172.21.15.67:0/3274002159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f062815f4c0 msgr2=0x7f06280addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.759+0000 7f0626d9d640 1 --2- 172.21.15.67:0/3274002159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f062815f4c0 0x7f06280addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.759+0000 7f0626d9d640 1 -- 172.21.15.67:0/3274002159 >> v2:172.21.15.176:3300/0 conn(0x7f062815af70 msgr2=0x7f06280b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:32.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.759+0000 7f0626d9d640 1 --2- 172.21.15.67:0/3274002159 >> v2:172.21.15.176:3300/0 conn(0x7f062815af70 0x7f06280b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7f3094b48640 1 Processor -- start 2024-04-25T02:28:32.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7f3094b48640 1 -- start start 2024-04-25T02:28:32.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.759+0000 7fadec8fb640 1 -- 172.21.15.67:0/4217539956 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4037070 con 0x7fade806e5a0 2024-04-25T02:28:32.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.759+0000 7fadec8fb640 1 -- 172.21.15.67:0/4217539956 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade4032440 con 0x7fade806e5a0 2024-04-25T02:28:32.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.759+0000 7f67d5ffb640 1 -- 172.21.15.67:0/688407568 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c8032440 con 0x7f67d806b0c0 2024-04-25T02:28:32.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.759+0000 7f67d5ffb640 1 -- 172.21.15.67:0/688407568 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c8032810 con 0x7f67d806b0c0 2024-04-25T02:28:32.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.759+0000 7f0626d9d640 1 -- 172.21.15.67:0/3274002159 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062806ec60 con 0x7f06280b5ee0 2024-04-25T02:28:32.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.759+0000 7f062659c640 1 --2- 172.21.15.67:0/3274002159 >> v2:172.21.15.176:3300/0 conn(0x7f062815af70 0x7f06280b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:32.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.759+0000 7f6fd4190640 1 -- start start 2024-04-25T02:28:32.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7f67dd81c640 1 -- 172.21.15.67:0/688407568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67d806b0c0 msgr2=0x7f67d806b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7f67dd81c640 1 --2- 172.21.15.67:0/688407568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67d806b0c0 0x7f67d806b550 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009800 tx=0x7f67c802a1e0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7f91e5bf9640 1 Processor -- start 2024-04-25T02:28:32.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7fadec8fb640 1 -- 172.21.15.67:0/4217539956 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4032810 con 0x7fade806e5a0 2024-04-25T02:28:32.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.758+0000 7f922f2f5640 1 -- 172.21.15.67:0/1800992252 wait complete. 2024-04-25T02:28:32.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7f0626d9d640 1 --2- 172.21.15.67:0/3274002159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06280b5ee0 0x7f06280ae2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0628074e80 tx=0x7f061802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a5fd0dd07d213c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7f67dd81c640 1 -- 172.21.15.67:0/688407568 shutdown_connections 2024-04-25T02:28:32.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7f67dd81c640 1 --2- 172.21.15.67:0/688407568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67d806b0c0 0x7f67d806b550 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7f67dd81c640 1 -- 172.21.15.67:0/688407568 >> 172.21.15.67:0/688407568 conn(0x7f67d80b2850 msgr2=0x7f67d80b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7fadee8ff640 1 -- 172.21.15.67:0/4217539956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fade806e5a0 msgr2=0x7fade80cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7fadee8ff640 1 --2- 172.21.15.67:0/4217539956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fade806e5a0 0x7fade80cc560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fade40097a0 tx=0x7fade402a230 comp rx=0 tx=0).stop 2024-04-25T02:28:32.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7f6fd4190640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fcc070df0 0x7f6fcc071250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7f6fd4190640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fcc0b4fe0 con 0x7f6fcc15cbf0 2024-04-25T02:28:32.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7f6fd4190640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fcc06d5c0 con 0x7f6fcc16a5a0 2024-04-25T02:28:32.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7f6fd4190640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6fcc071790 con 0x7f6fcc070df0 2024-04-25T02:28:32.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7f91e5bf9640 1 -- start start 2024-04-25T02:28:32.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7f67dd81c640 1 -- 172.21.15.67:0/688407568 shutdown_connections 2024-04-25T02:28:32.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7f922f2f5640 1 Processor -- start 2024-04-25T02:28:32.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7fa38359e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa38406dc70 0x7fa384163f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7fa38359e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa38406e450 0x7fa384162580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7fa38359e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa38416f110 0x7fa38415e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7fa38359e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa384173f80 con 0x7fa38416f110 2024-04-25T02:28:32.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7fa38359e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa384173e00 con 0x7fa38406e450 2024-04-25T02:28:32.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7fa38359e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa38406d1f0 con 0x7fa38406dc70 2024-04-25T02:28:32.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7fa38259c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa38406dc70 0x7fa384163f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7f6fd172b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fcc070df0 0x7f6fcc071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7f6fd272d640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f6fcc16a5a0 0x7f6fcc16c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:42500/0 (socket says 172.21.15.67:42500) 2024-04-25T02:28:32.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7f6fd272d640 1 -- 172.21.15.67:0/1369128709 learned_addr learned my addr 172.21.15.67:0/1369128709 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:32.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7fa38259c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa38406dc70 0x7fa384163f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:47146/0 (socket says 172.21.15.67:47146) 2024-04-25T02:28:32.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7fa38259c640 1 -- 172.21.15.67:0/376278457 learned_addr learned my addr 172.21.15.67:0/376278457 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7f062559a640 1 -- 172.21.15.67:0/3274002159 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0618037070 con 0x7f06280b5ee0 2024-04-25T02:28:32.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7f3094b48640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30900ca430 0x7f30901540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7f3094b48640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f309013fbd0 0x7f30901558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7f3094b48640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f309015b3b0 0x7f309015dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7f3094b48640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f309006d340 con 0x7f30900ca430 2024-04-25T02:28:32.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7f3094b48640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f309006d060 con 0x7f309015b3b0 2024-04-25T02:28:32.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7f3094b48640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3090140540 con 0x7f309013fbd0 2024-04-25T02:28:32.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7f062559a640 1 -- 172.21.15.67:0/3274002159 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0618032440 con 0x7f06280b5ee0 2024-04-25T02:28:32.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7fadee8ff640 1 -- 172.21.15.67:0/4217539956 shutdown_connections 2024-04-25T02:28:32.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7fadee8ff640 1 --2- 172.21.15.67:0/4217539956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fade806e5a0 0x7fade80cc560 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7fadee8ff640 1 -- 172.21.15.67:0/4217539956 >> 172.21.15.67:0/4217539956 conn(0x7fade80b1f10 msgr2=0x7fade80cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7f062559a640 1 -- 172.21.15.67:0/3274002159 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0618037070 con 0x7f06280b5ee0 2024-04-25T02:28:32.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7fadee8ff640 1 -- 172.21.15.67:0/4217539956 shutdown_connections 2024-04-25T02:28:32.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7fa381d9b640 1 --2- 172.21.15.67:0/376278457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa38406e450 0x7fa384162580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7fadee8ff640 1 -- 172.21.15.67:0/4217539956 wait complete. 2024-04-25T02:28:32.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7f308dd9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f309013fbd0 0x7f30901558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7f308dd9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f309013fbd0 0x7f30901558b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:47158/0 (socket says 172.21.15.67:47158) 2024-04-25T02:28:32.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7f308dd9b640 1 -- 172.21.15.67:0/1979914815 learned_addr learned my addr 172.21.15.67:0/1979914815 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7fa382d9d640 1 --2- 172.21.15.67:0/376278457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa38416f110 0x7fa38415e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7f6fd172b640 1 -- 172.21.15.67:0/1369128709 >> v1:172.21.15.176:6789/0 conn(0x7f6fcc16a5a0 legacy=0x7f6fcc16c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7f6fd172b640 1 -- 172.21.15.67:0/1369128709 >> v1:172.21.15.67:6789/0 conn(0x7f6fcc15cbf0 legacy=0x7f6fcc06cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f6fd172b640 1 -- 172.21.15.67:0/1369128709 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fcc06d8a0 con 0x7f6fcc070df0 2024-04-25T02:28:32.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f91e5bf9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91e006e370 0x7f91e015f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f91e5bf9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e0145800 0x7f91e013f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f308dd9b640 1 -- 172.21.15.67:0/1979914815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f309015b3b0 msgr2=0x7f309015dc10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T02:28:32.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f308dd9b640 1 --2- 172.21.15.67:0/1979914815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f309015b3b0 0x7f309015dc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f308dd9b640 1 -- 172.21.15.67:0/1979914815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30900ca430 msgr2=0x7f30901540f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:28:32.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f308dd9b640 1 --2- 172.21.15.67:0/1979914815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30900ca430 0x7f30901540f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f308dd9b640 1 -- 172.21.15.67:0/1979914815 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3090156aa0 con 0x7f309013fbd0 2024-04-25T02:28:32.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f91df7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91e006e370 0x7f91e015f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f91df7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91e006e370 0x7f91e015f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:47162/0 (socket says 172.21.15.67:47162) 2024-04-25T02:28:32.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f91df7fe640 1 -- 172.21.15.67:0/862911298 learned_addr learned my addr 172.21.15.67:0/862911298 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f062ce6d640 1 -- 172.21.15.67:0/3274002159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06280b5ee0 msgr2=0x7f06280ae2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f062ce6d640 1 --2- 172.21.15.67:0/3274002159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06280b5ee0 0x7f06280ae2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0628074e80 tx=0x7f061802a110 comp rx=0 tx=0).stop 2024-04-25T02:28:32.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f91e5bf9640 1 --2- 172.21.15.67:0/862911298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e015d0c0 0x7f91e01f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.761+0000 7f922f2f5640 1 -- start start 2024-04-25T02:28:32.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f308dd9b640 1 --2- 172.21.15.67:0/1979914815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f309013fbd0 0x7f30901558b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f308800ba80 tx=0x7f308800bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.760+0000 7f67dd81c640 1 -- 172.21.15.67:0/688407568 wait complete. 2024-04-25T02:28:32.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f91deffd640 1 --2- 172.21.15.67:0/862911298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e0145800 0x7f91e013f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f062ce6d640 1 -- 172.21.15.67:0/3274002159 shutdown_connections 2024-04-25T02:28:32.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f062ce6d640 1 --2- 172.21.15.67:0/3274002159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06280b5ee0 0x7f06280ae2f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f062ce6d640 1 --2- 172.21.15.67:0/3274002159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f062815f4c0 0x7f06280addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f062ce6d640 1 --2- 172.21.15.67:0/3274002159 >> v2:172.21.15.176:3300/0 conn(0x7f062815af70 0x7f06280b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f67dd81c640 1 Processor -- start 2024-04-25T02:28:32.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f062ce6d640 1 -- 172.21.15.67:0/3274002159 >> 172.21.15.67:0/3274002159 conn(0x7f06280d0e00 msgr2=0x7f06280d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f91dffff640 1 --2- 172.21.15.67:0/862911298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e015d0c0 0x7f91e01f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f307effd640 1 -- 172.21.15.67:0/1979914815 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088019070 con 0x7f309013fbd0 2024-04-25T02:28:32.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f307effd640 1 -- 172.21.15.67:0/1979914815 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f308800cc90 con 0x7f309013fbd0 2024-04-25T02:28:32.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f307effd640 1 -- 172.21.15.67:0/1979914815 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088014680 con 0x7f309013fbd0 2024-04-25T02:28:32.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f922f2f5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f922004b3c0 0x7f9220171a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f922f2f5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f922004f4d0 0x7f92200d86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.762+0000 7f922f2f5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f922004fe90 0x7f922004e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7fa381d9b640 1 -- 172.21.15.67:0/376278457 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa38406dc70 msgr2=0x7fa384163f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7fa381d9b640 1 --2- 172.21.15.67:0/376278457 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa38406dc70 0x7fa384163f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7fa381d9b640 1 -- 172.21.15.67:0/376278457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa38416f110 msgr2=0x7fa38415e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f3094b48640 1 -- 172.21.15.67:0/1979914815 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3090156200 con 0x7f309013fbd0 2024-04-25T02:28:32.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f3094b48640 1 -- 172.21.15.67:0/1979914815 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f30901567c0 con 0x7f309013fbd0 2024-04-25T02:28:32.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f922f2f5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9220054830 con 0x7f922004b3c0 2024-04-25T02:28:32.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f922d091640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f922004b3c0 0x7f9220171a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f922d091640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f922004b3c0 0x7f9220171a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54414/0 (socket says 172.21.15.67:54414) 2024-04-25T02:28:32.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f922d892640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f922004fe90 0x7f922004e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f922d091640 1 -- 172.21.15.67:0/1189665617 learned_addr learned my addr 172.21.15.67:0/1189665617 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f922f2f5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f922004b7a0 con 0x7f922004fe90 2024-04-25T02:28:32.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f922f2f5640 1 -- 172.21.15.67:0/1189665617 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f92200549b0 con 0x7f922004f4d0 2024-04-25T02:28:32.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f91e5bf9640 1 -- 172.21.15.67:0/862911298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f91e006b9d0 con 0x7f91e015d0c0 2024-04-25T02:28:32.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f91e5bf9640 1 -- 172.21.15.67:0/862911298 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f91e006b850 con 0x7f91e0145800 2024-04-25T02:28:32.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f91e5bf9640 1 -- 172.21.15.67:0/862911298 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f91e0160080 con 0x7f91e006e370 2024-04-25T02:28:32.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f6fd172b640 1 --2- 172.21.15.67:0/1369128709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fcc070df0 0x7f6fcc071250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80097d0 tx=0x7f6fc802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61817e2ef301f133 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7fa381d9b640 1 --2- 172.21.15.67:0/376278457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa38416f110 0x7fa38415e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7fa381d9b640 1 -- 172.21.15.67:0/376278457 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa384164590 con 0x7fa38406e450 2024-04-25T02:28:32.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7fa382d9d640 1 --2- 172.21.15.67:0/376278457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa38416f110 0x7fa38415e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:32.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f922c890640 1 --2- 172.21.15.67:0/1189665617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f922004f4d0 0x7f92200d86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7fa381d9b640 1 --2- 172.21.15.67:0/376278457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa38406e450 0x7fa384162580 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa378009fd0 tx=0x7fa37800b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7fadee8ff640 1 Processor -- start 2024-04-25T02:28:32.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7fadee8ff640 1 -- start start 2024-04-25T02:28:32.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f062ce6d640 1 -- 172.21.15.67:0/3274002159 shutdown_connections 2024-04-25T02:28:32.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f062ce6d640 1 -- 172.21.15.67:0/3274002159 wait complete. 2024-04-25T02:28:32.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f922d892640 1 -- 172.21.15.67:0/1189665617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f922004f4d0 msgr2=0x7f92200d86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f922d892640 1 --2- 172.21.15.67:0/1189665617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f922004f4d0 0x7f92200d86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f922d892640 1 -- 172.21.15.67:0/1189665617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f922004b3c0 msgr2=0x7f9220171a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f922d892640 1 --2- 172.21.15.67:0/1189665617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f922004b3c0 0x7f9220171a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f922d892640 1 -- 172.21.15.67:0/1189665617 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9220037b00 con 0x7f922004fe90 2024-04-25T02:28:32.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f922c890640 1 --2- 172.21.15.67:0/1189665617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f922004f4d0 0x7f92200d86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:32.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f922d091640 1 --2- 172.21.15.67:0/1189665617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f922004b3c0 0x7f9220171a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:32.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f6fd0f2a640 1 -- 172.21.15.67:0/1369128709 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8037070 con 0x7f6fcc070df0 2024-04-25T02:28:32.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f6fd0f2a640 1 -- 172.21.15.67:0/1369128709 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc8032440 con 0x7f6fcc070df0 2024-04-25T02:28:32.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f6fd0f2a640 1 -- 172.21.15.67:0/1369128709 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8032810 con 0x7f6fcc070df0 2024-04-25T02:28:32.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f922d892640 1 --2- 172.21.15.67:0/1189665617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f922004fe90 0x7f922004e120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9218031000 tx=0x7f92180046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.763+0000 7f67dd81c640 1 -- start start 2024-04-25T02:28:32.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7fa372ffd640 1 -- 172.21.15.67:0/376278457 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378015020 con 0x7fa38406e450 2024-04-25T02:28:32.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f921dffb640 1 -- 172.21.15.67:0/1189665617 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218037040 con 0x7f922004fe90 2024-04-25T02:28:32.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7fa372ffd640 1 -- 172.21.15.67:0/376278457 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa378011830 con 0x7fa38406e450 2024-04-25T02:28:32.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7fa38359e640 1 -- 172.21.15.67:0/376278457 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa384164870 con 0x7fa38406e450 2024-04-25T02:28:32.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f6fd4190640 1 -- 172.21.15.67:0/1369128709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fcc070df0 msgr2=0x7f6fcc071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f6fd4190640 1 --2- 172.21.15.67:0/1369128709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fcc070df0 0x7f6fcc071250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80097d0 tx=0x7f6fc802a210 comp rx=0 tx=0).stop 2024-04-25T02:28:32.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f3094b48640 1 -- 172.21.15.67:0/1979914815 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30900756b0 con 0x7f309013fbd0 2024-04-25T02:28:32.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7fa38359e640 1 -- 172.21.15.67:0/376278457 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa384164e30 con 0x7fa38406e450 2024-04-25T02:28:32.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f6fd4190640 1 -- 172.21.15.67:0/1369128709 shutdown_connections 2024-04-25T02:28:32.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f6fd4190640 1 --2- 172.21.15.67:0/1369128709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fcc070df0 0x7f6fcc071250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f6fd4190640 1 -- 172.21.15.67:0/1369128709 >> 172.21.15.67:0/1369128709 conn(0x7f6fcc0b19c0 msgr2=0x7f6fcc0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:32.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f921dffb640 1 -- 172.21.15.67:0/1189665617 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9218003be0 con 0x7f922004fe90 2024-04-25T02:28:32.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f6fd4190640 1 -- 172.21.15.67:0/1369128709 shutdown_connections 2024-04-25T02:28:32.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f91df7fe640 1 -- 172.21.15.67:0/862911298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e0145800 msgr2=0x7f91e013f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f91df7fe640 1 --2- 172.21.15.67:0/862911298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e0145800 0x7f91e013f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f91df7fe640 1 -- 172.21.15.67:0/862911298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e015d0c0 msgr2=0x7f91e01f3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f922f2f5640 1 -- 172.21.15.67:0/1189665617 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9220037de0 con 0x7f922004fe90 2024-04-25T02:28:32.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f91df7fe640 1 --2- 172.21.15.67:0/862911298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e015d0c0 0x7f91e01f3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f91df7fe640 1 -- 172.21.15.67:0/862911298 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e01f4050 con 0x7f91e006e370 2024-04-25T02:28:32.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f922f2f5640 1 -- 172.21.15.67:0/1189665617 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92200383a0 con 0x7f922004fe90 2024-04-25T02:28:32.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7fadee8ff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fade806e1c0 0x7fade8154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7fadee8ff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fade80ccaa0 0x7fade80b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7fadee8ff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fade80acda0 0x7fade8155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7fadee8ff640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fade81670e0 con 0x7fade80ccaa0 2024-04-25T02:28:32.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7fadee8ff640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fade8166c50 con 0x7fade80acda0 2024-04-25T02:28:32.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7fadee8ff640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fade8155120 con 0x7fade806e1c0 2024-04-25T02:28:32.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f6fd4190640 1 -- 172.21.15.67:0/1369128709 wait complete. 2024-04-25T02:28:32.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f67dd81c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67d806b0c0 0x7f67d81e5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f67dd81c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67d8145800 0x7f67d81e6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f67dd81c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d815d0c0 0x7f67d80ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f67dd81c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f67d8160200 con 0x7f67d815d0c0 2024-04-25T02:28:32.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f67dd81c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f67d8160080 con 0x7f67d806b0c0 2024-04-25T02:28:32.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f67dd81c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f67d8160380 con 0x7f67d8145800 2024-04-25T02:28:32.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f67d77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d815d0c0 0x7f67d80ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f67d77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d815d0c0 0x7f67d80ce7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54420/0 (socket says 172.21.15.67:54420) 2024-04-25T02:28:32.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.764+0000 7f67d77fe640 1 -- 172.21.15.67:0/885420867 learned_addr learned my addr 172.21.15.67:0/885420867 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f67d77fe640 1 -- 172.21.15.67:0/885420867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67d8145800 msgr2=0x7f67d81e6020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:28:32.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f67d77fe640 1 --2- 172.21.15.67:0/885420867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67d8145800 0x7f67d81e6020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f67d77fe640 1 -- 172.21.15.67:0/885420867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67d806b0c0 msgr2=0x7f67d81e5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f67d77fe640 1 --2- 172.21.15.67:0/885420867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67d806b0c0 0x7f67d81e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f67d77fe640 1 -- 172.21.15.67:0/885420867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d815d7c0 con 0x7f67d815d0c0 2024-04-25T02:28:32.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f91dffff640 1 --2- 172.21.15.67:0/862911298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e015d0c0 0x7f91e01f3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:32.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.765+0000 7f307effd640 1 -- 172.21.15.67:0/1979914815 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f308801c070 con 0x7f309013fbd0 2024-04-25T02:28:32.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.766+0000 7f307effd640 1 --2- 172.21.15.67:0/1979914815 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f307006bf00 0x7f307006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.766+0000 7f062ce6d640 1 Processor -- start 2024-04-25T02:28:32.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.766+0000 7f307effd640 1 -- 172.21.15.67:0/1979914815 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f308808ac70 con 0x7f309013fbd0 2024-04-25T02:28:32.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.766+0000 7f062ce6d640 1 -- start start 2024-04-25T02:28:32.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.766+0000 7f921dffb640 1 -- 172.21.15.67:0/1189665617 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92180325f0 con 0x7f922004fe90 2024-04-25T02:28:32.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.766+0000 7faded8fd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fade806e1c0 0x7fade8154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.766+0000 7faded8fd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fade806e1c0 0x7fade8154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:47194/0 (socket says 172.21.15.67:47194) 2024-04-25T02:28:32.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.766+0000 7faded8fd640 1 -- 172.21.15.67:0/2794702956 learned_addr learned my addr 172.21.15.67:0/2794702956 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.766+0000 7fadee0fe640 1 --2- 172.21.15.67:0/2794702956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fade80acda0 0x7fade8155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.766+0000 7f91df7fe640 1 --2- 172.21.15.67:0/862911298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91e006e370 0x7f91e015f2f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f91d800c7d0 tx=0x7f91d800cc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.766+0000 7f308e59c640 1 --2- 172.21.15.67:0/1979914815 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f307006bf00 0x7f307006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.767+0000 7faded0fc640 1 --2- 172.21.15.67:0/2794702956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fade80ccaa0 0x7fade80b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.767+0000 7f922f2f5640 1 -- 172.21.15.67:0/1189665617 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9208005290 con 0x7f922004fe90 2024-04-25T02:28:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.767+0000 7faded8fd640 1 -- 172.21.15.67:0/2794702956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fade80acda0 msgr2=0x7fade8155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.767+0000 7faded8fd640 1 --2- 172.21.15.67:0/2794702956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fade80acda0 0x7fade8155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.767+0000 7faded8fd640 1 -- 172.21.15.67:0/2794702956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fade80ccaa0 msgr2=0x7fade80b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.767+0000 7faded8fd640 1 --2- 172.21.15.67:0/2794702956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fade80ccaa0 0x7fade80b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.767+0000 7faded8fd640 1 -- 172.21.15.67:0/2794702956 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade80ae770 con 0x7fade806e1c0 2024-04-25T02:28:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.767+0000 7faded0fc640 1 --2- 172.21.15.67:0/2794702956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fade80ccaa0 0x7fade80b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:32.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.767+0000 7fa372ffd640 1 -- 172.21.15.67:0/376278457 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378011c20 con 0x7fa38406e450 2024-04-25T02:28:32.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.767+0000 7faded8fd640 1 --2- 172.21.15.67:0/2794702956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fade806e1c0 0x7fade8154be0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fadd800c430 tx=0x7fadd800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.767+0000 7f67d77fe640 1 --2- 172.21.15.67:0/885420867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d815d0c0 0x7f67d80ce7d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009800 tx=0x7f67c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.767+0000 7f6fd4190640 1 Processor -- start 2024-04-25T02:28:32.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.767+0000 7f6fd4190640 1 -- start start 2024-04-25T02:28:32.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.767+0000 7fa370ff9640 1 -- 172.21.15.67:0/376278457 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa368005290 con 0x7fa38406e450 2024-04-25T02:28:32.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.767+0000 7f308e59c640 1 --2- 172.21.15.67:0/1979914815 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f307006bf00 0x7f307006e3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3084001410 tx=0x7f3084005870 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.767+0000 7f67bffff640 1 -- 172.21.15.67:0/885420867 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c8037040 con 0x7f67d815d0c0 2024-04-25T02:28:32.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.767+0000 7f67bffff640 1 -- 172.21.15.67:0/885420867 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c8004230 con 0x7f67d815d0c0 2024-04-25T02:28:32.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.767+0000 7f67dd81c640 1 -- 172.21.15.67:0/885420867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d815daa0 con 0x7f67d815d0c0 2024-04-25T02:28:32.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f062ce6d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06280b5ee0 0x7f062815e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f67dd81c640 1 -- 172.21.15.67:0/885420867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d815e060 con 0x7f67d815d0c0 2024-04-25T02:28:32.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f67bffff640 1 -- 172.21.15.67:0/885420867 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c8006e10 con 0x7f67d815d0c0 2024-04-25T02:28:32.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f062ce6d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f062815af70 0x7f06281580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f062659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06280b5ee0 0x7f062815e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f062659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06280b5ee0 0x7f062815e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54438/0 (socket says 172.21.15.67:54438) 2024-04-25T02:28:32.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f6fd4190640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fcc070df0 0x7f6fcc1679a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f6fd4190640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fcc15cbf0 0x7f6fcc158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f6fd4190640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fcc16a5a0 0x7f6fcc1688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7fa372ffd640 1 -- 172.21.15.67:0/376278457 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa378018020 con 0x7fa38406e450 2024-04-25T02:28:32.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f6fd4190640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6fcc06e660 con 0x7f6fcc070df0 2024-04-25T02:28:32.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f6fd4190640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6fcc06de60 con 0x7f6fcc15cbf0 2024-04-25T02:28:32.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f6fd4190640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6fcc15cfd0 con 0x7f6fcc16a5a0 2024-04-25T02:28:32.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f921dffb640 1 -- 172.21.15.67:0/1189665617 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9218032790 con 0x7f922004fe90 2024-04-25T02:28:32.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f921dffb640 1 --2- 172.21.15.67:0/1189665617 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f920c06bf00 0x7f920c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f6fd172b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fcc15cbf0 0x7f6fcc158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f921dffb640 1 -- 172.21.15.67:0/1189665617 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f92180ab490 con 0x7f922004fe90 2024-04-25T02:28:32.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f6fd272d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fcc16a5a0 0x7f6fcc1688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f6fd272d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fcc16a5a0 0x7f6fcc1688f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:47198/0 (socket says 172.21.15.67:47198) 2024-04-25T02:28:32.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f062ce6d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f062815f4c0 0x7f0628159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f062ce6d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f06280b4310 con 0x7f06280b5ee0 2024-04-25T02:28:32.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f062ce6d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f062806f220 con 0x7f062815af70 2024-04-25T02:28:32.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f0625d9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f062815af70 0x7f06281580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f062ce6d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f06280b4490 con 0x7f062815f4c0 2024-04-25T02:28:32.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f062659c640 1 -- 172.21.15.67:0/4191057959 learned_addr learned my addr 172.21.15.67:0/4191057959 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7f0626d9d640 1 --2- 172.21.15.67:0/4191057959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f062815f4c0 0x7f0628159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.768+0000 7f6fd272d640 1 -- 172.21.15.67:0/50678312 learned_addr learned my addr 172.21.15.67:0/50678312 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:32.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7f6fd1f2c640 1 --2- 172.21.15.67:0/50678312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fcc070df0 0x7f6fcc1679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7fa372ffd640 1 --2- 172.21.15.67:0/376278457 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa36406be80 0x7fa36406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7f922d091640 1 --2- 172.21.15.67:0/1189665617 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f920c06bf00 0x7f920c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7f67dd81c640 1 -- 172.21.15.67:0/885420867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b8005290 con 0x7f67d815d0c0 2024-04-25T02:28:32.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7f6fd272d640 1 -- 172.21.15.67:0/50678312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fcc15cbf0 msgr2=0x7f6fcc158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7f6fd272d640 1 --2- 172.21.15.67:0/50678312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fcc15cbf0 0x7f6fcc158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7f6fd272d640 1 -- 172.21.15.67:0/50678312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fcc070df0 msgr2=0x7f6fcc1679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7f6fd272d640 1 --2- 172.21.15.67:0/50678312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fcc070df0 0x7f6fcc1679a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7f6fd272d640 1 -- 172.21.15.67:0/50678312 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fcc1590a0 con 0x7f6fcc16a5a0 2024-04-25T02:28:32.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7f062659c640 1 -- 172.21.15.67:0/4191057959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f062815f4c0 msgr2=0x7f0628159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7f062659c640 1 --2- 172.21.15.67:0/4191057959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f062815f4c0 0x7f0628159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7fa38259c640 1 --2- 172.21.15.67:0/376278457 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa36406be80 0x7fa36406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7f062659c640 1 -- 172.21.15.67:0/4191057959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f062815af70 msgr2=0x7f06281580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:32.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7f062659c640 1 --2- 172.21.15.67:0/4191057959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f062815af70 0x7f06281580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:32.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7f062659c640 1 -- 172.21.15.67:0/4191057959 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0628157000 con 0x7f06280b5ee0 2024-04-25T02:28:32.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7fa372ffd640 1 -- 172.21.15.67:0/376278457 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa37808ac30 con 0x7fa38406e450 2024-04-25T02:28:32.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7f6fd1f2c640 1 --2- 172.21.15.67:0/50678312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fcc070df0 0x7f6fcc1679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:32.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7f6fd172b640 1 --2- 172.21.15.67:0/50678312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fcc15cbf0 0x7f6fcc158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:32.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7f062659c640 1 --2- 172.21.15.67:0/4191057959 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06280b5ee0 0x7f062815e020 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f062000d5c0 tx=0x7f062000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.769+0000 7f6fd272d640 1 --2- 172.21.15.67:0/50678312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fcc16a5a0 0x7f6fcc1688f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400caa0 tx=0x7f6fc400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.770+0000 7f0616ffd640 1 -- 172.21.15.67:0/4191057959 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0620003b90 con 0x7f06280b5ee0 2024-04-25T02:28:32.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.770+0000 7f922d091640 1 --2- 172.21.15.67:0/1189665617 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f920c06bf00 0x7f920c06e3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9224006fd0 tx=0x7f9224008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.770+0000 7f0616ffd640 1 -- 172.21.15.67:0/4191057959 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0620003d30 con 0x7f06280b5ee0 2024-04-25T02:28:32.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.770+0000 7f67bffff640 1 -- 172.21.15.67:0/885420867 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f67c803a070 con 0x7f67d815d0c0 2024-04-25T02:28:32.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.770+0000 7fa38259c640 1 --2- 172.21.15.67:0/376278457 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa36406be80 0x7fa36406e340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00b580 tx=0x7fa37c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.770+0000 7f062ce6d640 1 -- 172.21.15.67:0/4191057959 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06281575c0 con 0x7f06280b5ee0 2024-04-25T02:28:32.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.770+0000 7f0616ffd640 1 -- 172.21.15.67:0/4191057959 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0620004250 con 0x7f06280b5ee0 2024-04-25T02:28:32.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.770+0000 7f062ce6d640 1 -- 172.21.15.67:0/4191057959 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0628157b80 con 0x7f06280b5ee0 2024-04-25T02:28:32.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.770+0000 7f67bffff640 1 --2- 172.21.15.67:0/885420867 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f67c406be80 0x7f67c406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.771+0000 7f67bffff640 1 -- 172.21.15.67:0/885420867 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f67c80ab540 con 0x7f67d815d0c0 2024-04-25T02:28:32.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.771+0000 7f67d6ffd640 1 --2- 172.21.15.67:0/885420867 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f67c406be80 0x7f67c406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.771+0000 7f062ce6d640 1 -- 172.21.15.67:0/4191057959 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06280681f0 con 0x7f06280b5ee0 2024-04-25T02:28:32.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.771+0000 7f67d6ffd640 1 --2- 172.21.15.67:0/885420867 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f67c406be80 0x7f67c406e340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f67d00012e0 tx=0x7f67d0001650 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.771+0000 7f91c7fff640 1 -- 172.21.15.67:0/862911298 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8017070 con 0x7f91e006e370 2024-04-25T02:28:32.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.771+0000 7f6fc27fc640 1 -- 172.21.15.67:0/50678312 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4017070 con 0x7f6fcc16a5a0 2024-04-25T02:28:32.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.771+0000 7f6fc27fc640 1 -- 172.21.15.67:0/50678312 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc400aae0 con 0x7f6fcc16a5a0 2024-04-25T02:28:32.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.771+0000 7f91c7fff640 1 -- 172.21.15.67:0/862911298 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d8003da0 con 0x7f91e006e370 2024-04-25T02:28:32.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.771+0000 7f91c7fff640 1 -- 172.21.15.67:0/862911298 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d80052b0 con 0x7f91e006e370 2024-04-25T02:28:32.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.771+0000 7f91e5bf9640 1 -- 172.21.15.67:0/862911298 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e00b3930 con 0x7f91e006e370 2024-04-25T02:28:32.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.771+0000 7fadde7fc640 1 -- 172.21.15.67:0/2794702956 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8017070 con 0x7fade806e1c0 2024-04-25T02:28:32.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.771+0000 7fadde7fc640 1 -- 172.21.15.67:0/2794702956 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd80052f0 con 0x7fade806e1c0 2024-04-25T02:28:32.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.771+0000 7fadde7fc640 1 -- 172.21.15.67:0/2794702956 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8003830 con 0x7fade806e1c0 2024-04-25T02:28:32.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.771+0000 7f91e5bf9640 1 -- 172.21.15.67:0/862911298 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e00b3ed0 con 0x7f91e006e370 2024-04-25T02:28:32.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.771+0000 7f6fd4190640 1 -- 172.21.15.67:0/50678312 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fcc159380 con 0x7f6fcc16a5a0 2024-04-25T02:28:32.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.772+0000 7fadee8ff640 1 -- 172.21.15.67:0/2794702956 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade80b4310 con 0x7fade806e1c0 2024-04-25T02:28:32.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.771+0000 7f6fd4190640 1 -- 172.21.15.67:0/50678312 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fcc159c20 con 0x7f6fcc16a5a0 2024-04-25T02:28:32.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.772+0000 7fadee8ff640 1 -- 172.21.15.67:0/2794702956 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fade80aea10 con 0x7fade806e1c0 2024-04-25T02:28:32.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.772+0000 7f6fc27fc640 1 -- 172.21.15.67:0/50678312 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4012400 con 0x7f6fcc16a5a0 2024-04-25T02:28:32.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.772+0000 7f307effd640 1 -- 172.21.15.67:0/1979914815 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3088059570 con 0x7f309013fbd0 2024-04-25T02:28:32.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.773+0000 7fadee8ff640 1 -- 172.21.15.67:0/2794702956 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade8067e40 con 0x7fade806e1c0 2024-04-25T02:28:32.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.773+0000 7f91e5bf9640 1 -- 172.21.15.67:0/862911298 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e0075750 con 0x7f91e006e370 2024-04-25T02:28:32.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.773+0000 7f6fd4190640 1 -- 172.21.15.67:0/50678312 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fcc159550 con 0x7f6fcc16a5a0 2024-04-25T02:28:32.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.773+0000 7f91c7fff640 1 -- 172.21.15.67:0/862911298 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91d8005450 con 0x7f91e006e370 2024-04-25T02:28:32.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.774+0000 7f6fc27fc640 1 -- 172.21.15.67:0/50678312 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6fc401a070 con 0x7f6fcc16a5a0 2024-04-25T02:28:32.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.774+0000 7f91c7fff640 1 --2- 172.21.15.67:0/862911298 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f91cc06be60 0x7f91cc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.774+0000 7f91c7fff640 1 -- 172.21.15.67:0/862911298 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f91d808a290 con 0x7f91e006e370 2024-04-25T02:28:32.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.774+0000 7f91deffd640 1 --2- 172.21.15.67:0/862911298 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f91cc06be60 0x7f91cc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.774+0000 7f921dffb640 1 -- 172.21.15.67:0/1189665617 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9218079d90 con 0x7f922004fe90 2024-04-25T02:28:32.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.774+0000 7f6fc27fc640 1 --2- 172.21.15.67:0/50678312 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6fb006be30 0x7f6fb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.775+0000 7fadde7fc640 1 -- 172.21.15.67:0/2794702956 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fadd801a070 con 0x7fade806e1c0 2024-04-25T02:28:32.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.775+0000 7f6fc27fc640 1 -- 172.21.15.67:0/50678312 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6fc408a970 con 0x7f6fcc16a5a0 2024-04-25T02:28:32.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.775+0000 7f6fd1f2c640 1 --2- 172.21.15.67:0/50678312 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6fb006be30 0x7f6fb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.775+0000 7f91deffd640 1 --2- 172.21.15.67:0/862911298 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f91cc06be60 0x7f91cc06e320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f91d4037000 tx=0x7f91d4008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.775+0000 7fadde7fc640 1 --2- 172.21.15.67:0/2794702956 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fadcc06bf30 0x7fadcc06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.775+0000 7f6fd1f2c640 1 --2- 172.21.15.67:0/50678312 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6fb006be30 0x7f6fb006e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc15a450 tx=0x7f6fbc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.775+0000 7fadde7fc640 1 -- 172.21.15.67:0/2794702956 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fadd808a730 con 0x7fade806e1c0 2024-04-25T02:28:32.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.775+0000 7faded0fc640 1 --2- 172.21.15.67:0/2794702956 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fadcc06bf30 0x7fadcc06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.776+0000 7faded0fc640 1 --2- 172.21.15.67:0/2794702956 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fadcc06bf30 0x7fadcc06e3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fade4034000 tx=0x7fade402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.778+0000 7f67bffff640 1 -- 172.21.15.67:0/885420867 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f67c8041020 con 0x7f67d815d0c0 2024-04-25T02:28:32.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.779+0000 7fadde7fc640 1 -- 172.21.15.67:0/2794702956 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fadd8021020 con 0x7fade806e1c0 2024-04-25T02:28:32.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.779+0000 7fa372ffd640 1 -- 172.21.15.67:0/376278457 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa37801f020 con 0x7fa38406e450 2024-04-25T02:28:32.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.779+0000 7f0616ffd640 1 -- 172.21.15.67:0/4191057959 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f06200043f0 con 0x7f06280b5ee0 2024-04-25T02:28:32.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.780+0000 7f0616ffd640 1 --2- 172.21.15.67:0/4191057959 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f060806be30 0x7f060806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:32.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.780+0000 7f0616ffd640 1 -- 172.21.15.67:0/4191057959 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f062008ba50 con 0x7f06280b5ee0 2024-04-25T02:28:32.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.780+0000 7f0625d9b640 1 --2- 172.21.15.67:0/4191057959 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f060806be30 0x7f060806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:32.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.781+0000 7f0625d9b640 1 --2- 172.21.15.67:0/4191057959 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f060806be30 0x7f060806e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f062815e560 tx=0x7f061c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:32.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.784+0000 7f91c7fff640 1 -- 172.21.15.67:0/862911298 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f91d80585f0 con 0x7f91e006e370 2024-04-25T02:28:32.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.787+0000 7f0616ffd640 1 -- 172.21.15.67:0/4191057959 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0620015020 con 0x7f06280b5ee0 2024-04-25T02:28:32.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:32.788+0000 7f6fc27fc640 1 -- 172.21.15.67:0/50678312 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6fc4058cd0 con 0x7f6fcc16a5a0 2024-04-25T02:28:33.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.201+0000 7f922f2f5640 1 -- 172.21.15.67:0/1189665617 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9208005580 con 0x7f922004fe90 2024-04-25T02:28:33.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.202+0000 7f921dffb640 1 -- 172.21.15.67:0/1189665617 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9218079690 con 0x7f922004fe90 2024-04-25T02:28:33.206 INFO:teuthology.orchestra.run.smithi067.stdout:55834574853 2024-04-25T02:28:33.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.205+0000 7f92137fe640 1 -- 172.21.15.67:0/1189665617 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f920c06bf00 msgr2=0x7f920c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:33.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.205+0000 7f92137fe640 1 --2- 172.21.15.67:0/1189665617 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f920c06bf00 0x7f920c06e3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9224006fd0 tx=0x7f9224008040 comp rx=0 tx=0).stop 2024-04-25T02:28:33.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.206+0000 7f92137fe640 1 -- 172.21.15.67:0/1189665617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f922004fe90 msgr2=0x7f922004e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:33.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.206+0000 7f92137fe640 1 --2- 172.21.15.67:0/1189665617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f922004fe90 0x7f922004e120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9218031000 tx=0x7f92180046c0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.206+0000 7f92137fe640 1 -- 172.21.15.67:0/1189665617 shutdown_connections 2024-04-25T02:28:33.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.206+0000 7f92137fe640 1 --2- 172.21.15.67:0/1189665617 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f920c06bf00 0x7f920c06e3c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.206+0000 7f92137fe640 1 --2- 172.21.15.67:0/1189665617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f922004fe90 0x7f922004e120 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.206+0000 7f92137fe640 1 --2- 172.21.15.67:0/1189665617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f922004f4d0 0x7f92200d86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.206+0000 7f92137fe640 1 --2- 172.21.15.67:0/1189665617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f922004b3c0 0x7f9220171a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.206+0000 7f92137fe640 1 -- 172.21.15.67:0/1189665617 >> 172.21.15.67:0/1189665617 conn(0x7f922000a400 msgr2=0x7f92200eafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:33.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.206+0000 7f92137fe640 1 -- 172.21.15.67:0/1189665617 shutdown_connections 2024-04-25T02:28:33.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.206+0000 7f92137fe640 1 -- 172.21.15.67:0/1189665617 wait complete. 2024-04-25T02:28:33.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.209+0000 7f3094b48640 1 -- 172.21.15.67:0/1979914815 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f309006ea90 con 0x7f309013fbd0 2024-04-25T02:28:33.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.209+0000 7f307effd640 1 -- 172.21.15.67:0/1979914815 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3088058e70 con 0x7f309013fbd0 2024-04-25T02:28:33.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.209+0000 7f67dd81c640 1 -- 172.21.15.67:0/885420867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f67b8005580 con 0x7f67d815d0c0 2024-04-25T02:28:33.214 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2024-04-25T02:28:33.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.210+0000 7f67bffff640 1 -- 172.21.15.67:0/885420867 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f67c8079ed0 con 0x7f67d815d0c0 2024-04-25T02:28:33.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.212+0000 7fadee8ff640 1 -- 172.21.15.67:0/2794702956 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fade80cec20 con 0x7fade806e1c0 2024-04-25T02:28:33.217 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2024-04-25T02:28:33.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.213+0000 7f3094b48640 1 -- 172.21.15.67:0/1979914815 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f307006bf00 msgr2=0x7f307006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:33.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.213+0000 7f3094b48640 1 --2- 172.21.15.67:0/1979914815 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f307006bf00 0x7f307006e3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3084001410 tx=0x7f3084005870 comp rx=0 tx=0).stop 2024-04-25T02:28:33.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.213+0000 7f3094b48640 1 -- 172.21.15.67:0/1979914815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f309013fbd0 msgr2=0x7f30901558b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:33.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.213+0000 7f3094b48640 1 --2- 172.21.15.67:0/1979914815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f309013fbd0 0x7f30901558b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f308800ba80 tx=0x7f308800bf40 comp rx=0 tx=0).stop 2024-04-25T02:28:33.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.213+0000 7fadde7fc640 1 -- 172.21.15.67:0/2794702956 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fade80cec20 con 0x7fade806e1c0 2024-04-25T02:28:33.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.213+0000 7f3094b48640 1 -- 172.21.15.67:0/1979914815 shutdown_connections 2024-04-25T02:28:33.219 INFO:teuthology.orchestra.run.smithi067.stdout:55834574853 2024-04-25T02:28:33.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.213+0000 7f3094b48640 1 --2- 172.21.15.67:0/1979914815 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f307006bf00 0x7f307006e3c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.213+0000 7f3094b48640 1 --2- 172.21.15.67:0/1979914815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f309015b3b0 0x7f309015dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.213+0000 7f3094b48640 1 --2- 172.21.15.67:0/1979914815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f309013fbd0 0x7f30901558b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.213+0000 7f3094b48640 1 --2- 172.21.15.67:0/1979914815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30900ca430 0x7f30901540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.213+0000 7f3094b48640 1 -- 172.21.15.67:0/1979914815 >> 172.21.15.67:0/1979914815 conn(0x7f30900cfc50 msgr2=0x7f30900cd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:33.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.214+0000 7f3094b48640 1 -- 172.21.15.67:0/1979914815 shutdown_connections 2024-04-25T02:28:33.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.214+0000 7f3094b48640 1 -- 172.21.15.67:0/1979914815 wait complete. 2024-04-25T02:28:33.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.214+0000 7f67dd81c640 1 -- 172.21.15.67:0/885420867 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f67c406be80 msgr2=0x7f67c406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:33.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.214+0000 7f67dd81c640 1 --2- 172.21.15.67:0/885420867 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f67c406be80 0x7f67c406e340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f67d00012e0 tx=0x7f67d0001650 comp rx=0 tx=0).stop 2024-04-25T02:28:33.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.214+0000 7f67dd81c640 1 -- 172.21.15.67:0/885420867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d815d0c0 msgr2=0x7f67d80ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:33.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.214+0000 7f67dd81c640 1 --2- 172.21.15.67:0/885420867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d815d0c0 0x7f67d80ce7d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009800 tx=0x7f67c80046c0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.214+0000 7f67dd81c640 1 -- 172.21.15.67:0/885420867 shutdown_connections 2024-04-25T02:28:33.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.214+0000 7f67dd81c640 1 --2- 172.21.15.67:0/885420867 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f67c406be80 0x7f67c406e340 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f67d00012e0 tx=0x7f67d0001650 comp rx=0 tx=0).stop 2024-04-25T02:28:33.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.214+0000 7f67dd81c640 1 --2- 172.21.15.67:0/885420867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d815d0c0 0x7f67d80ce7d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.214+0000 7f67dd81c640 1 --2- 172.21.15.67:0/885420867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67d8145800 0x7f67d81e6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.214+0000 7f67dd81c640 1 --2- 172.21.15.67:0/885420867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67d806b0c0 0x7f67d81e5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.214+0000 7f67dd81c640 1 -- 172.21.15.67:0/885420867 >> 172.21.15.67:0/885420867 conn(0x7f67d80b2850 msgr2=0x7f67d806de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:33.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.215+0000 7f67dd81c640 1 -- 172.21.15.67:0/885420867 shutdown_connections 2024-04-25T02:28:33.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.215+0000 7f67dd81c640 1 -- 172.21.15.67:0/885420867 wait complete. 2024-04-25T02:28:33.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.216+0000 7fadee8ff640 1 -- 172.21.15.67:0/2794702956 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fadcc06bf30 msgr2=0x7fadcc06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:33.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.216+0000 7fadee8ff640 1 --2- 172.21.15.67:0/2794702956 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fadcc06bf30 0x7fadcc06e3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fade4034000 tx=0x7fade402e000 comp rx=0 tx=0).stop 2024-04-25T02:28:33.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.216+0000 7fadee8ff640 1 -- 172.21.15.67:0/2794702956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fade806e1c0 msgr2=0x7fade8154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:33.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.216+0000 7fadee8ff640 1 --2- 172.21.15.67:0/2794702956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fade806e1c0 0x7fade8154be0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fadd800c430 tx=0x7fadd800c8f0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.216+0000 7fadee8ff640 1 -- 172.21.15.67:0/2794702956 shutdown_connections 2024-04-25T02:28:33.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.216+0000 7fadee8ff640 1 --2- 172.21.15.67:0/2794702956 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fadcc06bf30 0x7fadcc06e3f0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fade4034000 tx=0x7fade402e000 comp rx=0 tx=0).stop 2024-04-25T02:28:33.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.216+0000 7fadee8ff640 1 --2- 172.21.15.67:0/2794702956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fade80acda0 0x7fade8155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.216+0000 7fadee8ff640 1 --2- 172.21.15.67:0/2794702956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fade80ccaa0 0x7fade80b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.216+0000 7fadee8ff640 1 --2- 172.21.15.67:0/2794702956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fade806e1c0 0x7fade8154be0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fadd800c430 tx=0x7fadd800c8f0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.216+0000 7fadee8ff640 1 -- 172.21.15.67:0/2794702956 >> 172.21.15.67:0/2794702956 conn(0x7fade80b1f10 msgr2=0x7fade8162180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:33.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.217+0000 7fadee8ff640 1 -- 172.21.15.67:0/2794702956 shutdown_connections 2024-04-25T02:28:33.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.217+0000 7fadee8ff640 1 -- 172.21.15.67:0/2794702956 wait complete. 2024-04-25T02:28:33.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.219+0000 7fa370ff9640 1 -- 172.21.15.67:0/376278457 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa368005580 con 0x7fa38406e450 2024-04-25T02:28:33.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.219+0000 7fa372ffd640 1 -- 172.21.15.67:0/376278457 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa378059690 con 0x7fa38406e450 2024-04-25T02:28:33.225 INFO:teuthology.orchestra.run.smithi067.stdout:55834574853 2024-04-25T02:28:33.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.221+0000 7f6fd4190640 1 -- 172.21.15.67:0/50678312 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6fcc069110 con 0x7f6fcc16a5a0 2024-04-25T02:28:33.225 INFO:teuthology.orchestra.run.smithi067.stdout:55834574852 2024-04-25T02:28:33.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.222+0000 7f6fc27fc640 1 -- 172.21.15.67:0/50678312 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6fc405cfd0 con 0x7f6fcc16a5a0 2024-04-25T02:28:33.226 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2024-04-25T02:28:33.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.221+0000 7f91e5bf9640 1 -- 172.21.15.67:0/862911298 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f91e00721e0 con 0x7f91e006e370 2024-04-25T02:28:33.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.221+0000 7f91c7fff640 1 -- 172.21.15.67:0/862911298 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f91d805c8f0 con 0x7f91e006e370 2024-04-25T02:28:33.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.224+0000 7fa370ff9640 1 -- 172.21.15.67:0/376278457 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa36406be80 msgr2=0x7fa36406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:33.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.224+0000 7fa370ff9640 1 --2- 172.21.15.67:0/376278457 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa36406be80 0x7fa36406e340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00b580 tx=0x7fa37c02e000 comp rx=0 tx=0).stop 2024-04-25T02:28:33.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.224+0000 7fa370ff9640 1 -- 172.21.15.67:0/376278457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa38406e450 msgr2=0x7fa384162580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:33.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.224+0000 7fa370ff9640 1 --2- 172.21.15.67:0/376278457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa38406e450 0x7fa384162580 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa378009fd0 tx=0x7fa37800b870 comp rx=0 tx=0).stop 2024-04-25T02:28:33.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.224+0000 7f062ce6d640 1 -- 172.21.15.67:0/4191057959 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f06280d1c70 con 0x7f06280b5ee0 2024-04-25T02:28:33.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.224+0000 7fa370ff9640 1 -- 172.21.15.67:0/376278457 shutdown_connections 2024-04-25T02:28:33.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.224+0000 7fa370ff9640 1 --2- 172.21.15.67:0/376278457 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa36406be80 0x7fa36406e340 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.224+0000 7fa370ff9640 1 --2- 172.21.15.67:0/376278457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa38416f110 0x7fa38415e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.224+0000 7fa370ff9640 1 --2- 172.21.15.67:0/376278457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa38406e450 0x7fa384162580 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.224+0000 7fa370ff9640 1 --2- 172.21.15.67:0/376278457 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa38406dc70 0x7fa384163f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.224+0000 7fa370ff9640 1 -- 172.21.15.67:0/376278457 >> 172.21.15.67:0/376278457 conn(0x7fa3840b1ac0 msgr2=0x7fa3840ae6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:33.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.224+0000 7f0616ffd640 1 -- 172.21.15.67:0/4191057959 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0620059f20 con 0x7f06280b5ee0 2024-04-25T02:28:33.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.225+0000 7fa370ff9640 1 -- 172.21.15.67:0/376278457 shutdown_connections 2024-04-25T02:28:33.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.225+0000 7fa370ff9640 1 -- 172.21.15.67:0/376278457 wait complete. 2024-04-25T02:28:33.230 INFO:teuthology.orchestra.run.smithi067.stdout:55834574853 2024-04-25T02:28:33.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.225+0000 7f91e5bf9640 1 -- 172.21.15.67:0/862911298 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f91cc06be60 msgr2=0x7f91cc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:33.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.225+0000 7f91e5bf9640 1 --2- 172.21.15.67:0/862911298 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f91cc06be60 0x7f91cc06e320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f91d4037000 tx=0x7f91d4008030 comp rx=0 tx=0).stop 2024-04-25T02:28:33.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.225+0000 7f91e5bf9640 1 -- 172.21.15.67:0/862911298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91e006e370 msgr2=0x7f91e015f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:33.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.225+0000 7f91e5bf9640 1 --2- 172.21.15.67:0/862911298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91e006e370 0x7f91e015f2f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f91d800c7d0 tx=0x7f91d800cc90 comp rx=0 tx=0).stop 2024-04-25T02:28:33.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.225+0000 7f91e5bf9640 1 -- 172.21.15.67:0/862911298 shutdown_connections 2024-04-25T02:28:33.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.225+0000 7f91e5bf9640 1 --2- 172.21.15.67:0/862911298 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f91cc06be60 0x7f91cc06e320 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.225+0000 7f91e5bf9640 1 --2- 172.21.15.67:0/862911298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e015d0c0 0x7f91e01f3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.225+0000 7f91e5bf9640 1 --2- 172.21.15.67:0/862911298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e0145800 0x7f91e013f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.225+0000 7f91e5bf9640 1 --2- 172.21.15.67:0/862911298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91e006e370 0x7f91e015f2f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.225+0000 7f91e5bf9640 1 -- 172.21.15.67:0/862911298 >> 172.21.15.67:0/862911298 conn(0x7f91e00b2850 msgr2=0x7f91e0141540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:33.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.226+0000 7f91e5bf9640 1 -- 172.21.15.67:0/862911298 shutdown_connections 2024-04-25T02:28:33.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.226+0000 7f91e5bf9640 1 -- 172.21.15.67:0/862911298 wait complete. 2024-04-25T02:28:33.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.226+0000 7f6fd4190640 1 -- 172.21.15.67:0/50678312 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6fb006be30 msgr2=0x7f6fb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:33.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.226+0000 7f6fd4190640 1 --2- 172.21.15.67:0/50678312 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6fb006be30 0x7f6fb006e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc15a450 tx=0x7f6fbc009040 comp rx=0 tx=0).stop 2024-04-25T02:28:33.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.226+0000 7f6fd4190640 1 -- 172.21.15.67:0/50678312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fcc16a5a0 msgr2=0x7f6fcc1688f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:33.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.226+0000 7f6fd4190640 1 --2- 172.21.15.67:0/50678312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fcc16a5a0 0x7f6fcc1688f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400caa0 tx=0x7f6fc400cf60 comp rx=0 tx=0).stop 2024-04-25T02:28:33.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.226+0000 7f6fd4190640 1 -- 172.21.15.67:0/50678312 shutdown_connections 2024-04-25T02:28:33.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.226+0000 7f6fd4190640 1 --2- 172.21.15.67:0/50678312 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6fb006be30 0x7f6fb006e2f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.226+0000 7f6fd4190640 1 --2- 172.21.15.67:0/50678312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fcc16a5a0 0x7f6fcc1688f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.226+0000 7f6fd4190640 1 --2- 172.21.15.67:0/50678312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fcc15cbf0 0x7f6fcc158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.226+0000 7f6fd4190640 1 --2- 172.21.15.67:0/50678312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fcc070df0 0x7f6fcc1679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.226+0000 7f6fd4190640 1 -- 172.21.15.67:0/50678312 >> 172.21.15.67:0/50678312 conn(0x7f6fcc0b19c0 msgr2=0x7f6fcc09b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:33.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.226+0000 7f6fd4190640 1 -- 172.21.15.67:0/50678312 shutdown_connections 2024-04-25T02:28:33.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.226+0000 7f6fd4190640 1 -- 172.21.15.67:0/50678312 wait complete. 2024-04-25T02:28:33.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-04-25T02:28:33.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.228+0000 7f062ce6d640 1 -- 172.21.15.67:0/4191057959 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f060806be30 msgr2=0x7f060806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:33.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.228+0000 7f062ce6d640 1 --2- 172.21.15.67:0/4191057959 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f060806be30 0x7f060806e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f062815e560 tx=0x7f061c008040 comp rx=0 tx=0).stop 2024-04-25T02:28:33.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.228+0000 7f062ce6d640 1 -- 172.21.15.67:0/4191057959 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06280b5ee0 msgr2=0x7f062815e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:33.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.228+0000 7f062ce6d640 1 --2- 172.21.15.67:0/4191057959 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06280b5ee0 0x7f062815e020 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f062000d5c0 tx=0x7f062000da80 comp rx=0 tx=0).stop 2024-04-25T02:28:33.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.229+0000 7f062ce6d640 1 -- 172.21.15.67:0/4191057959 shutdown_connections 2024-04-25T02:28:33.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.229+0000 7f062ce6d640 1 --2- 172.21.15.67:0/4191057959 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f060806be30 0x7f060806e2f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.229+0000 7f062ce6d640 1 --2- 172.21.15.67:0/4191057959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f062815f4c0 0x7f0628159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.229+0000 7f062ce6d640 1 --2- 172.21.15.67:0/4191057959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f062815af70 0x7f06281580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.229+0000 7f062ce6d640 1 --2- 172.21.15.67:0/4191057959 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06280b5ee0 0x7f062815e020 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:33.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.229+0000 7f062ce6d640 1 -- 172.21.15.67:0/4191057959 >> 172.21.15.67:0/4191057959 conn(0x7f06280d0e00 msgr2=0x7f06280af920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:33.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.229+0000 7f062ce6d640 1 -- 172.21.15.67:0/4191057959 shutdown_connections 2024-04-25T02:28:33.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:33.229+0000 7f062ce6d640 1 -- 172.21.15.67:0/4191057959 wait complete. 2024-04-25T02:28:33.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-04-25T02:28:33.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-04-25T02:28:33.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-04-25T02:28:33.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-04-25T02:28:33.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-04-25T02:28:33.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-04-25T02:28:33.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-04-25T02:28:34.235 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T02:28:34.241 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:28:34.243 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:28:34.245 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T02:28:34.250 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T02:28:34.251 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T02:28:34.253 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:28:34.254 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:28:34.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.398+0000 7fa238e5d640 1 Processor -- start 2024-04-25T02:28:34.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.398+0000 7fa238e5d640 1 -- start start 2024-04-25T02:28:34.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.400+0000 7fa238e5d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23406e2f0 0x7fa23406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.400+0000 7fa238e5d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa234072be0 0x7fa2340acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.400+0000 7fa238e5d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23406d250 con 0x7fa23416e920 2024-04-25T02:28:34.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.400+0000 7fa238e5d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa23406d530 con 0x7fa234072be0 2024-04-25T02:28:34.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.400+0000 7fa238e5d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa23406d810 con 0x7fa23406e2f0 2024-04-25T02:28:34.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.400+0000 7fa232d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa234072be0 0x7fa2340acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.400+0000 7fa232d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa234072be0 0x7fa2340acda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54454/0 (socket says 172.21.15.67:54454) 2024-04-25T02:28:34.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.400+0000 7fa232d9d640 1 -- 172.21.15.67:0/1823141703 learned_addr learned my addr 172.21.15.67:0/1823141703 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:34.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.400+0000 7fa231d9b640 1 --2- 172.21.15.67:0/1823141703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23406e2f0 0x7fa23406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.401+0000 7fa232d9d640 1 -- 172.21.15.67:0/1823141703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23406e2f0 msgr2=0x7fa23406cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:34.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.401+0000 7fa232d9d640 1 --2- 172.21.15.67:0/1823141703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23406e2f0 0x7fa23406cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.401+0000 7fa232d9d640 1 -- 172.21.15.67:0/1823141703 >> v1:172.21.15.176:6789/0 conn(0x7fa23416e920 legacy=0x7fa23416ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.401+0000 7fa232d9d640 1 -- 172.21.15.67:0/1823141703 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23406daf0 con 0x7fa234072be0 2024-04-25T02:28:34.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.402+0000 7fa232d9d640 1 --2- 172.21.15.67:0/1823141703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa234072be0 0x7fa2340acda0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0076e0 tx=0x7fa22c02c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3a14f62b8598fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.403+0000 7fa23159a640 1 -- 172.21.15.67:0/1823141703 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c039070 con 0x7fa234072be0 2024-04-25T02:28:34.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.403+0000 7fa23159a640 1 -- 172.21.15.67:0/1823141703 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa22c003990 con 0x7fa234072be0 2024-04-25T02:28:34.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.404+0000 7fa238e5d640 1 -- 172.21.15.67:0/1823141703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa234072be0 msgr2=0x7fa2340acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.404+0000 7fa238e5d640 1 --2- 172.21.15.67:0/1823141703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa234072be0 0x7fa2340acda0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0076e0 tx=0x7fa22c02c940 comp rx=0 tx=0).stop 2024-04-25T02:28:34.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.404+0000 7fa238e5d640 1 -- 172.21.15.67:0/1823141703 shutdown_connections 2024-04-25T02:28:34.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.404+0000 7fa238e5d640 1 --2- 172.21.15.67:0/1823141703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa234072be0 0x7fa2340acda0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.404+0000 7fa238e5d640 1 --2- 172.21.15.67:0/1823141703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa23406e2f0 0x7fa23406cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.404+0000 7fa238e5d640 1 -- 172.21.15.67:0/1823141703 >> 172.21.15.67:0/1823141703 conn(0x7fa2340b19c0 msgr2=0x7fa2340b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:34.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.405+0000 7fa238e5d640 1 -- 172.21.15.67:0/1823141703 shutdown_connections 2024-04-25T02:28:34.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.405+0000 7fa238e5d640 1 -- 172.21.15.67:0/1823141703 wait complete. 2024-04-25T02:28:34.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.408+0000 7fa238e5d640 1 Processor -- start 2024-04-25T02:28:34.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.408+0000 7fa238e5d640 1 -- start start 2024-04-25T02:28:34.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.409+0000 7fa238e5d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa23416e920 0x7fa234162ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.409+0000 7fa238e5d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa234204e50 0x7fa234165a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.409+0000 7fa23259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa23416e920 0x7fa234162ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.409+0000 7fa23259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa23416e920 0x7fa234162ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54468/0 (socket says 172.21.15.67:54468) 2024-04-25T02:28:34.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.409+0000 7fa23259c640 1 -- 172.21.15.67:0/2366674472 learned_addr learned my addr 172.21.15.67:0/2366674472 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:34.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.409+0000 7fa238e5d640 1 --2- 172.21.15.67:0/2366674472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2342052d0 0x7fa234202920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.409+0000 7fa238e5d640 1 -- 172.21.15.67:0/2366674472 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa23408bc90 con 0x7fa23416e920 2024-04-25T02:28:34.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.409+0000 7fa238e5d640 1 -- 172.21.15.67:0/2366674472 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa234073060 con 0x7fa234204e50 2024-04-25T02:28:34.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.409+0000 7fa238e5d640 1 -- 172.21.15.67:0/2366674472 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa23408be10 con 0x7fa2342052d0 2024-04-25T02:28:34.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.410+0000 7fa231d9b640 1 --2- 172.21.15.67:0/2366674472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa234204e50 0x7fa234165a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.410+0000 7fa232d9d640 1 --2- 172.21.15.67:0/2366674472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2342052d0 0x7fa234202920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.410+0000 7fa23259c640 1 -- 172.21.15.67:0/2366674472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2342052d0 msgr2=0x7fa234202920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.410+0000 7fa23259c640 1 --2- 172.21.15.67:0/2366674472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2342052d0 0x7fa234202920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.410+0000 7fa23259c640 1 -- 172.21.15.67:0/2366674472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa234204e50 msgr2=0x7fa234165a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.410+0000 7fa23259c640 1 --2- 172.21.15.67:0/2366674472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa234204e50 0x7fa234165a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.410+0000 7fa23259c640 1 -- 172.21.15.67:0/2366674472 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa234162430 con 0x7fa23416e920 2024-04-25T02:28:34.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.410+0000 7fa231d9b640 1 --2- 172.21.15.67:0/2366674472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa234204e50 0x7fa234165a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:34.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.410+0000 7fa23259c640 1 --2- 172.21.15.67:0/2366674472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa23416e920 0x7fa234162ef0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa22800c430 tx=0x7fa22800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.412+0000 7fa222ffd640 1 -- 172.21.15.67:0/2366674472 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa228017070 con 0x7fa23416e920 2024-04-25T02:28:34.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.412+0000 7fa238e5d640 1 -- 172.21.15.67:0/2366674472 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2341664e0 con 0x7fa23416e920 2024-04-25T02:28:34.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.412+0000 7fa238e5d640 1 -- 172.21.15.67:0/2366674472 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2341626f0 con 0x7fa23416e920 2024-04-25T02:28:34.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.415+0000 7fa222ffd640 1 -- 172.21.15.67:0/2366674472 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2280052d0 con 0x7fa23416e920 2024-04-25T02:28:34.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.415+0000 7fa222ffd640 1 -- 172.21.15.67:0/2366674472 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa228003830 con 0x7fa23416e920 2024-04-25T02:28:34.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.415+0000 7fa222ffd640 1 -- 172.21.15.67:0/2366674472 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa22801a070 con 0x7fa23416e920 2024-04-25T02:28:34.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.415+0000 7fa222ffd640 1 --2- 172.21.15.67:0/2366674472 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa21406bf30 0x7fa21406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.416+0000 7fa222ffd640 1 -- 172.21.15.67:0/2366674472 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa22808a240 con 0x7fa23416e920 2024-04-25T02:28:34.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.416+0000 7fa231d9b640 1 --2- 172.21.15.67:0/2366674472 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa21406bf30 0x7fa21406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.417+0000 7fa238e5d640 1 -- 172.21.15.67:0/2366674472 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa234069110 con 0x7fa23416e920 2024-04-25T02:28:34.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.427+0000 7fa222ffd640 1 -- 172.21.15.67:0/2366674472 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa228058610 con 0x7fa23416e920 2024-04-25T02:28:34.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.428+0000 7fa231d9b640 1 --2- 172.21.15.67:0/2366674472 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa21406bf30 0x7fa21406e3f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa2342058e0 tx=0x7fa224009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.455+0000 7f2b62464640 1 Processor -- start 2024-04-25T02:28:34.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.455+0000 7f2b62464640 1 -- start start 2024-04-25T02:28:34.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.456+0000 7f2b62464640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2b5c0d4730 0x7f2b5c0d2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.456+0000 7f2b62464640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2b5c06c890 0x7f2b5c0d2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.456+0000 7f2b62464640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b5c06cef0 con 0x7f2b5c0b3770 2024-04-25T02:28:34.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.456+0000 7f2b62464640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f2b5c06d1d0 con 0x7f2b5c06c890 2024-04-25T02:28:34.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.456+0000 7f2b62464640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2b5c0b0f60 con 0x7f2b5c0d4730 2024-04-25T02:28:34.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.457+0000 7f7740f29640 1 Processor -- start 2024-04-25T02:28:34.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.457+0000 7f2b60a01640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2b5c06c890 0x7f2b5c0d2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.457+0000 7f7740f29640 1 -- start start 2024-04-25T02:28:34.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.457+0000 7f2b60a01640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2b5c06c890 0x7f2b5c0d2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54472/0 (socket says 172.21.15.67:54472) 2024-04-25T02:28:34.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.457+0000 7f2b60a01640 1 -- 172.21.15.67:0/1080775971 learned_addr learned my addr 172.21.15.67:0/1080775971 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:34.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.457+0000 7f47d009a640 1 Processor -- start 2024-04-25T02:28:34.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.457+0000 7f47d009a640 1 -- start start 2024-04-25T02:28:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.457+0000 7f12fd5e2640 1 Processor -- start 2024-04-25T02:28:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.458+0000 7f12fd5e2640 1 -- start start 2024-04-25T02:28:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.457+0000 7f2b60a01640 1 -- 172.21.15.67:0/1080775971 >> v2:172.21.15.176:3300/0 conn(0x7f2b5c0d4730 msgr2=0x7f2b5c0d2790 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T02:28:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.457+0000 7f2b60a01640 1 --2- 172.21.15.67:0/1080775971 >> v2:172.21.15.176:3300/0 conn(0x7f2b5c0d4730 0x7f2b5c0d2790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.457+0000 7f2b60a01640 1 -- 172.21.15.67:0/1080775971 >> v1:172.21.15.176:6789/0 conn(0x7f2b5c0b3770 legacy=0x7f2b5c06c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:34.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.457+0000 7f2b60a01640 1 -- 172.21.15.67:0/1080775971 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5c0b1240 con 0x7f2b5c06c890 2024-04-25T02:28:34.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.457+0000 7f8ad151d640 1 Processor -- start 2024-04-25T02:28:34.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.458+0000 7f7740f29640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f773c071c10 0x7f773c0720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f7740f29640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f773c15f340 con 0x7f773c0ccda0 2024-04-25T02:28:34.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f7740f29640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f773c15f620 con 0x7f773c0d0500 2024-04-25T02:28:34.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f12fd5e2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12f815e3b0 0x7f12f80d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f7740f29640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f773c15b980 con 0x7f773c071c10 2024-04-25T02:28:34.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f2b60a01640 1 --2- 172.21.15.67:0/1080775971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b5c06c890 0x7f2b5c0d2cd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0d1c90 tx=0x7f2b4c02aa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345d398bd765ff7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.458+0000 7f47d009a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f47c815c230 0x7f47c8071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f47d009a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47c80af120 0x7f47c806cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f47d009a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c8160b20 con 0x7f47c80acda0 2024-04-25T02:28:34.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f47d009a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f47c815c610 con 0x7f47c815c230 2024-04-25T02:28:34.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f47d009a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f47c80ad230 con 0x7f47c80af120 2024-04-25T02:28:34.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f2b5affd640 1 -- 172.21.15.67:0/1080775971 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c033020 con 0x7f2b5c06c890 2024-04-25T02:28:34.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f773ad9d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f773c071c10 0x7f773c0720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f773ad9d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f773c071c10 0x7f773c0720a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:53994/0 (socket says 172.21.15.67:53994) 2024-04-25T02:28:34.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f773ad9d640 1 -- 172.21.15.67:0/971542651 learned_addr learned my addr 172.21.15.67:0/971542651 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:34.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f12fd5e2640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f80d2200 con 0x7f12f80cfc50 2024-04-25T02:28:34.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f12fd5e2640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f80b3740 con 0x7f12f80d4bc0 2024-04-25T02:28:34.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f12fd5e2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f12f80b3a20 con 0x7f12f815e3b0 2024-04-25T02:28:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f2b5affd640 1 -- 172.21.15.67:0/1080775971 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b4c02f410 con 0x7f2b5c06c890 2024-04-25T02:28:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f47cd635640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f47c80acda0 0x7f47c80aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:42536/0 (socket says 172.21.15.67:42536) 2024-04-25T02:28:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f47cd635640 1 -- 172.21.15.67:0/801147319 learned_addr learned my addr 172.21.15.67:0/801147319 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:34.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f2b5affd640 1 -- 172.21.15.67:0/1080775971 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c02f7e0 con 0x7f2b5c06c890 2024-04-25T02:28:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f12f77fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f12f80cfc50 0x7f12f80b4930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49390/0 (socket says 172.21.15.67:49390) 2024-04-25T02:28:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f773ad9d640 1 -- 172.21.15.67:0/971542651 >> v1:172.21.15.176:6789/0 conn(0x7f773c0d0500 legacy=0x7f773c15be10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T02:28:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f773ad9d640 1 -- 172.21.15.67:0/971542651 >> v1:172.21.15.67:6789/0 conn(0x7f773c0ccda0 legacy=0x7f773c15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.459+0000 7f47ce637640 1 --2- 172.21.15.67:0/801147319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47c80af120 0x7f47c806cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f12f77fe640 1 -- 172.21.15.67:0/1688911592 learned_addr learned my addr 172.21.15.67:0/1688911592 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:34.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f773ad9d640 1 -- 172.21.15.67:0/971542651 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f773c15f900 con 0x7f773c071c10 2024-04-25T02:28:34.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.458+0000 7f8ad151d640 1 -- start start 2024-04-25T02:28:34.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f8ad151d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8ac40df7a0 0x7f8ac40543b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f8ad151d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ac4007010 0x7f8ac4038e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f8ad151d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac4050420 con 0x7f8ac404fea0 2024-04-25T02:28:34.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f8ad151d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8ac40dfb80 con 0x7f8ac40df7a0 2024-04-25T02:28:34.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f8ad151d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac40389b0 con 0x7f8ac4007010 2024-04-25T02:28:34.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f8aca7fc640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f8ac404fea0 0x7f8ac4006900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:42572/0 (socket says 172.21.15.67:42572) 2024-04-25T02:28:34.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f8aca7fc640 1 -- 172.21.15.67:0/1928162969 learned_addr learned my addr 172.21.15.67:0/1928162969 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:34.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f47cde36640 1 --2- 172.21.15.67:0/801147319 >> v2:172.21.15.67:3300/0 conn(0x7f47c815c230 0x7f47c8071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f8ac9ffb640 1 -- 172.21.15.67:0/1928162969 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3418518634 0 0) 0x7f8ac4050420 con 0x7f8ac404fea0 2024-04-25T02:28:34.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f47cce34640 1 -- 172.21.15.67:0/801147319 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 450693625 0 0) 0x7f47c8160b20 con 0x7f47c80acda0 2024-04-25T02:28:34.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f47cce34640 1 -- 172.21.15.67:0/801147319 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47b4003520 con 0x7f47c80acda0 2024-04-25T02:28:34.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f2b62464640 1 -- 172.21.15.67:0/1080775971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b5c06c890 msgr2=0x7f2b5c0d2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f2b62464640 1 --2- 172.21.15.67:0/1080775971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b5c06c890 0x7f2b5c0d2cd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0d1c90 tx=0x7f2b4c02aa00 comp rx=0 tx=0).stop 2024-04-25T02:28:34.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f12f5ffb640 1 -- 172.21.15.67:0/1688911592 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3821214376 0 0) 0x7f12f80d2200 con 0x7f12f80cfc50 2024-04-25T02:28:34.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f47ce637640 1 -- 172.21.15.67:0/801147319 >> v2:172.21.15.67:3300/0 conn(0x7f47c815c230 msgr2=0x7f47c8071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:34.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f12f5ffb640 1 -- 172.21.15.67:0/1688911592 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12e0003520 con 0x7f12f80cfc50 2024-04-25T02:28:34.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f2b62464640 1 -- 172.21.15.67:0/1080775971 shutdown_connections 2024-04-25T02:28:34.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f2b62464640 1 --2- 172.21.15.67:0/1080775971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b5c06c890 0x7f2b5c0d2cd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f2b62464640 1 --2- 172.21.15.67:0/1080775971 >> v2:172.21.15.176:3300/0 conn(0x7f2b5c0d4730 0x7f2b5c0d2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f2b62464640 1 -- 172.21.15.67:0/1080775971 >> 172.21.15.67:0/1080775971 conn(0x7f2b5c08dbb0 msgr2=0x7f2b5c09d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:34.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f8ac9ffb640 1 -- 172.21.15.67:0/1928162969 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ab4003520 con 0x7f8ac404fea0 2024-04-25T02:28:34.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f12f6ffd640 1 --2- 172.21.15.67:0/1688911592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12f815e3b0 0x7f12f80d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f8acbfff640 1 --2- 172.21.15.67:0/1928162969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ac4007010 0x7f8ac4038e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f8acaffd640 1 --2- 172.21.15.67:0/1928162969 >> v2:172.21.15.176:3300/0 conn(0x7f8ac40df7a0 0x7f8ac40543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f8ac9ffb640 1 -- 172.21.15.67:0/1928162969 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4103632829 0 0) 0x7f8ab4003520 con 0x7f8ac404fea0 2024-04-25T02:28:34.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f8ac9ffb640 1 -- 172.21.15.67:0/1928162969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ac4007010 msgr2=0x7f8ac4038e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:34.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f8ac9ffb640 1 --2- 172.21.15.67:0/1928162969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ac4007010 0x7f8ac4038e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f8ac9ffb640 1 -- 172.21.15.67:0/1928162969 >> v2:172.21.15.176:3300/0 conn(0x7f8ac40df7a0 msgr2=0x7f8ac40543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:34.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f8ac9ffb640 1 --2- 172.21.15.67:0/1928162969 >> v2:172.21.15.176:3300/0 conn(0x7f8ac40df7a0 0x7f8ac40543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f47ce637640 1 --2- 172.21.15.67:0/801147319 >> v2:172.21.15.67:3300/0 conn(0x7f47c815c230 0x7f47c8071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f47ce637640 1 -- 172.21.15.67:0/801147319 >> v1:172.21.15.176:6789/0 conn(0x7f47c80acda0 legacy=0x7f47c80aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.460+0000 7f47ce637640 1 -- 172.21.15.67:0/801147319 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c815fd60 con 0x7f47c80af120 2024-04-25T02:28:34.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f8ac9ffb640 1 -- 172.21.15.67:0/1928162969 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac4050700 con 0x7f8ac404fea0 2024-04-25T02:28:34.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f8acbfff640 1 --2- 172.21.15.67:0/1928162969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ac4007010 0x7f8ac4038e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:34.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f8ac9ffb640 1 -- 172.21.15.67:0/1928162969 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f8abc001670 con 0x7f8ac404fea0 2024-04-25T02:28:34.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f8acaffd640 1 --2- 172.21.15.67:0/1928162969 >> v2:172.21.15.176:3300/0 conn(0x7f8ac40df7a0 0x7f8ac40543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:34.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f8ac9ffb640 1 -- 172.21.15.67:0/1928162969 >> v1:172.21.15.176:6789/0 conn(0x7f8ac404fea0 legacy=0x7f8ac4006900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f8ac9ffb640 1 --2- 172.21.15.67:0/1928162969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ab40039b0 0x7f8ab4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f773ad9d640 1 --2- 172.21.15.67:0/971542651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f773c071c10 0x7f773c0720a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7734009e50 tx=0x7f773402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d31a604f85044b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f12f5ffb640 1 -- 172.21.15.67:0/1688911592 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3201951875 0 0) 0x7f12e0003520 con 0x7f12f80cfc50 2024-04-25T02:28:34.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f12f5ffb640 1 -- 172.21.15.67:0/1688911592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12f815e3b0 msgr2=0x7f12f80d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:34.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f12f5ffb640 1 --2- 172.21.15.67:0/1688911592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12f815e3b0 0x7f12f80d2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f12f5ffb640 1 -- 172.21.15.67:0/1688911592 >> v1:172.21.15.176:6789/0 conn(0x7f12f80d4bc0 legacy=0x7f12f80b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f12f5ffb640 1 -- 172.21.15.67:0/1688911592 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f80b3d00 con 0x7f12f80cfc50 2024-04-25T02:28:34.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f12f6ffd640 1 --2- 172.21.15.67:0/1688911592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12f815e3b0 0x7f12f80d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:34.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f12f5ffb640 1 -- 172.21.15.67:0/1688911592 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f12f00019f0 con 0x7f12f80cfc50 2024-04-25T02:28:34.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f12f5ffb640 1 -- 172.21.15.67:0/1688911592 >> v1:172.21.15.67:6789/0 conn(0x7f12f80cfc50 legacy=0x7f12f80b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f47cde36640 1 --2- 172.21.15.67:0/801147319 >> v2:172.21.15.67:3300/0 conn(0x7f47c815c230 0x7f47c8071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:34.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f2b62464640 1 -- 172.21.15.67:0/1080775971 shutdown_connections 2024-04-25T02:28:34.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.461+0000 7f2b62464640 1 -- 172.21.15.67:0/1080775971 wait complete. 2024-04-25T02:28:34.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f8ac9ffb640 1 --2- 172.21.15.67:0/1928162969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ac4007010 0x7f8ab4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f8acaffd640 1 --2- 172.21.15.67:0/1928162969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ab40039b0 0x7f8ab4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f12f5ffb640 1 --2- 172.21.15.67:0/1688911592 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12e00039e0 0x7f12e0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f12f5ffb640 1 --2- 172.21.15.67:0/1688911592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12f815e3b0 0x7f12e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f8ac9ffb640 1 --2- 172.21.15.67:0/1928162969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ab4004d40 0x7f8ab40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f8ac9ffb640 1 -- 172.21.15.67:0/1928162969 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac40389b0 con 0x7f8ab40039b0 2024-04-25T02:28:34.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f12f5ffb640 1 --2- 172.21.15.67:0/1688911592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12e0004d40 0x7f12e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f8ac9ffb640 1 -- 172.21.15.67:0/1928162969 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab400bba0 con 0x7f8ab4004d40 2024-04-25T02:28:34.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f8ac9ffb640 1 -- 172.21.15.67:0/1928162969 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab400bda0 con 0x7f8ac4007010 2024-04-25T02:28:34.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f8aca7fc640 1 --2- 172.21.15.67:0/1928162969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ac4007010 0x7f8ab4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f8acbfff640 1 --2- 172.21.15.67:0/1928162969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ab4004d40 0x7f8ab40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f12f67fc640 1 --2- 172.21.15.67:0/1688911592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12f815e3b0 0x7f12e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f12f5ffb640 1 -- 172.21.15.67:0/1688911592 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f12f80b3a20 con 0x7f12e0004d40 2024-04-25T02:28:34.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f12f5ffb640 1 -- 172.21.15.67:0/1688911592 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f12e000ba70 con 0x7f12e00039e0 2024-04-25T02:28:34.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7fa13c8ed640 1 Processor -- start 2024-04-25T02:28:34.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f12f5ffb640 1 -- 172.21.15.67:0/1688911592 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f12e000bc70 con 0x7f12f815e3b0 2024-04-25T02:28:34.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f12f6ffd640 1 --2- 172.21.15.67:0/1688911592 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12e00039e0 0x7f12e0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f47ce637640 1 --2- 172.21.15.67:0/801147319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47c80af120 0x7f47c806cb70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009d90 tx=0x7f47c002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3067dccba402aa46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7fa13c8ed640 1 -- start start 2024-04-25T02:28:34.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f773959a640 1 -- 172.21.15.67:0/971542651 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7734036070 con 0x7f773c071c10 2024-04-25T02:28:34.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f773959a640 1 -- 172.21.15.67:0/971542651 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7734031600 con 0x7f773c071c10 2024-04-25T02:28:34.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f773959a640 1 -- 172.21.15.67:0/971542651 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77340319d0 con 0x7f773c071c10 2024-04-25T02:28:34.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.462+0000 7f12f77fe640 1 --2- 172.21.15.67:0/1688911592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12e0004d40 0x7f12e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.463+0000 7f8acbfff640 1 -- 172.21.15.67:0/1928162969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ac4007010 msgr2=0x7f8ab4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:34.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.463+0000 7f8acbfff640 1 --2- 172.21.15.67:0/1928162969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ac4007010 0x7f8ab4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.463+0000 7f8acbfff640 1 -- 172.21.15.67:0/1928162969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ab40039b0 msgr2=0x7f8ab4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:34.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.463+0000 7f8acbfff640 1 --2- 172.21.15.67:0/1928162969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ab40039b0 0x7f8ab4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.463+0000 7f8acbfff640 1 -- 172.21.15.67:0/1928162969 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab4003520 con 0x7f8ab4004d40 2024-04-25T02:28:34.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.463+0000 7f2b62464640 1 Processor -- start 2024-04-25T02:28:34.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.463+0000 7f12f77fe640 1 -- 172.21.15.67:0/1688911592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12f815e3b0 msgr2=0x7f12e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:34.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.463+0000 7f12f77fe640 1 --2- 172.21.15.67:0/1688911592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12f815e3b0 0x7f12e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.463+0000 7f12f77fe640 1 -- 172.21.15.67:0/1688911592 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12e00039e0 msgr2=0x7f12e0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:34.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.463+0000 7f12f77fe640 1 --2- 172.21.15.67:0/1688911592 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12e00039e0 0x7f12e0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.463+0000 7f12f77fe640 1 -- 172.21.15.67:0/1688911592 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e0003520 con 0x7f12e0004d40 2024-04-25T02:28:34.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.463+0000 7f7b2ad09640 1 Processor -- start 2024-04-25T02:28:34.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.463+0000 7f47cce34640 1 -- 172.21.15.67:0/801147319 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0007740 con 0x7f47c80af120 2024-04-25T02:28:34.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.463+0000 7f47cce34640 1 -- 172.21.15.67:0/801147319 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c00078e0 con 0x7f47c80af120 2024-04-25T02:28:34.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.463+0000 7f47cce34640 1 -- 172.21.15.67:0/801147319 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0007d10 con 0x7f47c80af120 2024-04-25T02:28:34.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7f7740f29640 1 -- 172.21.15.67:0/971542651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f773c071c10 msgr2=0x7f773c0720a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7f7740f29640 1 --2- 172.21.15.67:0/971542651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f773c071c10 0x7f773c0720a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7734009e50 tx=0x7f773402a710 comp rx=0 tx=0).stop 2024-04-25T02:28:34.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7fa13c8ed640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa13003e840 0x7fa130053bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7fa13c8ed640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa130054130 0x7fa1300068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7fa13c8ed640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa130058570 con 0x7fa1300e30c0 2024-04-25T02:28:34.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7fa13c8ed640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa130058850 con 0x7fa13003e840 2024-04-25T02:28:34.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7fa13c8ed640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa130058b30 con 0x7fa130054130 2024-04-25T02:28:34.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7fa13659c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa13003e840 0x7fa130053bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7fa13659c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa13003e840 0x7fa130053bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:54030/0 (socket says 172.21.15.67:54030) 2024-04-25T02:28:34.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7fa13659c640 1 -- 172.21.15.67:0/3654827608 learned_addr learned my addr 172.21.15.67:0/3654827608 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:34.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7fa136d9d640 1 --1- 172.21.15.67:0/3654827608 >> v1:172.21.15.176:6789/0 conn(0x7fa1300e30c0 0x7fa130057d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:42578/0 (socket says 172.21.15.67:42578) 2024-04-25T02:28:34.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7f7740f29640 1 -- 172.21.15.67:0/971542651 shutdown_connections 2024-04-25T02:28:34.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7f7740f29640 1 --2- 172.21.15.67:0/971542651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f773c071c10 0x7f773c0720a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7f7b2ad09640 1 -- start start 2024-04-25T02:28:34.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7f7740f29640 1 -- 172.21.15.67:0/971542651 >> 172.21.15.67:0/971542651 conn(0x7f773c0d0d50 msgr2=0x7f773c0d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:34.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7f12f77fe640 1 --2- 172.21.15.67:0/1688911592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12e0004d40 0x7f12e00051c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12f000a760 tx=0x7f12e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57972037a757670 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7fa13759e640 1 --2- 172.21.15.67:0/3654827608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa130054130 0x7fa1300068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7f8acbfff640 1 --2- 172.21.15.67:0/1928162969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ab4004d40 0x7f8ab40051c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8acc04fa20 tx=0x7f8ab4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d387fef0bcc86e22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7f7740f29640 1 -- 172.21.15.67:0/971542651 shutdown_connections 2024-04-25T02:28:34.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7f7740f29640 1 -- 172.21.15.67:0/971542651 wait complete. 2024-04-25T02:28:34.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7f2b62464640 1 -- start start 2024-04-25T02:28:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7fa13659c640 1 -- 172.21.15.67:0/3654827608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa130054130 msgr2=0x7fa1300068d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7fa13659c640 1 --2- 172.21.15.67:0/3654827608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa130054130 0x7fa1300068d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7fa13659c640 1 -- 172.21.15.67:0/3654827608 >> v1:172.21.15.176:6789/0 conn(0x7fa1300e30c0 legacy=0x7fa130057d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7fa13659c640 1 -- 172.21.15.67:0/3654827608 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1300063b0 con 0x7fa13003e840 2024-04-25T02:28:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7f47d009a640 1 -- 172.21.15.67:0/801147319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47c80af120 msgr2=0x7f47c806cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.464+0000 7f47d009a640 1 --2- 172.21.15.67:0/801147319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47c80af120 0x7f47c806cb70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009d90 tx=0x7f47c002a680 comp rx=0 tx=0).stop 2024-04-25T02:28:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7f12f5ffb640 1 -- 172.21.15.67:0/1688911592 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f000a3b0 con 0x7f12e0004d40 2024-04-25T02:28:34.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7f12f5ffb640 1 -- 172.21.15.67:0/1688911592 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f002f070 con 0x7f12e0004d40 2024-04-25T02:28:34.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7f7b2ad09640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7b240b4fd0 0x7f7b240d4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7f2b62464640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b5c06c890 0x7f2b5c153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7f7b2ad09640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7b240d0f30 0x7f7b240b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7f7b2ad09640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b240d17c0 con 0x7f7b241618c0 2024-04-25T02:28:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7f7b2ad09640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f7b240d2530 con 0x7f7b240d0f30 2024-04-25T02:28:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7f7b2ad09640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7b240d2810 con 0x7f7b240b4fd0 2024-04-25T02:28:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7f7b28aa5640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f7b241618c0 0x7f7b240d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:42588/0 (socket says 172.21.15.67:42588) 2024-04-25T02:28:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7f7b28aa5640 1 -- 172.21.15.67:0/2341174889 learned_addr learned my addr 172.21.15.67:0/2341174889 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7f7b237fe640 1 -- 172.21.15.67:0/2341174889 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2522633941 0 0) 0x7f7b240d17c0 con 0x7f7b241618c0 2024-04-25T02:28:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7f7b237fe640 1 -- 172.21.15.67:0/2341174889 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b0c003520 con 0x7f7b241618c0 2024-04-25T02:28:34.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f2b62464640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b5c0b3770 0x7f2b5c071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f7b292a6640 1 --2- 172.21.15.67:0/2341174889 >> v2:172.21.15.67:3300/0 conn(0x7f7b240d0f30 0x7f7b240b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f2b62464640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b5c0d4730 0x7f2b5c0b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f2b62464640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c16c680 con 0x7f2b5c06c890 2024-04-25T02:28:34.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f12fd5e2640 1 -- 172.21.15.67:0/1688911592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12e0004d40 msgr2=0x7f12e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f12fd5e2640 1 --2- 172.21.15.67:0/1688911592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12e0004d40 0x7f12e00051c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12f000a760 tx=0x7f12e0005830 comp rx=0 tx=0).stop 2024-04-25T02:28:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f2b62464640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c0d4d20 con 0x7f2b5c0b3770 2024-04-25T02:28:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f2b62464640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2b5c16c800 con 0x7f2b5c0d4730 2024-04-25T02:28:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f2b5bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b5c06c890 0x7f2b5c153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f2b5b7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b5c0b3770 0x7f2b5c071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f2b5bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b5c06c890 0x7f2b5c153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54526/0 (socket says 172.21.15.67:54526) 2024-04-25T02:28:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f2b5bfff640 1 -- 172.21.15.67:0/2072827890 learned_addr learned my addr 172.21.15.67:0/2072827890 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f2b60a01640 1 --2- 172.21.15.67:0/2072827890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b5c0d4730 0x7f2b5c0b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f7b237fe640 1 -- 172.21.15.67:0/2341174889 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3774477038 0 0) 0x7f7b0c003520 con 0x7f7b241618c0 2024-04-25T02:28:34.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7f47d009a640 1 -- 172.21.15.67:0/801147319 shutdown_connections 2024-04-25T02:28:34.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7f47d009a640 1 --2- 172.21.15.67:0/801147319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47c80af120 0x7f47c806cb70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f7b237fe640 1 -- 172.21.15.67:0/2341174889 >> v2:172.21.15.176:3300/0 conn(0x7f7b240b4fd0 msgr2=0x7f7b240d4a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T02:28:34.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f7b237fe640 1 --2- 172.21.15.67:0/2341174889 >> v2:172.21.15.176:3300/0 conn(0x7f7b240b4fd0 0x7f7b240d4a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f7b237fe640 1 -- 172.21.15.67:0/2341174889 >> v2:172.21.15.67:3300/0 conn(0x7f7b240d0f30 msgr2=0x7f7b240b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:34.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7f47d009a640 1 --2- 172.21.15.67:0/801147319 >> v2:172.21.15.67:3300/0 conn(0x7f47c815c230 0x7f47c8071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7f47d009a640 1 -- 172.21.15.67:0/801147319 >> 172.21.15.67:0/801147319 conn(0x7f47c80b19c0 msgr2=0x7f47c80b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:34.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7f47d009a640 1 -- 172.21.15.67:0/801147319 shutdown_connections 2024-04-25T02:28:34.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.465+0000 7f47d009a640 1 -- 172.21.15.67:0/801147319 wait complete. 2024-04-25T02:28:34.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f12f77fe640 1 -- 172.21.15.67:0/1688911592 reap_dead start 2024-04-25T02:28:34.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f7b237fe640 1 --2- 172.21.15.67:0/2341174889 >> v2:172.21.15.67:3300/0 conn(0x7f7b240d0f30 0x7f7b240b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f12fd5e2640 1 -- 172.21.15.67:0/1688911592 shutdown_connections 2024-04-25T02:28:34.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f12fd5e2640 1 -- 172.21.15.67:0/1688911592 >> 172.21.15.67:0/1688911592 conn(0x7f12f80d40a0 msgr2=0x7f12f80d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:34.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f7b237fe640 1 -- 172.21.15.67:0/2341174889 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b240d2af0 con 0x7f7b241618c0 2024-04-25T02:28:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f7b237fe640 1 -- 172.21.15.67:0/2341174889 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f7b18001670 con 0x7f7b241618c0 2024-04-25T02:28:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f7b237fe640 1 -- 172.21.15.67:0/2341174889 >> v1:172.21.15.176:6789/0 conn(0x7f7b241618c0 legacy=0x7f7b240d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f7b237fe640 1 --2- 172.21.15.67:0/2341174889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b0c0039b0 0x7f7b0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f8ac9ffb640 1 -- 172.21.15.67:0/1928162969 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0b7070 con 0x7f8ab4004d40 2024-04-25T02:28:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7fa13659c640 1 --2- 172.21.15.67:0/3654827608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa13003e840 0x7fa130053bf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa128009870 tx=0x7fa12802a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94902fdb3a2d8be2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f8ac9ffb640 1 -- 172.21.15.67:0/1928162969 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8acc0aaa20 con 0x7f8ab4004d40 2024-04-25T02:28:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f7b237fe640 1 --2- 172.21.15.67:0/2341174889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b0c004800 0x7f7b0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f7b237fe640 1 --2- 172.21.15.67:0/2341174889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b0c0052e0 0x7f7b0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.467+0000 7f7740f29640 1 Processor -- start 2024-04-25T02:28:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f2b5bfff640 1 -- 172.21.15.67:0/2072827890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b5c0d4730 msgr2=0x7f2b5c0b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f2b5bfff640 1 --2- 172.21.15.67:0/2072827890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b5c0d4730 0x7f2b5c0b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f2b5bfff640 1 -- 172.21.15.67:0/2072827890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b5c0b3770 msgr2=0x7f2b5c071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f2b5bfff640 1 --2- 172.21.15.67:0/2072827890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b5c0b3770 0x7f2b5c071550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f2b5bfff640 1 -- 172.21.15.67:0/2072827890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5c071f30 con 0x7f2b5c06c890 2024-04-25T02:28:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.467+0000 7f2b60a01640 1 --2- 172.21.15.67:0/2072827890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b5c0d4730 0x7f2b5c0b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.467+0000 7f2b5b7fe640 1 --2- 172.21.15.67:0/2072827890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b5c0b3770 0x7f2b5c071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.467+0000 7fa135d9b640 1 -- 172.21.15.67:0/3654827608 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa128037070 con 0x7fa13003e840 2024-04-25T02:28:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.467+0000 7fa135d9b640 1 -- 172.21.15.67:0/3654827608 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa128032440 con 0x7fa13003e840 2024-04-25T02:28:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.467+0000 7fa135d9b640 1 -- 172.21.15.67:0/3654827608 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa128032810 con 0x7fa13003e840 2024-04-25T02:28:34.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.467+0000 7f7740f29640 1 -- start start 2024-04-25T02:28:34.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f7b237fe640 1 -- 172.21.15.67:0/2341174889 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7b240d2530 con 0x7f7b0c0039b0 2024-04-25T02:28:34.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f7b237fe640 1 -- 172.21.15.67:0/2341174889 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7b240d2810 con 0x7f7b0c004800 2024-04-25T02:28:34.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f7b237fe640 1 -- 172.21.15.67:0/2341174889 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7b0c00c260 con 0x7f7b0c0052e0 2024-04-25T02:28:34.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f7b292a6640 1 --2- 172.21.15.67:0/2341174889 >> v2:172.21.15.67:3300/0 conn(0x7f7b240d0f30 0x7f7b240b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:34.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.466+0000 7f7b28aa5640 1 --2- 172.21.15.67:0/2341174889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b0c0039b0 0x7f7b0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.467+0000 7f47d009a640 1 Processor -- start 2024-04-25T02:28:34.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.467+0000 7f47d009a640 1 -- start start 2024-04-25T02:28:34.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.467+0000 7f2b5bfff640 1 --2- 172.21.15.67:0/2072827890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b5c06c890 0x7f2b5c153540 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000b3e0 tx=0x7f2b5000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.467+0000 7f7b28aa5640 1 -- 172.21.15.67:0/2341174889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b0c0052e0 msgr2=0x7f7b0c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:34.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.467+0000 7f7b28aa5640 1 --2- 172.21.15.67:0/2341174889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b0c0052e0 0x7f7b0c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.467+0000 7f7b28aa5640 1 -- 172.21.15.67:0/2341174889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b0c004800 msgr2=0x7f7b0c004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T02:28:34.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.467+0000 7f7b28aa5640 1 --2- 172.21.15.67:0/2341174889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b0c004800 0x7f7b0c004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.467+0000 7f7b28aa5640 1 -- 172.21.15.67:0/2341174889 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b240d2af0 con 0x7f7b0c0039b0 2024-04-25T02:28:34.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.467+0000 7f8ad151d640 1 -- 172.21.15.67:0/1928162969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ab4004d40 msgr2=0x7f8ab40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.467+0000 7f7b292a6640 1 -- 172.21.15.67:0/2341174889 reap_dead start 2024-04-25T02:28:34.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.467+0000 7f8ad151d640 1 --2- 172.21.15.67:0/1928162969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ab4004d40 0x7f8ab40051c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8acc04fa20 tx=0x7f8ab4005830 comp rx=0 tx=0).stop 2024-04-25T02:28:34.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f8acbfff640 1 -- 172.21.15.67:0/1928162969 reap_dead start 2024-04-25T02:28:34.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f8ad151d640 1 -- 172.21.15.67:0/1928162969 shutdown_connections 2024-04-25T02:28:34.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f8ad151d640 1 -- 172.21.15.67:0/1928162969 >> 172.21.15.67:0/1928162969 conn(0x7f8ac4054ca0 msgr2=0x7f8ac40550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:34.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f12fd5e2640 1 -- 172.21.15.67:0/1688911592 shutdown_connections 2024-04-25T02:28:34.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7fa13c8ed640 1 -- 172.21.15.67:0/3654827608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa13003e840 msgr2=0x7fa130053bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7fa13c8ed640 1 --2- 172.21.15.67:0/3654827608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa13003e840 0x7fa130053bf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa128009870 tx=0x7fa12802a200 comp rx=0 tx=0).stop 2024-04-25T02:28:34.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f8ad151d640 1 -- 172.21.15.67:0/1928162969 shutdown_connections 2024-04-25T02:28:34.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f7b28aa5640 1 --2- 172.21.15.67:0/2341174889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b0c0039b0 0x7f7b0c003dd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800c340 tx=0x7f7b0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e17489efd1ac6f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f8ad151d640 1 -- 172.21.15.67:0/1928162969 wait complete. 2024-04-25T02:28:34.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f47d009a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47c80acda0 0x7f47c8149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f7740f29640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f773c071c10 0x7f773c0c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f7740f29640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f773c0ccda0 0x7f773c0c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f7b237fe640 1 -- 172.21.15.67:0/2341174889 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18036070 con 0x7f7b0c0039b0 2024-04-25T02:28:34.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f7b237fe640 1 -- 172.21.15.67:0/2341174889 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b18005ad0 con 0x7f7b0c0039b0 2024-04-25T02:28:34.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f7b237fe640 1 -- 172.21.15.67:0/2341174889 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18007d90 con 0x7f7b0c0039b0 2024-04-25T02:28:34.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7f7740f29640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f773c0d0500 0x7f773c154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7fa13c8ed640 1 -- 172.21.15.67:0/3654827608 shutdown_connections 2024-04-25T02:28:34.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7fa13c8ed640 1 --2- 172.21.15.67:0/3654827608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa130054130 0x7fa1300068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7fa13c8ed640 1 --2- 172.21.15.67:0/3654827608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa13003e840 0x7fa130053bf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7fa13c8ed640 1 -- 172.21.15.67:0/3654827608 >> 172.21.15.67:0/3654827608 conn(0x7fa1300559e0 msgr2=0x7fa130055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:34.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7f7739d9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f773c0ccda0 0x7f773c0c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7f7739d9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f773c0ccda0 0x7f773c0c71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:47354/0 (socket says 172.21.15.67:47354) 2024-04-25T02:28:34.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7f7b2ad09640 1 -- 172.21.15.67:0/2341174889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b0c0039b0 msgr2=0x7f7b0c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7f7b2ad09640 1 --2- 172.21.15.67:0/2341174889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b0c0039b0 0x7f7b0c003dd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800c340 tx=0x7f7b0c005830 comp rx=0 tx=0).stop 2024-04-25T02:28:34.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.470+0000 7f7b2ad09640 1 -- 172.21.15.67:0/2341174889 shutdown_connections 2024-04-25T02:28:34.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.470+0000 7f7b2ad09640 1 --2- 172.21.15.67:0/2341174889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b0c0039b0 0x7f7b0c003dd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.470+0000 7f7b2ad09640 1 -- 172.21.15.67:0/2341174889 >> 172.21.15.67:0/2341174889 conn(0x7f7b240d3f50 msgr2=0x7f7b240d4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:34.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f12fd5e2640 1 -- 172.21.15.67:0/1688911592 wait complete. 2024-04-25T02:28:34.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.470+0000 7f12fd5e2640 1 Processor -- start 2024-04-25T02:28:34.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f47d009a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47c80af120 0x7f47c80b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f47d009a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47c815c230 0x7f47c80cf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f47d009a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f47c8160600 con 0x7f47c815c230 2024-04-25T02:28:34.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f47d009a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f47c8160320 con 0x7f47c80acda0 2024-04-25T02:28:34.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f47d009a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f47c80ad4d0 con 0x7f47c80af120 2024-04-25T02:28:34.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f47cde36640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47c80acda0 0x7f47c8149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f47cde36640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47c80acda0 0x7f47c8149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:54062/0 (socket says 172.21.15.67:54062) 2024-04-25T02:28:34.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f47cde36640 1 -- 172.21.15.67:0/2884235350 learned_addr learned my addr 172.21.15.67:0/2884235350 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:34.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f47ce637640 1 --2- 172.21.15.67:0/2884235350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47c815c230 0x7f47c80cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f47cd635640 1 --2- 172.21.15.67:0/2884235350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47c80af120 0x7f47c80b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7f47cde36640 1 -- 172.21.15.67:0/2884235350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47c80af120 msgr2=0x7f47c80b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7f47cde36640 1 --2- 172.21.15.67:0/2884235350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47c80af120 0x7f47c80b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7f47cde36640 1 -- 172.21.15.67:0/2884235350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47c815c230 msgr2=0x7f47c80cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7f47cde36640 1 --2- 172.21.15.67:0/2884235350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47c815c230 0x7f47c80cf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7f47cde36640 1 -- 172.21.15.67:0/2884235350 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c80b4140 con 0x7f47c80acda0 2024-04-25T02:28:34.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7f47cde36640 1 --2- 172.21.15.67:0/2884235350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47c80acda0 0x7f47c8149310 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f47c400d7d0 tx=0x7f47c400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.470+0000 7f47be7fc640 1 -- 172.21.15.67:0/2884235350 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c4004030 con 0x7f47c80acda0 2024-04-25T02:28:34.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.470+0000 7f47be7fc640 1 -- 172.21.15.67:0/2884235350 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c40041d0 con 0x7f47c80acda0 2024-04-25T02:28:34.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.470+0000 7f8ad151d640 1 Processor -- start 2024-04-25T02:28:34.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.471+0000 7f8ad151d640 1 -- start start 2024-04-25T02:28:34.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7f7740f29640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f773c0cd300 con 0x7f773c0d0500 2024-04-25T02:28:34.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7f7740f29640 1 -- 172.21.15.67:0/26204748 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f773c0cd180 con 0x7f773c071c10 2024-04-25T02:28:34.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7f7739d9b640 1 -- 172.21.15.67:0/26204748 learned_addr learned my addr 172.21.15.67:0/26204748 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:34.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7f7740f29640 1 -- 172.21.15.67:0/26204748 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f773c0ce920 con 0x7f773c0ccda0 2024-04-25T02:28:34.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f2b58ff9640 1 -- 172.21.15.67:0/2072827890 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b50015020 con 0x7f2b5c06c890 2024-04-25T02:28:34.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.470+0000 7f773ad9d640 1 --2- 172.21.15.67:0/26204748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f773c0d0500 0x7f773c154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.470+0000 7f773ad9d640 1 -- 172.21.15.67:0/26204748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f773c0ccda0 msgr2=0x7f773c0c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.470+0000 7f773ad9d640 1 --2- 172.21.15.67:0/26204748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f773c0ccda0 0x7f773c0c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.470+0000 7f773ad9d640 1 -- 172.21.15.67:0/26204748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f773c071c10 msgr2=0x7f773c0c8090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T02:28:34.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.470+0000 7f773ad9d640 1 --2- 172.21.15.67:0/26204748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f773c071c10 0x7f773c0c8090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.470+0000 7f773ad9d640 1 -- 172.21.15.67:0/26204748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f773c0c5360 con 0x7f773c0d0500 2024-04-25T02:28:34.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.471+0000 7f773ad9d640 1 --2- 172.21.15.67:0/26204748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f773c0d0500 0x7f773c154b70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7734030000 tx=0x7f7734004a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.471+0000 7f7739d9b640 1 --2- 172.21.15.67:0/26204748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f773c0ccda0 0x7f773c0c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:34.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f2b58ff9640 1 -- 172.21.15.67:0/2072827890 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b50011850 con 0x7f2b5c06c890 2024-04-25T02:28:34.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f2b58ff9640 1 -- 172.21.15.67:0/2072827890 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b50011c40 con 0x7f2b5c06c890 2024-04-25T02:28:34.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.468+0000 7f2b62464640 1 -- 172.21.15.67:0/2072827890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b5c0b3d40 con 0x7f2b5c06c890 2024-04-25T02:28:34.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.471+0000 7f47be7fc640 1 -- 172.21.15.67:0/2884235350 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c40096a0 con 0x7f47c80acda0 2024-04-25T02:28:34.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.469+0000 7f2b62464640 1 -- 172.21.15.67:0/2072827890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b5c153a80 con 0x7f2b5c06c890 2024-04-25T02:28:34.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.471+0000 7f2b62464640 1 -- 172.21.15.67:0/2072827890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b5c069110 con 0x7f2b5c06c890 2024-04-25T02:28:34.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.471+0000 7f772affd640 1 -- 172.21.15.67:0/26204748 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7734036070 con 0x7f773c0d0500 2024-04-25T02:28:34.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.470+0000 7f12fd5e2640 1 -- start start 2024-04-25T02:28:34.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.471+0000 7f12fd5e2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12f81530e0 0x7f12f8160020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.471+0000 7f12fd5e2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12f81534e0 0x7f12f80b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.471+0000 7f772affd640 1 -- 172.21.15.67:0/26204748 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7734037040 con 0x7f773c0d0500 2024-04-25T02:28:34.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7f7b2ad09640 1 -- 172.21.15.67:0/2341174889 shutdown_connections 2024-04-25T02:28:34.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7f7740f29640 1 -- 172.21.15.67:0/26204748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f773c0c5640 con 0x7f773c0d0500 2024-04-25T02:28:34.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7f12fd5e2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12f80b7200 0x7f12f80b7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7f8ad151d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ab4004d40 0x7f8ac40cf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7f8ad151d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ac417c630 0x7f8ac40da0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7f12f77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12f80b7200 0x7f12f80b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7f12f77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12f80b7200 0x7f12f80b7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54562/0 (socket says 172.21.15.67:54562) 2024-04-25T02:28:34.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7f12f67fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12f81534e0 0x7f12f80b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7f12f67fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12f81534e0 0x7f12f80b6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:47358/0 (socket says 172.21.15.67:47358) 2024-04-25T02:28:34.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7f8aca7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ac417c630 0x7f8ac40da0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7f12f77fe640 1 -- 172.21.15.67:0/2262614528 learned_addr learned my addr 172.21.15.67:0/2262614528 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:34.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7f8aca7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ac417c630 0x7f8ac40da0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54576/0 (socket says 172.21.15.67:54576) 2024-04-25T02:28:34.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7f8aca7fc640 1 -- 172.21.15.67:0/1937341502 learned_addr learned my addr 172.21.15.67:0/1937341502 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:34.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7f8ad151d640 1 --2- 172.21.15.67:0/1937341502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ac417cab0 0x7f8ac403d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7f8acaffd640 1 --2- 172.21.15.67:0/1937341502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ab4004d40 0x7f8ac40cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7f8ad151d640 1 -- 172.21.15.67:0/1937341502 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac40548f0 con 0x7f8ac417c630 2024-04-25T02:28:34.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7f8ad151d640 1 -- 172.21.15.67:0/1937341502 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac40385d0 con 0x7f8ac417cab0 2024-04-25T02:28:34.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7f8ad151d640 1 -- 172.21.15.67:0/1937341502 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac4006070 con 0x7f8ab4004d40 2024-04-25T02:28:34.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7f7b2ad09640 1 -- 172.21.15.67:0/2341174889 wait complete. 2024-04-25T02:28:34.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7f8acbfff640 1 --2- 172.21.15.67:0/1937341502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ac417cab0 0x7f8ac403d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7f772affd640 1 -- 172.21.15.67:0/26204748 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7734003c00 con 0x7f773c0d0500 2024-04-25T02:28:34.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7f7740f29640 1 -- 172.21.15.67:0/26204748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f773c0b4a90 con 0x7f773c0d0500 2024-04-25T02:28:34.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7f12fd5e2640 1 -- 172.21.15.67:0/2262614528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f12f815e910 con 0x7f12f80b7200 2024-04-25T02:28:34.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7f12fd5e2640 1 -- 172.21.15.67:0/2262614528 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f12f815e790 con 0x7f12f81530e0 2024-04-25T02:28:34.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7f12fd5e2640 1 -- 172.21.15.67:0/2262614528 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f12f80b5040 con 0x7f12f81534e0 2024-04-25T02:28:34.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7f12f77fe640 1 -- 172.21.15.67:0/2262614528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12f81534e0 msgr2=0x7f12f80b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7f12f77fe640 1 --2- 172.21.15.67:0/2262614528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12f81534e0 0x7f12f80b6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7f12f77fe640 1 -- 172.21.15.67:0/2262614528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12f81530e0 msgr2=0x7f12f8160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7f12f77fe640 1 --2- 172.21.15.67:0/2262614528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12f81530e0 0x7f12f8160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7f12f77fe640 1 -- 172.21.15.67:0/2262614528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f80ca420 con 0x7f12f80b7200 2024-04-25T02:28:34.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7f12f67fc640 1 --2- 172.21.15.67:0/2262614528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12f81534e0 0x7f12f80b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:34.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7f2b58ff9640 1 -- 172.21.15.67:0/2072827890 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b50018020 con 0x7f2b5c06c890 2024-04-25T02:28:34.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7f2b58ff9640 1 --2- 172.21.15.67:0/2072827890 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2b4806bf00 0x7f2b4806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7f2b58ff9640 1 -- 172.21.15.67:0/2072827890 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2b5008ac70 con 0x7f2b5c06c890 2024-04-25T02:28:34.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7f2b5b7fe640 1 --2- 172.21.15.67:0/2072827890 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2b4806bf00 0x7f2b4806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7f12f77fe640 1 --2- 172.21.15.67:0/2262614528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12f80b7200 0x7f12f80b7680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f12f000a850 tx=0x7f12f80d5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7f7b2ad09640 1 Processor -- start 2024-04-25T02:28:34.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7f7b2ad09640 1 -- start start 2024-04-25T02:28:34.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7f47d009a640 1 -- 172.21.15.67:0/2884235350 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c81590a0 con 0x7f47c80acda0 2024-04-25T02:28:34.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7f47d009a640 1 -- 172.21.15.67:0/2884235350 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c8149850 con 0x7f47c80acda0 2024-04-25T02:28:34.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.470+0000 7fa13c8ed640 1 -- 172.21.15.67:0/3654827608 shutdown_connections 2024-04-25T02:28:34.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.470+0000 7fa13c8ed640 1 -- 172.21.15.67:0/3654827608 wait complete. 2024-04-25T02:28:34.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7fa13c8ed640 1 Processor -- start 2024-04-25T02:28:34.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.472+0000 7fa13c8ed640 1 -- start start 2024-04-25T02:28:34.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7fa13c8ed640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa13003e840 0x7fa1300dc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7fa13c8ed640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa130054130 0x7fa1300db7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7fa13c8ed640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1300e30c0 0x7fa1300dbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7fa13c8ed640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa130006e10 con 0x7fa1300e30c0 2024-04-25T02:28:34.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7fa13c8ed640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa1300e34a0 con 0x7fa13003e840 2024-04-25T02:28:34.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.473+0000 7fa13c8ed640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa130006f90 con 0x7fa130054130 2024-04-25T02:28:34.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7fa136d9d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa13003e840 0x7fa1300dc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7fa13659c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa130054130 0x7fa1300db7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7fa13659c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa130054130 0x7fa1300db7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:47374/0 (socket says 172.21.15.67:47374) 2024-04-25T02:28:34.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7fa13659c640 1 -- 172.21.15.67:0/2096078840 learned_addr learned my addr 172.21.15.67:0/2096078840 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:34.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7fa13759e640 1 --2- 172.21.15.67:0/2096078840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1300e30c0 0x7fa1300dbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7f8acbfff640 1 -- 172.21.15.67:0/1937341502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ab4004d40 msgr2=0x7f8ac40cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7f8acbfff640 1 --2- 172.21.15.67:0/1937341502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ab4004d40 0x7f8ac40cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7f8acbfff640 1 -- 172.21.15.67:0/1937341502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ac417c630 msgr2=0x7f8ac40da0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7f8acbfff640 1 --2- 172.21.15.67:0/1937341502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ac417c630 0x7f8ac40da0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7f8acbfff640 1 -- 172.21.15.67:0/1937341502 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac40d9000 con 0x7f8ac417cab0 2024-04-25T02:28:34.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7fa13659c640 1 -- 172.21.15.67:0/2096078840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa13003e840 msgr2=0x7fa1300dc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7fa13659c640 1 --2- 172.21.15.67:0/2096078840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa13003e840 0x7fa1300dc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.475+0000 7f772affd640 1 -- 172.21.15.67:0/26204748 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7734007910 con 0x7f773c0d0500 2024-04-25T02:28:34.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7fa13659c640 1 -- 172.21.15.67:0/2096078840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1300e30c0 msgr2=0x7fa1300dbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7fa13659c640 1 --2- 172.21.15.67:0/2096078840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1300e30c0 0x7fa1300dbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.475+0000 7f2b5b7fe640 1 --2- 172.21.15.67:0/2072827890 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2b4806bf00 0x7f2b4806e3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0cff80 tx=0x7f2b54009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7fa13659c640 1 -- 172.21.15.67:0/2096078840 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1300d8b50 con 0x7fa130054130 2024-04-25T02:28:34.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.474+0000 7fa13759e640 1 --2- 172.21.15.67:0/2096078840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1300e30c0 0x7fa1300dbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:34.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.475+0000 7f772affd640 1 --2- 172.21.15.67:0/26204748 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f771c06be80 0x7f771c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.475+0000 7f8acbfff640 1 --2- 172.21.15.67:0/1937341502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ac417cab0 0x7f8ac403d200 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8acc06a010 tx=0x7f8acc0754c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.476+0000 7f8ab37fe640 1 -- 172.21.15.67:0/1937341502 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0c2070 con 0x7f8ac417cab0 2024-04-25T02:28:34.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.475+0000 7fa13659c640 1 --2- 172.21.15.67:0/2096078840 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa130054130 0x7fa1300db7b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa128009990 tx=0x7fa1280046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.475+0000 7fa11f7fe640 1 -- 172.21.15.67:0/2096078840 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa128042070 con 0x7fa130054130 2024-04-25T02:28:34.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.475+0000 7fa11f7fe640 1 -- 172.21.15.67:0/2096078840 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa128004250 con 0x7fa130054130 2024-04-25T02:28:34.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.475+0000 7fa11f7fe640 1 -- 172.21.15.67:0/2096078840 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa128037040 con 0x7fa130054130 2024-04-25T02:28:34.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.475+0000 7fa13c8ed640 1 -- 172.21.15.67:0/2096078840 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1300504a0 con 0x7fa130054130 2024-04-25T02:28:34.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.475+0000 7fa13c8ed640 1 -- 172.21.15.67:0/2096078840 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1300dcdc0 con 0x7fa130054130 2024-04-25T02:28:34.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.476+0000 7f8ab37fe640 1 -- 172.21.15.67:0/1937341502 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8acc0923b0 con 0x7f8ac417cab0 2024-04-25T02:28:34.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.476+0000 7f7740f29640 1 -- 172.21.15.67:0/26204748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f773c0756b0 con 0x7f773c0d0500 2024-04-25T02:28:34.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.475+0000 7f7b2ad09640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b0c0039b0 0x7f7b240cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.475+0000 7f7b2ad09640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b240c8380 0x7f7b24071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.475+0000 7f7b2ad09640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b2415d0a0 0x7f7b2415d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.475+0000 7f7b2ad09640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7b240d1360 con 0x7f7b2415d0a0 2024-04-25T02:28:34.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.475+0000 7f7b2ad09640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7b24161ca0 con 0x7f7b0c0039b0 2024-04-25T02:28:34.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.475+0000 7f7b2ad09640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7b240d14e0 con 0x7f7b240c8380 2024-04-25T02:28:34.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.476+0000 7f7b28aa5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b0c0039b0 0x7f7b240cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.476+0000 7f7b28aa5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b0c0039b0 0x7f7b240cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:54092/0 (socket says 172.21.15.67:54092) 2024-04-25T02:28:34.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.476+0000 7f7b28aa5640 1 -- 172.21.15.67:0/109161558 learned_addr learned my addr 172.21.15.67:0/109161558 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:34.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.476+0000 7f7b23fff640 1 --2- 172.21.15.67:0/109161558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b240c8380 0x7f7b24071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.476+0000 7f773a59c640 1 --2- 172.21.15.67:0/26204748 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f771c06be80 0x7f771c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.476+0000 7f7b292a6640 1 --2- 172.21.15.67:0/109161558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b2415d0a0 0x7f7b2415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.476+0000 7f8ad151d640 1 -- 172.21.15.67:0/1937341502 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac40d92e0 con 0x7f8ac417cab0 2024-04-25T02:28:34.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.477+0000 7f8ad151d640 1 -- 172.21.15.67:0/1937341502 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac40d98a0 con 0x7f8ac417cab0 2024-04-25T02:28:34.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.477+0000 7f8ab37fe640 1 -- 172.21.15.67:0/1937341502 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0b7070 con 0x7f8ac417cab0 2024-04-25T02:28:34.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.477+0000 7fa13c8ed640 1 -- 172.21.15.67:0/2096078840 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1300057e0 con 0x7fa130054130 2024-04-25T02:28:34.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.477+0000 7f7b292a6640 1 -- 172.21.15.67:0/109161558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b240c8380 msgr2=0x7f7b24071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.477+0000 7f7b292a6640 1 --2- 172.21.15.67:0/109161558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b240c8380 0x7f7b24071c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.477+0000 7f47abfff640 1 -- 172.21.15.67:0/2884235350 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c8069110 con 0x7f47c80acda0 2024-04-25T02:28:34.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.477+0000 7f7b292a6640 1 -- 172.21.15.67:0/109161558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b0c0039b0 msgr2=0x7f7b240cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.477+0000 7f7b292a6640 1 --2- 172.21.15.67:0/109161558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b0c0039b0 0x7f7b240cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.477+0000 7f7b292a6640 1 -- 172.21.15.67:0/109161558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2415da70 con 0x7f7b2415d0a0 2024-04-25T02:28:34.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.477+0000 7f47be7fc640 1 -- 172.21.15.67:0/2884235350 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47c4009840 con 0x7f47c80acda0 2024-04-25T02:28:34.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.477+0000 7f7b292a6640 1 --2- 172.21.15.67:0/109161558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b2415d0a0 0x7f7b2415d530 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7b240d1ad0 tx=0x7f7b1c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.478+0000 7f773a59c640 1 --2- 172.21.15.67:0/26204748 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f771c06be80 0x7f771c06e340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f772c003c50 tx=0x7f772c0079b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.478+0000 7f47be7fc640 1 --2- 172.21.15.67:0/2884235350 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f47ac06bf30 0x7f47ac06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.478+0000 7f47cd635640 1 --2- 172.21.15.67:0/2884235350 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f47ac06bf30 0x7f47ac06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.478+0000 7f47be7fc640 1 -- 172.21.15.67:0/2884235350 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f47c408afa0 con 0x7f47c80acda0 2024-04-25T02:28:34.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.478+0000 7f8ad151d640 1 -- 172.21.15.67:0/1937341502 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac4005570 con 0x7f8ac417cab0 2024-04-25T02:28:34.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.478+0000 7fa11f7fe640 1 -- 172.21.15.67:0/2096078840 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa128045070 con 0x7fa130054130 2024-04-25T02:28:34.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.479+0000 7f47cd635640 1 --2- 172.21.15.67:0/2884235350 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f47ac06bf30 0x7f47ac06e3f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f47c815b1b0 tx=0x7f47b8007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.479+0000 7f8ab37fe640 1 -- 172.21.15.67:0/1937341502 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8acc0c5070 con 0x7f8ac417cab0 2024-04-25T02:28:34.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.479+0000 7fa11f7fe640 1 --2- 172.21.15.67:0/2096078840 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa12406be80 0x7fa12406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.479+0000 7fa11f7fe640 1 -- 172.21.15.67:0/2096078840 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa1280ab150 con 0x7fa130054130 2024-04-25T02:28:34.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.479+0000 7f8ab37fe640 1 --2- 172.21.15.67:0/1937341502 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8ab806be80 0x7f8ab806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.479+0000 7fa136d9d640 1 --2- 172.21.15.67:0/2096078840 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa12406be80 0x7fa12406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.479+0000 7f8ab37fe640 1 -- 172.21.15.67:0/1937341502 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8acc126be0 con 0x7f8ac417cab0 2024-04-25T02:28:34.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.479+0000 7f8acaffd640 1 --2- 172.21.15.67:0/1937341502 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8ab806be80 0x7f8ab806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.480+0000 7fa136d9d640 1 --2- 172.21.15.67:0/2096078840 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa12406be80 0x7fa12406e340 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa12c007fd0 tx=0x7fa12c007c20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.480+0000 7f8acaffd640 1 --2- 172.21.15.67:0/1937341502 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8ab806be80 0x7f8ab806e340 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40dda60 tx=0x7f8ac0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.480+0000 7f12df7fe640 1 -- 172.21.15.67:0/2262614528 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0043070 con 0x7f12f80b7200 2024-04-25T02:28:34.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.481+0000 7f772affd640 1 -- 172.21.15.67:0/26204748 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f77340b0060 con 0x7f773c0d0500 2024-04-25T02:28:34.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.481+0000 7f12df7fe640 1 -- 172.21.15.67:0/2262614528 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f002f070 con 0x7f12f80b7200 2024-04-25T02:28:34.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.481+0000 7f7b217fa640 1 -- 172.21.15.67:0/109161558 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c01a070 con 0x7f7b2415d0a0 2024-04-25T02:28:34.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.481+0000 7f2b58ff9640 1 -- 172.21.15.67:0/2072827890 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2b5001f020 con 0x7f2b5c06c890 2024-04-25T02:28:34.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.481+0000 7f12fd5e2640 1 -- 172.21.15.67:0/2262614528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f80ca140 con 0x7f12f80b7200 2024-04-25T02:28:34.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.481+0000 7f12fd5e2640 1 -- 172.21.15.67:0/2262614528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f815f820 con 0x7f12f80b7200 2024-04-25T02:28:34.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.481+0000 7f7b217fa640 1 -- 172.21.15.67:0/109161558 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c015440 con 0x7f7b2415d0a0 2024-04-25T02:28:34.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.481+0000 7f7b2ad09640 1 -- 172.21.15.67:0/109161558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b240cd5b0 con 0x7f7b2415d0a0 2024-04-25T02:28:34.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.481+0000 7f7b2ad09640 1 -- 172.21.15.67:0/109161558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b2406e3e0 con 0x7f7b2415d0a0 2024-04-25T02:28:34.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.481+0000 7f7b217fa640 1 -- 172.21.15.67:0/109161558 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c0157f0 con 0x7f7b2415d0a0 2024-04-25T02:28:34.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.481+0000 7f12df7fe640 1 -- 172.21.15.67:0/2262614528 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0034470 con 0x7f12f80b7200 2024-04-25T02:28:34.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.482+0000 7f12dd7fa640 1 -- 172.21.15.67:0/2262614528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12d0005290 con 0x7f12f80b7200 2024-04-25T02:28:34.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.482+0000 7f7b0affd640 1 -- 172.21.15.67:0/109161558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7afc005290 con 0x7f7b2415d0a0 2024-04-25T02:28:34.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.482+0000 7fa11f7fe640 1 -- 172.21.15.67:0/2096078840 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa12804c020 con 0x7fa130054130 2024-04-25T02:28:34.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.483+0000 7f47be7fc640 1 -- 172.21.15.67:0/2884235350 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f47c40592e0 con 0x7f47c80acda0 2024-04-25T02:28:34.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.487+0000 7f8ab37fe640 1 -- 172.21.15.67:0/1937341502 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8acc0f50b0 con 0x7f8ac417cab0 2024-04-25T02:28:34.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.489+0000 7f772affd640 1 -- 172.21.15.67:0/26204748 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7734079f00 con 0x7f773c0d0500 2024-04-25T02:28:34.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.491+0000 7f12df7fe640 1 -- 172.21.15.67:0/2262614528 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f12f0046070 con 0x7f12f80b7200 2024-04-25T02:28:34.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.494+0000 7f12df7fe640 1 --2- 172.21.15.67:0/2262614528 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f12e406be30 0x7f12e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.494+0000 7f12df7fe640 1 -- 172.21.15.67:0/2262614528 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f12f00ab2e0 con 0x7f12f80b7200 2024-04-25T02:28:34.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.494+0000 7f7b217fa640 1 -- 172.21.15.67:0/109161558 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b1c01d070 con 0x7f7b2415d0a0 2024-04-25T02:28:34.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.495+0000 7f7b217fa640 1 --2- 172.21.15.67:0/109161558 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7b1006bf00 0x7f7b1006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:34.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.495+0000 7f7b217fa640 1 -- 172.21.15.67:0/109161558 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7b1c08b630 con 0x7f7b2415d0a0 2024-04-25T02:28:34.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.496+0000 7f12f6ffd640 1 --2- 172.21.15.67:0/2262614528 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f12e406be30 0x7f12e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.496+0000 7f7b28aa5640 1 --2- 172.21.15.67:0/109161558 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7b1006bf00 0x7f7b1006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:34.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.497+0000 7f7b28aa5640 1 --2- 172.21.15.67:0/109161558 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7b1006bf00 0x7f7b1006e3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7b18000fb0 tx=0x7f7b18009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.497+0000 7f12f6ffd640 1 --2- 172.21.15.67:0/2262614528 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f12e406be30 0x7f12e406e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009ab0 tx=0x7f12ec0093a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:34.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.500+0000 7f12df7fe640 1 -- 172.21.15.67:0/2262614528 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f12f003a040 con 0x7f12f80b7200 2024-04-25T02:28:34.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.510+0000 7f7b217fa640 1 -- 172.21.15.67:0/109161558 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7b1c059970 con 0x7f7b2415d0a0 2024-04-25T02:28:34.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.841+0000 7fa238e5d640 1 -- 172.21.15.67:0/2366674472 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa2340cf560 con 0x7fa23416e920 2024-04-25T02:28:34.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.842+0000 7fa222ffd640 1 -- 172.21.15.67:0/2366674472 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa22805c910 con 0x7fa23416e920 2024-04-25T02:28:34.846 INFO:teuthology.orchestra.run.smithi067.stdout:55834574853 2024-04-25T02:28:34.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.845+0000 7fa220ff9640 1 -- 172.21.15.67:0/2366674472 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa21406bf30 msgr2=0x7fa21406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.845+0000 7fa220ff9640 1 --2- 172.21.15.67:0/2366674472 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa21406bf30 0x7fa21406e3f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa2342058e0 tx=0x7fa224009190 comp rx=0 tx=0).stop 2024-04-25T02:28:34.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.845+0000 7fa220ff9640 1 -- 172.21.15.67:0/2366674472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa23416e920 msgr2=0x7fa234162ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.845+0000 7fa220ff9640 1 --2- 172.21.15.67:0/2366674472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa23416e920 0x7fa234162ef0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa22800c430 tx=0x7fa22800c8f0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.846+0000 7fa220ff9640 1 -- 172.21.15.67:0/2366674472 shutdown_connections 2024-04-25T02:28:34.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.846+0000 7fa220ff9640 1 --2- 172.21.15.67:0/2366674472 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa21406bf30 0x7fa21406e3f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.846+0000 7fa220ff9640 1 --2- 172.21.15.67:0/2366674472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2342052d0 0x7fa234202920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.846+0000 7fa220ff9640 1 --2- 172.21.15.67:0/2366674472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa234204e50 0x7fa234165a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.846+0000 7fa220ff9640 1 --2- 172.21.15.67:0/2366674472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa23416e920 0x7fa234162ef0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.846+0000 7fa220ff9640 1 -- 172.21.15.67:0/2366674472 >> 172.21.15.67:0/2366674472 conn(0x7fa2340b19c0 msgr2=0x7fa23416ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:34.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.846+0000 7fa220ff9640 1 -- 172.21.15.67:0/2366674472 shutdown_connections 2024-04-25T02:28:34.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.846+0000 7fa220ff9640 1 -- 172.21.15.67:0/2366674472 wait complete. 2024-04-25T02:28:34.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-04-25T02:28:34.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.890+0000 7f8ad151d640 1 -- 172.21.15.67:0/1937341502 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8ac40dcf00 con 0x7f8ac417cab0 2024-04-25T02:28:34.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.891+0000 7f8ab37fe640 1 -- 172.21.15.67:0/1937341502 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8acc0f93b0 con 0x7f8ac417cab0 2024-04-25T02:28:34.895 INFO:teuthology.orchestra.run.smithi067.stdout:55834574856 2024-04-25T02:28:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.893+0000 7f8ad151d640 1 -- 172.21.15.67:0/1937341502 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8ab806be80 msgr2=0x7f8ab806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.893+0000 7f8ad151d640 1 --2- 172.21.15.67:0/1937341502 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8ab806be80 0x7f8ab806e340 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40dda60 tx=0x7f8ac0008040 comp rx=0 tx=0).stop 2024-04-25T02:28:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.893+0000 7f8ad151d640 1 -- 172.21.15.67:0/1937341502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ac417cab0 msgr2=0x7f8ac403d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.893+0000 7f8ad151d640 1 --2- 172.21.15.67:0/1937341502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ac417cab0 0x7f8ac403d200 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8acc06a010 tx=0x7f8acc0754c0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.893+0000 7f8ad151d640 1 -- 172.21.15.67:0/1937341502 shutdown_connections 2024-04-25T02:28:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.893+0000 7f8ad151d640 1 --2- 172.21.15.67:0/1937341502 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8ab806be80 0x7f8ab806e340 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.893+0000 7f8ad151d640 1 --2- 172.21.15.67:0/1937341502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ac417cab0 0x7f8ac403d200 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.893+0000 7f8ad151d640 1 --2- 172.21.15.67:0/1937341502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ac417c630 0x7f8ac40da0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.893+0000 7f8ad151d640 1 --2- 172.21.15.67:0/1937341502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ab4004d40 0x7f8ac40cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.894+0000 7f8ad151d640 1 -- 172.21.15.67:0/1937341502 >> 172.21.15.67:0/1937341502 conn(0x7f8ac4054ca0 msgr2=0x7f8ac4037ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:34.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.894+0000 7f8ad151d640 1 -- 172.21.15.67:0/1937341502 shutdown_connections 2024-04-25T02:28:34.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.894+0000 7f8ad151d640 1 -- 172.21.15.67:0/1937341502 wait complete. 2024-04-25T02:28:34.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.3 2024-04-25T02:28:34.909 DEBUG:teuthology.parallel:result is None 2024-04-25T02:28:34.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.913+0000 7f47abfff640 1 -- 172.21.15.67:0/2884235350 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f47c806d060 con 0x7f47c80acda0 2024-04-25T02:28:34.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.913+0000 7f2b62464640 1 -- 172.21.15.67:0/2072827890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2b5c0cf540 con 0x7f2b5c06c890 2024-04-25T02:28:34.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.913+0000 7f7740f29640 1 -- 172.21.15.67:0/26204748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f773c0cc3b0 con 0x7f773c0d0500 2024-04-25T02:28:34.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.914+0000 7f47be7fc640 1 -- 172.21.15.67:0/2884235350 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f47c405d5e0 con 0x7f47c80acda0 2024-04-25T02:28:34.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.914+0000 7f2b58ff9640 1 -- 172.21.15.67:0/2072827890 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2b50058fb0 con 0x7f2b5c06c890 2024-04-25T02:28:34.919 INFO:teuthology.orchestra.run.smithi067.stdout:55834574855 2024-04-25T02:28:34.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.914+0000 7f772affd640 1 -- 172.21.15.67:0/26204748 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7734079800 con 0x7f773c0d0500 2024-04-25T02:28:34.919 INFO:teuthology.orchestra.run.smithi067.stdout:55834574856 2024-04-25T02:28:34.920 INFO:teuthology.orchestra.run.smithi067.stdout:55834574855 2024-04-25T02:28:34.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.916+0000 7f2b62464640 1 -- 172.21.15.67:0/2072827890 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2b4806bf00 msgr2=0x7f2b4806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.916+0000 7f2b62464640 1 --2- 172.21.15.67:0/2072827890 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2b4806bf00 0x7f2b4806e3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0cff80 tx=0x7f2b54009040 comp rx=0 tx=0).stop 2024-04-25T02:28:34.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.916+0000 7f2b62464640 1 -- 172.21.15.67:0/2072827890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b5c06c890 msgr2=0x7f2b5c153540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.916+0000 7f2b62464640 1 --2- 172.21.15.67:0/2072827890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b5c06c890 0x7f2b5c153540 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000b3e0 tx=0x7f2b5000b8a0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.916+0000 7f2b62464640 1 -- 172.21.15.67:0/2072827890 shutdown_connections 2024-04-25T02:28:34.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f2b62464640 1 --2- 172.21.15.67:0/2072827890 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2b4806bf00 0x7f2b4806e3c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f2b62464640 1 --2- 172.21.15.67:0/2072827890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b5c0d4730 0x7f2b5c0b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f2b62464640 1 --2- 172.21.15.67:0/2072827890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b5c0b3770 0x7f2b5c071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f2b62464640 1 --2- 172.21.15.67:0/2072827890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b5c06c890 0x7f2b5c153540 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f2b62464640 1 -- 172.21.15.67:0/2072827890 >> 172.21.15.67:0/2072827890 conn(0x7f2b5c08dbb0 msgr2=0x7f2b5c0ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:34.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7fa13c8ed640 1 -- 172.21.15.67:0/2096078840 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa1300396b0 con 0x7fa130054130 2024-04-25T02:28:34.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f2b62464640 1 -- 172.21.15.67:0/2072827890 shutdown_connections 2024-04-25T02:28:34.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f2b62464640 1 -- 172.21.15.67:0/2072827890 wait complete. 2024-04-25T02:28:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f47abfff640 1 -- 172.21.15.67:0/2884235350 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f47ac06bf30 msgr2=0x7f47ac06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f47abfff640 1 --2- 172.21.15.67:0/2884235350 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f47ac06bf30 0x7f47ac06e3f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f47c815b1b0 tx=0x7f47b8007d30 comp rx=0 tx=0).stop 2024-04-25T02:28:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f47abfff640 1 -- 172.21.15.67:0/2884235350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47c80acda0 msgr2=0x7f47c8149310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f47abfff640 1 --2- 172.21.15.67:0/2884235350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47c80acda0 0x7f47c8149310 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f47c400d7d0 tx=0x7f47c400dc90 comp rx=0 tx=0).stop 2024-04-25T02:28:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f47abfff640 1 -- 172.21.15.67:0/2884235350 shutdown_connections 2024-04-25T02:28:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f47abfff640 1 --2- 172.21.15.67:0/2884235350 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f47ac06bf30 0x7f47ac06e3f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f47abfff640 1 --2- 172.21.15.67:0/2884235350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47c815c230 0x7f47c80cf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f47abfff640 1 --2- 172.21.15.67:0/2884235350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47c80af120 0x7f47c80b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f47abfff640 1 --2- 172.21.15.67:0/2884235350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47c80acda0 0x7f47c8149310 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f47abfff640 1 -- 172.21.15.67:0/2884235350 >> 172.21.15.67:0/2884235350 conn(0x7f47c80b19c0 msgr2=0x7f47c815b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f47abfff640 1 -- 172.21.15.67:0/2884235350 shutdown_connections 2024-04-25T02:28:34.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7f47abfff640 1 -- 172.21.15.67:0/2884235350 wait complete. 2024-04-25T02:28:34.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.917+0000 7fa11f7fe640 1 -- 172.21.15.67:0/2096078840 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa128079a50 con 0x7fa130054130 2024-04-25T02:28:34.924 INFO:teuthology.orchestra.run.smithi067.stdout:55834574855 2024-04-25T02:28:34.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.918+0000 7f7740f29640 1 -- 172.21.15.67:0/26204748 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f771c06be80 msgr2=0x7f771c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.918+0000 7f7740f29640 1 --2- 172.21.15.67:0/26204748 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f771c06be80 0x7f771c06e340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f772c003c50 tx=0x7f772c0079b0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.918+0000 7f7740f29640 1 -- 172.21.15.67:0/26204748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f773c0d0500 msgr2=0x7f773c154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.918+0000 7f7740f29640 1 --2- 172.21.15.67:0/26204748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f773c0d0500 0x7f773c154b70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7734030000 tx=0x7f7734004a70 comp rx=0 tx=0).stop 2024-04-25T02:28:34.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.918+0000 7f7740f29640 1 -- 172.21.15.67:0/26204748 shutdown_connections 2024-04-25T02:28:34.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.918+0000 7f7740f29640 1 --2- 172.21.15.67:0/26204748 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f771c06be80 0x7f771c06e340 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.918+0000 7f7740f29640 1 --2- 172.21.15.67:0/26204748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f773c0d0500 0x7f773c154b70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.918+0000 7f7740f29640 1 --2- 172.21.15.67:0/26204748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f773c0ccda0 0x7f773c0c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.918+0000 7f7740f29640 1 --2- 172.21.15.67:0/26204748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f773c071c10 0x7f773c0c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.918+0000 7f7740f29640 1 -- 172.21.15.67:0/26204748 >> 172.21.15.67:0/26204748 conn(0x7f773c0d0d50 msgr2=0x7f773c06ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:34.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.918+0000 7f7740f29640 1 -- 172.21.15.67:0/26204748 shutdown_connections 2024-04-25T02:28:34.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.918+0000 7f7740f29640 1 -- 172.21.15.67:0/26204748 wait complete. 2024-04-25T02:28:34.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.920+0000 7fa13c8ed640 1 -- 172.21.15.67:0/2096078840 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa12406be80 msgr2=0x7fa12406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.920+0000 7fa13c8ed640 1 --2- 172.21.15.67:0/2096078840 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa12406be80 0x7fa12406e340 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa12c007fd0 tx=0x7fa12c007c20 comp rx=0 tx=0).stop 2024-04-25T02:28:34.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.920+0000 7fa13c8ed640 1 -- 172.21.15.67:0/2096078840 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa130054130 msgr2=0x7fa1300db7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.920+0000 7fa13c8ed640 1 --2- 172.21.15.67:0/2096078840 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa130054130 0x7fa1300db7b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa128009990 tx=0x7fa1280046c0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.921+0000 7fa13c8ed640 1 -- 172.21.15.67:0/2096078840 shutdown_connections 2024-04-25T02:28:34.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.921+0000 7fa13c8ed640 1 --2- 172.21.15.67:0/2096078840 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa12406be80 0x7fa12406e340 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.921+0000 7fa13c8ed640 1 --2- 172.21.15.67:0/2096078840 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1300e30c0 0x7fa1300dbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.921+0000 7fa13c8ed640 1 --2- 172.21.15.67:0/2096078840 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa130054130 0x7fa1300db7b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.921+0000 7fa13c8ed640 1 --2- 172.21.15.67:0/2096078840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa13003e840 0x7fa1300dc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.921+0000 7fa13c8ed640 1 -- 172.21.15.67:0/2096078840 >> 172.21.15.67:0/2096078840 conn(0x7fa1300559e0 msgr2=0x7fa130057940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:34.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.921+0000 7fa13c8ed640 1 -- 172.21.15.67:0/2096078840 shutdown_connections 2024-04-25T02:28:34.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.921+0000 7fa13c8ed640 1 -- 172.21.15.67:0/2096078840 wait complete. 2024-04-25T02:28:34.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.928+0000 7f12dd7fa640 1 -- 172.21.15.67:0/2262614528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f12d0005850 con 0x7f12f80b7200 2024-04-25T02:28:34.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.929+0000 7f12df7fe640 1 -- 172.21.15.67:0/2262614528 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f12f0079590 con 0x7f12f80b7200 2024-04-25T02:28:34.933 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2024-04-25T02:28:34.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.931+0000 7f12dd7fa640 1 -- 172.21.15.67:0/2262614528 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f12e406be30 msgr2=0x7f12e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.931+0000 7f12dd7fa640 1 --2- 172.21.15.67:0/2262614528 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f12e406be30 0x7f12e406e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009ab0 tx=0x7f12ec0093a0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.931+0000 7f12dd7fa640 1 -- 172.21.15.67:0/2262614528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12f80b7200 msgr2=0x7f12f80b7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.931+0000 7f12dd7fa640 1 --2- 172.21.15.67:0/2262614528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12f80b7200 0x7f12f80b7680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f12f000a850 tx=0x7f12f80d5000 comp rx=0 tx=0).stop 2024-04-25T02:28:34.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.931+0000 7f12dd7fa640 1 -- 172.21.15.67:0/2262614528 shutdown_connections 2024-04-25T02:28:34.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.931+0000 7f12dd7fa640 1 --2- 172.21.15.67:0/2262614528 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f12e406be30 0x7f12e406e2f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.931+0000 7f12dd7fa640 1 --2- 172.21.15.67:0/2262614528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12f80b7200 0x7f12f80b7680 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.931+0000 7f12dd7fa640 1 --2- 172.21.15.67:0/2262614528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12f81534e0 0x7f12f80b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.931+0000 7f12dd7fa640 1 --2- 172.21.15.67:0/2262614528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12f81530e0 0x7f12f8160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.931+0000 7f12dd7fa640 1 -- 172.21.15.67:0/2262614528 >> 172.21.15.67:0/2262614528 conn(0x7f12f80d40a0 msgr2=0x7f12f806bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:34.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.4 2024-04-25T02:28:34.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.932+0000 7f12dd7fa640 1 -- 172.21.15.67:0/2262614528 shutdown_connections 2024-04-25T02:28:34.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.932+0000 7f12dd7fa640 1 -- 172.21.15.67:0/2262614528 wait complete. 2024-04-25T02:28:34.937 DEBUG:teuthology.parallel:result is None 2024-04-25T02:28:34.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.0 2024-04-25T02:28:34.942 DEBUG:teuthology.parallel:result is None 2024-04-25T02:28:34.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.1 2024-04-25T02:28:34.942 DEBUG:teuthology.parallel:result is None 2024-04-25T02:28:34.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.939+0000 7f7b0affd640 1 -- 172.21.15.67:0/109161558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7afc005850 con 0x7f7b2415d0a0 2024-04-25T02:28:34.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.940+0000 7f7b217fa640 1 -- 172.21.15.67:0/109161558 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7b1c05dc70 con 0x7f7b2415d0a0 2024-04-25T02:28:34.944 INFO:teuthology.orchestra.run.smithi067.stdout:55834574856 2024-04-25T02:28:34.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.2 2024-04-25T02:28:34.945 DEBUG:teuthology.parallel:result is None 2024-04-25T02:28:34.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.942+0000 7f7b0affd640 1 -- 172.21.15.67:0/109161558 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7b1006bf00 msgr2=0x7f7b1006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.942+0000 7f7b0affd640 1 --2- 172.21.15.67:0/109161558 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7b1006bf00 0x7f7b1006e3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7b18000fb0 tx=0x7f7b18009030 comp rx=0 tx=0).stop 2024-04-25T02:28:34.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.942+0000 7f7b0affd640 1 -- 172.21.15.67:0/109161558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b2415d0a0 msgr2=0x7f7b2415d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:34.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.942+0000 7f7b0affd640 1 --2- 172.21.15.67:0/109161558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b2415d0a0 0x7f7b2415d530 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7b240d1ad0 tx=0x7f7b1c00a710 comp rx=0 tx=0).stop 2024-04-25T02:28:34.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.942+0000 7f7b0affd640 1 -- 172.21.15.67:0/109161558 shutdown_connections 2024-04-25T02:28:34.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.942+0000 7f7b0affd640 1 --2- 172.21.15.67:0/109161558 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7b1006bf00 0x7f7b1006e3c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.942+0000 7f7b0affd640 1 --2- 172.21.15.67:0/109161558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b2415d0a0 0x7f7b2415d530 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.942+0000 7f7b0affd640 1 --2- 172.21.15.67:0/109161558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b240c8380 0x7f7b24071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.942+0000 7f7b0affd640 1 --2- 172.21.15.67:0/109161558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b0c0039b0 0x7f7b240cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:34.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.942+0000 7f7b0affd640 1 -- 172.21.15.67:0/109161558 >> 172.21.15.67:0/109161558 conn(0x7f7b240d3f50 msgr2=0x7f7b240b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:34.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.942+0000 7f7b0affd640 1 -- 172.21.15.67:0/109161558 shutdown_connections 2024-04-25T02:28:34.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:34.942+0000 7f7b0affd640 1 -- 172.21.15.67:0/109161558 wait complete. 2024-04-25T02:28:34.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2024-04-25T02:28:34.948 DEBUG:teuthology.parallel:result is None 2024-04-25T02:28:34.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.5 2024-04-25T02:28:34.957 DEBUG:teuthology.parallel:result is None 2024-04-25T02:28:35.874 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T02:28:35.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.984+0000 7f85cf3a2640 1 Processor -- start 2024-04-25T02:28:35.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.984+0000 7f85cf3a2640 1 -- start start 2024-04-25T02:28:35.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.985+0000 7f85cf3a2640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f85c815bfc0 0x7f85c80ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.985+0000 7f85cf3a2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c80d0210 0x7f85c80cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.985+0000 7f85cf3a2640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85c815c3a0 con 0x7f85c815e9f0 2024-04-25T02:28:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.985+0000 7f85cf3a2640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f85c80d0760 con 0x7f85c815bfc0 2024-04-25T02:28:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.985+0000 7f85cf3a2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f85c80d0a40 con 0x7f85c80d0210 2024-04-25T02:28:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.985+0000 7f85cd13e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f85c815bfc0 0x7f85c80ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.985+0000 7f85cc93d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c80d0210 0x7f85c80cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.985+0000 7f85cc93d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c80d0210 0x7f85c80cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:47392/0 (socket says 172.21.15.67:47392) 2024-04-25T02:28:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.985+0000 7f85cd13e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f85c815bfc0 0x7f85c80ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:54096/0 (socket says 172.21.15.67:54096) 2024-04-25T02:28:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.985+0000 7f85cd93f640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f85c815e9f0 0x7f85c8161f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:42604/0 (socket says 172.21.15.67:42604) 2024-04-25T02:28:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.985+0000 7f85cc93d640 1 -- 172.21.15.67:0/482031240 learned_addr learned my addr 172.21.15.67:0/482031240 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.986+0000 7f85cc93d640 1 -- 172.21.15.67:0/482031240 >> v2:172.21.15.176:3300/0 conn(0x7f85c815bfc0 msgr2=0x7f85c80ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.986+0000 7f85cc93d640 1 --2- 172.21.15.67:0/482031240 >> v2:172.21.15.176:3300/0 conn(0x7f85c815bfc0 0x7f85c80ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:35.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.986+0000 7f85cc93d640 1 -- 172.21.15.67:0/482031240 >> v1:172.21.15.176:6789/0 conn(0x7f85c815e9f0 legacy=0x7f85c8161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:35.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.986+0000 7f85cc93d640 1 -- 172.21.15.67:0/482031240 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c80d0d20 con 0x7f85c80d0210 2024-04-25T02:28:35.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.987+0000 7f85cc93d640 1 --2- 172.21.15.67:0/482031240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c80d0210 0x7f85c80cec90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f85bc009870 tx=0x7f85bc02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ded1afa7b5a6972 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:35.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.987+0000 7f85c7fff640 1 -- 172.21.15.67:0/482031240 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc037070 con 0x7f85c80d0210 2024-04-25T02:28:35.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.987+0000 7f85c7fff640 1 -- 172.21.15.67:0/482031240 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85bc032440 con 0x7f85c80d0210 2024-04-25T02:28:35.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.987+0000 7f85c7fff640 1 -- 172.21.15.67:0/482031240 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc032810 con 0x7f85c80d0210 2024-04-25T02:28:35.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.987+0000 7f85cf3a2640 1 -- 172.21.15.67:0/482031240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c80d0210 msgr2=0x7f85c80cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:35.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.987+0000 7f85cf3a2640 1 --2- 172.21.15.67:0/482031240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c80d0210 0x7f85c80cec90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f85bc009870 tx=0x7f85bc02a270 comp rx=0 tx=0).stop 2024-04-25T02:28:35.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.987+0000 7f85cf3a2640 1 -- 172.21.15.67:0/482031240 shutdown_connections 2024-04-25T02:28:35.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.987+0000 7f85cf3a2640 1 --2- 172.21.15.67:0/482031240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c80d0210 0x7f85c80cec90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:35.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.987+0000 7f85cf3a2640 1 --2- 172.21.15.67:0/482031240 >> v2:172.21.15.176:3300/0 conn(0x7f85c815bfc0 0x7f85c80ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:35.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.987+0000 7f85cf3a2640 1 -- 172.21.15.67:0/482031240 >> 172.21.15.67:0/482031240 conn(0x7f85c80d1ed0 msgr2=0x7f85c80d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:35.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.987+0000 7f85cf3a2640 1 -- 172.21.15.67:0/482031240 shutdown_connections 2024-04-25T02:28:35.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.987+0000 7f85cf3a2640 1 -- 172.21.15.67:0/482031240 wait complete. 2024-04-25T02:28:35.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.989+0000 7f85cf3a2640 1 Processor -- start 2024-04-25T02:28:35.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.989+0000 7f85cf3a2640 1 -- start start 2024-04-25T02:28:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.989+0000 7f85cf3a2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c80d0210 0x7f85c814f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.989+0000 7f85cf3a2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85c815bfc0 0x7f85c80b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.989+0000 7f85cf3a2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85c815e9f0 0x7f85c80b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.989+0000 7f85cf3a2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f85c80cf690 con 0x7f85c815e9f0 2024-04-25T02:28:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.989+0000 7f85cf3a2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f85c80d12e0 con 0x7f85c815bfc0 2024-04-25T02:28:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.989+0000 7f85cf3a2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f85c80cf810 con 0x7f85c80d0210 2024-04-25T02:28:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.990+0000 7f85cd93f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85c815e9f0 0x7f85c80b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.990+0000 7f85cd93f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85c815e9f0 0x7f85c80b2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54614/0 (socket says 172.21.15.67:54614) 2024-04-25T02:28:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.990+0000 7f85cd93f640 1 -- 172.21.15.67:0/1353440363 learned_addr learned my addr 172.21.15.67:0/1353440363 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.990+0000 7f85cd13e640 1 --2- 172.21.15.67:0/1353440363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c80d0210 0x7f85c814f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.990+0000 7f85cc93d640 1 --2- 172.21.15.67:0/1353440363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85c815bfc0 0x7f85c80b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.990+0000 7f85cd93f640 1 -- 172.21.15.67:0/1353440363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c80d0210 msgr2=0x7f85c814f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.990+0000 7f85cd93f640 1 --2- 172.21.15.67:0/1353440363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c80d0210 0x7f85c814f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.990+0000 7f85cd93f640 1 -- 172.21.15.67:0/1353440363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85c815bfc0 msgr2=0x7f85c80b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:35.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.990+0000 7f85cd93f640 1 --2- 172.21.15.67:0/1353440363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85c815bfc0 0x7f85c80b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:35.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.990+0000 7f85cd93f640 1 -- 172.21.15.67:0/1353440363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c80c59d0 con 0x7f85c815e9f0 2024-04-25T02:28:35.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.990+0000 7f85cd93f640 1 --2- 172.21.15.67:0/1353440363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85c815e9f0 0x7f85c80b2570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f85b800c7b0 tx=0x7f85b800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:35.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.990+0000 7f85c5ffb640 1 -- 172.21.15.67:0/1353440363 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b8017070 con 0x7f85c815e9f0 2024-04-25T02:28:35.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.990+0000 7f85c5ffb640 1 -- 172.21.15.67:0/1353440363 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85b800a640 con 0x7f85c815e9f0 2024-04-25T02:28:35.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.990+0000 7f85cf3a2640 1 -- 172.21.15.67:0/1353440363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85c80c5cb0 con 0x7f85c815e9f0 2024-04-25T02:28:35.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.990+0000 7f85c5ffb640 1 -- 172.21.15.67:0/1353440363 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b800a9f0 con 0x7f85c815e9f0 2024-04-25T02:28:35.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.991+0000 7f85cf3a2640 1 -- 172.21.15.67:0/1353440363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85c80c6270 con 0x7f85c815e9f0 2024-04-25T02:28:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.991+0000 7f85cf3a2640 1 -- 172.21.15.67:0/1353440363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85c8069110 con 0x7f85c815e9f0 2024-04-25T02:28:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.992+0000 7f85c5ffb640 1 -- 172.21.15.67:0/1353440363 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85b801a070 con 0x7f85c815e9f0 2024-04-25T02:28:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.992+0000 7f85c5ffb640 1 --2- 172.21.15.67:0/1353440363 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f85b406be60 0x7f85b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.992+0000 7f85c5ffb640 1 -- 172.21.15.67:0/1353440363 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f85b808a370 con 0x7f85c815e9f0 2024-04-25T02:28:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.992+0000 7f85cd13e640 1 --2- 172.21.15.67:0/1353440363 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f85b406be60 0x7f85b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.993+0000 7f85cd13e640 1 --2- 172.21.15.67:0/1353440363 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f85b406be60 0x7f85b406e320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f85c80b3160 tx=0x7f85c0009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:35.996+0000 7f85c5ffb640 1 -- 172.21.15.67:0/1353440363 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f85b80586e0 con 0x7f85c815e9f0 2024-04-25T02:28:36.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.179+0000 7f85cf3a2640 1 -- 172.21.15.67:0/1353440363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f85c80c8d20 con 0x7f85c815e9f0 2024-04-25T02:28:36.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.179+0000 7f85c5ffb640 1 -- 172.21.15.67:0/1353440363 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f85b805c9e0 con 0x7f85c815e9f0 2024-04-25T02:28:36.183 INFO:teuthology.orchestra.run.smithi067.stdout:55834574855 2024-04-25T02:28:36.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.181+0000 7f85cf3a2640 1 -- 172.21.15.67:0/1353440363 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f85b406be60 msgr2=0x7f85b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:36.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.181+0000 7f85cf3a2640 1 --2- 172.21.15.67:0/1353440363 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f85b406be60 0x7f85b406e320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f85c80b3160 tx=0x7f85c0009190 comp rx=0 tx=0).stop 2024-04-25T02:28:36.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.181+0000 7f85cf3a2640 1 -- 172.21.15.67:0/1353440363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85c815e9f0 msgr2=0x7f85c80b2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:36.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.181+0000 7f85cf3a2640 1 --2- 172.21.15.67:0/1353440363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85c815e9f0 0x7f85c80b2570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f85b800c7b0 tx=0x7f85b800cc70 comp rx=0 tx=0).stop 2024-04-25T02:28:36.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.181+0000 7f85cf3a2640 1 -- 172.21.15.67:0/1353440363 shutdown_connections 2024-04-25T02:28:36.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.181+0000 7f85cf3a2640 1 --2- 172.21.15.67:0/1353440363 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f85b406be60 0x7f85b406e320 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.181+0000 7f85cf3a2640 1 --2- 172.21.15.67:0/1353440363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85c815e9f0 0x7f85c80b2570 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.181+0000 7f85cf3a2640 1 --2- 172.21.15.67:0/1353440363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85c815bfc0 0x7f85c80b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.181+0000 7f85cf3a2640 1 --2- 172.21.15.67:0/1353440363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85c80d0210 0x7f85c814f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.181+0000 7f85cf3a2640 1 -- 172.21.15.67:0/1353440363 >> 172.21.15.67:0/1353440363 conn(0x7f85c80d1ed0 msgr2=0x7f85c815b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:36.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.181+0000 7f85cf3a2640 1 -- 172.21.15.67:0/1353440363 shutdown_connections 2024-04-25T02:28:36.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.181+0000 7f85cf3a2640 1 -- 172.21.15.67:0/1353440363 wait complete. 2024-04-25T02:28:36.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.6 2024-04-25T02:28:36.196 DEBUG:teuthology.parallel:result is None 2024-04-25T02:28:36.196 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T02:28:36.196 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:28:36.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.292+0000 7ff9481b7640 1 Processor -- start 2024-04-25T02:28:36.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.292+0000 7ff9481b7640 1 -- start start 2024-04-25T02:28:36.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.293+0000 7ff9481b7640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff94015ee50 0x7ff9400d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:36.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.293+0000 7ff9481b7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff9400d2c00 0x7ff940160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:36.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.293+0000 7ff9481b7640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff94015fba0 con 0x7ff94015f230 2024-04-25T02:28:36.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.293+0000 7ff9481b7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff9400d4eb0 con 0x7ff9400d2c00 2024-04-25T02:28:36.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.293+0000 7ff9481b7640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff94015fe40 con 0x7ff94015ee50 2024-04-25T02:28:36.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.293+0000 7ff946754640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff9400d2c00 0x7ff940160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:36.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.293+0000 7ff946754640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff9400d2c00 0x7ff940160920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54626/0 (socket says 172.21.15.67:54626) 2024-04-25T02:28:36.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.293+0000 7ff946754640 1 -- 172.21.15.67:0/3189854995 learned_addr learned my addr 172.21.15.67:0/3189854995 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:36.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.293+0000 7ff945f53640 1 --2- 172.21.15.67:0/3189854995 >> v2:172.21.15.176:3300/0 conn(0x7ff94015ee50 0x7ff9400d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:36.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.294+0000 7ff946754640 1 -- 172.21.15.67:0/3189854995 >> v2:172.21.15.176:3300/0 conn(0x7ff94015ee50 msgr2=0x7ff9400d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:36.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.294+0000 7ff946754640 1 --2- 172.21.15.67:0/3189854995 >> v2:172.21.15.176:3300/0 conn(0x7ff94015ee50 0x7ff9400d47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.294+0000 7ff946754640 1 -- 172.21.15.67:0/3189854995 >> v1:172.21.15.176:6789/0 conn(0x7ff94015f230 legacy=0x7ff9400d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:36.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.294+0000 7ff946754640 1 -- 172.21.15.67:0/3189854995 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff940160120 con 0x7ff9400d2c00 2024-04-25T02:28:36.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.294+0000 7ff946754640 1 --2- 172.21.15.67:0/3189854995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9400d2c00 0x7ff940160920 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff9400d1bf0 tx=0x7ff93002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499cf8289a60998 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:36.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.294+0000 7ff944f51640 1 -- 172.21.15.67:0/3189854995 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff930036070 con 0x7ff9400d2c00 2024-04-25T02:28:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.294+0000 7ff944f51640 1 -- 172.21.15.67:0/3189854995 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff930031600 con 0x7ff9400d2c00 2024-04-25T02:28:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.294+0000 7ff944f51640 1 -- 172.21.15.67:0/3189854995 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9300319d0 con 0x7ff9400d2c00 2024-04-25T02:28:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.295+0000 7ff9481b7640 1 -- 172.21.15.67:0/3189854995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9400d2c00 msgr2=0x7ff940160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.295+0000 7ff9481b7640 1 --2- 172.21.15.67:0/3189854995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9400d2c00 0x7ff940160920 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff9400d1bf0 tx=0x7ff93002a730 comp rx=0 tx=0).stop 2024-04-25T02:28:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.295+0000 7ff9481b7640 1 -- 172.21.15.67:0/3189854995 shutdown_connections 2024-04-25T02:28:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.295+0000 7ff9481b7640 1 --2- 172.21.15.67:0/3189854995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9400d2c00 0x7ff940160920 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.295+0000 7ff9481b7640 1 --2- 172.21.15.67:0/3189854995 >> v2:172.21.15.176:3300/0 conn(0x7ff94015ee50 0x7ff9400d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.295+0000 7ff9481b7640 1 -- 172.21.15.67:0/3189854995 >> 172.21.15.67:0/3189854995 conn(0x7ff94009d450 msgr2=0x7ff9400d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.295+0000 7ff9481b7640 1 -- 172.21.15.67:0/3189854995 shutdown_connections 2024-04-25T02:28:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.295+0000 7ff9481b7640 1 -- 172.21.15.67:0/3189854995 wait complete. 2024-04-25T02:28:36.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.296+0000 7ff9481b7640 1 Processor -- start 2024-04-25T02:28:36.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.296+0000 7ff9481b7640 1 -- start start 2024-04-25T02:28:36.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.297+0000 7ff9481b7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9400d2c00 0x7ff9400d0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:36.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.297+0000 7ff9481b7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff94015ee50 0x7ff9400cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:36.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.297+0000 7ff9481b7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff94015f230 0x7ff940152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:36.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.297+0000 7ff9481b7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff94015f810 con 0x7ff94015ee50 2024-04-25T02:28:36.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.297+0000 7ff9481b7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff94015f690 con 0x7ff94015f230 2024-04-25T02:28:36.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.297+0000 7ff9481b7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff940160e60 con 0x7ff9400d2c00 2024-04-25T02:28:36.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.297+0000 7ff945752640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff94015ee50 0x7ff9400cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:36.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.297+0000 7ff945752640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff94015ee50 0x7ff9400cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54628/0 (socket says 172.21.15.67:54628) 2024-04-25T02:28:36.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.297+0000 7ff945752640 1 -- 172.21.15.67:0/2545084324 learned_addr learned my addr 172.21.15.67:0/2545084324 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:36.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.297+0000 7ff945f53640 1 --2- 172.21.15.67:0/2545084324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9400d2c00 0x7ff9400d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:36.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.297+0000 7ff946754640 1 --2- 172.21.15.67:0/2545084324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff94015f230 0x7ff940152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:36.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.297+0000 7ff945752640 1 -- 172.21.15.67:0/2545084324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9400d2c00 msgr2=0x7ff9400d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:36.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.297+0000 7ff945752640 1 --2- 172.21.15.67:0/2545084324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9400d2c00 0x7ff9400d0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.297+0000 7ff945752640 1 -- 172.21.15.67:0/2545084324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff94015f230 msgr2=0x7ff940152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:36.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.297+0000 7ff945752640 1 --2- 172.21.15.67:0/2545084324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff94015f230 0x7ff940152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.297+0000 7ff945752640 1 -- 172.21.15.67:0/2545084324 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9400cdc70 con 0x7ff94015ee50 2024-04-25T02:28:36.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.297+0000 7ff945f53640 1 --2- 172.21.15.67:0/2545084324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9400d2c00 0x7ff9400d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:36.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.298+0000 7ff945752640 1 --2- 172.21.15.67:0/2545084324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff94015ee50 0x7ff9400cd300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c470 tx=0x7ff93400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:36.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.298+0000 7ff93e7fc640 1 -- 172.21.15.67:0/2545084324 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9340052d0 con 0x7ff94015ee50 2024-04-25T02:28:36.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.298+0000 7ff93e7fc640 1 -- 172.21.15.67:0/2545084324 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff934005490 con 0x7ff94015ee50 2024-04-25T02:28:36.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.298+0000 7ff93e7fc640 1 -- 172.21.15.67:0/2545084324 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff934007260 con 0x7ff94015ee50 2024-04-25T02:28:36.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.298+0000 7ff9481b7640 1 -- 172.21.15.67:0/2545084324 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9400cdf50 con 0x7ff94015ee50 2024-04-25T02:28:36.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.298+0000 7ff9481b7640 1 -- 172.21.15.67:0/2545084324 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9401f5630 con 0x7ff94015ee50 2024-04-25T02:28:36.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.299+0000 7ff9481b7640 1 -- 172.21.15.67:0/2545084324 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff940069110 con 0x7ff94015ee50 2024-04-25T02:28:36.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.299+0000 7ff93e7fc640 1 -- 172.21.15.67:0/2545084324 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff934007400 con 0x7ff94015ee50 2024-04-25T02:28:36.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.300+0000 7ff93e7fc640 1 --2- 172.21.15.67:0/2545084324 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff92c06be30 0x7ff92c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:36.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.300+0000 7ff93e7fc640 1 -- 172.21.15.67:0/2545084324 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff93408a300 con 0x7ff94015ee50 2024-04-25T02:28:36.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.300+0000 7ff945f53640 1 --2- 172.21.15.67:0/2545084324 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff92c06be30 0x7ff92c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:36.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.300+0000 7ff945f53640 1 --2- 172.21.15.67:0/2545084324 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff92c06be30 0x7ff92c06e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff938009b90 tx=0x7ff938008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:36.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.304+0000 7ff93e7fc640 1 -- 172.21.15.67:0/2545084324 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff934058cb0 con 0x7ff94015ee50 2024-04-25T02:28:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.484+0000 7ff9481b7640 1 -- 172.21.15.67:0/2545084324 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff94015cd60 con 0x7ff92c06be30 2024-04-25T02:28:36.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.490+0000 7ff93e7fc640 1 -- 172.21.15.67:0/2545084324 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7ff94015cd60 con 0x7ff92c06be30 2024-04-25T02:28:36.497 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:36.498 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-25T02:28:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.493+0000 7ff9481b7640 1 -- 172.21.15.67:0/2545084324 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff92c06be30 msgr2=0x7ff92c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.493+0000 7ff9481b7640 1 --2- 172.21.15.67:0/2545084324 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff92c06be30 0x7ff92c06e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff938009b90 tx=0x7ff938008040 comp rx=0 tx=0).stop 2024-04-25T02:28:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.493+0000 7ff9481b7640 1 -- 172.21.15.67:0/2545084324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff94015ee50 msgr2=0x7ff9400cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.493+0000 7ff9481b7640 1 --2- 172.21.15.67:0/2545084324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff94015ee50 0x7ff9400cd300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c470 tx=0x7ff93400c930 comp rx=0 tx=0).stop 2024-04-25T02:28:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.494+0000 7ff9481b7640 1 -- 172.21.15.67:0/2545084324 shutdown_connections 2024-04-25T02:28:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.494+0000 7ff9481b7640 1 --2- 172.21.15.67:0/2545084324 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff92c06be30 0x7ff92c06e2f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.494+0000 7ff9481b7640 1 --2- 172.21.15.67:0/2545084324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff94015f230 0x7ff940152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.494+0000 7ff9481b7640 1 --2- 172.21.15.67:0/2545084324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff94015ee50 0x7ff9400cd300 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.494+0000 7ff9481b7640 1 --2- 172.21.15.67:0/2545084324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9400d2c00 0x7ff9400d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.494+0000 7ff9481b7640 1 -- 172.21.15.67:0/2545084324 >> 172.21.15.67:0/2545084324 conn(0x7ff94009d450 msgr2=0x7ff9400d1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.494+0000 7ff9481b7640 1 -- 172.21.15.67:0/2545084324 shutdown_connections 2024-04-25T02:28:36.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.494+0000 7ff9481b7640 1 -- 172.21.15.67:0/2545084324 wait complete. 2024-04-25T02:28:36.508 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-25T02:28:36.332542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219020,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755700,"statfs":{"total":773094113280,"available":772869836800,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.519376"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266478+0000","last_change":"2024-04-25T02:28:26.842721+0000","last_active":"2024-04-25T02:28:28.266478+0000","last_peered":"2024-04-25T02:28:28.266478+0000","last_clean":"2024-04-25T02:28:28.266478+0000","last_became_active":"2024-04-25T02:28:26.842458+0000","last_became_peered":"2024-04-25T02:28:26.842458+0000","last_unstale":"2024-04-25T02:28:28.266478+0000","last_undegraded":"2024-04-25T02:28:28.266478+0000","last_fullsized":"2024-04-25T02:28:28.266478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:17.268811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.823036+0000","last_change":"2024-04-25T02:28:26.837624+0000","last_active":"2024-04-25T02:28:27.823036+0000","last_peered":"2024-04-25T02:28:27.823036+0000","last_clean":"2024-04-25T02:28:27.823036+0000","last_became_active":"2024-04-25T02:28:26.837058+0000","last_became_peered":"2024-04-25T02:28:26.837058+0000","last_unstale":"2024-04-25T02:28:27.823036+0000","last_undegraded":"2024-04-25T02:28:27.823036+0000","last_fullsized":"2024-04-25T02:28:27.823036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:35.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266185+0000","last_change":"2024-04-25T02:28:26.826784+0000","last_active":"2024-04-25T02:28:28.266185+0000","last_peered":"2024-04-25T02:28:28.266185+0000","last_clean":"2024-04-25T02:28:28.266185+0000","last_became_active":"2024-04-25T02:28:26.825536+0000","last_became_peered":"2024-04-25T02:28:26.825536+0000","last_unstale":"2024-04-25T02:28:28.266185+0000","last_undegraded":"2024-04-25T02:28:28.266185+0000","last_fullsized":"2024-04-25T02:28:28.266185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:12.142773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826216+0000","last_change":"2024-04-25T02:28:26.831333+0000","last_active":"2024-04-25T02:28:27.826216+0000","last_peered":"2024-04-25T02:28:27.826216+0000","last_clean":"2024-04-25T02:28:27.826216+0000","last_became_active":"2024-04-25T02:28:26.831046+0000","last_became_peered":"2024-04-25T02:28:26.831046+0000","last_unstale":"2024-04-25T02:28:27.826216+0000","last_undegraded":"2024-04-25T02:28:27.826216+0000","last_fullsized":"2024-04-25T02:28:27.826216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266136+0000","last_change":"2024-04-25T02:28:26.835027+0000","last_active":"2024-04-25T02:28:28.266136+0000","last_peered":"2024-04-25T02:28:28.266136+0000","last_clean":"2024-04-25T02:28:28.266136+0000","last_became_active":"2024-04-25T02:28:26.834736+0000","last_became_peered":"2024-04-25T02:28:26.834736+0000","last_unstale":"2024-04-25T02:28:28.266136+0000","last_undegraded":"2024-04-25T02:28:28.266136+0000","last_fullsized":"2024-04-25T02:28:28.266136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:05.955540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826676+0000","last_change":"2024-04-25T02:28:26.832120+0000","last_active":"2024-04-25T02:28:27.826676+0000","last_peered":"2024-04-25T02:28:27.826676+0000","last_clean":"2024-04-25T02:28:27.826676+0000","last_became_active":"2024-04-25T02:28:26.831833+0000","last_became_peered":"2024-04-25T02:28:26.831833+0000","last_unstale":"2024-04-25T02:28:27.826676+0000","last_undegraded":"2024-04-25T02:28:27.826676+0000","last_fullsized":"2024-04-25T02:28:27.826676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:21.146249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266243+0000","last_change":"2024-04-25T02:28:26.837402+0000","last_active":"2024-04-25T02:28:28.266243+0000","last_peered":"2024-04-25T02:28:28.266243+0000","last_clean":"2024-04-25T02:28:28.266243+0000","last_became_active":"2024-04-25T02:28:26.836964+0000","last_became_peered":"2024-04-25T02:28:26.836964+0000","last_unstale":"2024-04-25T02:28:28.266243+0000","last_undegraded":"2024-04-25T02:28:28.266243+0000","last_fullsized":"2024-04-25T02:28:28.266243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:26.305868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266771+0000","last_change":"2024-04-25T02:28:26.838251+0000","last_active":"2024-04-25T02:28:28.266771+0000","last_peered":"2024-04-25T02:28:28.266771+0000","last_clean":"2024-04-25T02:28:28.266771+0000","last_became_active":"2024-04-25T02:28:26.837980+0000","last_became_peered":"2024-04-25T02:28:26.837980+0000","last_unstale":"2024-04-25T02:28:28.266771+0000","last_undegraded":"2024-04-25T02:28:28.266771+0000","last_fullsized":"2024-04-25T02:28:28.266771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:12.142773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266517+0000","last_change":"2024-04-25T02:28:26.843536+0000","last_active":"2024-04-25T02:28:28.266517+0000","last_peered":"2024-04-25T02:28:28.266517+0000","last_clean":"2024-04-25T02:28:28.266517+0000","last_became_active":"2024-04-25T02:28:26.841986+0000","last_became_peered":"2024-04-25T02:28:26.841986+0000","last_unstale":"2024-04-25T02:28:28.266517+0000","last_undegraded":"2024-04-25T02:28:28.266517+0000","last_fullsized":"2024-04-25T02:28:28.266517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:08.277396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829942+0000","last_change":"2024-04-25T02:28:26.835526+0000","last_active":"2024-04-25T02:28:27.829942+0000","last_peered":"2024-04-25T02:28:27.829942+0000","last_clean":"2024-04-25T02:28:27.829942+0000","last_became_active":"2024-04-25T02:28:26.835228+0000","last_became_peered":"2024-04-25T02:28:26.835228+0000","last_unstale":"2024-04-25T02:28:27.829942+0000","last_undegraded":"2024-04-25T02:28:27.829942+0000","last_fullsized":"2024-04-25T02:28:27.829942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829950+0000","last_change":"2024-04-25T02:28:26.836024+0000","last_active":"2024-04-25T02:28:27.829950+0000","last_peered":"2024-04-25T02:28:27.829950+0000","last_clean":"2024-04-25T02:28:27.829950+0000","last_became_active":"2024-04-25T02:28:26.835757+0000","last_became_peered":"2024-04-25T02:28:26.835757+0000","last_unstale":"2024-04-25T02:28:27.829950+0000","last_undegraded":"2024-04-25T02:28:27.829950+0000","last_fullsized":"2024-04-25T02:28:27.829950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826663+0000","last_change":"2024-04-25T02:28:26.833151+0000","last_active":"2024-04-25T02:28:27.826663+0000","last_peered":"2024-04-25T02:28:27.826663+0000","last_clean":"2024-04-25T02:28:27.826663+0000","last_became_active":"2024-04-25T02:28:26.832420+0000","last_became_peered":"2024-04-25T02:28:26.832420+0000","last_unstale":"2024-04-25T02:28:27.826663+0000","last_undegraded":"2024-04-25T02:28:27.826663+0000","last_fullsized":"2024-04-25T02:28:27.826663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:11.788886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266446+0000","last_change":"2024-04-25T02:28:26.827208+0000","last_active":"2024-04-25T02:28:28.266446+0000","last_peered":"2024-04-25T02:28:28.266446+0000","last_clean":"2024-04-25T02:28:28.266446+0000","last_became_active":"2024-04-25T02:28:26.826926+0000","last_became_peered":"2024-04-25T02:28:26.826926+0000","last_unstale":"2024-04-25T02:28:28.266446+0000","last_undegraded":"2024-04-25T02:28:28.266446+0000","last_fullsized":"2024-04-25T02:28:28.266446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:14.690953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265726+0000","last_change":"2024-04-25T02:28:26.833942+0000","last_active":"2024-04-25T02:28:28.265726+0000","last_peered":"2024-04-25T02:28:28.265726+0000","last_clean":"2024-04-25T02:28:28.265726+0000","last_became_active":"2024-04-25T02:28:26.833059+0000","last_became_peered":"2024-04-25T02:28:26.833059+0000","last_unstale":"2024-04-25T02:28:28.265726+0000","last_undegraded":"2024-04-25T02:28:28.265726+0000","last_fullsized":"2024-04-25T02:28:28.265726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:19:26.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822826+0000","last_change":"2024-04-25T02:28:26.841353+0000","last_active":"2024-04-25T02:28:27.822826+0000","last_peered":"2024-04-25T02:28:27.822826+0000","last_clean":"2024-04-25T02:28:27.822826+0000","last_became_active":"2024-04-25T02:28:26.841024+0000","last_became_peered":"2024-04-25T02:28:26.841024+0000","last_unstale":"2024-04-25T02:28:27.822826+0000","last_undegraded":"2024-04-25T02:28:27.822826+0000","last_fullsized":"2024-04-25T02:28:27.822826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:09.762419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826145+0000","last_change":"2024-04-25T02:28:26.831558+0000","last_active":"2024-04-25T02:28:27.826145+0000","last_peered":"2024-04-25T02:28:27.826145+0000","last_clean":"2024-04-25T02:28:27.826145+0000","last_became_active":"2024-04-25T02:28:26.831124+0000","last_became_peered":"2024-04-25T02:28:26.831124+0000","last_unstale":"2024-04-25T02:28:27.826145+0000","last_undegraded":"2024-04-25T02:28:27.826145+0000","last_fullsized":"2024-04-25T02:28:27.826145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827300+0000","last_change":"2024-04-25T02:28:26.833767+0000","last_active":"2024-04-25T02:28:27.827300+0000","last_peered":"2024-04-25T02:28:27.827300+0000","last_clean":"2024-04-25T02:28:27.827300+0000","last_became_active":"2024-04-25T02:28:26.833261+0000","last_became_peered":"2024-04-25T02:28:26.833261+0000","last_unstale":"2024-04-25T02:28:27.827300+0000","last_undegraded":"2024-04-25T02:28:27.827300+0000","last_fullsized":"2024-04-25T02:28:27.827300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:17.268811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266709+0000","last_change":"2024-04-25T02:28:26.829506+0000","last_active":"2024-04-25T02:28:28.266709+0000","last_peered":"2024-04-25T02:28:28.266709+0000","last_clean":"2024-04-25T02:28:28.266709+0000","last_became_active":"2024-04-25T02:28:26.829220+0000","last_became_peered":"2024-04-25T02:28:26.829220+0000","last_unstale":"2024-04-25T02:28:28.266709+0000","last_undegraded":"2024-04-25T02:28:28.266709+0000","last_fullsized":"2024-04-25T02:28:28.266709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:54.957406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266478+0000","last_change":"2024-04-25T02:28:26.836463+0000","last_active":"2024-04-25T02:28:28.266478+0000","last_peered":"2024-04-25T02:28:28.266478+0000","last_clean":"2024-04-25T02:28:28.266478+0000","last_became_active":"2024-04-25T02:28:26.836202+0000","last_became_peered":"2024-04-25T02:28:26.836202+0000","last_unstale":"2024-04-25T02:28:28.266478+0000","last_undegraded":"2024-04-25T02:28:28.266478+0000","last_fullsized":"2024-04-25T02:28:28.266478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:19.911809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829840+0000","last_change":"2024-04-25T02:28:26.826332+0000","last_active":"2024-04-25T02:28:27.829840+0000","last_peered":"2024-04-25T02:28:27.829840+0000","last_clean":"2024-04-25T02:28:27.829840+0000","last_became_active":"2024-04-25T02:28:26.825996+0000","last_became_peered":"2024-04-25T02:28:26.825996+0000","last_unstale":"2024-04-25T02:28:27.829840+0000","last_undegraded":"2024-04-25T02:28:27.829840+0000","last_fullsized":"2024-04-25T02:28:27.829840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:14.690953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266099+0000","last_change":"2024-04-25T02:28:26.832851+0000","last_active":"2024-04-25T02:28:28.266099+0000","last_peered":"2024-04-25T02:28:28.266099+0000","last_clean":"2024-04-25T02:28:28.266099+0000","last_became_active":"2024-04-25T02:28:26.830932+0000","last_became_peered":"2024-04-25T02:28:26.830932+0000","last_unstale":"2024-04-25T02:28:28.266099+0000","last_undegraded":"2024-04-25T02:28:28.266099+0000","last_fullsized":"2024-04-25T02:28:28.266099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:27.737871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826827+0000","last_change":"2024-04-25T02:28:26.833872+0000","last_active":"2024-04-25T02:28:27.826827+0000","last_peered":"2024-04-25T02:28:27.826827+0000","last_clean":"2024-04-25T02:28:27.826827+0000","last_became_active":"2024-04-25T02:28:26.833622+0000","last_became_peered":"2024-04-25T02:28:26.833622+0000","last_unstale":"2024-04-25T02:28:27.826827+0000","last_undegraded":"2024-04-25T02:28:27.826827+0000","last_fullsized":"2024-04-25T02:28:27.826827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:41.798312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266222+0000","last_change":"2024-04-25T02:28:26.839712+0000","last_active":"2024-04-25T02:28:28.266222+0000","last_peered":"2024-04-25T02:28:28.266222+0000","last_clean":"2024-04-25T02:28:28.266222+0000","last_became_active":"2024-04-25T02:28:26.839411+0000","last_became_peered":"2024-04-25T02:28:26.839411+0000","last_unstale":"2024-04-25T02:28:28.266222+0000","last_undegraded":"2024-04-25T02:28:28.266222+0000","last_fullsized":"2024-04-25T02:28:28.266222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826301+0000","last_change":"2024-04-25T02:28:26.831405+0000","last_active":"2024-04-25T02:28:27.826301+0000","last_peered":"2024-04-25T02:28:27.826301+0000","last_clean":"2024-04-25T02:28:27.826301+0000","last_became_active":"2024-04-25T02:28:26.830794+0000","last_became_peered":"2024-04-25T02:28:26.830794+0000","last_unstale":"2024-04-25T02:28:27.826301+0000","last_undegraded":"2024-04-25T02:28:27.826301+0000","last_fullsized":"2024-04-25T02:28:27.826301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:35.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266665+0000","last_change":"2024-04-25T02:28:26.839008+0000","last_active":"2024-04-25T02:28:28.266665+0000","last_peered":"2024-04-25T02:28:28.266665+0000","last_clean":"2024-04-25T02:28:28.266665+0000","last_became_active":"2024-04-25T02:28:26.838644+0000","last_became_peered":"2024-04-25T02:28:26.838644+0000","last_unstale":"2024-04-25T02:28:28.266665+0000","last_undegraded":"2024-04-25T02:28:28.266665+0000","last_fullsized":"2024-04-25T02:28:28.266665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829981+0000","last_change":"2024-04-25T02:28:26.831816+0000","last_active":"2024-04-25T02:28:27.829981+0000","last_peered":"2024-04-25T02:28:27.829981+0000","last_clean":"2024-04-25T02:28:27.829981+0000","last_became_active":"2024-04-25T02:28:26.831553+0000","last_became_peered":"2024-04-25T02:28:26.831553+0000","last_unstale":"2024-04-25T02:28:27.829981+0000","last_undegraded":"2024-04-25T02:28:27.829981+0000","last_fullsized":"2024-04-25T02:28:27.829981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:35.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822894+0000","last_change":"2024-04-25T02:28:26.839750+0000","last_active":"2024-04-25T02:28:27.822894+0000","last_peered":"2024-04-25T02:28:27.822894+0000","last_clean":"2024-04-25T02:28:27.822894+0000","last_became_active":"2024-04-25T02:28:26.839465+0000","last_became_peered":"2024-04-25T02:28:26.839465+0000","last_unstale":"2024-04-25T02:28:27.822894+0000","last_undegraded":"2024-04-25T02:28:27.822894+0000","last_fullsized":"2024-04-25T02:28:27.822894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:14.690953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266891+0000","last_change":"2024-04-25T02:28:26.841574+0000","last_active":"2024-04-25T02:28:28.266891+0000","last_peered":"2024-04-25T02:28:28.266891+0000","last_clean":"2024-04-25T02:28:28.266891+0000","last_became_active":"2024-04-25T02:28:26.841294+0000","last_became_peered":"2024-04-25T02:28:26.841294+0000","last_unstale":"2024-04-25T02:28:28.266891+0000","last_undegraded":"2024-04-25T02:28:28.266891+0000","last_fullsized":"2024-04-25T02:28:28.266891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:05.955540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266251+0000","last_change":"2024-04-25T02:28:26.826424+0000","last_active":"2024-04-25T02:28:28.266251+0000","last_peered":"2024-04-25T02:28:28.266251+0000","last_clean":"2024-04-25T02:28:28.266251+0000","last_became_active":"2024-04-25T02:28:26.826110+0000","last_became_peered":"2024-04-25T02:28:26.826110+0000","last_unstale":"2024-04-25T02:28:28.266251+0000","last_undegraded":"2024-04-25T02:28:28.266251+0000","last_fullsized":"2024-04-25T02:28:28.266251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827064+0000","last_change":"2024-04-25T02:28:26.827830+0000","last_active":"2024-04-25T02:28:27.827064+0000","last_peered":"2024-04-25T02:28:27.827064+0000","last_clean":"2024-04-25T02:28:27.827064+0000","last_became_active":"2024-04-25T02:28:26.827580+0000","last_became_peered":"2024-04-25T02:28:26.827580+0000","last_unstale":"2024-04-25T02:28:27.827064+0000","last_undegraded":"2024-04-25T02:28:27.827064+0000","last_fullsized":"2024-04-25T02:28:27.827064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:26.897425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266587+0000","last_change":"2024-04-25T02:28:26.835685+0000","last_active":"2024-04-25T02:28:28.266587+0000","last_peered":"2024-04-25T02:28:28.266587+0000","last_clean":"2024-04-25T02:28:28.266587+0000","last_became_active":"2024-04-25T02:28:26.835362+0000","last_became_peered":"2024-04-25T02:28:26.835362+0000","last_unstale":"2024-04-25T02:28:28.266587+0000","last_undegraded":"2024-04-25T02:28:28.266587+0000","last_fullsized":"2024-04-25T02:28:28.266587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:23.832987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829554+0000","last_change":"2024-04-25T02:28:26.829119+0000","last_active":"2024-04-25T02:28:27.829554+0000","last_peered":"2024-04-25T02:28:27.829554+0000","last_clean":"2024-04-25T02:28:27.829554+0000","last_became_active":"2024-04-25T02:28:26.828611+0000","last_became_peered":"2024-04-25T02:28:26.828611+0000","last_unstale":"2024-04-25T02:28:27.829554+0000","last_undegraded":"2024-04-25T02:28:27.829554+0000","last_fullsized":"2024-04-25T02:28:27.829554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826257+0000","last_change":"2024-04-25T02:28:26.836988+0000","last_active":"2024-04-25T02:28:27.826257+0000","last_peered":"2024-04-25T02:28:27.826257+0000","last_clean":"2024-04-25T02:28:27.826257+0000","last_became_active":"2024-04-25T02:28:26.836475+0000","last_became_peered":"2024-04-25T02:28:26.836475+0000","last_unstale":"2024-04-25T02:28:27.826257+0000","last_undegraded":"2024-04-25T02:28:27.826257+0000","last_fullsized":"2024-04-25T02:28:27.826257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:33.827773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266723+0000","last_change":"2024-04-25T02:28:25.831862+0000","last_active":"2024-04-25T02:28:28.266723+0000","last_peered":"2024-04-25T02:28:28.266723+0000","last_clean":"2024-04-25T02:28:28.266723+0000","last_became_active":"2024-04-25T02:28:25.831543+0000","last_became_peered":"2024-04-25T02:28:25.831543+0000","last_unstale":"2024-04-25T02:28:28.266723+0000","last_undegraded":"2024-04-25T02:28:28.266723+0000","last_fullsized":"2024-04-25T02:28:28.266723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266403+0000","last_change":"2024-04-25T02:28:26.824999+0000","last_active":"2024-04-25T02:28:28.266403+0000","last_peered":"2024-04-25T02:28:28.266403+0000","last_clean":"2024-04-25T02:28:28.266403+0000","last_became_active":"2024-04-25T02:28:26.824688+0000","last_became_peered":"2024-04-25T02:28:26.824688+0000","last_unstale":"2024-04-25T02:28:28.266403+0000","last_undegraded":"2024-04-25T02:28:28.266403+0000","last_fullsized":"2024-04-25T02:28:28.266403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:14.690953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829683+0000","last_change":"2024-04-25T02:28:25.821131+0000","last_active":"2024-04-25T02:28:27.829683+0000","last_peered":"2024-04-25T02:28:27.829683+0000","last_clean":"2024-04-25T02:28:27.829683+0000","last_became_active":"2024-04-25T02:28:25.820867+0000","last_became_peered":"2024-04-25T02:28:25.820867+0000","last_unstale":"2024-04-25T02:28:27.829683+0000","last_undegraded":"2024-04-25T02:28:27.829683+0000","last_fullsized":"2024-04-25T02:28:27.829683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:10.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266380+0000","last_change":"2024-04-25T02:28:25.830948+0000","last_active":"2024-04-25T02:28:28.266380+0000","last_peered":"2024-04-25T02:28:28.266380+0000","last_clean":"2024-04-25T02:28:28.266380+0000","last_became_active":"2024-04-25T02:28:25.830638+0000","last_became_peered":"2024-04-25T02:28:25.830638+0000","last_unstale":"2024-04-25T02:28:28.266380+0000","last_undegraded":"2024-04-25T02:28:28.266380+0000","last_fullsized":"2024-04-25T02:28:28.266380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:48.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266977+0000","last_change":"2024-04-25T02:28:26.828838+0000","last_active":"2024-04-25T02:28:28.266977+0000","last_peered":"2024-04-25T02:28:28.266977+0000","last_clean":"2024-04-25T02:28:28.266977+0000","last_became_active":"2024-04-25T02:28:26.827915+0000","last_became_peered":"2024-04-25T02:28:26.827915+0000","last_unstale":"2024-04-25T02:28:28.266977+0000","last_undegraded":"2024-04-25T02:28:28.266977+0000","last_fullsized":"2024-04-25T02:28:28.266977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:21.146249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826399+0000","last_change":"2024-04-25T02:28:25.819425+0000","last_active":"2024-04-25T02:28:27.826399+0000","last_peered":"2024-04-25T02:28:27.826399+0000","last_clean":"2024-04-25T02:28:27.826399+0000","last_became_active":"2024-04-25T02:28:25.819124+0000","last_became_peered":"2024-04-25T02:28:25.819124+0000","last_unstale":"2024-04-25T02:28:27.826399+0000","last_undegraded":"2024-04-25T02:28:27.826399+0000","last_fullsized":"2024-04-25T02:28:27.826399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:32.823247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822908+0000","last_change":"2024-04-25T02:28:26.840249+0000","last_active":"2024-04-25T02:28:27.822908+0000","last_peered":"2024-04-25T02:28:27.822908+0000","last_clean":"2024-04-25T02:28:27.822908+0000","last_became_active":"2024-04-25T02:28:26.839935+0000","last_became_peered":"2024-04-25T02:28:26.839935+0000","last_unstale":"2024-04-25T02:28:27.822908+0000","last_undegraded":"2024-04-25T02:28:27.822908+0000","last_fullsized":"2024-04-25T02:28:27.822908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829936+0000","last_change":"2024-04-25T02:28:25.827094+0000","last_active":"2024-04-25T02:28:27.829936+0000","last_peered":"2024-04-25T02:28:27.829936+0000","last_clean":"2024-04-25T02:28:27.829936+0000","last_became_active":"2024-04-25T02:28:25.826833+0000","last_became_peered":"2024-04-25T02:28:25.826833+0000","last_unstale":"2024-04-25T02:28:27.829936+0000","last_undegraded":"2024-04-25T02:28:27.829936+0000","last_fullsized":"2024-04-25T02:28:27.829936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:48.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826933+0000","last_change":"2024-04-25T02:28:26.830006+0000","last_active":"2024-04-25T02:28:27.826933+0000","last_peered":"2024-04-25T02:28:27.826933+0000","last_clean":"2024-04-25T02:28:27.826933+0000","last_became_active":"2024-04-25T02:28:26.829703+0000","last_became_peered":"2024-04-25T02:28:26.829703+0000","last_unstale":"2024-04-25T02:28:27.826933+0000","last_undegraded":"2024-04-25T02:28:27.826933+0000","last_fullsized":"2024-04-25T02:28:27.826933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:26.305868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826920+0000","last_change":"2024-04-25T02:28:25.824029+0000","last_active":"2024-04-25T02:28:27.826920+0000","last_peered":"2024-04-25T02:28:27.826920+0000","last_clean":"2024-04-25T02:28:27.826920+0000","last_became_active":"2024-04-25T02:28:25.823734+0000","last_became_peered":"2024-04-25T02:28:25.823734+0000","last_unstale":"2024-04-25T02:28:27.826920+0000","last_undegraded":"2024-04-25T02:28:27.826920+0000","last_fullsized":"2024-04-25T02:28:27.826920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:22.828461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266445+0000","last_change":"2024-04-25T02:28:26.833144+0000","last_active":"2024-04-25T02:28:28.266445+0000","last_peered":"2024-04-25T02:28:28.266445+0000","last_clean":"2024-04-25T02:28:28.266445+0000","last_became_active":"2024-04-25T02:28:26.832578+0000","last_became_peered":"2024-04-25T02:28:26.832578+0000","last_unstale":"2024-04-25T02:28:28.266445+0000","last_undegraded":"2024-04-25T02:28:28.266445+0000","last_fullsized":"2024-04-25T02:28:28.266445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822999+0000","last_change":"2024-04-25T02:28:25.827731+0000","last_active":"2024-04-25T02:28:27.822999+0000","last_peered":"2024-04-25T02:28:27.822999+0000","last_clean":"2024-04-25T02:28:27.822999+0000","last_became_active":"2024-04-25T02:28:25.827415+0000","last_became_peered":"2024-04-25T02:28:25.827415+0000","last_unstale":"2024-04-25T02:28:27.822999+0000","last_undegraded":"2024-04-25T02:28:27.822999+0000","last_fullsized":"2024-04-25T02:28:27.822999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826897+0000","last_change":"2024-04-25T02:28:26.833382+0000","last_active":"2024-04-25T02:28:27.826897+0000","last_peered":"2024-04-25T02:28:27.826897+0000","last_clean":"2024-04-25T02:28:27.826897+0000","last_became_active":"2024-04-25T02:28:26.832896+0000","last_became_peered":"2024-04-25T02:28:26.832896+0000","last_unstale":"2024-04-25T02:28:27.826897+0000","last_undegraded":"2024-04-25T02:28:27.826897+0000","last_fullsized":"2024-04-25T02:28:27.826897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:23.832987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829943+0000","last_change":"2024-04-25T02:28:25.831322+0000","last_active":"2024-04-25T02:28:27.829943+0000","last_peered":"2024-04-25T02:28:27.829943+0000","last_clean":"2024-04-25T02:28:27.829943+0000","last_became_active":"2024-04-25T02:28:25.831024+0000","last_became_peered":"2024-04-25T02:28:25.831024+0000","last_unstale":"2024-04-25T02:28:27.829943+0000","last_undegraded":"2024-04-25T02:28:27.829943+0000","last_fullsized":"2024-04-25T02:28:27.829943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:22.828461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266281+0000","last_change":"2024-04-25T02:28:26.837505+0000","last_active":"2024-04-25T02:28:28.266281+0000","last_peered":"2024-04-25T02:28:28.266281+0000","last_clean":"2024-04-25T02:28:28.266281+0000","last_became_active":"2024-04-25T02:28:26.836986+0000","last_became_peered":"2024-04-25T02:28:26.836986+0000","last_unstale":"2024-04-25T02:28:28.266281+0000","last_undegraded":"2024-04-25T02:28:28.266281+0000","last_fullsized":"2024-04-25T02:28:28.266281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:26.897425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266515+0000","last_change":"2024-04-25T02:28:25.830714+0000","last_active":"2024-04-25T02:28:28.266515+0000","last_peered":"2024-04-25T02:28:28.266515+0000","last_clean":"2024-04-25T02:28:28.266515+0000","last_became_active":"2024-04-25T02:28:25.830407+0000","last_became_peered":"2024-04-25T02:28:25.830407+0000","last_unstale":"2024-04-25T02:28:28.266515+0000","last_undegraded":"2024-04-25T02:28:28.266515+0000","last_fullsized":"2024-04-25T02:28:28.266515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:15.170784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265782+0000","last_change":"2024-04-25T02:28:26.830192+0000","last_active":"2024-04-25T02:28:28.265782+0000","last_peered":"2024-04-25T02:28:28.265782+0000","last_clean":"2024-04-25T02:28:28.265782+0000","last_became_active":"2024-04-25T02:28:26.829820+0000","last_became_peered":"2024-04-25T02:28:26.829820+0000","last_unstale":"2024-04-25T02:28:28.265782+0000","last_undegraded":"2024-04-25T02:28:28.265782+0000","last_fullsized":"2024-04-25T02:28:28.265782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:29.495511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826919+0000","last_change":"2024-04-25T02:28:25.826726+0000","last_active":"2024-04-25T02:28:27.826919+0000","last_peered":"2024-04-25T02:28:27.826919+0000","last_clean":"2024-04-25T02:28:27.826919+0000","last_became_active":"2024-04-25T02:28:25.826427+0000","last_became_peered":"2024-04-25T02:28:25.826427+0000","last_unstale":"2024-04-25T02:28:27.826919+0000","last_undegraded":"2024-04-25T02:28:27.826919+0000","last_fullsized":"2024-04-25T02:28:27.826919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266162+0000","last_change":"2024-04-25T02:28:26.842107+0000","last_active":"2024-04-25T02:28:28.266162+0000","last_peered":"2024-04-25T02:28:28.266162+0000","last_clean":"2024-04-25T02:28:28.266162+0000","last_became_active":"2024-04-25T02:28:26.841784+0000","last_became_peered":"2024-04-25T02:28:26.841784+0000","last_unstale":"2024-04-25T02:28:28.266162+0000","last_undegraded":"2024-04-25T02:28:28.266162+0000","last_fullsized":"2024-04-25T02:28:28.266162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:21.146249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829509+0000","last_change":"2024-04-25T02:28:25.822245+0000","last_active":"2024-04-25T02:28:27.829509+0000","last_peered":"2024-04-25T02:28:27.829509+0000","last_clean":"2024-04-25T02:28:27.829509+0000","last_became_active":"2024-04-25T02:28:25.821961+0000","last_became_peered":"2024-04-25T02:28:25.821961+0000","last_unstale":"2024-04-25T02:28:27.829509+0000","last_undegraded":"2024-04-25T02:28:27.829509+0000","last_fullsized":"2024-04-25T02:28:27.829509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829553+0000","last_change":"2024-04-25T02:28:26.828898+0000","last_active":"2024-04-25T02:28:27.829553+0000","last_peered":"2024-04-25T02:28:27.829553+0000","last_clean":"2024-04-25T02:28:27.829553+0000","last_became_active":"2024-04-25T02:28:26.828274+0000","last_became_peered":"2024-04-25T02:28:26.828274+0000","last_unstale":"2024-04-25T02:28:27.829553+0000","last_undegraded":"2024-04-25T02:28:27.829553+0000","last_fullsized":"2024-04-25T02:28:27.829553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:12.142773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266835+0000","last_change":"2024-04-25T02:28:25.820968+0000","last_active":"2024-04-25T02:28:28.266835+0000","last_peered":"2024-04-25T02:28:28.266835+0000","last_clean":"2024-04-25T02:28:28.266835+0000","last_became_active":"2024-04-25T02:28:25.820583+0000","last_became_peered":"2024-04-25T02:28:25.820583+0000","last_unstale":"2024-04-25T02:28:28.266835+0000","last_undegraded":"2024-04-25T02:28:28.266835+0000","last_fullsized":"2024-04-25T02:28:28.266835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:17:36.734690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266094+0000","last_change":"2024-04-25T02:28:26.839360+0000","last_active":"2024-04-25T02:28:28.266094+0000","last_peered":"2024-04-25T02:28:28.266094+0000","last_clean":"2024-04-25T02:28:28.266094+0000","last_became_active":"2024-04-25T02:28:26.839071+0000","last_became_peered":"2024-04-25T02:28:26.839071+0000","last_unstale":"2024-04-25T02:28:28.266094+0000","last_undegraded":"2024-04-25T02:28:28.266094+0000","last_fullsized":"2024-04-25T02:28:28.266094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:52.300089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826544+0000","last_change":"2024-04-25T02:28:25.831348+0000","last_active":"2024-04-25T02:28:27.826544+0000","last_peered":"2024-04-25T02:28:27.826544+0000","last_clean":"2024-04-25T02:28:27.826544+0000","last_became_active":"2024-04-25T02:28:25.830958+0000","last_became_peered":"2024-04-25T02:28:25.830958+0000","last_unstale":"2024-04-25T02:28:27.826544+0000","last_undegraded":"2024-04-25T02:28:27.826544+0000","last_fullsized":"2024-04-25T02:28:27.826544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:14:28.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266367+0000","last_change":"2024-04-25T02:28:26.843465+0000","last_active":"2024-04-25T02:28:28.266367+0000","last_peered":"2024-04-25T02:28:28.266367+0000","last_clean":"2024-04-25T02:28:28.266367+0000","last_became_active":"2024-04-25T02:28:26.843147+0000","last_became_peered":"2024-04-25T02:28:26.843147+0000","last_unstale":"2024-04-25T02:28:28.266367+0000","last_undegraded":"2024-04-25T02:28:28.266367+0000","last_fullsized":"2024-04-25T02:28:28.266367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:28:45.463626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266818+0000","last_change":"2024-04-25T02:28:25.822767+0000","last_active":"2024-04-25T02:28:28.266818+0000","last_peered":"2024-04-25T02:28:28.266818+0000","last_clean":"2024-04-25T02:28:28.266818+0000","last_became_active":"2024-04-25T02:28:25.822396+0000","last_became_peered":"2024-04-25T02:28:25.822396+0000","last_unstale":"2024-04-25T02:28:28.266818+0000","last_undegraded":"2024-04-25T02:28:28.266818+0000","last_fullsized":"2024-04-25T02:28:28.266818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266583+0000","last_change":"2024-04-25T02:28:26.840019+0000","last_active":"2024-04-25T02:28:28.266583+0000","last_peered":"2024-04-25T02:28:28.266583+0000","last_clean":"2024-04-25T02:28:28.266583+0000","last_became_active":"2024-04-25T02:28:26.839739+0000","last_became_peered":"2024-04-25T02:28:26.839739+0000","last_unstale":"2024-04-25T02:28:28.266583+0000","last_undegraded":"2024-04-25T02:28:28.266583+0000","last_fullsized":"2024-04-25T02:28:28.266583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:31.847102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.823098+0000","last_change":"2024-04-25T02:28:25.819880+0000","last_active":"2024-04-25T02:28:27.823098+0000","last_peered":"2024-04-25T02:28:27.823098+0000","last_clean":"2024-04-25T02:28:27.823098+0000","last_became_active":"2024-04-25T02:28:25.819487+0000","last_became_peered":"2024-04-25T02:28:25.819487+0000","last_unstale":"2024-04-25T02:28:27.823098+0000","last_undegraded":"2024-04-25T02:28:27.823098+0000","last_fullsized":"2024-04-25T02:28:27.823098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:32.823247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826504+0000","last_change":"2024-04-25T02:28:26.830885+0000","last_active":"2024-04-25T02:28:27.826504+0000","last_peered":"2024-04-25T02:28:27.826504+0000","last_clean":"2024-04-25T02:28:27.826504+0000","last_became_active":"2024-04-25T02:28:26.830454+0000","last_became_peered":"2024-04-25T02:28:26.830454+0000","last_unstale":"2024-04-25T02:28:27.826504+0000","last_undegraded":"2024-04-25T02:28:27.826504+0000","last_fullsized":"2024-04-25T02:28:27.826504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:05.955540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266514+0000","last_change":"2024-04-25T02:28:25.820969+0000","last_active":"2024-04-25T02:28:28.266514+0000","last_peered":"2024-04-25T02:28:28.266514+0000","last_clean":"2024-04-25T02:28:28.266514+0000","last_became_active":"2024-04-25T02:28:25.820594+0000","last_became_peered":"2024-04-25T02:28:25.820594+0000","last_unstale":"2024-04-25T02:28:28.266514+0000","last_undegraded":"2024-04-25T02:28:28.266514+0000","last_fullsized":"2024-04-25T02:28:28.266514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:48.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266206+0000","last_change":"2024-04-25T02:28:26.843856+0000","last_active":"2024-04-25T02:28:28.266206+0000","last_peered":"2024-04-25T02:28:28.266206+0000","last_clean":"2024-04-25T02:28:28.266206+0000","last_became_active":"2024-04-25T02:28:26.841671+0000","last_became_peered":"2024-04-25T02:28:26.841671+0000","last_unstale":"2024-04-25T02:28:28.266206+0000","last_undegraded":"2024-04-25T02:28:28.266206+0000","last_fullsized":"2024-04-25T02:28:28.266206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:41.798312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265929+0000","last_change":"2024-04-25T02:28:15.520345+0000","last_active":"2024-04-25T02:28:28.265929+0000","last_peered":"2024-04-25T02:28:28.265929+0000","last_clean":"2024-04-25T02:28:28.265929+0000","last_became_active":"2024-04-25T02:28:15.519317+0000","last_became_peered":"2024-04-25T02:28:15.519317+0000","last_unstale":"2024-04-25T02:28:28.265929+0000","last_undegraded":"2024-04-25T02:28:28.265929+0000","last_fullsized":"2024-04-25T02:28:28.265929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_clean_scrub_stamp":"2024-04-25T02:28:14.374327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:20.125523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826154+0000","last_change":"2024-04-25T02:28:25.821889+0000","last_active":"2024-04-25T02:28:27.826154+0000","last_peered":"2024-04-25T02:28:27.826154+0000","last_clean":"2024-04-25T02:28:27.826154+0000","last_became_active":"2024-04-25T02:28:25.821633+0000","last_became_peered":"2024-04-25T02:28:25.821633+0000","last_unstale":"2024-04-25T02:28:27.826154+0000","last_undegraded":"2024-04-25T02:28:27.826154+0000","last_fullsized":"2024-04-25T02:28:27.826154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:48.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266206+0000","last_change":"2024-04-25T02:28:26.839035+0000","last_active":"2024-04-25T02:28:28.266206+0000","last_peered":"2024-04-25T02:28:28.266206+0000","last_clean":"2024-04-25T02:28:28.266206+0000","last_became_active":"2024-04-25T02:28:26.838759+0000","last_became_peered":"2024-04-25T02:28:26.838759+0000","last_unstale":"2024-04-25T02:28:28.266206+0000","last_undegraded":"2024-04-25T02:28:28.266206+0000","last_fullsized":"2024-04-25T02:28:28.266206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:09.762419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265862+0000","last_change":"2024-04-25T02:28:25.833571+0000","last_active":"2024-04-25T02:28:28.265862+0000","last_peered":"2024-04-25T02:28:28.265862+0000","last_clean":"2024-04-25T02:28:28.265862+0000","last_became_active":"2024-04-25T02:28:25.833379+0000","last_became_peered":"2024-04-25T02:28:25.833379+0000","last_unstale":"2024-04-25T02:28:28.265862+0000","last_undegraded":"2024-04-25T02:28:28.265862+0000","last_fullsized":"2024-04-25T02:28:28.265862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:32.823247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265668+0000","last_change":"2024-04-25T02:28:26.833450+0000","last_active":"2024-04-25T02:28:28.265668+0000","last_peered":"2024-04-25T02:28:28.265668+0000","last_clean":"2024-04-25T02:28:28.265668+0000","last_became_active":"2024-04-25T02:28:26.833117+0000","last_became_peered":"2024-04-25T02:28:26.833117+0000","last_unstale":"2024-04-25T02:28:28.265668+0000","last_undegraded":"2024-04-25T02:28:28.265668+0000","last_fullsized":"2024-04-25T02:28:28.265668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:20.271750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266705+0000","last_change":"2024-04-25T02:28:25.823596+0000","last_active":"2024-04-25T02:28:28.266705+0000","last_peered":"2024-04-25T02:28:28.266705+0000","last_clean":"2024-04-25T02:28:28.266705+0000","last_became_active":"2024-04-25T02:28:25.822949+0000","last_became_peered":"2024-04-25T02:28:25.822949+0000","last_unstale":"2024-04-25T02:28:28.266705+0000","last_undegraded":"2024-04-25T02:28:28.266705+0000","last_fullsized":"2024-04-25T02:28:28.266705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:47.613148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822846+0000","last_change":"2024-04-25T02:28:26.830075+0000","last_active":"2024-04-25T02:28:27.822846+0000","last_peered":"2024-04-25T02:28:27.822846+0000","last_clean":"2024-04-25T02:28:27.822846+0000","last_became_active":"2024-04-25T02:28:26.829526+0000","last_became_peered":"2024-04-25T02:28:26.829526+0000","last_unstale":"2024-04-25T02:28:27.822846+0000","last_undegraded":"2024-04-25T02:28:27.822846+0000","last_fullsized":"2024-04-25T02:28:27.822846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827031+0000","last_change":"2024-04-25T02:28:25.820913+0000","last_active":"2024-04-25T02:28:27.827031+0000","last_peered":"2024-04-25T02:28:27.827031+0000","last_clean":"2024-04-25T02:28:27.827031+0000","last_became_active":"2024-04-25T02:28:25.820531+0000","last_became_peered":"2024-04-25T02:28:25.820531+0000","last_unstale":"2024-04-25T02:28:27.827031+0000","last_undegraded":"2024-04-25T02:28:27.827031+0000","last_fullsized":"2024-04-25T02:28:27.827031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:10.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827117+0000","last_change":"2024-04-25T02:28:26.835487+0000","last_active":"2024-04-25T02:28:27.827117+0000","last_peered":"2024-04-25T02:28:27.827117+0000","last_clean":"2024-04-25T02:28:27.827117+0000","last_became_active":"2024-04-25T02:28:26.834842+0000","last_became_peered":"2024-04-25T02:28:26.834842+0000","last_unstale":"2024-04-25T02:28:27.827117+0000","last_undegraded":"2024-04-25T02:28:27.827117+0000","last_fullsized":"2024-04-25T02:28:27.827117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:54.957406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.823008+0000","last_change":"2024-04-25T02:28:25.831205+0000","last_active":"2024-04-25T02:28:27.823008+0000","last_peered":"2024-04-25T02:28:27.823008+0000","last_clean":"2024-04-25T02:28:27.823008+0000","last_became_active":"2024-04-25T02:28:25.830910+0000","last_became_peered":"2024-04-25T02:28:25.830910+0000","last_unstale":"2024-04-25T02:28:27.823008+0000","last_undegraded":"2024-04-25T02:28:27.823008+0000","last_fullsized":"2024-04-25T02:28:27.823008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:22.828461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827217+0000","last_change":"2024-04-25T02:28:26.830467+0000","last_active":"2024-04-25T02:28:27.827217+0000","last_peered":"2024-04-25T02:28:27.827217+0000","last_clean":"2024-04-25T02:28:27.827217+0000","last_became_active":"2024-04-25T02:28:26.830219+0000","last_became_peered":"2024-04-25T02:28:26.830219+0000","last_unstale":"2024-04-25T02:28:27.827217+0000","last_undegraded":"2024-04-25T02:28:27.827217+0000","last_fullsized":"2024-04-25T02:28:27.827217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:19.911809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266442+0000","last_change":"2024-04-25T02:28:25.831653+0000","last_active":"2024-04-25T02:28:28.266442+0000","last_peered":"2024-04-25T02:28:28.266442+0000","last_clean":"2024-04-25T02:28:28.266442+0000","last_became_active":"2024-04-25T02:28:25.831318+0000","last_became_peered":"2024-04-25T02:28:25.831318+0000","last_unstale":"2024-04-25T02:28:28.266442+0000","last_undegraded":"2024-04-25T02:28:28.266442+0000","last_fullsized":"2024-04-25T02:28:28.266442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:53.952880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822899+0000","last_change":"2024-04-25T02:28:26.832413+0000","last_active":"2024-04-25T02:28:27.822899+0000","last_peered":"2024-04-25T02:28:27.822899+0000","last_clean":"2024-04-25T02:28:27.822899+0000","last_became_active":"2024-04-25T02:28:26.832081+0000","last_became_peered":"2024-04-25T02:28:26.832081+0000","last_unstale":"2024-04-25T02:28:27.822899+0000","last_undegraded":"2024-04-25T02:28:27.822899+0000","last_fullsized":"2024-04-25T02:28:27.822899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829103+0000","last_change":"2024-04-25T02:28:25.824355+0000","last_active":"2024-04-25T02:28:27.829103+0000","last_peered":"2024-04-25T02:28:27.829103+0000","last_clean":"2024-04-25T02:28:27.829103+0000","last_became_active":"2024-04-25T02:28:25.824048+0000","last_became_peered":"2024-04-25T02:28:25.824048+0000","last_unstale":"2024-04-25T02:28:27.829103+0000","last_undegraded":"2024-04-25T02:28:27.829103+0000","last_fullsized":"2024-04-25T02:28:27.829103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:53.952880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266822+0000","last_change":"2024-04-25T02:28:26.831460+0000","last_active":"2024-04-25T02:28:28.266822+0000","last_peered":"2024-04-25T02:28:28.266822+0000","last_clean":"2024-04-25T02:28:28.266822+0000","last_became_active":"2024-04-25T02:28:26.831127+0000","last_became_peered":"2024-04-25T02:28:26.831127+0000","last_unstale":"2024-04-25T02:28:28.266822+0000","last_undegraded":"2024-04-25T02:28:28.266822+0000","last_fullsized":"2024-04-25T02:28:28.266822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:52.300089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.830022+0000","last_change":"2024-04-25T02:28:25.824264+0000","last_active":"2024-04-25T02:28:27.830022+0000","last_peered":"2024-04-25T02:28:27.830022+0000","last_clean":"2024-04-25T02:28:27.830022+0000","last_became_active":"2024-04-25T02:28:25.823953+0000","last_became_peered":"2024-04-25T02:28:25.823953+0000","last_unstale":"2024-04-25T02:28:27.830022+0000","last_undegraded":"2024-04-25T02:28:27.830022+0000","last_fullsized":"2024-04-25T02:28:27.830022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:32.823247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266650+0000","last_change":"2024-04-25T02:28:26.827330+0000","last_active":"2024-04-25T02:28:28.266650+0000","last_peered":"2024-04-25T02:28:28.266650+0000","last_clean":"2024-04-25T02:28:28.266650+0000","last_became_active":"2024-04-25T02:28:26.826944+0000","last_became_peered":"2024-04-25T02:28:26.826944+0000","last_unstale":"2024-04-25T02:28:28.266650+0000","last_undegraded":"2024-04-25T02:28:28.266650+0000","last_fullsized":"2024-04-25T02:28:28.266650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265859+0000","last_change":"2024-04-25T02:28:25.831605+0000","last_active":"2024-04-25T02:28:28.265859+0000","last_peered":"2024-04-25T02:28:28.265859+0000","last_clean":"2024-04-25T02:28:28.265859+0000","last_became_active":"2024-04-25T02:28:25.831328+0000","last_became_peered":"2024-04-25T02:28:25.831328+0000","last_unstale":"2024-04-25T02:28:28.265859+0000","last_undegraded":"2024-04-25T02:28:28.265859+0000","last_fullsized":"2024-04-25T02:28:28.265859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:04:33.145269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827334+0000","last_change":"2024-04-25T02:28:26.834040+0000","last_active":"2024-04-25T02:28:27.827334+0000","last_peered":"2024-04-25T02:28:27.827334+0000","last_clean":"2024-04-25T02:28:27.827334+0000","last_became_active":"2024-04-25T02:28:26.833740+0000","last_became_peered":"2024-04-25T02:28:26.833740+0000","last_unstale":"2024-04-25T02:28:27.827334+0000","last_undegraded":"2024-04-25T02:28:27.827334+0000","last_fullsized":"2024-04-25T02:28:27.827334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:04:34.149794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822940+0000","last_change":"2024-04-25T02:28:25.825296+0000","last_active":"2024-04-25T02:28:27.822940+0000","last_peered":"2024-04-25T02:28:27.822940+0000","last_clean":"2024-04-25T02:28:27.822940+0000","last_became_active":"2024-04-25T02:28:25.824989+0000","last_became_peered":"2024-04-25T02:28:25.824989+0000","last_unstale":"2024-04-25T02:28:27.822940+0000","last_undegraded":"2024-04-25T02:28:27.822940+0000","last_fullsized":"2024-04-25T02:28:27.822940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:10.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.267019+0000","last_change":"2024-04-25T02:28:26.831540+0000","last_active":"2024-04-25T02:28:28.267019+0000","last_peered":"2024-04-25T02:28:28.267019+0000","last_clean":"2024-04-25T02:28:28.267019+0000","last_became_active":"2024-04-25T02:28:26.831020+0000","last_became_peered":"2024-04-25T02:28:26.831020+0000","last_unstale":"2024-04-25T02:28:28.267019+0000","last_undegraded":"2024-04-25T02:28:28.267019+0000","last_fullsized":"2024-04-25T02:28:28.267019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:41.798312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.823029+0000","last_change":"2024-04-25T02:28:25.827630+0000","last_active":"2024-04-25T02:28:27.823029+0000","last_peered":"2024-04-25T02:28:27.823029+0000","last_clean":"2024-04-25T02:28:27.823029+0000","last_became_active":"2024-04-25T02:28:25.827277+0000","last_became_peered":"2024-04-25T02:28:25.827277+0000","last_unstale":"2024-04-25T02:28:27.823029+0000","last_undegraded":"2024-04-25T02:28:27.823029+0000","last_fullsized":"2024-04-25T02:28:27.823029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:04:33.145269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266602+0000","last_change":"2024-04-25T02:28:26.828333+0000","last_active":"2024-04-25T02:28:28.266602+0000","last_peered":"2024-04-25T02:28:28.266602+0000","last_clean":"2024-04-25T02:28:28.266602+0000","last_became_active":"2024-04-25T02:28:26.828026+0000","last_became_peered":"2024-04-25T02:28:26.828026+0000","last_unstale":"2024-04-25T02:28:28.266602+0000","last_undegraded":"2024-04-25T02:28:28.266602+0000","last_fullsized":"2024-04-25T02:28:28.266602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266350+0000","last_change":"2024-04-25T02:28:25.830120+0000","last_active":"2024-04-25T02:28:28.266350+0000","last_peered":"2024-04-25T02:28:28.266350+0000","last_clean":"2024-04-25T02:28:28.266350+0000","last_became_active":"2024-04-25T02:28:25.829808+0000","last_became_peered":"2024-04-25T02:28:25.829808+0000","last_unstale":"2024-04-25T02:28:28.266350+0000","last_undegraded":"2024-04-25T02:28:28.266350+0000","last_fullsized":"2024-04-25T02:28:28.266350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:37.081003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829555+0000","last_change":"2024-04-25T02:28:26.825705+0000","last_active":"2024-04-25T02:28:27.829555+0000","last_peered":"2024-04-25T02:28:27.829555+0000","last_clean":"2024-04-25T02:28:27.829555+0000","last_became_active":"2024-04-25T02:28:26.825382+0000","last_became_peered":"2024-04-25T02:28:26.825382+0000","last_unstale":"2024-04-25T02:28:27.829555+0000","last_undegraded":"2024-04-25T02:28:27.829555+0000","last_fullsized":"2024-04-25T02:28:27.829555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:09.762419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827064+0000","last_change":"2024-04-25T02:28:26.832976+0000","last_active":"2024-04-25T02:28:27.827064+0000","last_peered":"2024-04-25T02:28:27.827064+0000","last_clean":"2024-04-25T02:28:27.827064+0000","last_became_active":"2024-04-25T02:28:26.832717+0000","last_became_peered":"2024-04-25T02:28:26.832717+0000","last_unstale":"2024-04-25T02:28:27.827064+0000","last_undegraded":"2024-04-25T02:28:27.827064+0000","last_fullsized":"2024-04-25T02:28:27.827064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:28:45.463626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266302+0000","last_change":"2024-04-25T02:28:25.830578+0000","last_active":"2024-04-25T02:28:28.266302+0000","last_peered":"2024-04-25T02:28:28.266302+0000","last_clean":"2024-04-25T02:28:28.266302+0000","last_became_active":"2024-04-25T02:28:25.829878+0000","last_became_peered":"2024-04-25T02:28:25.829878+0000","last_unstale":"2024-04-25T02:28:28.266302+0000","last_undegraded":"2024-04-25T02:28:28.266302+0000","last_fullsized":"2024-04-25T02:28:28.266302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:10.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826362+0000","last_change":"2024-04-25T02:28:26.824909+0000","last_active":"2024-04-25T02:28:27.826362+0000","last_peered":"2024-04-25T02:28:27.826362+0000","last_clean":"2024-04-25T02:28:27.826362+0000","last_became_active":"2024-04-25T02:28:26.824570+0000","last_became_peered":"2024-04-25T02:28:26.824570+0000","last_unstale":"2024-04-25T02:28:27.826362+0000","last_undegraded":"2024-04-25T02:28:27.826362+0000","last_fullsized":"2024-04-25T02:28:27.826362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:52.300089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266326+0000","last_change":"2024-04-25T02:28:25.830311+0000","last_active":"2024-04-25T02:28:28.266326+0000","last_peered":"2024-04-25T02:28:28.266326+0000","last_clean":"2024-04-25T02:28:28.266326+0000","last_became_active":"2024-04-25T02:28:25.830025+0000","last_became_peered":"2024-04-25T02:28:25.830025+0000","last_unstale":"2024-04-25T02:28:28.266326+0000","last_undegraded":"2024-04-25T02:28:28.266326+0000","last_fullsized":"2024-04-25T02:28:28.266326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:22.828461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266204+0000","last_change":"2024-04-25T02:28:26.832875+0000","last_active":"2024-04-25T02:28:28.266204+0000","last_peered":"2024-04-25T02:28:28.266204+0000","last_clean":"2024-04-25T02:28:28.266204+0000","last_became_active":"2024-04-25T02:28:26.832208+0000","last_became_peered":"2024-04-25T02:28:26.832208+0000","last_unstale":"2024-04-25T02:28:28.266204+0000","last_undegraded":"2024-04-25T02:28:28.266204+0000","last_fullsized":"2024-04-25T02:28:28.266204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:09.762419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266877+0000","last_change":"2024-04-25T02:28:25.829350+0000","last_active":"2024-04-25T02:28:28.266877+0000","last_peered":"2024-04-25T02:28:28.266877+0000","last_clean":"2024-04-25T02:28:28.266877+0000","last_became_active":"2024-04-25T02:28:25.829072+0000","last_became_peered":"2024-04-25T02:28:25.829072+0000","last_unstale":"2024-04-25T02:28:28.266877+0000","last_undegraded":"2024-04-25T02:28:28.266877+0000","last_fullsized":"2024-04-25T02:28:28.266877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:17:36.734690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266692+0000","last_change":"2024-04-25T02:28:26.827282+0000","last_active":"2024-04-25T02:28:28.266692+0000","last_peered":"2024-04-25T02:28:28.266692+0000","last_clean":"2024-04-25T02:28:28.266692+0000","last_became_active":"2024-04-25T02:28:26.826977+0000","last_became_peered":"2024-04-25T02:28:26.826977+0000","last_unstale":"2024-04-25T02:28:28.266692+0000","last_undegraded":"2024-04-25T02:28:28.266692+0000","last_fullsized":"2024-04-25T02:28:28.266692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:35.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.267016+0000","last_change":"2024-04-25T02:28:25.829686+0000","last_active":"2024-04-25T02:28:28.267016+0000","last_peered":"2024-04-25T02:28:28.267016+0000","last_clean":"2024-04-25T02:28:28.267016+0000","last_became_active":"2024-04-25T02:28:25.829226+0000","last_became_peered":"2024-04-25T02:28:25.829226+0000","last_unstale":"2024-04-25T02:28:28.267016+0000","last_undegraded":"2024-04-25T02:28:28.267016+0000","last_fullsized":"2024-04-25T02:28:28.267016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:18.405319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:28:36.513 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:28:36.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.645+0000 7f78b41fb640 1 Processor -- start 2024-04-25T02:28:36.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.646+0000 7f78b41fb640 1 -- start start 2024-04-25T02:28:36.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.646+0000 7f78b41fb640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f78ac15c230 0x7f78ac071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:36.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.646+0000 7f78b41fb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac0acda0 0x7f78ac0aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:36.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.646+0000 7f78b41fb640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78ac160b20 con 0x7f78ac0aef50 2024-04-25T02:28:36.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.646+0000 7f78b41fb640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f78ac15c610 con 0x7f78ac15c230 2024-04-25T02:28:36.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.646+0000 7f78b41fb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f78ac0ad200 con 0x7f78ac0acda0 2024-04-25T02:28:36.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.647+0000 7f78b1f97640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f78ac15c230 0x7f78ac071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:36.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.647+0000 7f78b1f97640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f78ac15c230 0x7f78ac071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54642/0 (socket says 172.21.15.67:54642) 2024-04-25T02:28:36.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.647+0000 7f78b1f97640 1 -- 172.21.15.67:0/1761259424 learned_addr learned my addr 172.21.15.67:0/1761259424 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:36.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.647+0000 7f78b1796640 1 --2- 172.21.15.67:0/1761259424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac0acda0 0x7f78ac0aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:36.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.647+0000 7f78b1f97640 1 -- 172.21.15.67:0/1761259424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac0acda0 msgr2=0x7f78ac0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:36.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.647+0000 7f78b1f97640 1 --2- 172.21.15.67:0/1761259424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac0acda0 0x7f78ac0aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.647+0000 7f78b1f97640 1 -- 172.21.15.67:0/1761259424 >> v1:172.21.15.176:6789/0 conn(0x7f78ac0aef50 legacy=0x7f78ac0722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:36.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.647+0000 7f78b1f97640 1 -- 172.21.15.67:0/1761259424 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ac15fd60 con 0x7f78ac15c230 2024-04-25T02:28:36.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.647+0000 7f78b1796640 1 --2- 172.21.15.67:0/1761259424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac0acda0 0x7f78ac0aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:36.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.647+0000 7f78b1f97640 1 --2- 172.21.15.67:0/1761259424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac15c230 0x7f78ac071800 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f789c009870 tx=0x7f789c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88b1345c316636 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:36.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.648+0000 7f78b0f95640 1 -- 172.21.15.67:0/1761259424 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c037070 con 0x7f78ac15c230 2024-04-25T02:28:36.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.648+0000 7f78b0f95640 1 -- 172.21.15.67:0/1761259424 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789c032440 con 0x7f78ac15c230 2024-04-25T02:28:36.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.648+0000 7f78b0f95640 1 -- 172.21.15.67:0/1761259424 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c032810 con 0x7f78ac15c230 2024-04-25T02:28:36.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.648+0000 7f78b41fb640 1 -- 172.21.15.67:0/1761259424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac15c230 msgr2=0x7f78ac071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:36.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.648+0000 7f78b41fb640 1 --2- 172.21.15.67:0/1761259424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac15c230 0x7f78ac071800 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f789c009870 tx=0x7f789c02a200 comp rx=0 tx=0).stop 2024-04-25T02:28:36.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.648+0000 7f78b41fb640 1 -- 172.21.15.67:0/1761259424 shutdown_connections 2024-04-25T02:28:36.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.648+0000 7f78b41fb640 1 --2- 172.21.15.67:0/1761259424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac0acda0 0x7f78ac0aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.648+0000 7f78b41fb640 1 --2- 172.21.15.67:0/1761259424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac15c230 0x7f78ac071800 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.648+0000 7f78b41fb640 1 -- 172.21.15.67:0/1761259424 >> 172.21.15.67:0/1761259424 conn(0x7f78ac0b19c0 msgr2=0x7f78ac0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:36.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.648+0000 7f78b41fb640 1 -- 172.21.15.67:0/1761259424 shutdown_connections 2024-04-25T02:28:36.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.648+0000 7f78b41fb640 1 -- 172.21.15.67:0/1761259424 wait complete. 2024-04-25T02:28:36.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.649+0000 7f78b41fb640 1 Processor -- start 2024-04-25T02:28:36.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.649+0000 7f78b41fb640 1 -- start start 2024-04-25T02:28:36.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.650+0000 7f78b41fb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78ac0acda0 0x7f78ac15c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:36.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.650+0000 7f78b41fb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac0aef50 0x7f78ac154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:36.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.650+0000 7f78b41fb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac15c230 0x7f78ac1f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:36.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.650+0000 7f78b41fb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac160600 con 0x7f78ac15c230 2024-04-25T02:28:36.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.650+0000 7f78b41fb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac160320 con 0x7f78ac0acda0 2024-04-25T02:28:36.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.650+0000 7f78b41fb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f78ac0af3e0 con 0x7f78ac0aef50 2024-04-25T02:28:36.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.650+0000 7f78b2798640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac15c230 0x7f78ac1f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:36.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.650+0000 7f78b2798640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac15c230 0x7f78ac1f5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54658/0 (socket says 172.21.15.67:54658) 2024-04-25T02:28:36.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.650+0000 7f78b2798640 1 -- 172.21.15.67:0/63024337 learned_addr learned my addr 172.21.15.67:0/63024337 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:36.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.650+0000 7f78b1796640 1 --2- 172.21.15.67:0/63024337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac0aef50 0x7f78ac154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:36.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.650+0000 7f78b1f97640 1 --2- 172.21.15.67:0/63024337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78ac0acda0 0x7f78ac15c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:36.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.651+0000 7f78b2798640 1 -- 172.21.15.67:0/63024337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac0aef50 msgr2=0x7f78ac154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:36.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.651+0000 7f78b2798640 1 --2- 172.21.15.67:0/63024337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac0aef50 0x7f78ac154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.651+0000 7f78b2798640 1 -- 172.21.15.67:0/63024337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78ac0acda0 msgr2=0x7f78ac15c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:36.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.651+0000 7f78b2798640 1 --2- 172.21.15.67:0/63024337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78ac0acda0 0x7f78ac15c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.651+0000 7f78b2798640 1 -- 172.21.15.67:0/63024337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ac15cda0 con 0x7f78ac15c230 2024-04-25T02:28:36.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.651+0000 7f78b1f97640 1 --2- 172.21.15.67:0/63024337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78ac0acda0 0x7f78ac15c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:36.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.651+0000 7f78b2798640 1 --2- 172.21.15.67:0/63024337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac15c230 0x7f78ac1f5940 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f78a400c780 tx=0x7f78a400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:36.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.651+0000 7f78a27fc640 1 -- 172.21.15.67:0/63024337 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a4004b10 con 0x7f78ac15c230 2024-04-25T02:28:36.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.651+0000 7f78a27fc640 1 -- 172.21.15.67:0/63024337 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a4004cb0 con 0x7f78ac15c230 2024-04-25T02:28:36.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.651+0000 7f78b41fb640 1 -- 172.21.15.67:0/63024337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78ac15d080 con 0x7f78ac15c230 2024-04-25T02:28:36.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.651+0000 7f78a27fc640 1 -- 172.21.15.67:0/63024337 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a400aa90 con 0x7f78ac15c230 2024-04-25T02:28:36.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.651+0000 7f78b41fb640 1 -- 172.21.15.67:0/63024337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ac15d640 con 0x7f78ac15c230 2024-04-25T02:28:36.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.652+0000 7f78b41fb640 1 -- 172.21.15.67:0/63024337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78ac069110 con 0x7f78ac15c230 2024-04-25T02:28:36.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.652+0000 7f78a27fc640 1 -- 172.21.15.67:0/63024337 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78a400ac30 con 0x7f78ac15c230 2024-04-25T02:28:36.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.653+0000 7f78a27fc640 1 --2- 172.21.15.67:0/63024337 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f789006be30 0x7f789006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:36.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.653+0000 7f78a27fc640 1 -- 172.21.15.67:0/63024337 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f78a408b3b0 con 0x7f78ac15c230 2024-04-25T02:28:36.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.653+0000 7f78b1f97640 1 --2- 172.21.15.67:0/63024337 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f789006be30 0x7f789006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:36.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.654+0000 7f78b1f97640 1 --2- 172.21.15.67:0/63024337 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f789006be30 0x7f789006e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f789c034000 tx=0x7f789c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.657+0000 7f78a27fc640 1 -- 172.21.15.67:0/63024337 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f78a4059d60 con 0x7f78ac15c230 2024-04-25T02:28:36.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.837+0000 7f78b41fb640 1 -- 172.21.15.67:0/63024337 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78ac0b1550 con 0x7f789006be30 2024-04-25T02:28:36.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.844+0000 7f78a27fc640 1 -- 172.21.15.67:0/63024337 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f78ac0b1550 con 0x7f789006be30 2024-04-25T02:28:36.850 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:36.851 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-25T02:28:36.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.847+0000 7f78b41fb640 1 -- 172.21.15.67:0/63024337 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f789006be30 msgr2=0x7f789006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:36.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.847+0000 7f78b41fb640 1 --2- 172.21.15.67:0/63024337 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f789006be30 0x7f789006e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f789c034000 tx=0x7f789c02e000 comp rx=0 tx=0).stop 2024-04-25T02:28:36.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.847+0000 7f78b41fb640 1 -- 172.21.15.67:0/63024337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac15c230 msgr2=0x7f78ac1f5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:36.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.847+0000 7f78b41fb640 1 --2- 172.21.15.67:0/63024337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac15c230 0x7f78ac1f5940 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f78a400c780 tx=0x7f78a400cc40 comp rx=0 tx=0).stop 2024-04-25T02:28:36.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.847+0000 7f78b41fb640 1 -- 172.21.15.67:0/63024337 shutdown_connections 2024-04-25T02:28:36.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.847+0000 7f78b41fb640 1 --2- 172.21.15.67:0/63024337 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f789006be30 0x7f789006e2f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.847+0000 7f78b41fb640 1 --2- 172.21.15.67:0/63024337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac15c230 0x7f78ac1f5940 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.847+0000 7f78b41fb640 1 --2- 172.21.15.67:0/63024337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac0aef50 0x7f78ac154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.847+0000 7f78b41fb640 1 --2- 172.21.15.67:0/63024337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78ac0acda0 0x7f78ac15c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:36.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.847+0000 7f78b41fb640 1 -- 172.21.15.67:0/63024337 >> 172.21.15.67:0/63024337 conn(0x7f78ac0b19c0 msgr2=0x7f78ac0ad4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:36.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.848+0000 7f78b41fb640 1 -- 172.21.15.67:0/63024337 shutdown_connections 2024-04-25T02:28:36.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.848+0000 7f78b41fb640 1 -- 172.21.15.67:0/63024337 wait complete. 2024-04-25T02:28:36.862 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-25T02:28:36.332542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219020,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755700,"statfs":{"total":773094113280,"available":772869836800,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.519376"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266478+0000","last_change":"2024-04-25T02:28:26.842721+0000","last_active":"2024-04-25T02:28:28.266478+0000","last_peered":"2024-04-25T02:28:28.266478+0000","last_clean":"2024-04-25T02:28:28.266478+0000","last_became_active":"2024-04-25T02:28:26.842458+0000","last_became_peered":"2024-04-25T02:28:26.842458+0000","last_unstale":"2024-04-25T02:28:28.266478+0000","last_undegraded":"2024-04-25T02:28:28.266478+0000","last_fullsized":"2024-04-25T02:28:28.266478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:17.268811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.823036+0000","last_change":"2024-04-25T02:28:26.837624+0000","last_active":"2024-04-25T02:28:27.823036+0000","last_peered":"2024-04-25T02:28:27.823036+0000","last_clean":"2024-04-25T02:28:27.823036+0000","last_became_active":"2024-04-25T02:28:26.837058+0000","last_became_peered":"2024-04-25T02:28:26.837058+0000","last_unstale":"2024-04-25T02:28:27.823036+0000","last_undegraded":"2024-04-25T02:28:27.823036+0000","last_fullsized":"2024-04-25T02:28:27.823036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:35.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266185+0000","last_change":"2024-04-25T02:28:26.826784+0000","last_active":"2024-04-25T02:28:28.266185+0000","last_peered":"2024-04-25T02:28:28.266185+0000","last_clean":"2024-04-25T02:28:28.266185+0000","last_became_active":"2024-04-25T02:28:26.825536+0000","last_became_peered":"2024-04-25T02:28:26.825536+0000","last_unstale":"2024-04-25T02:28:28.266185+0000","last_undegraded":"2024-04-25T02:28:28.266185+0000","last_fullsized":"2024-04-25T02:28:28.266185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:12.142773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826216+0000","last_change":"2024-04-25T02:28:26.831333+0000","last_active":"2024-04-25T02:28:27.826216+0000","last_peered":"2024-04-25T02:28:27.826216+0000","last_clean":"2024-04-25T02:28:27.826216+0000","last_became_active":"2024-04-25T02:28:26.831046+0000","last_became_peered":"2024-04-25T02:28:26.831046+0000","last_unstale":"2024-04-25T02:28:27.826216+0000","last_undegraded":"2024-04-25T02:28:27.826216+0000","last_fullsized":"2024-04-25T02:28:27.826216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266136+0000","last_change":"2024-04-25T02:28:26.835027+0000","last_active":"2024-04-25T02:28:28.266136+0000","last_peered":"2024-04-25T02:28:28.266136+0000","last_clean":"2024-04-25T02:28:28.266136+0000","last_became_active":"2024-04-25T02:28:26.834736+0000","last_became_peered":"2024-04-25T02:28:26.834736+0000","last_unstale":"2024-04-25T02:28:28.266136+0000","last_undegraded":"2024-04-25T02:28:28.266136+0000","last_fullsized":"2024-04-25T02:28:28.266136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:05.955540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826676+0000","last_change":"2024-04-25T02:28:26.832120+0000","last_active":"2024-04-25T02:28:27.826676+0000","last_peered":"2024-04-25T02:28:27.826676+0000","last_clean":"2024-04-25T02:28:27.826676+0000","last_became_active":"2024-04-25T02:28:26.831833+0000","last_became_peered":"2024-04-25T02:28:26.831833+0000","last_unstale":"2024-04-25T02:28:27.826676+0000","last_undegraded":"2024-04-25T02:28:27.826676+0000","last_fullsized":"2024-04-25T02:28:27.826676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:21.146249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266243+0000","last_change":"2024-04-25T02:28:26.837402+0000","last_active":"2024-04-25T02:28:28.266243+0000","last_peered":"2024-04-25T02:28:28.266243+0000","last_clean":"2024-04-25T02:28:28.266243+0000","last_became_active":"2024-04-25T02:28:26.836964+0000","last_became_peered":"2024-04-25T02:28:26.836964+0000","last_unstale":"2024-04-25T02:28:28.266243+0000","last_undegraded":"2024-04-25T02:28:28.266243+0000","last_fullsized":"2024-04-25T02:28:28.266243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:26.305868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266771+0000","last_change":"2024-04-25T02:28:26.838251+0000","last_active":"2024-04-25T02:28:28.266771+0000","last_peered":"2024-04-25T02:28:28.266771+0000","last_clean":"2024-04-25T02:28:28.266771+0000","last_became_active":"2024-04-25T02:28:26.837980+0000","last_became_peered":"2024-04-25T02:28:26.837980+0000","last_unstale":"2024-04-25T02:28:28.266771+0000","last_undegraded":"2024-04-25T02:28:28.266771+0000","last_fullsized":"2024-04-25T02:28:28.266771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:12.142773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266517+0000","last_change":"2024-04-25T02:28:26.843536+0000","last_active":"2024-04-25T02:28:28.266517+0000","last_peered":"2024-04-25T02:28:28.266517+0000","last_clean":"2024-04-25T02:28:28.266517+0000","last_became_active":"2024-04-25T02:28:26.841986+0000","last_became_peered":"2024-04-25T02:28:26.841986+0000","last_unstale":"2024-04-25T02:28:28.266517+0000","last_undegraded":"2024-04-25T02:28:28.266517+0000","last_fullsized":"2024-04-25T02:28:28.266517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:08.277396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829942+0000","last_change":"2024-04-25T02:28:26.835526+0000","last_active":"2024-04-25T02:28:27.829942+0000","last_peered":"2024-04-25T02:28:27.829942+0000","last_clean":"2024-04-25T02:28:27.829942+0000","last_became_active":"2024-04-25T02:28:26.835228+0000","last_became_peered":"2024-04-25T02:28:26.835228+0000","last_unstale":"2024-04-25T02:28:27.829942+0000","last_undegraded":"2024-04-25T02:28:27.829942+0000","last_fullsized":"2024-04-25T02:28:27.829942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829950+0000","last_change":"2024-04-25T02:28:26.836024+0000","last_active":"2024-04-25T02:28:27.829950+0000","last_peered":"2024-04-25T02:28:27.829950+0000","last_clean":"2024-04-25T02:28:27.829950+0000","last_became_active":"2024-04-25T02:28:26.835757+0000","last_became_peered":"2024-04-25T02:28:26.835757+0000","last_unstale":"2024-04-25T02:28:27.829950+0000","last_undegraded":"2024-04-25T02:28:27.829950+0000","last_fullsized":"2024-04-25T02:28:27.829950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826663+0000","last_change":"2024-04-25T02:28:26.833151+0000","last_active":"2024-04-25T02:28:27.826663+0000","last_peered":"2024-04-25T02:28:27.826663+0000","last_clean":"2024-04-25T02:28:27.826663+0000","last_became_active":"2024-04-25T02:28:26.832420+0000","last_became_peered":"2024-04-25T02:28:26.832420+0000","last_unstale":"2024-04-25T02:28:27.826663+0000","last_undegraded":"2024-04-25T02:28:27.826663+0000","last_fullsized":"2024-04-25T02:28:27.826663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:11.788886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266446+0000","last_change":"2024-04-25T02:28:26.827208+0000","last_active":"2024-04-25T02:28:28.266446+0000","last_peered":"2024-04-25T02:28:28.266446+0000","last_clean":"2024-04-25T02:28:28.266446+0000","last_became_active":"2024-04-25T02:28:26.826926+0000","last_became_peered":"2024-04-25T02:28:26.826926+0000","last_unstale":"2024-04-25T02:28:28.266446+0000","last_undegraded":"2024-04-25T02:28:28.266446+0000","last_fullsized":"2024-04-25T02:28:28.266446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:14.690953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265726+0000","last_change":"2024-04-25T02:28:26.833942+0000","last_active":"2024-04-25T02:28:28.265726+0000","last_peered":"2024-04-25T02:28:28.265726+0000","last_clean":"2024-04-25T02:28:28.265726+0000","last_became_active":"2024-04-25T02:28:26.833059+0000","last_became_peered":"2024-04-25T02:28:26.833059+0000","last_unstale":"2024-04-25T02:28:28.265726+0000","last_undegraded":"2024-04-25T02:28:28.265726+0000","last_fullsized":"2024-04-25T02:28:28.265726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:19:26.997120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822826+0000","last_change":"2024-04-25T02:28:26.841353+0000","last_active":"2024-04-25T02:28:27.822826+0000","last_peered":"2024-04-25T02:28:27.822826+0000","last_clean":"2024-04-25T02:28:27.822826+0000","last_became_active":"2024-04-25T02:28:26.841024+0000","last_became_peered":"2024-04-25T02:28:26.841024+0000","last_unstale":"2024-04-25T02:28:27.822826+0000","last_undegraded":"2024-04-25T02:28:27.822826+0000","last_fullsized":"2024-04-25T02:28:27.822826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:09.762419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826145+0000","last_change":"2024-04-25T02:28:26.831558+0000","last_active":"2024-04-25T02:28:27.826145+0000","last_peered":"2024-04-25T02:28:27.826145+0000","last_clean":"2024-04-25T02:28:27.826145+0000","last_became_active":"2024-04-25T02:28:26.831124+0000","last_became_peered":"2024-04-25T02:28:26.831124+0000","last_unstale":"2024-04-25T02:28:27.826145+0000","last_undegraded":"2024-04-25T02:28:27.826145+0000","last_fullsized":"2024-04-25T02:28:27.826145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827300+0000","last_change":"2024-04-25T02:28:26.833767+0000","last_active":"2024-04-25T02:28:27.827300+0000","last_peered":"2024-04-25T02:28:27.827300+0000","last_clean":"2024-04-25T02:28:27.827300+0000","last_became_active":"2024-04-25T02:28:26.833261+0000","last_became_peered":"2024-04-25T02:28:26.833261+0000","last_unstale":"2024-04-25T02:28:27.827300+0000","last_undegraded":"2024-04-25T02:28:27.827300+0000","last_fullsized":"2024-04-25T02:28:27.827300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:17.268811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266709+0000","last_change":"2024-04-25T02:28:26.829506+0000","last_active":"2024-04-25T02:28:28.266709+0000","last_peered":"2024-04-25T02:28:28.266709+0000","last_clean":"2024-04-25T02:28:28.266709+0000","last_became_active":"2024-04-25T02:28:26.829220+0000","last_became_peered":"2024-04-25T02:28:26.829220+0000","last_unstale":"2024-04-25T02:28:28.266709+0000","last_undegraded":"2024-04-25T02:28:28.266709+0000","last_fullsized":"2024-04-25T02:28:28.266709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:54.957406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266478+0000","last_change":"2024-04-25T02:28:26.836463+0000","last_active":"2024-04-25T02:28:28.266478+0000","last_peered":"2024-04-25T02:28:28.266478+0000","last_clean":"2024-04-25T02:28:28.266478+0000","last_became_active":"2024-04-25T02:28:26.836202+0000","last_became_peered":"2024-04-25T02:28:26.836202+0000","last_unstale":"2024-04-25T02:28:28.266478+0000","last_undegraded":"2024-04-25T02:28:28.266478+0000","last_fullsized":"2024-04-25T02:28:28.266478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:19.911809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829840+0000","last_change":"2024-04-25T02:28:26.826332+0000","last_active":"2024-04-25T02:28:27.829840+0000","last_peered":"2024-04-25T02:28:27.829840+0000","last_clean":"2024-04-25T02:28:27.829840+0000","last_became_active":"2024-04-25T02:28:26.825996+0000","last_became_peered":"2024-04-25T02:28:26.825996+0000","last_unstale":"2024-04-25T02:28:27.829840+0000","last_undegraded":"2024-04-25T02:28:27.829840+0000","last_fullsized":"2024-04-25T02:28:27.829840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:14.690953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266099+0000","last_change":"2024-04-25T02:28:26.832851+0000","last_active":"2024-04-25T02:28:28.266099+0000","last_peered":"2024-04-25T02:28:28.266099+0000","last_clean":"2024-04-25T02:28:28.266099+0000","last_became_active":"2024-04-25T02:28:26.830932+0000","last_became_peered":"2024-04-25T02:28:26.830932+0000","last_unstale":"2024-04-25T02:28:28.266099+0000","last_undegraded":"2024-04-25T02:28:28.266099+0000","last_fullsized":"2024-04-25T02:28:28.266099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:27.737871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826827+0000","last_change":"2024-04-25T02:28:26.833872+0000","last_active":"2024-04-25T02:28:27.826827+0000","last_peered":"2024-04-25T02:28:27.826827+0000","last_clean":"2024-04-25T02:28:27.826827+0000","last_became_active":"2024-04-25T02:28:26.833622+0000","last_became_peered":"2024-04-25T02:28:26.833622+0000","last_unstale":"2024-04-25T02:28:27.826827+0000","last_undegraded":"2024-04-25T02:28:27.826827+0000","last_fullsized":"2024-04-25T02:28:27.826827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:41.798312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266222+0000","last_change":"2024-04-25T02:28:26.839712+0000","last_active":"2024-04-25T02:28:28.266222+0000","last_peered":"2024-04-25T02:28:28.266222+0000","last_clean":"2024-04-25T02:28:28.266222+0000","last_became_active":"2024-04-25T02:28:26.839411+0000","last_became_peered":"2024-04-25T02:28:26.839411+0000","last_unstale":"2024-04-25T02:28:28.266222+0000","last_undegraded":"2024-04-25T02:28:28.266222+0000","last_fullsized":"2024-04-25T02:28:28.266222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826301+0000","last_change":"2024-04-25T02:28:26.831405+0000","last_active":"2024-04-25T02:28:27.826301+0000","last_peered":"2024-04-25T02:28:27.826301+0000","last_clean":"2024-04-25T02:28:27.826301+0000","last_became_active":"2024-04-25T02:28:26.830794+0000","last_became_peered":"2024-04-25T02:28:26.830794+0000","last_unstale":"2024-04-25T02:28:27.826301+0000","last_undegraded":"2024-04-25T02:28:27.826301+0000","last_fullsized":"2024-04-25T02:28:27.826301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:35.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266665+0000","last_change":"2024-04-25T02:28:26.839008+0000","last_active":"2024-04-25T02:28:28.266665+0000","last_peered":"2024-04-25T02:28:28.266665+0000","last_clean":"2024-04-25T02:28:28.266665+0000","last_became_active":"2024-04-25T02:28:26.838644+0000","last_became_peered":"2024-04-25T02:28:26.838644+0000","last_unstale":"2024-04-25T02:28:28.266665+0000","last_undegraded":"2024-04-25T02:28:28.266665+0000","last_fullsized":"2024-04-25T02:28:28.266665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829981+0000","last_change":"2024-04-25T02:28:26.831816+0000","last_active":"2024-04-25T02:28:27.829981+0000","last_peered":"2024-04-25T02:28:27.829981+0000","last_clean":"2024-04-25T02:28:27.829981+0000","last_became_active":"2024-04-25T02:28:26.831553+0000","last_became_peered":"2024-04-25T02:28:26.831553+0000","last_unstale":"2024-04-25T02:28:27.829981+0000","last_undegraded":"2024-04-25T02:28:27.829981+0000","last_fullsized":"2024-04-25T02:28:27.829981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:35.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822894+0000","last_change":"2024-04-25T02:28:26.839750+0000","last_active":"2024-04-25T02:28:27.822894+0000","last_peered":"2024-04-25T02:28:27.822894+0000","last_clean":"2024-04-25T02:28:27.822894+0000","last_became_active":"2024-04-25T02:28:26.839465+0000","last_became_peered":"2024-04-25T02:28:26.839465+0000","last_unstale":"2024-04-25T02:28:27.822894+0000","last_undegraded":"2024-04-25T02:28:27.822894+0000","last_fullsized":"2024-04-25T02:28:27.822894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:14.690953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266891+0000","last_change":"2024-04-25T02:28:26.841574+0000","last_active":"2024-04-25T02:28:28.266891+0000","last_peered":"2024-04-25T02:28:28.266891+0000","last_clean":"2024-04-25T02:28:28.266891+0000","last_became_active":"2024-04-25T02:28:26.841294+0000","last_became_peered":"2024-04-25T02:28:26.841294+0000","last_unstale":"2024-04-25T02:28:28.266891+0000","last_undegraded":"2024-04-25T02:28:28.266891+0000","last_fullsized":"2024-04-25T02:28:28.266891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:05.955540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266251+0000","last_change":"2024-04-25T02:28:26.826424+0000","last_active":"2024-04-25T02:28:28.266251+0000","last_peered":"2024-04-25T02:28:28.266251+0000","last_clean":"2024-04-25T02:28:28.266251+0000","last_became_active":"2024-04-25T02:28:26.826110+0000","last_became_peered":"2024-04-25T02:28:26.826110+0000","last_unstale":"2024-04-25T02:28:28.266251+0000","last_undegraded":"2024-04-25T02:28:28.266251+0000","last_fullsized":"2024-04-25T02:28:28.266251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827064+0000","last_change":"2024-04-25T02:28:26.827830+0000","last_active":"2024-04-25T02:28:27.827064+0000","last_peered":"2024-04-25T02:28:27.827064+0000","last_clean":"2024-04-25T02:28:27.827064+0000","last_became_active":"2024-04-25T02:28:26.827580+0000","last_became_peered":"2024-04-25T02:28:26.827580+0000","last_unstale":"2024-04-25T02:28:27.827064+0000","last_undegraded":"2024-04-25T02:28:27.827064+0000","last_fullsized":"2024-04-25T02:28:27.827064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:26.897425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266587+0000","last_change":"2024-04-25T02:28:26.835685+0000","last_active":"2024-04-25T02:28:28.266587+0000","last_peered":"2024-04-25T02:28:28.266587+0000","last_clean":"2024-04-25T02:28:28.266587+0000","last_became_active":"2024-04-25T02:28:26.835362+0000","last_became_peered":"2024-04-25T02:28:26.835362+0000","last_unstale":"2024-04-25T02:28:28.266587+0000","last_undegraded":"2024-04-25T02:28:28.266587+0000","last_fullsized":"2024-04-25T02:28:28.266587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:23.832987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829554+0000","last_change":"2024-04-25T02:28:26.829119+0000","last_active":"2024-04-25T02:28:27.829554+0000","last_peered":"2024-04-25T02:28:27.829554+0000","last_clean":"2024-04-25T02:28:27.829554+0000","last_became_active":"2024-04-25T02:28:26.828611+0000","last_became_peered":"2024-04-25T02:28:26.828611+0000","last_unstale":"2024-04-25T02:28:27.829554+0000","last_undegraded":"2024-04-25T02:28:27.829554+0000","last_fullsized":"2024-04-25T02:28:27.829554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826257+0000","last_change":"2024-04-25T02:28:26.836988+0000","last_active":"2024-04-25T02:28:27.826257+0000","last_peered":"2024-04-25T02:28:27.826257+0000","last_clean":"2024-04-25T02:28:27.826257+0000","last_became_active":"2024-04-25T02:28:26.836475+0000","last_became_peered":"2024-04-25T02:28:26.836475+0000","last_unstale":"2024-04-25T02:28:27.826257+0000","last_undegraded":"2024-04-25T02:28:27.826257+0000","last_fullsized":"2024-04-25T02:28:27.826257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:33.827773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266723+0000","last_change":"2024-04-25T02:28:25.831862+0000","last_active":"2024-04-25T02:28:28.266723+0000","last_peered":"2024-04-25T02:28:28.266723+0000","last_clean":"2024-04-25T02:28:28.266723+0000","last_became_active":"2024-04-25T02:28:25.831543+0000","last_became_peered":"2024-04-25T02:28:25.831543+0000","last_unstale":"2024-04-25T02:28:28.266723+0000","last_undegraded":"2024-04-25T02:28:28.266723+0000","last_fullsized":"2024-04-25T02:28:28.266723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266403+0000","last_change":"2024-04-25T02:28:26.824999+0000","last_active":"2024-04-25T02:28:28.266403+0000","last_peered":"2024-04-25T02:28:28.266403+0000","last_clean":"2024-04-25T02:28:28.266403+0000","last_became_active":"2024-04-25T02:28:26.824688+0000","last_became_peered":"2024-04-25T02:28:26.824688+0000","last_unstale":"2024-04-25T02:28:28.266403+0000","last_undegraded":"2024-04-25T02:28:28.266403+0000","last_fullsized":"2024-04-25T02:28:28.266403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:14.690953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829683+0000","last_change":"2024-04-25T02:28:25.821131+0000","last_active":"2024-04-25T02:28:27.829683+0000","last_peered":"2024-04-25T02:28:27.829683+0000","last_clean":"2024-04-25T02:28:27.829683+0000","last_became_active":"2024-04-25T02:28:25.820867+0000","last_became_peered":"2024-04-25T02:28:25.820867+0000","last_unstale":"2024-04-25T02:28:27.829683+0000","last_undegraded":"2024-04-25T02:28:27.829683+0000","last_fullsized":"2024-04-25T02:28:27.829683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:10.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266380+0000","last_change":"2024-04-25T02:28:25.830948+0000","last_active":"2024-04-25T02:28:28.266380+0000","last_peered":"2024-04-25T02:28:28.266380+0000","last_clean":"2024-04-25T02:28:28.266380+0000","last_became_active":"2024-04-25T02:28:25.830638+0000","last_became_peered":"2024-04-25T02:28:25.830638+0000","last_unstale":"2024-04-25T02:28:28.266380+0000","last_undegraded":"2024-04-25T02:28:28.266380+0000","last_fullsized":"2024-04-25T02:28:28.266380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:48.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266977+0000","last_change":"2024-04-25T02:28:26.828838+0000","last_active":"2024-04-25T02:28:28.266977+0000","last_peered":"2024-04-25T02:28:28.266977+0000","last_clean":"2024-04-25T02:28:28.266977+0000","last_became_active":"2024-04-25T02:28:26.827915+0000","last_became_peered":"2024-04-25T02:28:26.827915+0000","last_unstale":"2024-04-25T02:28:28.266977+0000","last_undegraded":"2024-04-25T02:28:28.266977+0000","last_fullsized":"2024-04-25T02:28:28.266977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:21.146249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826399+0000","last_change":"2024-04-25T02:28:25.819425+0000","last_active":"2024-04-25T02:28:27.826399+0000","last_peered":"2024-04-25T02:28:27.826399+0000","last_clean":"2024-04-25T02:28:27.826399+0000","last_became_active":"2024-04-25T02:28:25.819124+0000","last_became_peered":"2024-04-25T02:28:25.819124+0000","last_unstale":"2024-04-25T02:28:27.826399+0000","last_undegraded":"2024-04-25T02:28:27.826399+0000","last_fullsized":"2024-04-25T02:28:27.826399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:32.823247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822908+0000","last_change":"2024-04-25T02:28:26.840249+0000","last_active":"2024-04-25T02:28:27.822908+0000","last_peered":"2024-04-25T02:28:27.822908+0000","last_clean":"2024-04-25T02:28:27.822908+0000","last_became_active":"2024-04-25T02:28:26.839935+0000","last_became_peered":"2024-04-25T02:28:26.839935+0000","last_unstale":"2024-04-25T02:28:27.822908+0000","last_undegraded":"2024-04-25T02:28:27.822908+0000","last_fullsized":"2024-04-25T02:28:27.822908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829936+0000","last_change":"2024-04-25T02:28:25.827094+0000","last_active":"2024-04-25T02:28:27.829936+0000","last_peered":"2024-04-25T02:28:27.829936+0000","last_clean":"2024-04-25T02:28:27.829936+0000","last_became_active":"2024-04-25T02:28:25.826833+0000","last_became_peered":"2024-04-25T02:28:25.826833+0000","last_unstale":"2024-04-25T02:28:27.829936+0000","last_undegraded":"2024-04-25T02:28:27.829936+0000","last_fullsized":"2024-04-25T02:28:27.829936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:48.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826933+0000","last_change":"2024-04-25T02:28:26.830006+0000","last_active":"2024-04-25T02:28:27.826933+0000","last_peered":"2024-04-25T02:28:27.826933+0000","last_clean":"2024-04-25T02:28:27.826933+0000","last_became_active":"2024-04-25T02:28:26.829703+0000","last_became_peered":"2024-04-25T02:28:26.829703+0000","last_unstale":"2024-04-25T02:28:27.826933+0000","last_undegraded":"2024-04-25T02:28:27.826933+0000","last_fullsized":"2024-04-25T02:28:27.826933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:26.305868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826920+0000","last_change":"2024-04-25T02:28:25.824029+0000","last_active":"2024-04-25T02:28:27.826920+0000","last_peered":"2024-04-25T02:28:27.826920+0000","last_clean":"2024-04-25T02:28:27.826920+0000","last_became_active":"2024-04-25T02:28:25.823734+0000","last_became_peered":"2024-04-25T02:28:25.823734+0000","last_unstale":"2024-04-25T02:28:27.826920+0000","last_undegraded":"2024-04-25T02:28:27.826920+0000","last_fullsized":"2024-04-25T02:28:27.826920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:22.828461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266445+0000","last_change":"2024-04-25T02:28:26.833144+0000","last_active":"2024-04-25T02:28:28.266445+0000","last_peered":"2024-04-25T02:28:28.266445+0000","last_clean":"2024-04-25T02:28:28.266445+0000","last_became_active":"2024-04-25T02:28:26.832578+0000","last_became_peered":"2024-04-25T02:28:26.832578+0000","last_unstale":"2024-04-25T02:28:28.266445+0000","last_undegraded":"2024-04-25T02:28:28.266445+0000","last_fullsized":"2024-04-25T02:28:28.266445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822999+0000","last_change":"2024-04-25T02:28:25.827731+0000","last_active":"2024-04-25T02:28:27.822999+0000","last_peered":"2024-04-25T02:28:27.822999+0000","last_clean":"2024-04-25T02:28:27.822999+0000","last_became_active":"2024-04-25T02:28:25.827415+0000","last_became_peered":"2024-04-25T02:28:25.827415+0000","last_unstale":"2024-04-25T02:28:27.822999+0000","last_undegraded":"2024-04-25T02:28:27.822999+0000","last_fullsized":"2024-04-25T02:28:27.822999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826897+0000","last_change":"2024-04-25T02:28:26.833382+0000","last_active":"2024-04-25T02:28:27.826897+0000","last_peered":"2024-04-25T02:28:27.826897+0000","last_clean":"2024-04-25T02:28:27.826897+0000","last_became_active":"2024-04-25T02:28:26.832896+0000","last_became_peered":"2024-04-25T02:28:26.832896+0000","last_unstale":"2024-04-25T02:28:27.826897+0000","last_undegraded":"2024-04-25T02:28:27.826897+0000","last_fullsized":"2024-04-25T02:28:27.826897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:23.832987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829943+0000","last_change":"2024-04-25T02:28:25.831322+0000","last_active":"2024-04-25T02:28:27.829943+0000","last_peered":"2024-04-25T02:28:27.829943+0000","last_clean":"2024-04-25T02:28:27.829943+0000","last_became_active":"2024-04-25T02:28:25.831024+0000","last_became_peered":"2024-04-25T02:28:25.831024+0000","last_unstale":"2024-04-25T02:28:27.829943+0000","last_undegraded":"2024-04-25T02:28:27.829943+0000","last_fullsized":"2024-04-25T02:28:27.829943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:22.828461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266281+0000","last_change":"2024-04-25T02:28:26.837505+0000","last_active":"2024-04-25T02:28:28.266281+0000","last_peered":"2024-04-25T02:28:28.266281+0000","last_clean":"2024-04-25T02:28:28.266281+0000","last_became_active":"2024-04-25T02:28:26.836986+0000","last_became_peered":"2024-04-25T02:28:26.836986+0000","last_unstale":"2024-04-25T02:28:28.266281+0000","last_undegraded":"2024-04-25T02:28:28.266281+0000","last_fullsized":"2024-04-25T02:28:28.266281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:26.897425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266515+0000","last_change":"2024-04-25T02:28:25.830714+0000","last_active":"2024-04-25T02:28:28.266515+0000","last_peered":"2024-04-25T02:28:28.266515+0000","last_clean":"2024-04-25T02:28:28.266515+0000","last_became_active":"2024-04-25T02:28:25.830407+0000","last_became_peered":"2024-04-25T02:28:25.830407+0000","last_unstale":"2024-04-25T02:28:28.266515+0000","last_undegraded":"2024-04-25T02:28:28.266515+0000","last_fullsized":"2024-04-25T02:28:28.266515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:15.170784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265782+0000","last_change":"2024-04-25T02:28:26.830192+0000","last_active":"2024-04-25T02:28:28.265782+0000","last_peered":"2024-04-25T02:28:28.265782+0000","last_clean":"2024-04-25T02:28:28.265782+0000","last_became_active":"2024-04-25T02:28:26.829820+0000","last_became_peered":"2024-04-25T02:28:26.829820+0000","last_unstale":"2024-04-25T02:28:28.265782+0000","last_undegraded":"2024-04-25T02:28:28.265782+0000","last_fullsized":"2024-04-25T02:28:28.265782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:29.495511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826919+0000","last_change":"2024-04-25T02:28:25.826726+0000","last_active":"2024-04-25T02:28:27.826919+0000","last_peered":"2024-04-25T02:28:27.826919+0000","last_clean":"2024-04-25T02:28:27.826919+0000","last_became_active":"2024-04-25T02:28:25.826427+0000","last_became_peered":"2024-04-25T02:28:25.826427+0000","last_unstale":"2024-04-25T02:28:27.826919+0000","last_undegraded":"2024-04-25T02:28:27.826919+0000","last_fullsized":"2024-04-25T02:28:27.826919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266162+0000","last_change":"2024-04-25T02:28:26.842107+0000","last_active":"2024-04-25T02:28:28.266162+0000","last_peered":"2024-04-25T02:28:28.266162+0000","last_clean":"2024-04-25T02:28:28.266162+0000","last_became_active":"2024-04-25T02:28:26.841784+0000","last_became_peered":"2024-04-25T02:28:26.841784+0000","last_unstale":"2024-04-25T02:28:28.266162+0000","last_undegraded":"2024-04-25T02:28:28.266162+0000","last_fullsized":"2024-04-25T02:28:28.266162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:21.146249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829509+0000","last_change":"2024-04-25T02:28:25.822245+0000","last_active":"2024-04-25T02:28:27.829509+0000","last_peered":"2024-04-25T02:28:27.829509+0000","last_clean":"2024-04-25T02:28:27.829509+0000","last_became_active":"2024-04-25T02:28:25.821961+0000","last_became_peered":"2024-04-25T02:28:25.821961+0000","last_unstale":"2024-04-25T02:28:27.829509+0000","last_undegraded":"2024-04-25T02:28:27.829509+0000","last_fullsized":"2024-04-25T02:28:27.829509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829553+0000","last_change":"2024-04-25T02:28:26.828898+0000","last_active":"2024-04-25T02:28:27.829553+0000","last_peered":"2024-04-25T02:28:27.829553+0000","last_clean":"2024-04-25T02:28:27.829553+0000","last_became_active":"2024-04-25T02:28:26.828274+0000","last_became_peered":"2024-04-25T02:28:26.828274+0000","last_unstale":"2024-04-25T02:28:27.829553+0000","last_undegraded":"2024-04-25T02:28:27.829553+0000","last_fullsized":"2024-04-25T02:28:27.829553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:12.142773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266835+0000","last_change":"2024-04-25T02:28:25.820968+0000","last_active":"2024-04-25T02:28:28.266835+0000","last_peered":"2024-04-25T02:28:28.266835+0000","last_clean":"2024-04-25T02:28:28.266835+0000","last_became_active":"2024-04-25T02:28:25.820583+0000","last_became_peered":"2024-04-25T02:28:25.820583+0000","last_unstale":"2024-04-25T02:28:28.266835+0000","last_undegraded":"2024-04-25T02:28:28.266835+0000","last_fullsized":"2024-04-25T02:28:28.266835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:17:36.734690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266094+0000","last_change":"2024-04-25T02:28:26.839360+0000","last_active":"2024-04-25T02:28:28.266094+0000","last_peered":"2024-04-25T02:28:28.266094+0000","last_clean":"2024-04-25T02:28:28.266094+0000","last_became_active":"2024-04-25T02:28:26.839071+0000","last_became_peered":"2024-04-25T02:28:26.839071+0000","last_unstale":"2024-04-25T02:28:28.266094+0000","last_undegraded":"2024-04-25T02:28:28.266094+0000","last_fullsized":"2024-04-25T02:28:28.266094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:52.300089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826544+0000","last_change":"2024-04-25T02:28:25.831348+0000","last_active":"2024-04-25T02:28:27.826544+0000","last_peered":"2024-04-25T02:28:27.826544+0000","last_clean":"2024-04-25T02:28:27.826544+0000","last_became_active":"2024-04-25T02:28:25.830958+0000","last_became_peered":"2024-04-25T02:28:25.830958+0000","last_unstale":"2024-04-25T02:28:27.826544+0000","last_undegraded":"2024-04-25T02:28:27.826544+0000","last_fullsized":"2024-04-25T02:28:27.826544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:14:28.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266367+0000","last_change":"2024-04-25T02:28:26.843465+0000","last_active":"2024-04-25T02:28:28.266367+0000","last_peered":"2024-04-25T02:28:28.266367+0000","last_clean":"2024-04-25T02:28:28.266367+0000","last_became_active":"2024-04-25T02:28:26.843147+0000","last_became_peered":"2024-04-25T02:28:26.843147+0000","last_unstale":"2024-04-25T02:28:28.266367+0000","last_undegraded":"2024-04-25T02:28:28.266367+0000","last_fullsized":"2024-04-25T02:28:28.266367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:28:45.463626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266818+0000","last_change":"2024-04-25T02:28:25.822767+0000","last_active":"2024-04-25T02:28:28.266818+0000","last_peered":"2024-04-25T02:28:28.266818+0000","last_clean":"2024-04-25T02:28:28.266818+0000","last_became_active":"2024-04-25T02:28:25.822396+0000","last_became_peered":"2024-04-25T02:28:25.822396+0000","last_unstale":"2024-04-25T02:28:28.266818+0000","last_undegraded":"2024-04-25T02:28:28.266818+0000","last_fullsized":"2024-04-25T02:28:28.266818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.702340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266583+0000","last_change":"2024-04-25T02:28:26.840019+0000","last_active":"2024-04-25T02:28:28.266583+0000","last_peered":"2024-04-25T02:28:28.266583+0000","last_clean":"2024-04-25T02:28:28.266583+0000","last_became_active":"2024-04-25T02:28:26.839739+0000","last_became_peered":"2024-04-25T02:28:26.839739+0000","last_unstale":"2024-04-25T02:28:28.266583+0000","last_undegraded":"2024-04-25T02:28:28.266583+0000","last_fullsized":"2024-04-25T02:28:28.266583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:31.847102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.823098+0000","last_change":"2024-04-25T02:28:25.819880+0000","last_active":"2024-04-25T02:28:27.823098+0000","last_peered":"2024-04-25T02:28:27.823098+0000","last_clean":"2024-04-25T02:28:27.823098+0000","last_became_active":"2024-04-25T02:28:25.819487+0000","last_became_peered":"2024-04-25T02:28:25.819487+0000","last_unstale":"2024-04-25T02:28:27.823098+0000","last_undegraded":"2024-04-25T02:28:27.823098+0000","last_fullsized":"2024-04-25T02:28:27.823098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:32.823247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826504+0000","last_change":"2024-04-25T02:28:26.830885+0000","last_active":"2024-04-25T02:28:27.826504+0000","last_peered":"2024-04-25T02:28:27.826504+0000","last_clean":"2024-04-25T02:28:27.826504+0000","last_became_active":"2024-04-25T02:28:26.830454+0000","last_became_peered":"2024-04-25T02:28:26.830454+0000","last_unstale":"2024-04-25T02:28:27.826504+0000","last_undegraded":"2024-04-25T02:28:27.826504+0000","last_fullsized":"2024-04-25T02:28:27.826504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:05.955540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266514+0000","last_change":"2024-04-25T02:28:25.820969+0000","last_active":"2024-04-25T02:28:28.266514+0000","last_peered":"2024-04-25T02:28:28.266514+0000","last_clean":"2024-04-25T02:28:28.266514+0000","last_became_active":"2024-04-25T02:28:25.820594+0000","last_became_peered":"2024-04-25T02:28:25.820594+0000","last_unstale":"2024-04-25T02:28:28.266514+0000","last_undegraded":"2024-04-25T02:28:28.266514+0000","last_fullsized":"2024-04-25T02:28:28.266514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:48.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266206+0000","last_change":"2024-04-25T02:28:26.843856+0000","last_active":"2024-04-25T02:28:28.266206+0000","last_peered":"2024-04-25T02:28:28.266206+0000","last_clean":"2024-04-25T02:28:28.266206+0000","last_became_active":"2024-04-25T02:28:26.841671+0000","last_became_peered":"2024-04-25T02:28:26.841671+0000","last_unstale":"2024-04-25T02:28:28.266206+0000","last_undegraded":"2024-04-25T02:28:28.266206+0000","last_fullsized":"2024-04-25T02:28:28.266206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:41.798312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265929+0000","last_change":"2024-04-25T02:28:15.520345+0000","last_active":"2024-04-25T02:28:28.265929+0000","last_peered":"2024-04-25T02:28:28.265929+0000","last_clean":"2024-04-25T02:28:28.265929+0000","last_became_active":"2024-04-25T02:28:15.519317+0000","last_became_peered":"2024-04-25T02:28:15.519317+0000","last_unstale":"2024-04-25T02:28:28.265929+0000","last_undegraded":"2024-04-25T02:28:28.265929+0000","last_fullsized":"2024-04-25T02:28:28.265929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_clean_scrub_stamp":"2024-04-25T02:28:14.374327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:20.125523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826154+0000","last_change":"2024-04-25T02:28:25.821889+0000","last_active":"2024-04-25T02:28:27.826154+0000","last_peered":"2024-04-25T02:28:27.826154+0000","last_clean":"2024-04-25T02:28:27.826154+0000","last_became_active":"2024-04-25T02:28:25.821633+0000","last_became_peered":"2024-04-25T02:28:25.821633+0000","last_unstale":"2024-04-25T02:28:27.826154+0000","last_undegraded":"2024-04-25T02:28:27.826154+0000","last_fullsized":"2024-04-25T02:28:27.826154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:48.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266206+0000","last_change":"2024-04-25T02:28:26.839035+0000","last_active":"2024-04-25T02:28:28.266206+0000","last_peered":"2024-04-25T02:28:28.266206+0000","last_clean":"2024-04-25T02:28:28.266206+0000","last_became_active":"2024-04-25T02:28:26.838759+0000","last_became_peered":"2024-04-25T02:28:26.838759+0000","last_unstale":"2024-04-25T02:28:28.266206+0000","last_undegraded":"2024-04-25T02:28:28.266206+0000","last_fullsized":"2024-04-25T02:28:28.266206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:09.762419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265862+0000","last_change":"2024-04-25T02:28:25.833571+0000","last_active":"2024-04-25T02:28:28.265862+0000","last_peered":"2024-04-25T02:28:28.265862+0000","last_clean":"2024-04-25T02:28:28.265862+0000","last_became_active":"2024-04-25T02:28:25.833379+0000","last_became_peered":"2024-04-25T02:28:25.833379+0000","last_unstale":"2024-04-25T02:28:28.265862+0000","last_undegraded":"2024-04-25T02:28:28.265862+0000","last_fullsized":"2024-04-25T02:28:28.265862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:32.823247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265668+0000","last_change":"2024-04-25T02:28:26.833450+0000","last_active":"2024-04-25T02:28:28.265668+0000","last_peered":"2024-04-25T02:28:28.265668+0000","last_clean":"2024-04-25T02:28:28.265668+0000","last_became_active":"2024-04-25T02:28:26.833117+0000","last_became_peered":"2024-04-25T02:28:26.833117+0000","last_unstale":"2024-04-25T02:28:28.265668+0000","last_undegraded":"2024-04-25T02:28:28.265668+0000","last_fullsized":"2024-04-25T02:28:28.265668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:20.271750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266705+0000","last_change":"2024-04-25T02:28:25.823596+0000","last_active":"2024-04-25T02:28:28.266705+0000","last_peered":"2024-04-25T02:28:28.266705+0000","last_clean":"2024-04-25T02:28:28.266705+0000","last_became_active":"2024-04-25T02:28:25.822949+0000","last_became_peered":"2024-04-25T02:28:25.822949+0000","last_unstale":"2024-04-25T02:28:28.266705+0000","last_undegraded":"2024-04-25T02:28:28.266705+0000","last_fullsized":"2024-04-25T02:28:28.266705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:47.613148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822846+0000","last_change":"2024-04-25T02:28:26.830075+0000","last_active":"2024-04-25T02:28:27.822846+0000","last_peered":"2024-04-25T02:28:27.822846+0000","last_clean":"2024-04-25T02:28:27.822846+0000","last_became_active":"2024-04-25T02:28:26.829526+0000","last_became_peered":"2024-04-25T02:28:26.829526+0000","last_unstale":"2024-04-25T02:28:27.822846+0000","last_undegraded":"2024-04-25T02:28:27.822846+0000","last_fullsized":"2024-04-25T02:28:27.822846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.452916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827031+0000","last_change":"2024-04-25T02:28:25.820913+0000","last_active":"2024-04-25T02:28:27.827031+0000","last_peered":"2024-04-25T02:28:27.827031+0000","last_clean":"2024-04-25T02:28:27.827031+0000","last_became_active":"2024-04-25T02:28:25.820531+0000","last_became_peered":"2024-04-25T02:28:25.820531+0000","last_unstale":"2024-04-25T02:28:27.827031+0000","last_undegraded":"2024-04-25T02:28:27.827031+0000","last_fullsized":"2024-04-25T02:28:27.827031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:10.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827117+0000","last_change":"2024-04-25T02:28:26.835487+0000","last_active":"2024-04-25T02:28:27.827117+0000","last_peered":"2024-04-25T02:28:27.827117+0000","last_clean":"2024-04-25T02:28:27.827117+0000","last_became_active":"2024-04-25T02:28:26.834842+0000","last_became_peered":"2024-04-25T02:28:26.834842+0000","last_unstale":"2024-04-25T02:28:27.827117+0000","last_undegraded":"2024-04-25T02:28:27.827117+0000","last_fullsized":"2024-04-25T02:28:27.827117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:54.957406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.823008+0000","last_change":"2024-04-25T02:28:25.831205+0000","last_active":"2024-04-25T02:28:27.823008+0000","last_peered":"2024-04-25T02:28:27.823008+0000","last_clean":"2024-04-25T02:28:27.823008+0000","last_became_active":"2024-04-25T02:28:25.830910+0000","last_became_peered":"2024-04-25T02:28:25.830910+0000","last_unstale":"2024-04-25T02:28:27.823008+0000","last_undegraded":"2024-04-25T02:28:27.823008+0000","last_fullsized":"2024-04-25T02:28:27.823008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:22.828461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827217+0000","last_change":"2024-04-25T02:28:26.830467+0000","last_active":"2024-04-25T02:28:27.827217+0000","last_peered":"2024-04-25T02:28:27.827217+0000","last_clean":"2024-04-25T02:28:27.827217+0000","last_became_active":"2024-04-25T02:28:26.830219+0000","last_became_peered":"2024-04-25T02:28:26.830219+0000","last_unstale":"2024-04-25T02:28:27.827217+0000","last_undegraded":"2024-04-25T02:28:27.827217+0000","last_fullsized":"2024-04-25T02:28:27.827217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:19.911809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266442+0000","last_change":"2024-04-25T02:28:25.831653+0000","last_active":"2024-04-25T02:28:28.266442+0000","last_peered":"2024-04-25T02:28:28.266442+0000","last_clean":"2024-04-25T02:28:28.266442+0000","last_became_active":"2024-04-25T02:28:25.831318+0000","last_became_peered":"2024-04-25T02:28:25.831318+0000","last_unstale":"2024-04-25T02:28:28.266442+0000","last_undegraded":"2024-04-25T02:28:28.266442+0000","last_fullsized":"2024-04-25T02:28:28.266442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:53.952880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822899+0000","last_change":"2024-04-25T02:28:26.832413+0000","last_active":"2024-04-25T02:28:27.822899+0000","last_peered":"2024-04-25T02:28:27.822899+0000","last_clean":"2024-04-25T02:28:27.822899+0000","last_became_active":"2024-04-25T02:28:26.832081+0000","last_became_peered":"2024-04-25T02:28:26.832081+0000","last_unstale":"2024-04-25T02:28:27.822899+0000","last_undegraded":"2024-04-25T02:28:27.822899+0000","last_fullsized":"2024-04-25T02:28:27.822899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829103+0000","last_change":"2024-04-25T02:28:25.824355+0000","last_active":"2024-04-25T02:28:27.829103+0000","last_peered":"2024-04-25T02:28:27.829103+0000","last_clean":"2024-04-25T02:28:27.829103+0000","last_became_active":"2024-04-25T02:28:25.824048+0000","last_became_peered":"2024-04-25T02:28:25.824048+0000","last_unstale":"2024-04-25T02:28:27.829103+0000","last_undegraded":"2024-04-25T02:28:27.829103+0000","last_fullsized":"2024-04-25T02:28:27.829103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:39:53.952880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266822+0000","last_change":"2024-04-25T02:28:26.831460+0000","last_active":"2024-04-25T02:28:28.266822+0000","last_peered":"2024-04-25T02:28:28.266822+0000","last_clean":"2024-04-25T02:28:28.266822+0000","last_became_active":"2024-04-25T02:28:26.831127+0000","last_became_peered":"2024-04-25T02:28:26.831127+0000","last_unstale":"2024-04-25T02:28:28.266822+0000","last_undegraded":"2024-04-25T02:28:28.266822+0000","last_fullsized":"2024-04-25T02:28:28.266822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:52.300089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.830022+0000","last_change":"2024-04-25T02:28:25.824264+0000","last_active":"2024-04-25T02:28:27.830022+0000","last_peered":"2024-04-25T02:28:27.830022+0000","last_clean":"2024-04-25T02:28:27.830022+0000","last_became_active":"2024-04-25T02:28:25.823953+0000","last_became_peered":"2024-04-25T02:28:25.823953+0000","last_unstale":"2024-04-25T02:28:27.830022+0000","last_undegraded":"2024-04-25T02:28:27.830022+0000","last_fullsized":"2024-04-25T02:28:27.830022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:32.823247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266650+0000","last_change":"2024-04-25T02:28:26.827330+0000","last_active":"2024-04-25T02:28:28.266650+0000","last_peered":"2024-04-25T02:28:28.266650+0000","last_clean":"2024-04-25T02:28:28.266650+0000","last_became_active":"2024-04-25T02:28:26.826944+0000","last_became_peered":"2024-04-25T02:28:26.826944+0000","last_unstale":"2024-04-25T02:28:28.266650+0000","last_undegraded":"2024-04-25T02:28:28.266650+0000","last_fullsized":"2024-04-25T02:28:28.266650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:34.138840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.265859+0000","last_change":"2024-04-25T02:28:25.831605+0000","last_active":"2024-04-25T02:28:28.265859+0000","last_peered":"2024-04-25T02:28:28.265859+0000","last_clean":"2024-04-25T02:28:28.265859+0000","last_became_active":"2024-04-25T02:28:25.831328+0000","last_became_peered":"2024-04-25T02:28:25.831328+0000","last_unstale":"2024-04-25T02:28:28.265859+0000","last_undegraded":"2024-04-25T02:28:28.265859+0000","last_fullsized":"2024-04-25T02:28:28.265859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:04:33.145269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827334+0000","last_change":"2024-04-25T02:28:26.834040+0000","last_active":"2024-04-25T02:28:27.827334+0000","last_peered":"2024-04-25T02:28:27.827334+0000","last_clean":"2024-04-25T02:28:27.827334+0000","last_became_active":"2024-04-25T02:28:26.833740+0000","last_became_peered":"2024-04-25T02:28:26.833740+0000","last_unstale":"2024-04-25T02:28:27.827334+0000","last_undegraded":"2024-04-25T02:28:27.827334+0000","last_fullsized":"2024-04-25T02:28:27.827334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:04:34.149794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.822940+0000","last_change":"2024-04-25T02:28:25.825296+0000","last_active":"2024-04-25T02:28:27.822940+0000","last_peered":"2024-04-25T02:28:27.822940+0000","last_clean":"2024-04-25T02:28:27.822940+0000","last_became_active":"2024-04-25T02:28:25.824989+0000","last_became_peered":"2024-04-25T02:28:25.824989+0000","last_unstale":"2024-04-25T02:28:27.822940+0000","last_undegraded":"2024-04-25T02:28:27.822940+0000","last_fullsized":"2024-04-25T02:28:27.822940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:10.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.267019+0000","last_change":"2024-04-25T02:28:26.831540+0000","last_active":"2024-04-25T02:28:28.267019+0000","last_peered":"2024-04-25T02:28:28.267019+0000","last_clean":"2024-04-25T02:28:28.267019+0000","last_became_active":"2024-04-25T02:28:26.831020+0000","last_became_peered":"2024-04-25T02:28:26.831020+0000","last_unstale":"2024-04-25T02:28:28.267019+0000","last_undegraded":"2024-04-25T02:28:28.267019+0000","last_fullsized":"2024-04-25T02:28:28.267019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:42:41.798312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.823029+0000","last_change":"2024-04-25T02:28:25.827630+0000","last_active":"2024-04-25T02:28:27.823029+0000","last_peered":"2024-04-25T02:28:27.823029+0000","last_clean":"2024-04-25T02:28:27.823029+0000","last_became_active":"2024-04-25T02:28:25.827277+0000","last_became_peered":"2024-04-25T02:28:25.827277+0000","last_unstale":"2024-04-25T02:28:27.823029+0000","last_undegraded":"2024-04-25T02:28:27.823029+0000","last_fullsized":"2024-04-25T02:28:27.823029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:04:33.145269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266602+0000","last_change":"2024-04-25T02:28:26.828333+0000","last_active":"2024-04-25T02:28:28.266602+0000","last_peered":"2024-04-25T02:28:28.266602+0000","last_clean":"2024-04-25T02:28:28.266602+0000","last_became_active":"2024-04-25T02:28:26.828026+0000","last_became_peered":"2024-04-25T02:28:26.828026+0000","last_unstale":"2024-04-25T02:28:28.266602+0000","last_undegraded":"2024-04-25T02:28:28.266602+0000","last_fullsized":"2024-04-25T02:28:28.266602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:36.748726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266350+0000","last_change":"2024-04-25T02:28:25.830120+0000","last_active":"2024-04-25T02:28:28.266350+0000","last_peered":"2024-04-25T02:28:28.266350+0000","last_clean":"2024-04-25T02:28:28.266350+0000","last_became_active":"2024-04-25T02:28:25.829808+0000","last_became_peered":"2024-04-25T02:28:25.829808+0000","last_unstale":"2024-04-25T02:28:28.266350+0000","last_undegraded":"2024-04-25T02:28:28.266350+0000","last_fullsized":"2024-04-25T02:28:28.266350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:38:37.081003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.829555+0000","last_change":"2024-04-25T02:28:26.825705+0000","last_active":"2024-04-25T02:28:27.829555+0000","last_peered":"2024-04-25T02:28:27.829555+0000","last_clean":"2024-04-25T02:28:27.829555+0000","last_became_active":"2024-04-25T02:28:26.825382+0000","last_became_peered":"2024-04-25T02:28:26.825382+0000","last_unstale":"2024-04-25T02:28:27.829555+0000","last_undegraded":"2024-04-25T02:28:27.829555+0000","last_fullsized":"2024-04-25T02:28:27.829555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:09.762419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.827064+0000","last_change":"2024-04-25T02:28:26.832976+0000","last_active":"2024-04-25T02:28:27.827064+0000","last_peered":"2024-04-25T02:28:27.827064+0000","last_clean":"2024-04-25T02:28:27.827064+0000","last_became_active":"2024-04-25T02:28:26.832717+0000","last_became_peered":"2024-04-25T02:28:26.832717+0000","last_unstale":"2024-04-25T02:28:27.827064+0000","last_undegraded":"2024-04-25T02:28:27.827064+0000","last_fullsized":"2024-04-25T02:28:27.827064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:28:45.463626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266302+0000","last_change":"2024-04-25T02:28:25.830578+0000","last_active":"2024-04-25T02:28:28.266302+0000","last_peered":"2024-04-25T02:28:28.266302+0000","last_clean":"2024-04-25T02:28:28.266302+0000","last_became_active":"2024-04-25T02:28:25.829878+0000","last_became_peered":"2024-04-25T02:28:25.829878+0000","last_unstale":"2024-04-25T02:28:28.266302+0000","last_undegraded":"2024-04-25T02:28:28.266302+0000","last_fullsized":"2024-04-25T02:28:28.266302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:10.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:27.826362+0000","last_change":"2024-04-25T02:28:26.824909+0000","last_active":"2024-04-25T02:28:27.826362+0000","last_peered":"2024-04-25T02:28:27.826362+0000","last_clean":"2024-04-25T02:28:27.826362+0000","last_became_active":"2024-04-25T02:28:26.824570+0000","last_became_peered":"2024-04-25T02:28:26.824570+0000","last_unstale":"2024-04-25T02:28:27.826362+0000","last_undegraded":"2024-04-25T02:28:27.826362+0000","last_fullsized":"2024-04-25T02:28:27.826362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:52.300089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266326+0000","last_change":"2024-04-25T02:28:25.830311+0000","last_active":"2024-04-25T02:28:28.266326+0000","last_peered":"2024-04-25T02:28:28.266326+0000","last_clean":"2024-04-25T02:28:28.266326+0000","last_became_active":"2024-04-25T02:28:25.830025+0000","last_became_peered":"2024-04-25T02:28:25.830025+0000","last_unstale":"2024-04-25T02:28:28.266326+0000","last_undegraded":"2024-04-25T02:28:28.266326+0000","last_fullsized":"2024-04-25T02:28:28.266326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:22.828461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266204+0000","last_change":"2024-04-25T02:28:26.832875+0000","last_active":"2024-04-25T02:28:28.266204+0000","last_peered":"2024-04-25T02:28:28.266204+0000","last_clean":"2024-04-25T02:28:28.266204+0000","last_became_active":"2024-04-25T02:28:26.832208+0000","last_became_peered":"2024-04-25T02:28:26.832208+0000","last_unstale":"2024-04-25T02:28:28.266204+0000","last_undegraded":"2024-04-25T02:28:28.266204+0000","last_fullsized":"2024-04-25T02:28:28.266204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:09.762419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266877+0000","last_change":"2024-04-25T02:28:25.829350+0000","last_active":"2024-04-25T02:28:28.266877+0000","last_peered":"2024-04-25T02:28:28.266877+0000","last_clean":"2024-04-25T02:28:28.266877+0000","last_became_active":"2024-04-25T02:28:25.829072+0000","last_became_peered":"2024-04-25T02:28:25.829072+0000","last_unstale":"2024-04-25T02:28:28.266877+0000","last_undegraded":"2024-04-25T02:28:28.266877+0000","last_fullsized":"2024-04-25T02:28:28.266877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:17:36.734690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.266692+0000","last_change":"2024-04-25T02:28:26.827282+0000","last_active":"2024-04-25T02:28:28.266692+0000","last_peered":"2024-04-25T02:28:28.266692+0000","last_clean":"2024-04-25T02:28:28.266692+0000","last_became_active":"2024-04-25T02:28:26.826977+0000","last_became_peered":"2024-04-25T02:28:26.826977+0000","last_unstale":"2024-04-25T02:28:28.266692+0000","last_undegraded":"2024-04-25T02:28:28.266692+0000","last_fullsized":"2024-04-25T02:28:28.266692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:25.803904+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.803904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:35.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.267016+0000","last_change":"2024-04-25T02:28:25.829686+0000","last_active":"2024-04-25T02:28:28.267016+0000","last_peered":"2024-04-25T02:28:28.267016+0000","last_clean":"2024-04-25T02:28:28.267016+0000","last_became_active":"2024-04-25T02:28:25.829226+0000","last_became_peered":"2024-04-25T02:28:25.829226+0000","last_unstale":"2024-04-25T02:28:28.267016+0000","last_undegraded":"2024-04-25T02:28:28.267016+0000","last_fullsized":"2024-04-25T02:28:28.267016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:24.799378+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.799378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:18.405319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:28:36.866 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T02:28:36.866 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T02:28:36.866 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T02:28:36.866 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T02:28:37.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.999+0000 7fae1a488640 1 Processor -- start 2024-04-25T02:28:37.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:36.999+0000 7fae1a488640 1 -- start start 2024-04-25T02:28:37.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.000+0000 7fae1a488640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fae1409aa70 0x7fae1406cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.000+0000 7fae1a488640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae140af330 0x7fae1406d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.000+0000 7fae1a488640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae1406e610 con 0x7fae140d00b0 2024-04-25T02:28:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.000+0000 7fae1a488640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fae140b4ba0 con 0x7fae1409aa70 2024-04-25T02:28:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.000+0000 7fae1a488640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fae140b4e40 con 0x7fae140af330 2024-04-25T02:28:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.000+0000 7fae137fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fae1409aa70 0x7fae1406cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.000+0000 7fae137fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fae1409aa70 0x7fae1406cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54674/0 (socket says 172.21.15.67:54674) 2024-04-25T02:28:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.000+0000 7fae137fe640 1 -- 172.21.15.67:0/2731857533 learned_addr learned my addr 172.21.15.67:0/2731857533 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.000+0000 7fae18a25640 1 --2- 172.21.15.67:0/2731857533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae140af330 0x7fae1406d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.000+0000 7fae137fe640 1 -- 172.21.15.67:0/2731857533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae140af330 msgr2=0x7fae1406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.000+0000 7fae137fe640 1 --2- 172.21.15.67:0/2731857533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae140af330 0x7fae1406d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.000+0000 7fae137fe640 1 -- 172.21.15.67:0/2731857533 >> v1:172.21.15.176:6789/0 conn(0x7fae140d00b0 legacy=0x7fae140d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.000+0000 7fae137fe640 1 -- 172.21.15.67:0/2731857533 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae140b4080 con 0x7fae1409aa70 2024-04-25T02:28:37.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.001+0000 7fae137fe640 1 --2- 172.21.15.67:0/2731857533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae1409aa70 0x7fae1406cbe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae04009870 tx=0x7fae0402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eedf26d33d78420 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:37.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.001+0000 7fae12ffd640 1 -- 172.21.15.67:0/2731857533 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04037070 con 0x7fae1409aa70 2024-04-25T02:28:37.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.001+0000 7fae12ffd640 1 -- 172.21.15.67:0/2731857533 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae04032440 con 0x7fae1409aa70 2024-04-25T02:28:37.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.001+0000 7fae12ffd640 1 -- 172.21.15.67:0/2731857533 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04032810 con 0x7fae1409aa70 2024-04-25T02:28:37.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.002+0000 7fae1a488640 1 -- 172.21.15.67:0/2731857533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae1409aa70 msgr2=0x7fae1406cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.002+0000 7fae1a488640 1 --2- 172.21.15.67:0/2731857533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae1409aa70 0x7fae1406cbe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae04009870 tx=0x7fae0402a210 comp rx=0 tx=0).stop 2024-04-25T02:28:37.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.002+0000 7fae1a488640 1 -- 172.21.15.67:0/2731857533 shutdown_connections 2024-04-25T02:28:37.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.002+0000 7fae1a488640 1 --2- 172.21.15.67:0/2731857533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae140af330 0x7fae1406d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.002+0000 7fae1a488640 1 --2- 172.21.15.67:0/2731857533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae1409aa70 0x7fae1406cbe0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.002+0000 7fae1a488640 1 -- 172.21.15.67:0/2731857533 >> 172.21.15.67:0/2731857533 conn(0x7fae1406b4e0 msgr2=0x7fae1406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:37.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.002+0000 7fae1a488640 1 -- 172.21.15.67:0/2731857533 shutdown_connections 2024-04-25T02:28:37.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.002+0000 7fae1a488640 1 -- 172.21.15.67:0/2731857533 wait complete. 2024-04-25T02:28:37.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.003+0000 7fae1a488640 1 Processor -- start 2024-04-25T02:28:37.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.003+0000 7fae1a488640 1 -- start start 2024-04-25T02:28:37.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.004+0000 7fae1a488640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae1409aa70 0x7fae140722e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.004+0000 7fae1a488640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae140af330 0x7fae1415c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.004+0000 7fae1a488640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae140d00b0 0x7fae14151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.004+0000 7fae1a488640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fae1415c300 con 0x7fae140d00b0 2024-04-25T02:28:37.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.004+0000 7fae1a488640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fae140b5120 con 0x7fae1409aa70 2024-04-25T02:28:37.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.004+0000 7fae1a488640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fae1415c480 con 0x7fae140af330 2024-04-25T02:28:37.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.004+0000 7fae18a25640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae140d00b0 0x7fae14151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.004+0000 7fae18a25640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae140d00b0 0x7fae14151830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54690/0 (socket says 172.21.15.67:54690) 2024-04-25T02:28:37.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.004+0000 7fae18a25640 1 -- 172.21.15.67:0/1449867334 learned_addr learned my addr 172.21.15.67:0/1449867334 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:37.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.004+0000 7fae13fff640 1 --2- 172.21.15.67:0/1449867334 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae1409aa70 0x7fae140722e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.004+0000 7fae137fe640 1 --2- 172.21.15.67:0/1449867334 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae140af330 0x7fae1415c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.004+0000 7fae18a25640 1 -- 172.21.15.67:0/1449867334 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae140af330 msgr2=0x7fae1415c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.004+0000 7fae18a25640 1 --2- 172.21.15.67:0/1449867334 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae140af330 0x7fae1415c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.004+0000 7fae18a25640 1 -- 172.21.15.67:0/1449867334 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae1409aa70 msgr2=0x7fae140722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.004+0000 7fae18a25640 1 --2- 172.21.15.67:0/1449867334 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae1409aa70 0x7fae140722e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.004+0000 7fae18a25640 1 -- 172.21.15.67:0/1449867334 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae14071240 con 0x7fae140d00b0 2024-04-25T02:28:37.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.004+0000 7fae18a25640 1 --2- 172.21.15.67:0/1449867334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae140d00b0 0x7fae14151830 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fae0c007e70 tx=0x7fae0c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:37.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.005+0000 7fae10ff9640 1 -- 172.21.15.67:0/1449867334 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c014620 con 0x7fae140d00b0 2024-04-25T02:28:37.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.005+0000 7fae10ff9640 1 -- 172.21.15.67:0/1449867334 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0c019070 con 0x7fae140d00b0 2024-04-25T02:28:37.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.005+0000 7fae1a488640 1 -- 172.21.15.67:0/1449867334 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae14071520 con 0x7fae140d00b0 2024-04-25T02:28:37.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.005+0000 7fae10ff9640 1 -- 172.21.15.67:0/1449867334 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c014a20 con 0x7fae140d00b0 2024-04-25T02:28:37.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.005+0000 7fae1a488640 1 -- 172.21.15.67:0/1449867334 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae14071ae0 con 0x7fae140d00b0 2024-04-25T02:28:37.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.006+0000 7fae1a488640 1 -- 172.21.15.67:0/1449867334 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae14069110 con 0x7fae140d00b0 2024-04-25T02:28:37.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.006+0000 7fae10ff9640 1 -- 172.21.15.67:0/1449867334 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae0c014bc0 con 0x7fae140d00b0 2024-04-25T02:28:37.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.007+0000 7fae10ff9640 1 --2- 172.21.15.67:0/1449867334 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fadf406be30 0x7fadf406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.007+0000 7fae10ff9640 1 -- 172.21.15.67:0/1449867334 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fae0c08b830 con 0x7fae140d00b0 2024-04-25T02:28:37.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.007+0000 7fae13fff640 1 --2- 172.21.15.67:0/1449867334 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fadf406be30 0x7fadf406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.007+0000 7fae13fff640 1 --2- 172.21.15.67:0/1449867334 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fadf406be30 0x7fadf406e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fadfc006fd0 tx=0x7fadfc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:37.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.011+0000 7fae10ff9640 1 -- 172.21.15.67:0/1449867334 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fae0c05a1e0 con 0x7fae140d00b0 2024-04-25T02:28:37.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.232+0000 7fae1a488640 1 -- 172.21.15.67:0/1449867334 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fae140aeb60 con 0x7fae140d00b0 2024-04-25T02:28:37.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.233+0000 7fae10ff9640 1 -- 172.21.15.67:0/1449867334 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fae0c059ae0 con 0x7fae140d00b0 2024-04-25T02:28:37.237 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:37.237 INFO:teuthology.orchestra.run.smithi067.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T02:28:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.234+0000 7fae1a488640 1 -- 172.21.15.67:0/1449867334 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fadf406be30 msgr2=0x7fadf406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.234+0000 7fae1a488640 1 --2- 172.21.15.67:0/1449867334 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fadf406be30 0x7fadf406e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fadfc006fd0 tx=0x7fadfc008040 comp rx=0 tx=0).stop 2024-04-25T02:28:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.234+0000 7fae1a488640 1 -- 172.21.15.67:0/1449867334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae140d00b0 msgr2=0x7fae14151830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.234+0000 7fae1a488640 1 --2- 172.21.15.67:0/1449867334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae140d00b0 0x7fae14151830 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fae0c007e70 tx=0x7fae0c00e4b0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.234+0000 7fae1a488640 1 -- 172.21.15.67:0/1449867334 shutdown_connections 2024-04-25T02:28:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.234+0000 7fae1a488640 1 --2- 172.21.15.67:0/1449867334 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fadf406be30 0x7fadf406e2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.234+0000 7fae1a488640 1 --2- 172.21.15.67:0/1449867334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae140d00b0 0x7fae14151830 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.234+0000 7fae1a488640 1 --2- 172.21.15.67:0/1449867334 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae140af330 0x7fae1415c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.234+0000 7fae1a488640 1 --2- 172.21.15.67:0/1449867334 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae1409aa70 0x7fae140722e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.234+0000 7fae1a488640 1 -- 172.21.15.67:0/1449867334 >> 172.21.15.67:0/1449867334 conn(0x7fae1406b4e0 msgr2=0x7fae140b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:37.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.235+0000 7fae1a488640 1 -- 172.21.15.67:0/1449867334 shutdown_connections 2024-04-25T02:28:37.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.235+0000 7fae1a488640 1 -- 172.21.15.67:0/1449867334 wait complete. 2024-04-25T02:28:37.249 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T02:28:37.250 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:37.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.346+0000 7ff0e2a37640 1 Processor -- start 2024-04-25T02:28:37.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.346+0000 7ff0e2a37640 1 -- start start 2024-04-25T02:28:37.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.347+0000 7ff0e2a37640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff0dc15bfc0 0x7ff0dc0ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.347+0000 7ff0e2a37640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff0dc15e9f0 0x7ff0dc06d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.347+0000 7ff0e2a37640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0dc15c3a0 con 0x7ff0dc0d0210 2024-04-25T02:28:37.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.347+0000 7ff0e2a37640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff0dc0d0760 con 0x7ff0dc15bfc0 2024-04-25T02:28:37.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.347+0000 7ff0e2a37640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff0dc0d0a40 con 0x7ff0dc15e9f0 2024-04-25T02:28:37.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.347+0000 7ff0dbfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff0dc15bfc0 0x7ff0dc0ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.347+0000 7ff0dbfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff0dc15bfc0 0x7ff0dc0ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54694/0 (socket says 172.21.15.67:54694) 2024-04-25T02:28:37.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.347+0000 7ff0db7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff0dc0d0210 0x7ff0dc161f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49392/0 (socket says 172.21.15.67:49392) 2024-04-25T02:28:37.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.347+0000 7ff0dbfff640 1 -- 172.21.15.67:0/3179610841 learned_addr learned my addr 172.21.15.67:0/3179610841 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:37.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.347+0000 7ff0e0fd4640 1 --2- 172.21.15.67:0/3179610841 >> v2:172.21.15.176:3300/0 conn(0x7ff0dc15e9f0 0x7ff0dc06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.347+0000 7ff0dbfff640 1 -- 172.21.15.67:0/3179610841 >> v2:172.21.15.176:3300/0 conn(0x7ff0dc15e9f0 msgr2=0x7ff0dc06d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:37.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.347+0000 7ff0dbfff640 1 --2- 172.21.15.67:0/3179610841 >> v2:172.21.15.176:3300/0 conn(0x7ff0dc15e9f0 0x7ff0dc06d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.347+0000 7ff0dbfff640 1 -- 172.21.15.67:0/3179610841 >> v1:172.21.15.67:6789/0 conn(0x7ff0dc0d0210 legacy=0x7ff0dc161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.347+0000 7ff0dbfff640 1 -- 172.21.15.67:0/3179610841 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0dc0d0d20 con 0x7ff0dc15bfc0 2024-04-25T02:28:37.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.348+0000 7ff0dbfff640 1 --2- 172.21.15.67:0/3179610841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc15bfc0 0x7ff0dc0ce750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc06d7b0 tx=0x7ff0c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3527e346c6fcbbf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:37.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.348+0000 7ff0daffd640 1 -- 172.21.15.67:0/3179610841 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4037070 con 0x7ff0dc15bfc0 2024-04-25T02:28:37.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.348+0000 7ff0daffd640 1 -- 172.21.15.67:0/3179610841 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c4032440 con 0x7ff0dc15bfc0 2024-04-25T02:28:37.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.348+0000 7ff0daffd640 1 -- 172.21.15.67:0/3179610841 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4032810 con 0x7ff0dc15bfc0 2024-04-25T02:28:37.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.348+0000 7ff0e2a37640 1 -- 172.21.15.67:0/3179610841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc15bfc0 msgr2=0x7ff0dc0ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.348+0000 7ff0e2a37640 1 --2- 172.21.15.67:0/3179610841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc15bfc0 0x7ff0dc0ce750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc06d7b0 tx=0x7ff0c402a270 comp rx=0 tx=0).stop 2024-04-25T02:28:37.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.348+0000 7ff0e2a37640 1 -- 172.21.15.67:0/3179610841 shutdown_connections 2024-04-25T02:28:37.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.348+0000 7ff0e2a37640 1 --2- 172.21.15.67:0/3179610841 >> v2:172.21.15.176:3300/0 conn(0x7ff0dc15e9f0 0x7ff0dc06d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.348+0000 7ff0e2a37640 1 --2- 172.21.15.67:0/3179610841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc15bfc0 0x7ff0dc0ce750 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.348+0000 7ff0e2a37640 1 -- 172.21.15.67:0/3179610841 >> 172.21.15.67:0/3179610841 conn(0x7ff0dc0d1ed0 msgr2=0x7ff0dc0d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:37.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.349+0000 7ff0e2a37640 1 -- 172.21.15.67:0/3179610841 shutdown_connections 2024-04-25T02:28:37.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.349+0000 7ff0e2a37640 1 -- 172.21.15.67:0/3179610841 wait complete. 2024-04-25T02:28:37.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.350+0000 7ff0e2a37640 1 Processor -- start 2024-04-25T02:28:37.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.350+0000 7ff0e2a37640 1 -- start start 2024-04-25T02:28:37.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0e2a37640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc0d0210 0x7ff0dc15b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0e2a37640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0dc15bfc0 0x7ff0dc1e8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0e2a37640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0dc15e9f0 0x7ff0dc1e6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0e2a37640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc0cf690 con 0x7ff0dc0d0210 2024-04-25T02:28:37.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0e2a37640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc0d12e0 con 0x7ff0dc15e9f0 2024-04-25T02:28:37.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0e2a37640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff0dc0cf810 con 0x7ff0dc15bfc0 2024-04-25T02:28:37.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0dbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc0d0210 0x7ff0dc15b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0dbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc0d0210 0x7ff0dc15b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54708/0 (socket says 172.21.15.67:54708) 2024-04-25T02:28:37.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0dbfff640 1 -- 172.21.15.67:0/3510160238 learned_addr learned my addr 172.21.15.67:0/3510160238 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:37.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0dbfff640 1 -- 172.21.15.67:0/3510160238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0dc15bfc0 msgr2=0x7ff0dc1e8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0db7fe640 1 --2- 172.21.15.67:0/3510160238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0dc15bfc0 0x7ff0dc1e8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0e0fd4640 1 --2- 172.21.15.67:0/3510160238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0dc15e9f0 0x7ff0dc1e6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0dbfff640 1 --2- 172.21.15.67:0/3510160238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0dc15bfc0 0x7ff0dc1e8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0dbfff640 1 -- 172.21.15.67:0/3510160238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0dc15e9f0 msgr2=0x7ff0dc1e6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0dbfff640 1 --2- 172.21.15.67:0/3510160238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0dc15e9f0 0x7ff0dc1e6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0dbfff640 1 -- 172.21.15.67:0/3510160238 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0dc1e74c0 con 0x7ff0dc0d0210 2024-04-25T02:28:37.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0db7fe640 1 --2- 172.21.15.67:0/3510160238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0dc15bfc0 0x7ff0dc1e8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:37.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0e0fd4640 1 --2- 172.21.15.67:0/3510160238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0dc15e9f0 0x7ff0dc1e6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:37.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0dbfff640 1 --2- 172.21.15.67:0/3510160238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc0d0210 0x7ff0dc15b380 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff0c402a2b0 tx=0x7ff0c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:37.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0d8ff9640 1 -- 172.21.15.67:0/3510160238 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4041020 con 0x7ff0dc0d0210 2024-04-25T02:28:37.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0d8ff9640 1 -- 172.21.15.67:0/3510160238 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c40306c0 con 0x7ff0dc0d0210 2024-04-25T02:28:37.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0e2a37640 1 -- 172.21.15.67:0/3510160238 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0dc1e96d0 con 0x7ff0dc0d0210 2024-04-25T02:28:37.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0d8ff9640 1 -- 172.21.15.67:0/3510160238 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4037040 con 0x7ff0dc0d0210 2024-04-25T02:28:37.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.351+0000 7ff0e2a37640 1 -- 172.21.15.67:0/3510160238 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0dc1e9c90 con 0x7ff0dc0d0210 2024-04-25T02:28:37.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.352+0000 7ff0e2a37640 1 -- 172.21.15.67:0/3510160238 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0dc069110 con 0x7ff0dc0d0210 2024-04-25T02:28:37.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.353+0000 7ff0d8ff9640 1 -- 172.21.15.67:0/3510160238 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0c4044020 con 0x7ff0dc0d0210 2024-04-25T02:28:37.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.353+0000 7ff0d8ff9640 1 --2- 172.21.15.67:0/3510160238 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff0bc06be30 0x7ff0bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.353+0000 7ff0d8ff9640 1 -- 172.21.15.67:0/3510160238 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff0c40ab610 con 0x7ff0dc0d0210 2024-04-25T02:28:37.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.353+0000 7ff0db7fe640 1 --2- 172.21.15.67:0/3510160238 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff0bc06be30 0x7ff0bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.354+0000 7ff0db7fe640 1 --2- 172.21.15.67:0/3510160238 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff0bc06be30 0x7ff0bc06e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc15ab80 tx=0x7ff0cc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:37.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.357+0000 7ff0d8ff9640 1 -- 172.21.15.67:0/3510160238 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff0c404b030 con 0x7ff0dc0d0210 2024-04-25T02:28:37.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.541+0000 7ff0e2a37640 1 -- 172.21.15.67:0/3510160238 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0dc15b970 con 0x7ff0dc0d0210 2024-04-25T02:28:37.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.542+0000 7ff0d8ff9640 1 -- 172.21.15.67:0/3510160238 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7ff0c407a050 con 0x7ff0dc0d0210 2024-04-25T02:28:37.546 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:37.547 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:27.819641+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:37.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.544+0000 7ff0e2a37640 1 -- 172.21.15.67:0/3510160238 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff0bc06be30 msgr2=0x7ff0bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.544+0000 7ff0e2a37640 1 --2- 172.21.15.67:0/3510160238 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff0bc06be30 0x7ff0bc06e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc15ab80 tx=0x7ff0cc009040 comp rx=0 tx=0).stop 2024-04-25T02:28:37.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.544+0000 7ff0e2a37640 1 -- 172.21.15.67:0/3510160238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc0d0210 msgr2=0x7ff0dc15b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.544+0000 7ff0e2a37640 1 --2- 172.21.15.67:0/3510160238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc0d0210 0x7ff0dc15b380 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff0c402a2b0 tx=0x7ff0c40046c0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.544+0000 7ff0e2a37640 1 -- 172.21.15.67:0/3510160238 shutdown_connections 2024-04-25T02:28:37.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.544+0000 7ff0e2a37640 1 --2- 172.21.15.67:0/3510160238 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff0bc06be30 0x7ff0bc06e2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.544+0000 7ff0e2a37640 1 --2- 172.21.15.67:0/3510160238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0dc15e9f0 0x7ff0dc1e6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.544+0000 7ff0e2a37640 1 --2- 172.21.15.67:0/3510160238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0dc15bfc0 0x7ff0dc1e8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.544+0000 7ff0e2a37640 1 --2- 172.21.15.67:0/3510160238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0dc0d0210 0x7ff0dc15b380 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.544+0000 7ff0e2a37640 1 -- 172.21.15.67:0/3510160238 >> 172.21.15.67:0/3510160238 conn(0x7ff0dc0d1ed0 msgr2=0x7ff0dc0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:37.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.544+0000 7ff0e2a37640 1 -- 172.21.15.67:0/3510160238 shutdown_connections 2024-04-25T02:28:37.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.544+0000 7ff0e2a37640 1 -- 172.21.15.67:0/3510160238 wait complete. 2024-04-25T02:28:37.559 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:28:24.445606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:28:25.161619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:28:37.560 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:28:37.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.659+0000 7fb687b48640 1 Processor -- start 2024-04-25T02:28:37.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.659+0000 7fb687b48640 1 -- start start 2024-04-25T02:28:37.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb687b48640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb68006cf50 0x7fb6800b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb687b48640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6800b3570 con 0x7fb6800b2da0 2024-04-25T02:28:37.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb687b48640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6800cff80 con 0x7fb6800cf060 2024-04-25T02:28:37.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb687b48640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb6800d05d0 con 0x7fb68006cf50 2024-04-25T02:28:37.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6850e3640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb6800b2da0 0x7fb68006c840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49402/0 (socket says 172.21.15.67:49402) 2024-04-25T02:28:37.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6850e3640 1 -- 172.21.15.67:0/3977533806 learned_addr learned my addr 172.21.15.67:0/3977533806 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6860e5640 1 --2- 172.21.15.67:0/3977533806 >> v2:172.21.15.176:3300/0 conn(0x7fb68006cf50 0x7fb6800b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6848e2640 1 -- 172.21.15.67:0/3977533806 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3668415587 0 0) 0x7fb6800b3570 con 0x7fb6800b2da0 2024-04-25T02:28:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6848e2640 1 -- 172.21.15.67:0/3977533806 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb66c003520 con 0x7fb6800b2da0 2024-04-25T02:28:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6848e2640 1 -- 172.21.15.67:0/3977533806 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2399408092 0 0) 0x7fb66c003520 con 0x7fb6800b2da0 2024-04-25T02:28:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6848e2640 1 -- 172.21.15.67:0/3977533806 >> v2:172.21.15.176:3300/0 conn(0x7fb68006cf50 msgr2=0x7fb6800b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6848e2640 1 --2- 172.21.15.67:0/3977533806 >> v2:172.21.15.176:3300/0 conn(0x7fb68006cf50 0x7fb6800b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6848e2640 1 -- 172.21.15.67:0/3977533806 >> v1:172.21.15.176:6789/0 conn(0x7fb6800cf060 legacy=0x7fb6800d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6848e2640 1 -- 172.21.15.67:0/3977533806 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6800d0260 con 0x7fb6800b2da0 2024-04-25T02:28:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6848e2640 1 -- 172.21.15.67:0/3977533806 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7fb670001670 con 0x7fb6800b2da0 2024-04-25T02:28:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6848e2640 1 -- 172.21.15.67:0/3977533806 >> v1:172.21.15.67:6789/0 conn(0x7fb6800b2da0 legacy=0x7fb68006c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6848e2640 1 --2- 172.21.15.67:0/3977533806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb66c0039b0 0x7fb66c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6848e2640 1 --2- 172.21.15.67:0/3977533806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb66c004800 0x7fb66c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6848e2640 1 --2- 172.21.15.67:0/3977533806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb66c0051c0 0x7fb66c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6848e2640 1 -- 172.21.15.67:0/3977533806 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb6800d05d0 con 0x7fb66c0051c0 2024-04-25T02:28:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6848e2640 1 -- 172.21.15.67:0/3977533806 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c00c160 con 0x7fb66c0039b0 2024-04-25T02:28:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6848e2640 1 -- 172.21.15.67:0/3977533806 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb66c00c360 con 0x7fb66c004800 2024-04-25T02:28:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.660+0000 7fb6860e5640 1 --2- 172.21.15.67:0/3977533806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb66c0051c0 0x7fb66c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.661+0000 7fb6858e4640 1 --2- 172.21.15.67:0/3977533806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb66c0039b0 0x7fb66c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.661+0000 7fb6850e3640 1 --2- 172.21.15.67:0/3977533806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb66c004800 0x7fb66c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.661+0000 7fb6860e5640 1 -- 172.21.15.67:0/3977533806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb66c004800 msgr2=0x7fb66c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.661+0000 7fb6860e5640 1 --2- 172.21.15.67:0/3977533806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb66c004800 0x7fb66c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.661+0000 7fb6860e5640 1 -- 172.21.15.67:0/3977533806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb66c0039b0 msgr2=0x7fb66c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.661+0000 7fb6860e5640 1 --2- 172.21.15.67:0/3977533806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb66c0039b0 0x7fb66c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.661+0000 7fb6860e5640 1 -- 172.21.15.67:0/3977533806 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66c003520 con 0x7fb66c0051c0 2024-04-25T02:28:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.661+0000 7fb6850e3640 1 --2- 172.21.15.67:0/3977533806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb66c004800 0x7fb66c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.661+0000 7fb6860e5640 1 -- 172.21.15.67:0/3977533806 reap_dead start 2024-04-25T02:28:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.661+0000 7fb6860e5640 1 --2- 172.21.15.67:0/3977533806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb66c0051c0 0x7fb66c00b9c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb678009fc0 tx=0x7fb66c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922cad671da83641 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.662+0000 7fb6848e2640 1 -- 172.21.15.67:0/3977533806 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678035020 con 0x7fb66c0051c0 2024-04-25T02:28:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.662+0000 7fb6848e2640 1 -- 172.21.15.67:0/3977533806 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb678003bd0 con 0x7fb66c0051c0 2024-04-25T02:28:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.662+0000 7fb6848e2640 1 -- 172.21.15.67:0/3977533806 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678009c10 con 0x7fb66c0051c0 2024-04-25T02:28:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.662+0000 7fb687b48640 1 -- 172.21.15.67:0/3977533806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb66c0051c0 msgr2=0x7fb66c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.662+0000 7fb687b48640 1 --2- 172.21.15.67:0/3977533806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb66c0051c0 0x7fb66c00b9c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb678009fc0 tx=0x7fb66c005830 comp rx=0 tx=0).stop 2024-04-25T02:28:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.662+0000 7fb687b48640 1 -- 172.21.15.67:0/3977533806 shutdown_connections 2024-04-25T02:28:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.662+0000 7fb687b48640 1 --2- 172.21.15.67:0/3977533806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb66c0051c0 0x7fb66c00b9c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.662+0000 7fb687b48640 1 -- 172.21.15.67:0/3977533806 >> 172.21.15.67:0/3977533806 conn(0x7fb6800b3a70 msgr2=0x7fb6800b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.662+0000 7fb687b48640 1 -- 172.21.15.67:0/3977533806 shutdown_connections 2024-04-25T02:28:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.662+0000 7fb687b48640 1 -- 172.21.15.67:0/3977533806 wait complete. 2024-04-25T02:28:37.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.663+0000 7fb687b48640 1 Processor -- start 2024-04-25T02:28:37.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.663+0000 7fb687b48640 1 -- start start 2024-04-25T02:28:37.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.664+0000 7fb687b48640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb66c0051c0 0x7fb68015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.664+0000 7fb687b48640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6800b23f0 0x7fb6801f8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.664+0000 7fb687b48640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6801f85b0 0x7fb6801581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.664+0000 7fb687b48640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb68006c9c0 con 0x7fb6801f85b0 2024-04-25T02:28:37.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.664+0000 7fb687b48640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb68006c840 con 0x7fb6800b23f0 2024-04-25T02:28:37.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.664+0000 7fb687b48640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb68006cb40 con 0x7fb66c0051c0 2024-04-25T02:28:37.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.664+0000 7fb6860e5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6801f85b0 0x7fb6801581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.664+0000 7fb6860e5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6801f85b0 0x7fb6801581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54726/0 (socket says 172.21.15.67:54726) 2024-04-25T02:28:37.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.664+0000 7fb6860e5640 1 -- 172.21.15.67:0/1578463908 learned_addr learned my addr 172.21.15.67:0/1578463908 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:37.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.664+0000 7fb6858e4640 1 --2- 172.21.15.67:0/1578463908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb66c0051c0 0x7fb68015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.664+0000 7fb6850e3640 1 --2- 172.21.15.67:0/1578463908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6800b23f0 0x7fb6801f8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.664+0000 7fb6860e5640 1 -- 172.21.15.67:0/1578463908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb66c0051c0 msgr2=0x7fb68015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.664+0000 7fb6860e5640 1 --2- 172.21.15.67:0/1578463908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb66c0051c0 0x7fb68015bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.664+0000 7fb6860e5640 1 -- 172.21.15.67:0/1578463908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6800b23f0 msgr2=0x7fb6801f8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.664+0000 7fb6860e5640 1 --2- 172.21.15.67:0/1578463908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6800b23f0 0x7fb6801f8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.664+0000 7fb6860e5640 1 -- 172.21.15.67:0/1578463908 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68015d2b0 con 0x7fb6801f85b0 2024-04-25T02:28:37.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.664+0000 7fb6858e4640 1 --2- 172.21.15.67:0/1578463908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb66c0051c0 0x7fb68015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:37.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.665+0000 7fb6860e5640 1 --2- 172.21.15.67:0/1578463908 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6801f85b0 0x7fb6801581d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb67800e200 tx=0x7fb678009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:37.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.665+0000 7fb6767fc640 1 -- 172.21.15.67:0/1578463908 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678035030 con 0x7fb6801f85b0 2024-04-25T02:28:37.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.665+0000 7fb6767fc640 1 -- 172.21.15.67:0/1578463908 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb678043070 con 0x7fb6801f85b0 2024-04-25T02:28:37.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.665+0000 7fb6767fc640 1 -- 172.21.15.67:0/1578463908 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67802d070 con 0x7fb6801f85b0 2024-04-25T02:28:37.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.665+0000 7fb687b48640 1 -- 172.21.15.67:0/1578463908 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb68015ca10 con 0x7fb6801f85b0 2024-04-25T02:28:37.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.665+0000 7fb687b48640 1 -- 172.21.15.67:0/1578463908 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb68015cfd0 con 0x7fb6801f85b0 2024-04-25T02:28:37.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.666+0000 7fb687b48640 1 -- 172.21.15.67:0/1578463908 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb680069110 con 0x7fb6801f85b0 2024-04-25T02:28:37.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.666+0000 7fb6767fc640 1 -- 172.21.15.67:0/1578463908 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb678005d10 con 0x7fb6801f85b0 2024-04-25T02:28:37.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.666+0000 7fb6767fc640 1 --2- 172.21.15.67:0/1578463908 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb66406be30 0x7fb66406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.667+0000 7fb6767fc640 1 -- 172.21.15.67:0/1578463908 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb6780abbb0 con 0x7fb6801f85b0 2024-04-25T02:28:37.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.667+0000 7fb6858e4640 1 --2- 172.21.15.67:0/1578463908 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb66406be30 0x7fb66406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.667+0000 7fb6858e4640 1 --2- 172.21.15.67:0/1578463908 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb66406be30 0x7fb66406e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb67c005580 tx=0x7fb67c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:37.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.671+0000 7fb6767fc640 1 -- 172.21.15.67:0/1578463908 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb68015d2b0 con 0x7fb6801f85b0 2024-04-25T02:28:37.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.853+0000 7fb687b48640 1 -- 172.21.15.67:0/1578463908 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb6801f79b0 con 0x7fb6801f85b0 2024-04-25T02:28:37.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.854+0000 7fb6767fc640 1 -- 172.21.15.67:0/1578463908 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fb6780af0a0 con 0x7fb6801f85b0 2024-04-25T02:28:37.858 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:28:37.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.856+0000 7fb687b48640 1 -- 172.21.15.67:0/1578463908 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb66406be30 msgr2=0x7fb66406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.856+0000 7fb687b48640 1 --2- 172.21.15.67:0/1578463908 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb66406be30 0x7fb66406e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb67c005580 tx=0x7fb67c009040 comp rx=0 tx=0).stop 2024-04-25T02:28:37.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.856+0000 7fb687b48640 1 -- 172.21.15.67:0/1578463908 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6801f85b0 msgr2=0x7fb6801581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.856+0000 7fb687b48640 1 --2- 172.21.15.67:0/1578463908 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6801f85b0 0x7fb6801581d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb67800e200 tx=0x7fb678009750 comp rx=0 tx=0).stop 2024-04-25T02:28:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.856+0000 7fb687b48640 1 -- 172.21.15.67:0/1578463908 shutdown_connections 2024-04-25T02:28:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.856+0000 7fb687b48640 1 --2- 172.21.15.67:0/1578463908 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb66406be30 0x7fb66406e2f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.856+0000 7fb687b48640 1 --2- 172.21.15.67:0/1578463908 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6801f85b0 0x7fb6801581d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.856+0000 7fb687b48640 1 --2- 172.21.15.67:0/1578463908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6800b23f0 0x7fb6801f8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.856+0000 7fb687b48640 1 --2- 172.21.15.67:0/1578463908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb66c0051c0 0x7fb68015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.856+0000 7fb687b48640 1 -- 172.21.15.67:0/1578463908 >> 172.21.15.67:0/1578463908 conn(0x7fb6800b3a70 msgr2=0x7fb68006f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.856+0000 7fb687b48640 1 -- 172.21.15.67:0/1578463908 shutdown_connections 2024-04-25T02:28:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.856+0000 7fb687b48640 1 -- 172.21.15.67:0/1578463908 wait complete. 2024-04-25T02:28:37.871 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:28:37.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.970+0000 7f53973b7640 1 Processor -- start 2024-04-25T02:28:37.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.970+0000 7f53973b7640 1 -- start start 2024-04-25T02:28:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.971+0000 7f53973b7640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f539006cf50 0x7f53900b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.971+0000 7f53973b7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53900b3570 con 0x7f53900cf060 2024-04-25T02:28:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.971+0000 7f53973b7640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53900cff80 con 0x7f53900b2da0 2024-04-25T02:28:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.971+0000 7f53973b7640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f53900d05d0 con 0x7f539006cf50 2024-04-25T02:28:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.971+0000 7f5395153640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f53900cf060 0x7f53900d0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49416/0 (socket says 172.21.15.67:49416) 2024-04-25T02:28:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.971+0000 7f5395153640 1 -- 172.21.15.67:0/3535264162 learned_addr learned my addr 172.21.15.67:0/3535264162 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.971+0000 7f5395954640 1 --2- 172.21.15.67:0/3535264162 >> v2:172.21.15.176:3300/0 conn(0x7f539006cf50 0x7f53900b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.971+0000 7f538ffff640 1 -- 172.21.15.67:0/3535264162 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 534584044 0 0) 0x7f53900b3570 con 0x7f53900cf060 2024-04-25T02:28:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.971+0000 7f538ffff640 1 -- 172.21.15.67:0/3535264162 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5378003520 con 0x7f53900cf060 2024-04-25T02:28:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f538ffff640 1 -- 172.21.15.67:0/3535264162 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 399694135 0 0) 0x7f5378003520 con 0x7f53900cf060 2024-04-25T02:28:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f538ffff640 1 -- 172.21.15.67:0/3535264162 >> v2:172.21.15.176:3300/0 conn(0x7f539006cf50 msgr2=0x7f53900b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f538ffff640 1 --2- 172.21.15.67:0/3535264162 >> v2:172.21.15.176:3300/0 conn(0x7f539006cf50 0x7f53900b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f538ffff640 1 -- 172.21.15.67:0/3535264162 >> v1:172.21.15.176:6789/0 conn(0x7f53900b2da0 legacy=0x7f539006c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f538ffff640 1 -- 172.21.15.67:0/3535264162 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53900d0260 con 0x7f53900cf060 2024-04-25T02:28:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f538ffff640 1 -- 172.21.15.67:0/3535264162 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f53800019f0 con 0x7f53900cf060 2024-04-25T02:28:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f538ffff640 1 -- 172.21.15.67:0/3535264162 >> v1:172.21.15.67:6789/0 conn(0x7f53900cf060 legacy=0x7f53900d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f538ffff640 1 --2- 172.21.15.67:0/3535264162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53780039b0 0x7f5378003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f538ffff640 1 --2- 172.21.15.67:0/3535264162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5378004800 0x7f5378004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f538ffff640 1 --2- 172.21.15.67:0/3535264162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53780051c0 0x7f537800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f538ffff640 1 -- 172.21.15.67:0/3535264162 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f53900d05d0 con 0x7f53780039b0 2024-04-25T02:28:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f538ffff640 1 -- 172.21.15.67:0/3535264162 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f537800c160 con 0x7f5378004800 2024-04-25T02:28:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f538ffff640 1 -- 172.21.15.67:0/3535264162 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f537800c360 con 0x7f53780051c0 2024-04-25T02:28:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f5395153640 1 --2- 172.21.15.67:0/3535264162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53780039b0 0x7f5378003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f5394952640 1 --2- 172.21.15.67:0/3535264162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5378004800 0x7f5378004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f5395954640 1 --2- 172.21.15.67:0/3535264162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53780051c0 0x7f537800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f5395153640 1 -- 172.21.15.67:0/3535264162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53780051c0 msgr2=0x7f537800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:37.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f5395153640 1 --2- 172.21.15.67:0/3535264162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53780051c0 0x7f537800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f5395153640 1 -- 172.21.15.67:0/3535264162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5378004800 msgr2=0x7f5378004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:37.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f5395153640 1 --2- 172.21.15.67:0/3535264162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5378004800 0x7f5378004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f5395153640 1 -- 172.21.15.67:0/3535264162 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5378003520 con 0x7f53780039b0 2024-04-25T02:28:37.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.972+0000 7f5395954640 1 -- 172.21.15.67:0/3535264162 reap_dead start 2024-04-25T02:28:37.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.973+0000 7f5395153640 1 --2- 172.21.15.67:0/3535264162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53780039b0 0x7f5378003dd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f538000a850 tx=0x7f5378005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d959cb82c71c4c4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:37.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.973+0000 7f538ffff640 1 -- 172.21.15.67:0/3535264162 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538000a4a0 con 0x7f53780039b0 2024-04-25T02:28:37.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.973+0000 7f538ffff640 1 -- 172.21.15.67:0/3535264162 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f538002f070 con 0x7f53780039b0 2024-04-25T02:28:37.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.973+0000 7f538ffff640 1 -- 172.21.15.67:0/3535264162 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538002bcb0 con 0x7f53780039b0 2024-04-25T02:28:37.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.973+0000 7f53973b7640 1 -- 172.21.15.67:0/3535264162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53780039b0 msgr2=0x7f5378003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.973+0000 7f53973b7640 1 --2- 172.21.15.67:0/3535264162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53780039b0 0x7f5378003dd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f538000a850 tx=0x7f5378005830 comp rx=0 tx=0).stop 2024-04-25T02:28:37.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.974+0000 7f53973b7640 1 -- 172.21.15.67:0/3535264162 shutdown_connections 2024-04-25T02:28:37.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.974+0000 7f53973b7640 1 --2- 172.21.15.67:0/3535264162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53780039b0 0x7f5378003dd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.974+0000 7f53973b7640 1 -- 172.21.15.67:0/3535264162 >> 172.21.15.67:0/3535264162 conn(0x7f53900b3a70 msgr2=0x7f53900b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:37.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.974+0000 7f53973b7640 1 -- 172.21.15.67:0/3535264162 shutdown_connections 2024-04-25T02:28:37.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.974+0000 7f53973b7640 1 -- 172.21.15.67:0/3535264162 wait complete. 2024-04-25T02:28:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.975+0000 7f53973b7640 1 Processor -- start 2024-04-25T02:28:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.975+0000 7f53973b7640 1 -- start start 2024-04-25T02:28:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.975+0000 7f53973b7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53780039b0 0x7f5390148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.975+0000 7f53973b7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5390158360 0x7f53901491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.975+0000 7f53973b7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53900c77e0 0x7f53900c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.976+0000 7f53973b7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f539006c9c0 con 0x7f5390158360 2024-04-25T02:28:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.976+0000 7f53973b7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f539006c840 con 0x7f53780039b0 2024-04-25T02:28:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.976+0000 7f53973b7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f539006cb40 con 0x7f53900c77e0 2024-04-25T02:28:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.976+0000 7f5394952640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5390158360 0x7f53901491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.976+0000 7f5394952640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5390158360 0x7f53901491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54756/0 (socket says 172.21.15.67:54756) 2024-04-25T02:28:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.976+0000 7f5394952640 1 -- 172.21.15.67:0/3567729484 learned_addr learned my addr 172.21.15.67:0/3567729484 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.976+0000 7f5394952640 1 -- 172.21.15.67:0/3567729484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53900c77e0 msgr2=0x7f53900c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.976+0000 7f5394952640 1 --2- 172.21.15.67:0/3567729484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53900c77e0 0x7f53900c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.976+0000 7f5394952640 1 -- 172.21.15.67:0/3567729484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53780039b0 msgr2=0x7f5390148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.976+0000 7f5394952640 1 --2- 172.21.15.67:0/3567729484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53780039b0 0x7f5390148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.976+0000 7f5394952640 1 -- 172.21.15.67:0/3567729484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53901496e0 con 0x7f5390158360 2024-04-25T02:28:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.976+0000 7f5394952640 1 --2- 172.21.15.67:0/3567729484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5390158360 0x7f53901491a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f538400f620 tx=0x7f538400fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.976+0000 7f538dffb640 1 -- 172.21.15.67:0/3567729484 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53840052e0 con 0x7f5390158360 2024-04-25T02:28:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.976+0000 7f538dffb640 1 -- 172.21.15.67:0/3567729484 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5384018070 con 0x7f5390158360 2024-04-25T02:28:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.976+0000 7f53973b7640 1 -- 172.21.15.67:0/3567729484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53900c6a60 con 0x7f5390158360 2024-04-25T02:28:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.976+0000 7f538dffb640 1 -- 172.21.15.67:0/3567729484 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5384003810 con 0x7f5390158360 2024-04-25T02:28:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.976+0000 7f53973b7640 1 -- 172.21.15.67:0/3567729484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53900c6d00 con 0x7f5390158360 2024-04-25T02:28:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.977+0000 7f53973b7640 1 -- 172.21.15.67:0/3567729484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53900b3570 con 0x7f5390158360 2024-04-25T02:28:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.978+0000 7f538dffb640 1 -- 172.21.15.67:0/3567729484 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f53840039b0 con 0x7f5390158360 2024-04-25T02:28:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.978+0000 7f538dffb640 1 --2- 172.21.15.67:0/3567729484 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f537c06be30 0x7f537c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.978+0000 7f538dffb640 1 -- 172.21.15.67:0/3567729484 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f538408ab00 con 0x7f5390158360 2024-04-25T02:28:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.978+0000 7f5395153640 1 --2- 172.21.15.67:0/3567729484 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f537c06be30 0x7f537c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.979+0000 7f5395153640 1 --2- 172.21.15.67:0/3567729484 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f537c06be30 0x7f537c06e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5380033000 tx=0x7f5380007000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:37.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:37.982+0000 7f538dffb640 1 -- 172.21.15.67:0/3567729484 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f53900b3570 con 0x7f5390158360 2024-04-25T02:28:38.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.164+0000 7f53973b7640 1 -- 172.21.15.67:0/3567729484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5390069110 con 0x7f5390158360 2024-04-25T02:28:38.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.164+0000 7f538dffb640 1 -- 172.21.15.67:0/3567729484 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f5384059540 con 0x7f5390158360 2024-04-25T02:28:38.168 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-25T02:28:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.166+0000 7f53973b7640 1 -- 172.21.15.67:0/3567729484 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f537c06be30 msgr2=0x7f537c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.166+0000 7f53973b7640 1 --2- 172.21.15.67:0/3567729484 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f537c06be30 0x7f537c06e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5380033000 tx=0x7f5380007000 comp rx=0 tx=0).stop 2024-04-25T02:28:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.166+0000 7f53973b7640 1 -- 172.21.15.67:0/3567729484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5390158360 msgr2=0x7f53901491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.166+0000 7f53973b7640 1 --2- 172.21.15.67:0/3567729484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5390158360 0x7f53901491a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f538400f620 tx=0x7f538400fae0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.166+0000 7f53973b7640 1 -- 172.21.15.67:0/3567729484 shutdown_connections 2024-04-25T02:28:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.166+0000 7f53973b7640 1 --2- 172.21.15.67:0/3567729484 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f537c06be30 0x7f537c06e2f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.166+0000 7f53973b7640 1 --2- 172.21.15.67:0/3567729484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53900c77e0 0x7f53900c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.166+0000 7f53973b7640 1 --2- 172.21.15.67:0/3567729484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5390158360 0x7f53901491a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.166+0000 7f53973b7640 1 --2- 172.21.15.67:0/3567729484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53780039b0 0x7f5390148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.166+0000 7f53973b7640 1 -- 172.21.15.67:0/3567729484 >> 172.21.15.67:0/3567729484 conn(0x7f53900b3a70 msgr2=0x7f53900cd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.166+0000 7f53973b7640 1 -- 172.21.15.67:0/3567729484 shutdown_connections 2024-04-25T02:28:38.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.166+0000 7f53973b7640 1 -- 172.21.15.67:0/3567729484 wait complete. 2024-04-25T02:28:38.181 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:28:38.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.281+0000 7fe249eee640 1 Processor -- start 2024-04-25T02:28:38.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.281+0000 7fe249eee640 1 -- start start 2024-04-25T02:28:38.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.282+0000 7fe249eee640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2440cee60 0x7fe24406c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:38.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.282+0000 7fe249eee640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe2440d0210 0x7fe24406c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:38.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.282+0000 7fe249eee640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe24415c3a0 con 0x7fe24415bfc0 2024-04-25T02:28:38.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.282+0000 7fe249eee640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe2440d0760 con 0x7fe2440d0210 2024-04-25T02:28:38.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.282+0000 7fe249eee640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe2440d0a40 con 0x7fe2440cee60 2024-04-25T02:28:38.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.282+0000 7fe243fff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe2440d0210 0x7fe24406c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:38.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.282+0000 7fe242ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2440cee60 0x7fe24406c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:38.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.282+0000 7fe243fff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe2440d0210 0x7fe24406c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:54204/0 (socket says 172.21.15.67:54204) 2024-04-25T02:28:38.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.282+0000 7fe243fff640 1 -- 172.21.15.67:0/171232700 learned_addr learned my addr 172.21.15.67:0/171232700 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:38.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.282+0000 7fe242ffd640 1 --2- 172.21.15.67:0/171232700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2440cee60 0x7fe24406c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:47500/0 (socket says 172.21.15.67:47500) 2024-04-25T02:28:38.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.282+0000 7fe2437fe640 1 --1- 172.21.15.67:0/171232700 >> v1:172.21.15.176:6789/0 conn(0x7fe24415bfc0 0x7fe2440ce750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:42660/0 (socket says 172.21.15.67:42660) 2024-04-25T02:28:38.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.282+0000 7fe243fff640 1 -- 172.21.15.67:0/171232700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2440cee60 msgr2=0x7fe24406c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:38.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.282+0000 7fe243fff640 1 --2- 172.21.15.67:0/171232700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2440cee60 0x7fe24406c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.282+0000 7fe243fff640 1 -- 172.21.15.67:0/171232700 >> v1:172.21.15.176:6789/0 conn(0x7fe24415bfc0 legacy=0x7fe2440ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:38.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.282+0000 7fe243fff640 1 -- 172.21.15.67:0/171232700 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2440d0d20 con 0x7fe2440d0210 2024-04-25T02:28:38.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.283+0000 7fe243fff640 1 --2- 172.21.15.67:0/171232700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2440d0210 0x7fe24406c7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009e50 tx=0x7fe23c02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e2a6f3d6f320777 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:38.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.283+0000 7fe2427fc640 1 -- 172.21.15.67:0/171232700 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c036070 con 0x7fe2440d0210 2024-04-25T02:28:38.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.283+0000 7fe2427fc640 1 -- 172.21.15.67:0/171232700 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe23c031600 con 0x7fe2440d0210 2024-04-25T02:28:38.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.283+0000 7fe2427fc640 1 -- 172.21.15.67:0/171232700 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c0319d0 con 0x7fe2440d0210 2024-04-25T02:28:38.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.284+0000 7fe249eee640 1 -- 172.21.15.67:0/171232700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2440d0210 msgr2=0x7fe24406c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:38.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.284+0000 7fe249eee640 1 --2- 172.21.15.67:0/171232700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2440d0210 0x7fe24406c7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009e50 tx=0x7fe23c02a710 comp rx=0 tx=0).stop 2024-04-25T02:28:38.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.284+0000 7fe249eee640 1 -- 172.21.15.67:0/171232700 shutdown_connections 2024-04-25T02:28:38.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.284+0000 7fe249eee640 1 --2- 172.21.15.67:0/171232700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2440d0210 0x7fe24406c7a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.284+0000 7fe249eee640 1 --2- 172.21.15.67:0/171232700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2440cee60 0x7fe24406c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.284+0000 7fe249eee640 1 -- 172.21.15.67:0/171232700 >> 172.21.15.67:0/171232700 conn(0x7fe2440d1ed0 msgr2=0x7fe2440d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:38.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.284+0000 7fe249eee640 1 -- 172.21.15.67:0/171232700 shutdown_connections 2024-04-25T02:28:38.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.284+0000 7fe249eee640 1 -- 172.21.15.67:0/171232700 wait complete. 2024-04-25T02:28:38.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.285+0000 7fe249eee640 1 Processor -- start 2024-04-25T02:28:38.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.285+0000 7fe249eee640 1 -- start start 2024-04-25T02:28:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.286+0000 7fe249eee640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2440cee60 0x7fe2440c7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.286+0000 7fe249eee640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2440d0210 0x7fe2441f7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.286+0000 7fe249eee640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe24415bfc0 0x7fe244150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.286+0000 7fe249eee640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe2440cf690 con 0x7fe24415bfc0 2024-04-25T02:28:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.286+0000 7fe249eee640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe2440d12e0 con 0x7fe2440d0210 2024-04-25T02:28:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.286+0000 7fe249eee640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe2440cf810 con 0x7fe2440cee60 2024-04-25T02:28:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.286+0000 7fe243fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe24415bfc0 0x7fe244150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.286+0000 7fe243fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe24415bfc0 0x7fe244150300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54760/0 (socket says 172.21.15.67:54760) 2024-04-25T02:28:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.286+0000 7fe243fff640 1 -- 172.21.15.67:0/1927951220 learned_addr learned my addr 172.21.15.67:0/1927951220 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.286+0000 7fe2437fe640 1 --2- 172.21.15.67:0/1927951220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2440cee60 0x7fe2440c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.286+0000 7fe242ffd640 1 --2- 172.21.15.67:0/1927951220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2440d0210 0x7fe2441f7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.286+0000 7fe243fff640 1 -- 172.21.15.67:0/1927951220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2440cee60 msgr2=0x7fe2440c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.286+0000 7fe243fff640 1 --2- 172.21.15.67:0/1927951220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2440cee60 0x7fe2440c7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.286+0000 7fe243fff640 1 -- 172.21.15.67:0/1927951220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2440d0210 msgr2=0x7fe2441f7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:38.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.286+0000 7fe243fff640 1 --2- 172.21.15.67:0/1927951220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2440d0210 0x7fe2441f7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.286+0000 7fe243fff640 1 -- 172.21.15.67:0/1927951220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2440c76a0 con 0x7fe24415bfc0 2024-04-25T02:28:38.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.286+0000 7fe243fff640 1 --2- 172.21.15.67:0/1927951220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe24415bfc0 0x7fe244150300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009e50 tx=0x7fe23c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:38.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.286+0000 7fe22bfff640 1 -- 172.21.15.67:0/1927951220 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c036050 con 0x7fe24415bfc0 2024-04-25T02:28:38.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.287+0000 7fe249eee640 1 -- 172.21.15.67:0/1927951220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe244154820 con 0x7fe24415bfc0 2024-04-25T02:28:38.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.287+0000 7fe22bfff640 1 -- 172.21.15.67:0/1927951220 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe23c042070 con 0x7fe24415bfc0 2024-04-25T02:28:38.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.287+0000 7fe22bfff640 1 -- 172.21.15.67:0/1927951220 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c009510 con 0x7fe24415bfc0 2024-04-25T02:28:38.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.287+0000 7fe249eee640 1 -- 172.21.15.67:0/1927951220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2440c6960 con 0x7fe24415bfc0 2024-04-25T02:28:38.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.288+0000 7fe249eee640 1 -- 172.21.15.67:0/1927951220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe244069110 con 0x7fe24415bfc0 2024-04-25T02:28:38.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.288+0000 7fe22bfff640 1 -- 172.21.15.67:0/1927951220 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe23c007bf0 con 0x7fe24415bfc0 2024-04-25T02:28:38.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.288+0000 7fe22bfff640 1 --2- 172.21.15.67:0/1927951220 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe23006be60 0x7fe23006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:38.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.289+0000 7fe22bfff640 1 -- 172.21.15.67:0/1927951220 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe23c0abcd0 con 0x7fe24415bfc0 2024-04-25T02:28:38.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.289+0000 7fe2437fe640 1 --2- 172.21.15.67:0/1927951220 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe23006be60 0x7fe23006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:38.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.289+0000 7fe2437fe640 1 --2- 172.21.15.67:0/1927951220 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe23006be60 0x7fe23006e320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe234000f60 tx=0x7fe234007ce0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:38.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.293+0000 7fe22bfff640 1 -- 172.21.15.67:0/1927951220 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe23c07a600 con 0x7fe24415bfc0 2024-04-25T02:28:38.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.478+0000 7fe249eee640 1 -- 172.21.15.67:0/1927951220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe2440b1430 con 0x7fe24415bfc0 2024-04-25T02:28:38.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.479+0000 7fe22bfff640 1 -- 172.21.15.67:0/1927951220 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fe23c079f00 con 0x7fe24415bfc0 2024-04-25T02:28:38.483 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-25T02:28:38.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.481+0000 7fe249eee640 1 -- 172.21.15.67:0/1927951220 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe23006be60 msgr2=0x7fe23006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:38.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.481+0000 7fe249eee640 1 --2- 172.21.15.67:0/1927951220 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe23006be60 0x7fe23006e320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe234000f60 tx=0x7fe234007ce0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.481+0000 7fe249eee640 1 -- 172.21.15.67:0/1927951220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe24415bfc0 msgr2=0x7fe244150300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:38.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.481+0000 7fe249eee640 1 --2- 172.21.15.67:0/1927951220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe24415bfc0 0x7fe244150300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009e50 tx=0x7fe23c004a40 comp rx=0 tx=0).stop 2024-04-25T02:28:38.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.481+0000 7fe249eee640 1 -- 172.21.15.67:0/1927951220 shutdown_connections 2024-04-25T02:28:38.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.481+0000 7fe249eee640 1 --2- 172.21.15.67:0/1927951220 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe23006be60 0x7fe23006e320 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.481+0000 7fe249eee640 1 --2- 172.21.15.67:0/1927951220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe24415bfc0 0x7fe244150300 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.481+0000 7fe249eee640 1 --2- 172.21.15.67:0/1927951220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2440d0210 0x7fe2441f7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.481+0000 7fe249eee640 1 --2- 172.21.15.67:0/1927951220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2440cee60 0x7fe2440c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.481+0000 7fe249eee640 1 -- 172.21.15.67:0/1927951220 >> 172.21.15.67:0/1927951220 conn(0x7fe2440d1ed0 msgr2=0x7fe24415b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:38.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.481+0000 7fe249eee640 1 -- 172.21.15.67:0/1927951220 shutdown_connections 2024-04-25T02:28:38.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.481+0000 7fe249eee640 1 -- 172.21.15.67:0/1927951220 wait complete. 2024-04-25T02:28:38.496 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:28:38.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.592+0000 7fa9896ee640 1 Processor -- start 2024-04-25T02:28:38.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.592+0000 7fa9896ee640 1 -- start start 2024-04-25T02:28:38.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.593+0000 7fa9896ee640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa98415a6f0 0x7fa9840b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:38.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.593+0000 7fa9896ee640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa9840b4b70 0x7fa9840ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:38.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.593+0000 7fa9896ee640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa98406ec30 con 0x7fa98406e7a0 2024-04-25T02:28:38.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.593+0000 7fa9896ee640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa9840b3fd0 con 0x7fa98415a6f0 2024-04-25T02:28:38.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.593+0000 7fa9896ee640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa9840b33c0 con 0x7fa9840b4b70 2024-04-25T02:28:38.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.593+0000 7fa982ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa98415a6f0 0x7fa9840b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:38.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.593+0000 7fa982ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa98415a6f0 0x7fa9840b2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54762/0 (socket says 172.21.15.67:54762) 2024-04-25T02:28:38.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.593+0000 7fa982ffd640 1 -- 172.21.15.67:0/4199544635 learned_addr learned my addr 172.21.15.67:0/4199544635 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:38.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.593+0000 7fa9837fe640 1 --2- 172.21.15.67:0/4199544635 >> v2:172.21.15.176:3300/0 conn(0x7fa9840b4b70 0x7fa9840ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:38.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.593+0000 7fa982ffd640 1 -- 172.21.15.67:0/4199544635 >> v2:172.21.15.176:3300/0 conn(0x7fa9840b4b70 msgr2=0x7fa9840ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:38.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.593+0000 7fa982ffd640 1 --2- 172.21.15.67:0/4199544635 >> v2:172.21.15.176:3300/0 conn(0x7fa9840b4b70 0x7fa9840ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.593+0000 7fa982ffd640 1 -- 172.21.15.67:0/4199544635 >> v1:172.21.15.176:6789/0 conn(0x7fa98406e7a0 legacy=0x7fa9840b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:38.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.593+0000 7fa982ffd640 1 -- 172.21.15.67:0/4199544635 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9840b36a0 con 0x7fa98415a6f0 2024-04-25T02:28:38.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.594+0000 7fa982ffd640 1 --2- 172.21.15.67:0/4199544635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a6f0 0x7fa9840b2cc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa9840b4150 tx=0x7fa97402c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2dbde8fb675d0e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:38.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.594+0000 7fa9827fc640 1 -- 172.21.15.67:0/4199544635 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa974036020 con 0x7fa98415a6f0 2024-04-25T02:28:38.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.594+0000 7fa9827fc640 1 -- 172.21.15.67:0/4199544635 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa974032820 con 0x7fa98415a6f0 2024-04-25T02:28:38.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.594+0000 7fa9827fc640 1 -- 172.21.15.67:0/4199544635 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa974032bf0 con 0x7fa98415a6f0 2024-04-25T02:28:38.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.594+0000 7fa9896ee640 1 -- 172.21.15.67:0/4199544635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a6f0 msgr2=0x7fa9840b2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:38.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.594+0000 7fa9896ee640 1 --2- 172.21.15.67:0/4199544635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a6f0 0x7fa9840b2cc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa9840b4150 tx=0x7fa97402c920 comp rx=0 tx=0).stop 2024-04-25T02:28:38.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.595+0000 7fa9896ee640 1 -- 172.21.15.67:0/4199544635 shutdown_connections 2024-04-25T02:28:38.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.595+0000 7fa9896ee640 1 --2- 172.21.15.67:0/4199544635 >> v2:172.21.15.176:3300/0 conn(0x7fa9840b4b70 0x7fa9840ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.595+0000 7fa9896ee640 1 --2- 172.21.15.67:0/4199544635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a6f0 0x7fa9840b2cc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.595+0000 7fa9896ee640 1 -- 172.21.15.67:0/4199544635 >> 172.21.15.67:0/4199544635 conn(0x7fa9840b19c0 msgr2=0x7fa9840b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:38.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.595+0000 7fa9896ee640 1 -- 172.21.15.67:0/4199544635 shutdown_connections 2024-04-25T02:28:38.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.595+0000 7fa9896ee640 1 -- 172.21.15.67:0/4199544635 wait complete. 2024-04-25T02:28:38.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.596+0000 7fa9896ee640 1 Processor -- start 2024-04-25T02:28:38.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.596+0000 7fa9896ee640 1 -- start start 2024-04-25T02:28:38.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa9896ee640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa98406e7a0 0x7fa984154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:38.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa9896ee640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9840b4b70 0x7fa98415b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:38.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa9896ee640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a6f0 0x7fa984152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:38.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa9896ee640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa98415aad0 con 0x7fa98415a6f0 2024-04-25T02:28:38.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa9896ee640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa9840b3c60 con 0x7fa9840b4b70 2024-04-25T02:28:38.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa9896ee640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa9840ad5c0 con 0x7fa98406e7a0 2024-04-25T02:28:38.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa9837fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a6f0 0x7fa984152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:38.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa9837fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a6f0 0x7fa984152830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54768/0 (socket says 172.21.15.67:54768) 2024-04-25T02:28:38.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa9837fe640 1 -- 172.21.15.67:0/1259580714 learned_addr learned my addr 172.21.15.67:0/1259580714 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:38.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa982ffd640 1 --2- 172.21.15.67:0/1259580714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa98406e7a0 0x7fa984154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:38.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa97bfff640 1 --2- 172.21.15.67:0/1259580714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9840b4b70 0x7fa98415b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:38.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa9837fe640 1 -- 172.21.15.67:0/1259580714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa98406e7a0 msgr2=0x7fa984154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:38.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa9837fe640 1 --2- 172.21.15.67:0/1259580714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa98406e7a0 0x7fa984154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa9837fe640 1 -- 172.21.15.67:0/1259580714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9840b4b70 msgr2=0x7fa98415b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:38.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa9837fe640 1 --2- 172.21.15.67:0/1259580714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9840b4b70 0x7fa98415b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa9837fe640 1 -- 172.21.15.67:0/1259580714 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa98415c210 con 0x7fa98415a6f0 2024-04-25T02:28:38.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa982ffd640 1 --2- 172.21.15.67:0/1259580714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa98406e7a0 0x7fa984154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:38.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa97bfff640 1 --2- 172.21.15.67:0/1259580714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9840b4b70 0x7fa98415b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:38.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa9837fe640 1 --2- 172.21.15.67:0/1259580714 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a6f0 0x7fa984152830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa97c007db0 tx=0x7fa97c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:38.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa97b7fe640 1 -- 172.21.15.67:0/1259580714 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c014420 con 0x7fa98415a6f0 2024-04-25T02:28:38.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa97b7fe640 1 -- 172.21.15.67:0/1259580714 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa97c019070 con 0x7fa98415a6f0 2024-04-25T02:28:38.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa9896ee640 1 -- 172.21.15.67:0/1259580714 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa98415c4f0 con 0x7fa98415a6f0 2024-04-25T02:28:38.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa97b7fe640 1 -- 172.21.15.67:0/1259580714 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c014800 con 0x7fa98415a6f0 2024-04-25T02:28:38.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.597+0000 7fa9896ee640 1 -- 172.21.15.67:0/1259580714 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9841503f0 con 0x7fa98415a6f0 2024-04-25T02:28:38.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.598+0000 7fa9896ee640 1 -- 172.21.15.67:0/1259580714 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa984069110 con 0x7fa98415a6f0 2024-04-25T02:28:38.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.599+0000 7fa97b7fe640 1 -- 172.21.15.67:0/1259580714 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa97c0149a0 con 0x7fa98415a6f0 2024-04-25T02:28:38.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.599+0000 7fa97b7fe640 1 --2- 172.21.15.67:0/1259580714 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa96406be30 0x7fa96406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:38.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.599+0000 7fa97b7fe640 1 -- 172.21.15.67:0/1259580714 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa97c08b620 con 0x7fa98415a6f0 2024-04-25T02:28:38.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.599+0000 7fa982ffd640 1 --2- 172.21.15.67:0/1259580714 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa96406be30 0x7fa96406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:38.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.600+0000 7fa982ffd640 1 --2- 172.21.15.67:0/1259580714 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa96406be30 0x7fa96406e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa974037000 tx=0x7fa97403d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:38.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.603+0000 7fa97b7fe640 1 -- 172.21.15.67:0/1259580714 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa97c05a060 con 0x7fa98415a6f0 2024-04-25T02:28:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.823+0000 7fa9896ee640 1 -- 172.21.15.67:0/1259580714 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa98406e150 con 0x7fa98415a6f0 2024-04-25T02:28:38.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.824+0000 7fa97b7fe640 1 -- 172.21.15.67:0/1259580714 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5172 (secure 0 0 0) 0x7fa97c059960 con 0x7fa98415a6f0 2024-04-25T02:28:38.828 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:38.828 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1246739775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1246739775},{"type":"v1","addr":"172.21.15.67:6835","nonce":1246739775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/267757090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":267757090},{"type":"v1","addr":"172.21.15.67:6833","nonce":267757090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/90768677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":90768677},{"type":"v1","addr":"172.21.15.176:6837","nonce":90768677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:28:26.184170+0000","modified":"2024-04-25T02:28:29.181464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/1058053785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1058053785},{"type":"v1","addr":"172.21.15.176:6836","nonce":1058053785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-25T02:28:38.828 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 7 2024-04-25T02:28:38.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.826+0000 7fa9896ee640 1 -- 172.21.15.67:0/1259580714 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa96406be30 msgr2=0x7fa96406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.826+0000 7fa9896ee640 1 --2- 172.21.15.67:0/1259580714 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa96406be30 0x7fa96406e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa974037000 tx=0x7fa97403d040 comp rx=0 tx=0).stop 2024-04-25T02:28:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.826+0000 7fa9896ee640 1 -- 172.21.15.67:0/1259580714 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a6f0 msgr2=0x7fa984152830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.826+0000 7fa9896ee640 1 --2- 172.21.15.67:0/1259580714 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a6f0 0x7fa984152830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa97c007db0 tx=0x7fa97c00e4b0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.826+0000 7fa9896ee640 1 -- 172.21.15.67:0/1259580714 shutdown_connections 2024-04-25T02:28:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.826+0000 7fa9896ee640 1 --2- 172.21.15.67:0/1259580714 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa96406be30 0x7fa96406e2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.826+0000 7fa9896ee640 1 --2- 172.21.15.67:0/1259580714 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa98415a6f0 0x7fa984152830 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.826+0000 7fa9896ee640 1 --2- 172.21.15.67:0/1259580714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9840b4b70 0x7fa98415b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.826+0000 7fa9896ee640 1 --2- 172.21.15.67:0/1259580714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa98406e7a0 0x7fa984154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.826+0000 7fa9896ee640 1 -- 172.21.15.67:0/1259580714 >> 172.21.15.67:0/1259580714 conn(0x7fa9840b19c0 msgr2=0x7fa9840aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.826+0000 7fa9896ee640 1 -- 172.21.15.67:0/1259580714 shutdown_connections 2024-04-25T02:28:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.826+0000 7fa9896ee640 1 -- 172.21.15.67:0/1259580714 wait complete. 2024-04-25T02:28:38.841 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:38.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.938+0000 7f2411fd5640 1 Processor -- start 2024-04-25T02:28:38.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.938+0000 7f2411fd5640 1 -- start start 2024-04-25T02:28:38.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.939+0000 7f2411fd5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f240c0af120 0x7f240c071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:38.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.939+0000 7f2411fd5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f240c0acda0 0x7f240c06cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.939+0000 7f2411fd5640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f240c160b20 con 0x7f240c15c230 2024-04-25T02:28:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.939+0000 7f2411fd5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f240c15c610 con 0x7f240c0af120 2024-04-25T02:28:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.939+0000 7f2411fd5640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f240c15fd60 con 0x7f240c0acda0 2024-04-25T02:28:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.939+0000 7f240affd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f240c0af120 0x7f240c071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.939+0000 7f240affd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f240c0af120 0x7f240c071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54778/0 (socket says 172.21.15.67:54778) 2024-04-25T02:28:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.939+0000 7f240affd640 1 -- 172.21.15.67:0/1967068140 learned_addr learned my addr 172.21.15.67:0/1967068140 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.939+0000 7f240bfff640 1 --2- 172.21.15.67:0/1967068140 >> v2:172.21.15.176:3300/0 conn(0x7f240c0acda0 0x7f240c06cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.939+0000 7f240affd640 1 -- 172.21.15.67:0/1967068140 >> v2:172.21.15.176:3300/0 conn(0x7f240c0acda0 msgr2=0x7f240c06cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.939+0000 7f240affd640 1 --2- 172.21.15.67:0/1967068140 >> v2:172.21.15.176:3300/0 conn(0x7f240c0acda0 0x7f240c06cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.939+0000 7f240affd640 1 -- 172.21.15.67:0/1967068140 >> v1:172.21.15.176:6789/0 conn(0x7f240c15c230 legacy=0x7f240c0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.939+0000 7f240affd640 1 -- 172.21.15.67:0/1967068140 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240c160040 con 0x7f240c0af120 2024-04-25T02:28:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.939+0000 7f240bfff640 1 --2- 172.21.15.67:0/1967068140 >> v2:172.21.15.176:3300/0 conn(0x7f240c0acda0 0x7f240c06cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.940+0000 7f240affd640 1 --2- 172.21.15.67:0/1967068140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f240c0af120 0x7f240c071800 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f240c070d80 tx=0x7f240002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d8281865018b8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.940+0000 7f240a7fc640 1 -- 172.21.15.67:0/1967068140 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2400037070 con 0x7f240c0af120 2024-04-25T02:28:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.940+0000 7f240a7fc640 1 -- 172.21.15.67:0/1967068140 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2400032440 con 0x7f240c0af120 2024-04-25T02:28:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.940+0000 7f240a7fc640 1 -- 172.21.15.67:0/1967068140 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2400032810 con 0x7f240c0af120 2024-04-25T02:28:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.941+0000 7f2411fd5640 1 -- 172.21.15.67:0/1967068140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f240c0af120 msgr2=0x7f240c071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.941+0000 7f2411fd5640 1 --2- 172.21.15.67:0/1967068140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f240c0af120 0x7f240c071800 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f240c070d80 tx=0x7f240002a270 comp rx=0 tx=0).stop 2024-04-25T02:28:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.941+0000 7f2411fd5640 1 -- 172.21.15.67:0/1967068140 shutdown_connections 2024-04-25T02:28:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.941+0000 7f2411fd5640 1 --2- 172.21.15.67:0/1967068140 >> v2:172.21.15.176:3300/0 conn(0x7f240c0acda0 0x7f240c06cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.941+0000 7f2411fd5640 1 --2- 172.21.15.67:0/1967068140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f240c0af120 0x7f240c071800 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.941+0000 7f2411fd5640 1 -- 172.21.15.67:0/1967068140 >> 172.21.15.67:0/1967068140 conn(0x7f240c0b19c0 msgr2=0x7f240c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.941+0000 7f2411fd5640 1 -- 172.21.15.67:0/1967068140 shutdown_connections 2024-04-25T02:28:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.941+0000 7f2411fd5640 1 -- 172.21.15.67:0/1967068140 wait complete. 2024-04-25T02:28:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.942+0000 7f2411fd5640 1 Processor -- start 2024-04-25T02:28:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.942+0000 7f2411fd5640 1 -- start start 2024-04-25T02:28:38.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f2411fd5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f240c0acda0 0x7f240c15e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f2411fd5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f240c0af120 0x7f240c0cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f2411fd5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f240c15c230 0x7f240c153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f2411fd5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f240c0ad1f0 con 0x7f240c15c230 2024-04-25T02:28:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f2411fd5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f240c160600 con 0x7f240c0af120 2024-04-25T02:28:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f2411fd5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f240c0ad4d0 con 0x7f240c0acda0 2024-04-25T02:28:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f240bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f240c15c230 0x7f240c153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f240bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f240c15c230 0x7f240c153800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54790/0 (socket says 172.21.15.67:54790) 2024-04-25T02:28:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f240bfff640 1 -- 172.21.15.67:0/891307661 learned_addr learned my addr 172.21.15.67:0/891307661 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f240b7fe640 1 --2- 172.21.15.67:0/891307661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f240c0acda0 0x7f240c15e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f240bfff640 1 -- 172.21.15.67:0/891307661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f240c0acda0 msgr2=0x7f240c15e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f240affd640 1 --2- 172.21.15.67:0/891307661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f240c0af120 0x7f240c0cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f240bfff640 1 --2- 172.21.15.67:0/891307661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f240c0acda0 0x7f240c15e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f240bfff640 1 -- 172.21.15.67:0/891307661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f240c0af120 msgr2=0x7f240c0cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:38.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f240bfff640 1 --2- 172.21.15.67:0/891307661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f240c0af120 0x7f240c0cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:38.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f240bfff640 1 -- 172.21.15.67:0/891307661 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240c1f4fe0 con 0x7f240c15c230 2024-04-25T02:28:38.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f240b7fe640 1 --2- 172.21.15.67:0/891307661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f240c0acda0 0x7f240c15e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:38.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f240affd640 1 --2- 172.21.15.67:0/891307661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f240c0af120 0x7f240c0cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:38.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.943+0000 7f240bfff640 1 --2- 172.21.15.67:0/891307661 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f240c15c230 0x7f240c153800 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2404007de0 tx=0x7f240400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:38.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.944+0000 7f23f3fff640 1 -- 172.21.15.67:0/891307661 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240401a070 con 0x7f240c15c230 2024-04-25T02:28:38.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.944+0000 7f23f3fff640 1 -- 172.21.15.67:0/891307661 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2404003990 con 0x7f240c15c230 2024-04-25T02:28:38.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.944+0000 7f2411fd5640 1 -- 172.21.15.67:0/891307661 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240c15ef40 con 0x7f240c15c230 2024-04-25T02:28:38.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.944+0000 7f23f3fff640 1 -- 172.21.15.67:0/891307661 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404003d80 con 0x7f240c15c230 2024-04-25T02:28:38.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.944+0000 7f2411fd5640 1 -- 172.21.15.67:0/891307661 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f240c1f5250 con 0x7f240c15c230 2024-04-25T02:28:38.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.945+0000 7f2411fd5640 1 -- 172.21.15.67:0/891307661 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f240c069110 con 0x7f240c15c230 2024-04-25T02:28:38.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.945+0000 7f23f3fff640 1 -- 172.21.15.67:0/891307661 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f240401d070 con 0x7f240c15c230 2024-04-25T02:28:38.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.945+0000 7f23f3fff640 1 --2- 172.21.15.67:0/891307661 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f23f806be30 0x7f23f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:38.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.946+0000 7f23f3fff640 1 -- 172.21.15.67:0/891307661 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f240408b0e0 con 0x7f240c15c230 2024-04-25T02:28:38.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.946+0000 7f240b7fe640 1 --2- 172.21.15.67:0/891307661 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f23f806be30 0x7f23f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:38.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.946+0000 7f240b7fe640 1 --2- 172.21.15.67:0/891307661 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f23f806be30 0x7f23f806e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f240c159f50 tx=0x7f23fc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:38.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:38.950+0000 7f23f3fff640 1 -- 172.21.15.67:0/891307661 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2404010070 con 0x7f240c15c230 2024-04-25T02:28:39.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.134+0000 7f2411fd5640 1 -- 172.21.15.67:0/891307661 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f240c1f5420 con 0x7f240c15c230 2024-04-25T02:28:39.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.135+0000 7f23f3fff640 1 -- 172.21.15.67:0/891307661 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f2404059b20 con 0x7f240c15c230 2024-04-25T02:28:39.140 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:39.140 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:27.819641+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:39.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.137+0000 7f2411fd5640 1 -- 172.21.15.67:0/891307661 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f23f806be30 msgr2=0x7f23f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.137+0000 7f2411fd5640 1 --2- 172.21.15.67:0/891307661 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f23f806be30 0x7f23f806e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f240c159f50 tx=0x7f23fc009040 comp rx=0 tx=0).stop 2024-04-25T02:28:39.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.137+0000 7f2411fd5640 1 -- 172.21.15.67:0/891307661 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f240c15c230 msgr2=0x7f240c153800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.137+0000 7f2411fd5640 1 --2- 172.21.15.67:0/891307661 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f240c15c230 0x7f240c153800 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2404007de0 tx=0x7f240400d4a0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.137+0000 7f2411fd5640 1 -- 172.21.15.67:0/891307661 shutdown_connections 2024-04-25T02:28:39.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.137+0000 7f2411fd5640 1 --2- 172.21.15.67:0/891307661 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f23f806be30 0x7f23f806e2f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.137+0000 7f2411fd5640 1 --2- 172.21.15.67:0/891307661 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f240c15c230 0x7f240c153800 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.137+0000 7f2411fd5640 1 --2- 172.21.15.67:0/891307661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f240c0af120 0x7f240c0cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.137+0000 7f2411fd5640 1 --2- 172.21.15.67:0/891307661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f240c0acda0 0x7f240c15e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.137+0000 7f2411fd5640 1 -- 172.21.15.67:0/891307661 >> 172.21.15.67:0/891307661 conn(0x7f240c0b19c0 msgr2=0x7f240c0cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:39.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.137+0000 7f2411fd5640 1 -- 172.21.15.67:0/891307661 shutdown_connections 2024-04-25T02:28:39.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.137+0000 7f2411fd5640 1 -- 172.21.15.67:0/891307661 wait complete. 2024-04-25T02:28:39.152 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:28:24.445606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:28:25.161619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:28:39.153 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:28:39.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.252+0000 7fd37d49e640 1 Processor -- start 2024-04-25T02:28:39.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.253+0000 7fd37d49e640 1 -- start start 2024-04-25T02:28:39.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.253+0000 7fd37d49e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd378156620 0x7fd37815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.253+0000 7fd37d49e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd37806edf0 0x7fd37806dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.253+0000 7fd37d49e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd3780ae8e0 0x7fd3780aed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.253+0000 7fd37d49e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd37806d100 con 0x7fd3780ae8e0 2024-04-25T02:28:39.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.253+0000 7fd37d49e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd3780acda0 con 0x7fd37806edf0 2024-04-25T02:28:39.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.253+0000 7fd37d49e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd3780ad060 con 0x7fd378156620 2024-04-25T02:28:39.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.253+0000 7fd3777fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd3780ae8e0 0x7fd3780aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.254+0000 7fd3777fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd3780ae8e0 0x7fd3780aed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54792/0 (socket says 172.21.15.67:54792) 2024-04-25T02:28:39.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.254+0000 7fd3777fe640 1 -- 172.21.15.67:0/2111354665 learned_addr learned my addr 172.21.15.67:0/2111354665 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:39.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.254+0000 7fd376ffd640 1 --2- 172.21.15.67:0/2111354665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd378156620 0x7fd37815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.254+0000 7fd3767fc640 1 --2- 172.21.15.67:0/2111354665 >> v2:172.21.15.176:3300/0 conn(0x7fd37806edf0 0x7fd37806dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.254+0000 7fd3777fe640 1 -- 172.21.15.67:0/2111354665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd378156620 msgr2=0x7fd37815cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:39.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.254+0000 7fd3777fe640 1 --2- 172.21.15.67:0/2111354665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd378156620 0x7fd37815cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.254+0000 7fd3777fe640 1 -- 172.21.15.67:0/2111354665 >> v2:172.21.15.176:3300/0 conn(0x7fd37806edf0 msgr2=0x7fd37806dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:39.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.254+0000 7fd3777fe640 1 --2- 172.21.15.67:0/2111354665 >> v2:172.21.15.176:3300/0 conn(0x7fd37806edf0 0x7fd37806dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.254+0000 7fd3777fe640 1 -- 172.21.15.67:0/2111354665 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37806d3a0 con 0x7fd3780ae8e0 2024-04-25T02:28:39.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.254+0000 7fd3777fe640 1 --2- 172.21.15.67:0/2111354665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3780ae8e0 0x7fd3780aed70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd3780709b0 tx=0x7fd37002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecba85e5e0732b72 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:39.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.255+0000 7fd375ffb640 1 -- 172.21.15.67:0/2111354665 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd370037070 con 0x7fd3780ae8e0 2024-04-25T02:28:39.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.255+0000 7fd375ffb640 1 -- 172.21.15.67:0/2111354665 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd370032440 con 0x7fd3780ae8e0 2024-04-25T02:28:39.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.255+0000 7fd375ffb640 1 -- 172.21.15.67:0/2111354665 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd370032810 con 0x7fd3780ae8e0 2024-04-25T02:28:39.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.255+0000 7fd37d49e640 1 -- 172.21.15.67:0/2111354665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3780ae8e0 msgr2=0x7fd3780aed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.255+0000 7fd37d49e640 1 --2- 172.21.15.67:0/2111354665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3780ae8e0 0x7fd3780aed70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd3780709b0 tx=0x7fd37002a1e0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.255+0000 7fd37d49e640 1 -- 172.21.15.67:0/2111354665 shutdown_connections 2024-04-25T02:28:39.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.255+0000 7fd37d49e640 1 --2- 172.21.15.67:0/2111354665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3780ae8e0 0x7fd3780aed70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.255+0000 7fd37d49e640 1 --2- 172.21.15.67:0/2111354665 >> v2:172.21.15.176:3300/0 conn(0x7fd37806edf0 0x7fd37806dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.255+0000 7fd37d49e640 1 --2- 172.21.15.67:0/2111354665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd378156620 0x7fd37815cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.255+0000 7fd37d49e640 1 -- 172.21.15.67:0/2111354665 >> 172.21.15.67:0/2111354665 conn(0x7fd3780b19c0 msgr2=0x7fd3780b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:39.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.255+0000 7fd37d49e640 1 -- 172.21.15.67:0/2111354665 shutdown_connections 2024-04-25T02:28:39.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.255+0000 7fd37d49e640 1 -- 172.21.15.67:0/2111354665 wait complete. 2024-04-25T02:28:39.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.257+0000 7fd37d49e640 1 Processor -- start 2024-04-25T02:28:39.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.257+0000 7fd37d49e640 1 -- start start 2024-04-25T02:28:39.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.257+0000 7fd37d49e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37806edf0 0x7fd37815d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.257+0000 7fd37d49e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3780ae8e0 0x7fd37815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.257+0000 7fd37d49e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd378156620 0x7fd3781f1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.257+0000 7fd37d49e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd37806e0e0 con 0x7fd3780ae8e0 2024-04-25T02:28:39.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.257+0000 7fd37d49e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd3780af2b0 con 0x7fd37806edf0 2024-04-25T02:28:39.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.257+0000 7fd37d49e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd3780ad340 con 0x7fd378156620 2024-04-25T02:28:39.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.257+0000 7fd3767fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3780ae8e0 0x7fd37815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.257+0000 7fd3767fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3780ae8e0 0x7fd37815ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54796/0 (socket says 172.21.15.67:54796) 2024-04-25T02:28:39.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.257+0000 7fd3767fc640 1 -- 172.21.15.67:0/1592732018 learned_addr learned my addr 172.21.15.67:0/1592732018 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:39.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.258+0000 7fd376ffd640 1 --2- 172.21.15.67:0/1592732018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37806edf0 0x7fd37815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.258+0000 7fd3777fe640 1 --2- 172.21.15.67:0/1592732018 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd378156620 0x7fd3781f1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.258+0000 7fd3767fc640 1 -- 172.21.15.67:0/1592732018 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd378156620 msgr2=0x7fd3781f1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.258+0000 7fd3767fc640 1 --2- 172.21.15.67:0/1592732018 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd378156620 0x7fd3781f1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.258+0000 7fd3767fc640 1 -- 172.21.15.67:0/1592732018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37806edf0 msgr2=0x7fd37815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.258+0000 7fd3767fc640 1 --2- 172.21.15.67:0/1592732018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37806edf0 0x7fd37815d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.258+0000 7fd3767fc640 1 -- 172.21.15.67:0/1592732018 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37815e7a0 con 0x7fd3780ae8e0 2024-04-25T02:28:39.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.258+0000 7fd3767fc640 1 --2- 172.21.15.67:0/1592732018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3780ae8e0 0x7fd37815ddb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd36000d7d0 tx=0x7fd36000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:39.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.258+0000 7fd36f7fe640 1 -- 172.21.15.67:0/1592732018 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360018020 con 0x7fd3780ae8e0 2024-04-25T02:28:39.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.258+0000 7fd36f7fe640 1 -- 172.21.15.67:0/1592732018 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3600096a0 con 0x7fd3780ae8e0 2024-04-25T02:28:39.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.258+0000 7fd37d49e640 1 -- 172.21.15.67:0/1592732018 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd37815ea80 con 0x7fd3780ae8e0 2024-04-25T02:28:39.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.258+0000 7fd36f7fe640 1 -- 172.21.15.67:0/1592732018 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360009a90 con 0x7fd3780ae8e0 2024-04-25T02:28:39.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.258+0000 7fd37d49e640 1 -- 172.21.15.67:0/1592732018 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3781f3210 con 0x7fd3780ae8e0 2024-04-25T02:28:39.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.259+0000 7fd37d49e640 1 -- 172.21.15.67:0/1592732018 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd37815ec50 con 0x7fd3780ae8e0 2024-04-25T02:28:39.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.259+0000 7fd36f7fe640 1 -- 172.21.15.67:0/1592732018 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd36001b020 con 0x7fd3780ae8e0 2024-04-25T02:28:39.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.260+0000 7fd36f7fe640 1 --2- 172.21.15.67:0/1592732018 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd35806be30 0x7fd35806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.260+0000 7fd36f7fe640 1 -- 172.21.15.67:0/1592732018 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd36008b410 con 0x7fd3780ae8e0 2024-04-25T02:28:39.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.260+0000 7fd376ffd640 1 --2- 172.21.15.67:0/1592732018 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd35806be30 0x7fd35806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.260+0000 7fd376ffd640 1 --2- 172.21.15.67:0/1592732018 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd35806be30 0x7fd35806e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd37815beb0 tx=0x7fd3680039b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:39.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.264+0000 7fd36f7fe640 1 -- 172.21.15.67:0/1592732018 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd360022020 con 0x7fd3780ae8e0 2024-04-25T02:28:39.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.445+0000 7fd37d49e640 1 -- 172.21.15.67:0/1592732018 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd378069110 con 0x7fd3780ae8e0 2024-04-25T02:28:39.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.445+0000 7fd36f7fe640 1 -- 172.21.15.67:0/1592732018 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fd360059dc0 con 0x7fd3780ae8e0 2024-04-25T02:28:39.450 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:28:39.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.448+0000 7fd37d49e640 1 -- 172.21.15.67:0/1592732018 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd35806be30 msgr2=0x7fd35806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.448+0000 7fd37d49e640 1 --2- 172.21.15.67:0/1592732018 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd35806be30 0x7fd35806e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd37815beb0 tx=0x7fd3680039b0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.448+0000 7fd37d49e640 1 -- 172.21.15.67:0/1592732018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3780ae8e0 msgr2=0x7fd37815ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.448+0000 7fd37d49e640 1 --2- 172.21.15.67:0/1592732018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3780ae8e0 0x7fd37815ddb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd36000d7d0 tx=0x7fd36000dc90 comp rx=0 tx=0).stop 2024-04-25T02:28:39.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.448+0000 7fd37d49e640 1 -- 172.21.15.67:0/1592732018 shutdown_connections 2024-04-25T02:28:39.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.448+0000 7fd37d49e640 1 --2- 172.21.15.67:0/1592732018 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd35806be30 0x7fd35806e2f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.448+0000 7fd37d49e640 1 --2- 172.21.15.67:0/1592732018 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd378156620 0x7fd3781f1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.448+0000 7fd37d49e640 1 --2- 172.21.15.67:0/1592732018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3780ae8e0 0x7fd37815ddb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.448+0000 7fd37d49e640 1 --2- 172.21.15.67:0/1592732018 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37806edf0 0x7fd37815d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.448+0000 7fd37d49e640 1 -- 172.21.15.67:0/1592732018 >> 172.21.15.67:0/1592732018 conn(0x7fd3780b19c0 msgr2=0x7fd3780722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:39.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.448+0000 7fd37d49e640 1 -- 172.21.15.67:0/1592732018 shutdown_connections 2024-04-25T02:28:39.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.448+0000 7fd37d49e640 1 -- 172.21.15.67:0/1592732018 wait complete. 2024-04-25T02:28:39.462 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:28:39.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.562+0000 7fd579261640 1 Processor -- start 2024-04-25T02:28:39.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.562+0000 7fd579261640 1 -- start start 2024-04-25T02:28:39.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.563+0000 7fd579261640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd57415e400 0x7fd57406c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.563+0000 7fd579261640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5740d2c40 0x7fd57406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.563+0000 7fd579261640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd57406c1d0 0x7fd574161f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.563+0000 7fd579261640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd5740d1590 con 0x7fd57406c1d0 2024-04-25T02:28:39.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.563+0000 7fd579261640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd57409b630 con 0x7fd57415e400 2024-04-25T02:28:39.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.563+0000 7fd579261640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd5740d04f0 con 0x7fd5740d2c40 2024-04-25T02:28:39.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.563+0000 7fd5737fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd57406c1d0 0x7fd574161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.563+0000 7fd5737fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd57406c1d0 0x7fd574161f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54806/0 (socket says 172.21.15.67:54806) 2024-04-25T02:28:39.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.563+0000 7fd5737fe640 1 -- 172.21.15.67:0/2517463278 learned_addr learned my addr 172.21.15.67:0/2517463278 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:39.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.563+0000 7fd5727fc640 1 --2- 172.21.15.67:0/2517463278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5740d2c40 0x7fd57406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.563+0000 7fd572ffd640 1 --2- 172.21.15.67:0/2517463278 >> v2:172.21.15.176:3300/0 conn(0x7fd57415e400 0x7fd57406c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.564+0000 7fd5737fe640 1 -- 172.21.15.67:0/2517463278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5740d2c40 msgr2=0x7fd57406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:39.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.564+0000 7fd5737fe640 1 --2- 172.21.15.67:0/2517463278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5740d2c40 0x7fd57406cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.564+0000 7fd5737fe640 1 -- 172.21.15.67:0/2517463278 >> v2:172.21.15.176:3300/0 conn(0x7fd57415e400 msgr2=0x7fd57406c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:39.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.564+0000 7fd5737fe640 1 --2- 172.21.15.67:0/2517463278 >> v2:172.21.15.176:3300/0 conn(0x7fd57415e400 0x7fd57406c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.564+0000 7fd5737fe640 1 -- 172.21.15.67:0/2517463278 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5740d07d0 con 0x7fd57406c1d0 2024-04-25T02:28:39.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.564+0000 7fd5737fe640 1 --2- 172.21.15.67:0/2517463278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57406c1d0 0x7fd574161f60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd574074c30 tx=0x7fd56402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c656eddfd0efb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:39.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.564+0000 7fd571ffb640 1 -- 172.21.15.67:0/2517463278 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd564037070 con 0x7fd57406c1d0 2024-04-25T02:28:39.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.564+0000 7fd571ffb640 1 -- 172.21.15.67:0/2517463278 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd564032440 con 0x7fd57406c1d0 2024-04-25T02:28:39.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.564+0000 7fd571ffb640 1 -- 172.21.15.67:0/2517463278 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd564032810 con 0x7fd57406c1d0 2024-04-25T02:28:39.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.565+0000 7fd579261640 1 -- 172.21.15.67:0/2517463278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57406c1d0 msgr2=0x7fd574161f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.565+0000 7fd579261640 1 --2- 172.21.15.67:0/2517463278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57406c1d0 0x7fd574161f60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd574074c30 tx=0x7fd56402a270 comp rx=0 tx=0).stop 2024-04-25T02:28:39.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.565+0000 7fd579261640 1 -- 172.21.15.67:0/2517463278 shutdown_connections 2024-04-25T02:28:39.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.565+0000 7fd579261640 1 --2- 172.21.15.67:0/2517463278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57406c1d0 0x7fd574161f60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.565+0000 7fd579261640 1 --2- 172.21.15.67:0/2517463278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5740d2c40 0x7fd57406cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.565+0000 7fd579261640 1 --2- 172.21.15.67:0/2517463278 >> v2:172.21.15.176:3300/0 conn(0x7fd57415e400 0x7fd57406c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.565+0000 7fd579261640 1 -- 172.21.15.67:0/2517463278 >> 172.21.15.67:0/2517463278 conn(0x7fd5740d1f10 msgr2=0x7fd5740d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:39.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.565+0000 7fd579261640 1 -- 172.21.15.67:0/2517463278 shutdown_connections 2024-04-25T02:28:39.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.565+0000 7fd579261640 1 -- 172.21.15.67:0/2517463278 wait complete. 2024-04-25T02:28:39.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.566+0000 7fd579261640 1 Processor -- start 2024-04-25T02:28:39.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.566+0000 7fd579261640 1 -- start start 2024-04-25T02:28:39.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.567+0000 7fd579261640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57406c1d0 0x7fd574151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.567+0000 7fd579261640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5740d2c40 0x7fd5740cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.567+0000 7fd579261640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd57415e400 0x7fd5740cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.567+0000 7fd579261640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd5740d1070 con 0x7fd57406c1d0 2024-04-25T02:28:39.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.567+0000 7fd579261640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd5740d0d90 con 0x7fd57415e400 2024-04-25T02:28:39.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.567+0000 7fd579261640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd5740d01e0 con 0x7fd5740d2c40 2024-04-25T02:28:39.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.567+0000 7fd572ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57406c1d0 0x7fd574151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.567+0000 7fd572ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57406c1d0 0x7fd574151f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54812/0 (socket says 172.21.15.67:54812) 2024-04-25T02:28:39.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.567+0000 7fd572ffd640 1 -- 172.21.15.67:0/44106178 learned_addr learned my addr 172.21.15.67:0/44106178 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:39.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.567+0000 7fd5727fc640 1 --2- 172.21.15.67:0/44106178 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5740d2c40 0x7fd5740cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.567+0000 7fd5737fe640 1 --2- 172.21.15.67:0/44106178 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd57415e400 0x7fd5740cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.567+0000 7fd572ffd640 1 -- 172.21.15.67:0/44106178 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5740d2c40 msgr2=0x7fd5740cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.567+0000 7fd572ffd640 1 --2- 172.21.15.67:0/44106178 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5740d2c40 0x7fd5740cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.567+0000 7fd572ffd640 1 -- 172.21.15.67:0/44106178 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd57415e400 msgr2=0x7fd5740cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.567+0000 7fd572ffd640 1 --2- 172.21.15.67:0/44106178 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd57415e400 0x7fd5740cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.567+0000 7fd572ffd640 1 -- 172.21.15.67:0/44106178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5740c9dc0 con 0x7fd57406c1d0 2024-04-25T02:28:39.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.567+0000 7fd5737fe640 1 --2- 172.21.15.67:0/44106178 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd57415e400 0x7fd5740cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:39.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.567+0000 7fd5727fc640 1 --2- 172.21.15.67:0/44106178 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5740d2c40 0x7fd5740cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:39.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.568+0000 7fd572ffd640 1 --2- 172.21.15.67:0/44106178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57406c1d0 0x7fd574151f60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd56c00efc0 tx=0x7fd56c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:39.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.568+0000 7fd56b7fe640 1 -- 172.21.15.67:0/44106178 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c018020 con 0x7fd57406c1d0 2024-04-25T02:28:39.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.568+0000 7fd56b7fe640 1 -- 172.21.15.67:0/44106178 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd56c014480 con 0x7fd57406c1d0 2024-04-25T02:28:39.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.568+0000 7fd579261640 1 -- 172.21.15.67:0/44106178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5740cc890 con 0x7fd57406c1d0 2024-04-25T02:28:39.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.568+0000 7fd56b7fe640 1 -- 172.21.15.67:0/44106178 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c014850 con 0x7fd57406c1d0 2024-04-25T02:28:39.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.568+0000 7fd579261640 1 -- 172.21.15.67:0/44106178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5740ca040 con 0x7fd57406c1d0 2024-04-25T02:28:39.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.569+0000 7fd579261640 1 -- 172.21.15.67:0/44106178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5740681f0 con 0x7fd57406c1d0 2024-04-25T02:28:39.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.569+0000 7fd56b7fe640 1 -- 172.21.15.67:0/44106178 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd56c005d10 con 0x7fd57406c1d0 2024-04-25T02:28:39.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.570+0000 7fd56b7fe640 1 --2- 172.21.15.67:0/44106178 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd55406be30 0x7fd55406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.570+0000 7fd56b7fe640 1 -- 172.21.15.67:0/44106178 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd56c08b8a0 con 0x7fd57406c1d0 2024-04-25T02:28:39.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.570+0000 7fd5727fc640 1 --2- 172.21.15.67:0/44106178 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd55406be30 0x7fd55406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.570+0000 7fd5727fc640 1 --2- 172.21.15.67:0/44106178 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd55406be30 0x7fd55406e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd5741eac50 tx=0x7fd55c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:39.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.574+0000 7fd56b7fe640 1 -- 172.21.15.67:0/44106178 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd56c022070 con 0x7fd57406c1d0 2024-04-25T02:28:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.757+0000 7fd579261640 1 -- 172.21.15.67:0/44106178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd574067c90 con 0x7fd57406c1d0 2024-04-25T02:28:39.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.758+0000 7fd56b7fe640 1 -- 172.21.15.67:0/44106178 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fd5740c9dc0 con 0x7fd57406c1d0 2024-04-25T02:28:39.762 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-25T02:28:39.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.760+0000 7fd579261640 1 -- 172.21.15.67:0/44106178 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd55406be30 msgr2=0x7fd55406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.760+0000 7fd579261640 1 --2- 172.21.15.67:0/44106178 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd55406be30 0x7fd55406e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd5741eac50 tx=0x7fd55c008040 comp rx=0 tx=0).stop 2024-04-25T02:28:39.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.760+0000 7fd579261640 1 -- 172.21.15.67:0/44106178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57406c1d0 msgr2=0x7fd574151f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.760+0000 7fd579261640 1 --2- 172.21.15.67:0/44106178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57406c1d0 0x7fd574151f60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd56c00efc0 tx=0x7fd56c00c490 comp rx=0 tx=0).stop 2024-04-25T02:28:39.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.760+0000 7fd579261640 1 -- 172.21.15.67:0/44106178 shutdown_connections 2024-04-25T02:28:39.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.760+0000 7fd579261640 1 --2- 172.21.15.67:0/44106178 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd55406be30 0x7fd55406e2f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.760+0000 7fd579261640 1 --2- 172.21.15.67:0/44106178 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd57415e400 0x7fd5740cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.760+0000 7fd579261640 1 --2- 172.21.15.67:0/44106178 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5740d2c40 0x7fd5740cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.760+0000 7fd579261640 1 --2- 172.21.15.67:0/44106178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57406c1d0 0x7fd574151f60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.760+0000 7fd579261640 1 -- 172.21.15.67:0/44106178 >> 172.21.15.67:0/44106178 conn(0x7fd5740d1f10 msgr2=0x7fd57409aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:39.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.760+0000 7fd579261640 1 -- 172.21.15.67:0/44106178 shutdown_connections 2024-04-25T02:28:39.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.760+0000 7fd579261640 1 -- 172.21.15.67:0/44106178 wait complete. 2024-04-25T02:28:39.775 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:28:39.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.874+0000 7f27367ab640 1 Processor -- start 2024-04-25T02:28:39.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.874+0000 7f27367ab640 1 -- start start 2024-04-25T02:28:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.874+0000 7f27367ab640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f273015b090 0x7f273009db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.874+0000 7f27367ab640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27300b2cc0 0x7f273006e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.874+0000 7f27367ab640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27300ad820 con 0x7f273006ea70 2024-04-25T02:28:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.874+0000 7f27367ab640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f27300b3260 con 0x7f273015b090 2024-04-25T02:28:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.874+0000 7f27367ab640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f27300b3540 con 0x7f27300b2cc0 2024-04-25T02:28:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.875+0000 7f2734d48640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f273006ea70 0x7f273015ec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49422/0 (socket says 172.21.15.67:49422) 2024-04-25T02:28:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.875+0000 7f2734d48640 1 -- 172.21.15.67:0/2761241319 learned_addr learned my addr 172.21.15.67:0/2761241319 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.875+0000 7f272f7fe640 1 --2- 172.21.15.67:0/2761241319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27300b2cc0 0x7f273006e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.875+0000 7f272ffff640 1 --2- 172.21.15.67:0/2761241319 >> v2:172.21.15.176:3300/0 conn(0x7f273015b090 0x7f273009db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.875+0000 7f272effd640 1 -- 172.21.15.67:0/2761241319 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3498664503 0 0) 0x7f27300ad820 con 0x7f273006ea70 2024-04-25T02:28:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.875+0000 7f272effd640 1 -- 172.21.15.67:0/2761241319 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2718003520 con 0x7f273006ea70 2024-04-25T02:28:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.875+0000 7f272effd640 1 -- 172.21.15.67:0/2761241319 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 160445974 0 0) 0x7f2718003520 con 0x7f273006ea70 2024-04-25T02:28:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.875+0000 7f272ffff640 1 -- 172.21.15.67:0/2761241319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27300b2cc0 msgr2=0x7f273006e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.875+0000 7f272ffff640 1 --2- 172.21.15.67:0/2761241319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27300b2cc0 0x7f273006e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.875+0000 7f272ffff640 1 -- 172.21.15.67:0/2761241319 >> v1:172.21.15.67:6789/0 conn(0x7f273006ea70 legacy=0x7f273015ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.875+0000 7f272ffff640 1 -- 172.21.15.67:0/2761241319 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27300b3820 con 0x7f273015b090 2024-04-25T02:28:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.875+0000 7f272f7fe640 1 --2- 172.21.15.67:0/2761241319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27300b2cc0 0x7f273006e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.876+0000 7f272ffff640 1 --2- 172.21.15.67:0/2761241319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f273015b090 0x7f273009db30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f27200097a0 tx=0x7f272002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3b690885ebf6d15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.876+0000 7f272effd640 1 -- 172.21.15.67:0/2761241319 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720037070 con 0x7f273015b090 2024-04-25T02:28:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.876+0000 7f272effd640 1 -- 172.21.15.67:0/2761241319 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f272002aba0 con 0x7f273015b090 2024-04-25T02:28:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.876+0000 7f272effd640 1 -- 172.21.15.67:0/2761241319 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27280019f0 con 0x7f273015b090 2024-04-25T02:28:39.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.877+0000 7f27367ab640 1 -- 172.21.15.67:0/2761241319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f273015b090 msgr2=0x7f273009db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.877+0000 7f27367ab640 1 --2- 172.21.15.67:0/2761241319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f273015b090 0x7f273009db30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f27200097a0 tx=0x7f272002a110 comp rx=0 tx=0).stop 2024-04-25T02:28:39.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.877+0000 7f27367ab640 1 -- 172.21.15.67:0/2761241319 shutdown_connections 2024-04-25T02:28:39.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.877+0000 7f27367ab640 1 --2- 172.21.15.67:0/2761241319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27300b2cc0 0x7f273006e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.877+0000 7f27367ab640 1 --2- 172.21.15.67:0/2761241319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f273015b090 0x7f273009db30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.877+0000 7f27367ab640 1 -- 172.21.15.67:0/2761241319 >> 172.21.15.67:0/2761241319 conn(0x7f27300b19c0 msgr2=0x7f27300b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:39.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.877+0000 7f27367ab640 1 -- 172.21.15.67:0/2761241319 shutdown_connections 2024-04-25T02:28:39.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.877+0000 7f27367ab640 1 -- 172.21.15.67:0/2761241319 wait complete. 2024-04-25T02:28:39.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.878+0000 7f27367ab640 1 Processor -- start 2024-04-25T02:28:39.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.878+0000 7f27367ab640 1 -- start start 2024-04-25T02:28:39.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.879+0000 7f27367ab640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f273006ea70 0x7f273015ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.879+0000 7f27367ab640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27300b2cc0 0x7f2730142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.879+0000 7f27367ab640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f273015b090 0x7f27301428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.879+0000 7f27367ab640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f273015b470 con 0x7f273006ea70 2024-04-25T02:28:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.879+0000 7f27367ab640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f27300b4f70 con 0x7f273015b090 2024-04-25T02:28:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.879+0000 7f27367ab640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2730070e10 con 0x7f27300b2cc0 2024-04-25T02:28:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.879+0000 7f272ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f273006ea70 0x7f273015ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.879+0000 7f272ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f273006ea70 0x7f273015ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54820/0 (socket says 172.21.15.67:54820) 2024-04-25T02:28:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.879+0000 7f272ffff640 1 -- 172.21.15.67:0/2506443470 learned_addr learned my addr 172.21.15.67:0/2506443470 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.879+0000 7f272f7fe640 1 --2- 172.21.15.67:0/2506443470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27300b2cc0 0x7f2730142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.879+0000 7f2734d48640 1 --2- 172.21.15.67:0/2506443470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f273015b090 0x7f27301428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.879+0000 7f272ffff640 1 -- 172.21.15.67:0/2506443470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27300b2cc0 msgr2=0x7f2730142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.879+0000 7f272ffff640 1 --2- 172.21.15.67:0/2506443470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27300b2cc0 0x7f2730142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.879+0000 7f272ffff640 1 -- 172.21.15.67:0/2506443470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f273015b090 msgr2=0x7f27301428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.879+0000 7f272ffff640 1 --2- 172.21.15.67:0/2506443470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f273015b090 0x7f27301428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.879+0000 7f272ffff640 1 -- 172.21.15.67:0/2506443470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273015bc10 con 0x7f273006ea70 2024-04-25T02:28:39.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.879+0000 7f272ffff640 1 --2- 172.21.15.67:0/2506443470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f273006ea70 0x7f273015ccb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2720035040 tx=0x7f27200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.881+0000 7f272cff9640 1 -- 172.21.15.67:0/2506443470 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272003f070 con 0x7f273006ea70 2024-04-25T02:28:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.881+0000 7f272cff9640 1 -- 172.21.15.67:0/2506443470 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2720043410 con 0x7f273006ea70 2024-04-25T02:28:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.881+0000 7f27367ab640 1 -- 172.21.15.67:0/2506443470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273015bef0 con 0x7f273006ea70 2024-04-25T02:28:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.881+0000 7f272cff9640 1 -- 172.21.15.67:0/2506443470 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720043800 con 0x7f273006ea70 2024-04-25T02:28:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.881+0000 7f27367ab640 1 -- 172.21.15.67:0/2506443470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f273015c4b0 con 0x7f273006ea70 2024-04-25T02:28:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.882+0000 7f27367ab640 1 -- 172.21.15.67:0/2506443470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f273015abd0 con 0x7f273006ea70 2024-04-25T02:28:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.883+0000 7f272cff9640 1 -- 172.21.15.67:0/2506443470 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f272004c440 con 0x7f273006ea70 2024-04-25T02:28:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.883+0000 7f272cff9640 1 --2- 172.21.15.67:0/2506443470 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f271c06be30 0x7f271c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.883+0000 7f272cff9640 1 -- 172.21.15.67:0/2506443470 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f27200acca0 con 0x7f273006ea70 2024-04-25T02:28:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.883+0000 7f272f7fe640 1 --2- 172.21.15.67:0/2506443470 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f271c06be30 0x7f271c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.884+0000 7f272f7fe640 1 --2- 172.21.15.67:0/2506443470 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f271c06be30 0x7f271c06e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2724009560 tx=0x7f2724009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:39.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:39.887+0000 7f272cff9640 1 -- 172.21.15.67:0/2506443470 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f272007b6e0 con 0x7f273006ea70 2024-04-25T02:28:40.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.070+0000 7f27367ab640 1 -- 172.21.15.67:0/2506443470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f273006cdd0 con 0x7f273006ea70 2024-04-25T02:28:40.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.071+0000 7f272cff9640 1 -- 172.21.15.67:0/2506443470 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f272007afe0 con 0x7f273006ea70 2024-04-25T02:28:40.075 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-25T02:28:40.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.072+0000 7f27367ab640 1 -- 172.21.15.67:0/2506443470 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f271c06be30 msgr2=0x7f271c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:40.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.072+0000 7f27367ab640 1 --2- 172.21.15.67:0/2506443470 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f271c06be30 0x7f271c06e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2724009560 tx=0x7f2724009190 comp rx=0 tx=0).stop 2024-04-25T02:28:40.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.072+0000 7f27367ab640 1 -- 172.21.15.67:0/2506443470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f273006ea70 msgr2=0x7f273015ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:40.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.072+0000 7f27367ab640 1 --2- 172.21.15.67:0/2506443470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f273006ea70 0x7f273015ccb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2720035040 tx=0x7f27200046c0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.072+0000 7f27367ab640 1 -- 172.21.15.67:0/2506443470 shutdown_connections 2024-04-25T02:28:40.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.072+0000 7f27367ab640 1 --2- 172.21.15.67:0/2506443470 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f271c06be30 0x7f271c06e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.072+0000 7f27367ab640 1 --2- 172.21.15.67:0/2506443470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f273015b090 0x7f27301428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.072+0000 7f27367ab640 1 --2- 172.21.15.67:0/2506443470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27300b2cc0 0x7f2730142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.072+0000 7f27367ab640 1 --2- 172.21.15.67:0/2506443470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f273006ea70 0x7f273015ccb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.073+0000 7f27367ab640 1 -- 172.21.15.67:0/2506443470 >> 172.21.15.67:0/2506443470 conn(0x7f27300b19c0 msgr2=0x7f27300afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:40.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.073+0000 7f27367ab640 1 -- 172.21.15.67:0/2506443470 shutdown_connections 2024-04-25T02:28:40.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.073+0000 7f27367ab640 1 -- 172.21.15.67:0/2506443470 wait complete. 2024-04-25T02:28:40.087 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:28:40.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.184+0000 7f8b2175a640 1 Processor -- start 2024-04-25T02:28:40.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.184+0000 7f8b2175a640 1 -- start start 2024-04-25T02:28:40.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.185+0000 7f8b2175a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8b1c15ee50 0x7f8b1c0d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.185+0000 7f8b2175a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8b1c15f230 0x7f8b1c0d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.185+0000 7f8b2175a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b1c0d2a30 0x7f8b1c161da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.185+0000 7f8b2175a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8b1c15fba0 con 0x7f8b1c15ee50 2024-04-25T02:28:40.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.185+0000 7f8b2175a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8b1c0d4eb0 con 0x7f8b1c15f230 2024-04-25T02:28:40.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.185+0000 7f8b2175a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8b1c15fe40 con 0x7f8b1c0d2a30 2024-04-25T02:28:40.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.185+0000 7f8b1affd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8b1c15ee50 0x7f8b1c0d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:40.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.185+0000 7f8b1affd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8b1c15ee50 0x7f8b1c0d47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54834/0 (socket says 172.21.15.67:54834) 2024-04-25T02:28:40.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.185+0000 7f8b1affd640 1 -- 172.21.15.67:0/2234291029 learned_addr learned my addr 172.21.15.67:0/2234291029 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:40.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.185+0000 7f8b1affd640 1 -- 172.21.15.67:0/2234291029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b1c0d2a30 msgr2=0x7f8b1c161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:40.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.185+0000 7f8b1affd640 1 --2- 172.21.15.67:0/2234291029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b1c0d2a30 0x7f8b1c161da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.185+0000 7f8b1affd640 1 -- 172.21.15.67:0/2234291029 >> v2:172.21.15.176:3300/0 conn(0x7f8b1c15f230 msgr2=0x7f8b1c0d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:40.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.185+0000 7f8b1affd640 1 --2- 172.21.15.67:0/2234291029 >> v2:172.21.15.176:3300/0 conn(0x7f8b1c15f230 0x7f8b1c0d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.185+0000 7f8b1affd640 1 -- 172.21.15.67:0/2234291029 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1c160120 con 0x7f8b1c15ee50 2024-04-25T02:28:40.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.186+0000 7f8b1affd640 1 --2- 172.21.15.67:0/2234291029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b1c15ee50 0x7f8b1c0d47b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c09d9c0 tx=0x7f8b0c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c946ab695c0167 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:40.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.186+0000 7f8b19ffb640 1 -- 172.21.15.67:0/2234291029 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c036070 con 0x7f8b1c15ee50 2024-04-25T02:28:40.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.186+0000 7f8b19ffb640 1 -- 172.21.15.67:0/2234291029 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b0c031600 con 0x7f8b1c15ee50 2024-04-25T02:28:40.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.186+0000 7f8b19ffb640 1 -- 172.21.15.67:0/2234291029 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0319d0 con 0x7f8b1c15ee50 2024-04-25T02:28:40.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.186+0000 7f8b2175a640 1 -- 172.21.15.67:0/2234291029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b1c15ee50 msgr2=0x7f8b1c0d47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:40.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.186+0000 7f8b2175a640 1 --2- 172.21.15.67:0/2234291029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b1c15ee50 0x7f8b1c0d47b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c09d9c0 tx=0x7f8b0c02a6a0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.186+0000 7f8b2175a640 1 -- 172.21.15.67:0/2234291029 shutdown_connections 2024-04-25T02:28:40.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.186+0000 7f8b2175a640 1 --2- 172.21.15.67:0/2234291029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b1c0d2a30 0x7f8b1c161da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.186+0000 7f8b2175a640 1 --2- 172.21.15.67:0/2234291029 >> v2:172.21.15.176:3300/0 conn(0x7f8b1c15f230 0x7f8b1c0d24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.186+0000 7f8b2175a640 1 --2- 172.21.15.67:0/2234291029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b1c15ee50 0x7f8b1c0d47b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.186+0000 7f8b2175a640 1 -- 172.21.15.67:0/2234291029 >> 172.21.15.67:0/2234291029 conn(0x7f8b1c09d450 msgr2=0x7f8b1c0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:40.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.187+0000 7f8b2175a640 1 -- 172.21.15.67:0/2234291029 shutdown_connections 2024-04-25T02:28:40.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.187+0000 7f8b2175a640 1 -- 172.21.15.67:0/2234291029 wait complete. 2024-04-25T02:28:40.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.188+0000 7f8b2175a640 1 Processor -- start 2024-04-25T02:28:40.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.188+0000 7f8b2175a640 1 -- start start 2024-04-25T02:28:40.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b2175a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b1c0d2a30 0x7f8b1c15b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b2175a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b1c15ee50 0x7f8b1c148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b2175a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b1c15f230 0x7f8b1c149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b2175a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c15f810 con 0x7f8b1c15f230 2024-04-25T02:28:40.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b2175a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c15f690 con 0x7f8b1c15ee50 2024-04-25T02:28:40.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b2175a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8b1c1622e0 con 0x7f8b1c0d2a30 2024-04-25T02:28:40.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b1b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b1c15f230 0x7f8b1c149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:40.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b1b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b1c15f230 0x7f8b1c149510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54848/0 (socket says 172.21.15.67:54848) 2024-04-25T02:28:40.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b1b7fe640 1 -- 172.21.15.67:0/1145379271 learned_addr learned my addr 172.21.15.67:0/1145379271 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:40.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b1a7fc640 1 --2- 172.21.15.67:0/1145379271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b1c15ee50 0x7f8b1c148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:40.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b1affd640 1 --2- 172.21.15.67:0/1145379271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b1c0d2a30 0x7f8b1c15b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:40.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b1b7fe640 1 -- 172.21.15.67:0/1145379271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b1c0d2a30 msgr2=0x7f8b1c15b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:40.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b1b7fe640 1 --2- 172.21.15.67:0/1145379271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b1c0d2a30 0x7f8b1c15b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b1b7fe640 1 -- 172.21.15.67:0/1145379271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b1c15ee50 msgr2=0x7f8b1c148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:40.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b1b7fe640 1 --2- 172.21.15.67:0/1145379271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b1c15ee50 0x7f8b1c148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b1b7fe640 1 -- 172.21.15.67:0/1145379271 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1c15b6a0 con 0x7f8b1c15f230 2024-04-25T02:28:40.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b1b7fe640 1 --2- 172.21.15.67:0/1145379271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b1c15f230 0x7f8b1c149510 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009fd0 tx=0x7f8b1400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:40.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b037fe640 1 -- 172.21.15.67:0/1145379271 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14011830 con 0x7f8b1c15f230 2024-04-25T02:28:40.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b037fe640 1 -- 172.21.15.67:0/1145379271 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b14016070 con 0x7f8b1c15f230 2024-04-25T02:28:40.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b2175a640 1 -- 172.21.15.67:0/1145379271 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b1c15db40 con 0x7f8b1c15f230 2024-04-25T02:28:40.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b037fe640 1 -- 172.21.15.67:0/1145379271 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14011bf0 con 0x7f8b1c15f230 2024-04-25T02:28:40.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.189+0000 7f8b2175a640 1 -- 172.21.15.67:0/1145379271 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b1c15e100 con 0x7f8b1c15f230 2024-04-25T02:28:40.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.190+0000 7f8b2175a640 1 -- 172.21.15.67:0/1145379271 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b1c069110 con 0x7f8b1c15f230 2024-04-25T02:28:40.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.191+0000 7f8b037fe640 1 -- 172.21.15.67:0/1145379271 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b1401b460 con 0x7f8b1c15f230 2024-04-25T02:28:40.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.191+0000 7f8b037fe640 1 --2- 172.21.15.67:0/1145379271 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8b0806be30 0x7f8b0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.192+0000 7f8b037fe640 1 -- 172.21.15.67:0/1145379271 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8b1408aa70 con 0x7f8b1c15f230 2024-04-25T02:28:40.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.192+0000 7f8b1affd640 1 --2- 172.21.15.67:0/1145379271 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8b0806be30 0x7f8b0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:40.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.192+0000 7f8b1affd640 1 --2- 172.21.15.67:0/1145379271 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8b0806be30 0x7f8b0806e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c033000 tx=0x7f8b0c009000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:40.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.196+0000 7f8b037fe640 1 -- 172.21.15.67:0/1145379271 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8b14058d40 con 0x7f8b1c15f230 2024-04-25T02:28:40.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.416+0000 7f8b2175a640 1 -- 172.21.15.67:0/1145379271 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b1c08e200 con 0x7f8b1c15f230 2024-04-25T02:28:40.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.416+0000 7f8b037fe640 1 -- 172.21.15.67:0/1145379271 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5172 (secure 0 0 0) 0x7f8b1405d040 con 0x7f8b1c15f230 2024-04-25T02:28:40.421 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:40.421 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1246739775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1246739775},{"type":"v1","addr":"172.21.15.67:6835","nonce":1246739775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/267757090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":267757090},{"type":"v1","addr":"172.21.15.67:6833","nonce":267757090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/90768677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":90768677},{"type":"v1","addr":"172.21.15.176:6837","nonce":90768677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:28:26.184170+0000","modified":"2024-04-25T02:28:29.181464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/1058053785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1058053785},{"type":"v1","addr":"172.21.15.176:6836","nonce":1058053785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-25T02:28:40.421 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 7 2024-04-25T02:28:40.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.418+0000 7f8b2175a640 1 -- 172.21.15.67:0/1145379271 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8b0806be30 msgr2=0x7f8b0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:40.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.418+0000 7f8b2175a640 1 --2- 172.21.15.67:0/1145379271 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8b0806be30 0x7f8b0806e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c033000 tx=0x7f8b0c009000 comp rx=0 tx=0).stop 2024-04-25T02:28:40.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.418+0000 7f8b2175a640 1 -- 172.21.15.67:0/1145379271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b1c15f230 msgr2=0x7f8b1c149510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:40.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.418+0000 7f8b2175a640 1 --2- 172.21.15.67:0/1145379271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b1c15f230 0x7f8b1c149510 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009fd0 tx=0x7f8b1400b8e0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.418+0000 7f8b2175a640 1 -- 172.21.15.67:0/1145379271 shutdown_connections 2024-04-25T02:28:40.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.418+0000 7f8b2175a640 1 --2- 172.21.15.67:0/1145379271 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8b0806be30 0x7f8b0806e2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.418+0000 7f8b2175a640 1 --2- 172.21.15.67:0/1145379271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b1c15f230 0x7f8b1c149510 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.418+0000 7f8b2175a640 1 --2- 172.21.15.67:0/1145379271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b1c15ee50 0x7f8b1c148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.418+0000 7f8b2175a640 1 --2- 172.21.15.67:0/1145379271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b1c0d2a30 0x7f8b1c15b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.418+0000 7f8b2175a640 1 -- 172.21.15.67:0/1145379271 >> 172.21.15.67:0/1145379271 conn(0x7f8b1c09d450 msgr2=0x7f8b1c0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:40.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.418+0000 7f8b2175a640 1 -- 172.21.15.67:0/1145379271 shutdown_connections 2024-04-25T02:28:40.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.418+0000 7f8b2175a640 1 -- 172.21.15.67:0/1145379271 wait complete. 2024-04-25T02:28:40.434 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:40.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.529+0000 7f0fc266d640 1 Processor -- start 2024-04-25T02:28:40.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.530+0000 7f0fc266d640 1 -- start start 2024-04-25T02:28:40.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.530+0000 7f0fc266d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0fbc15e210 0x7f0fbc06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.530+0000 7f0fc266d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0fbc15e5f0 0x7f0fbc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.530+0000 7f0fc266d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fbc0d2cc0 con 0x7f0fbc0cecc0 2024-04-25T02:28:40.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.530+0000 7f0fc266d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0fbc06c6f0 con 0x7f0fbc15e5f0 2024-04-25T02:28:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.530+0000 7f0fc266d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f0fbc0d2fa0 con 0x7f0fbc15e210 2024-04-25T02:28:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.530+0000 7f0fbb7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0fbc15e5f0 0x7f0fbc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.531+0000 7f0fbb7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0fbc15e5f0 0x7f0fbc06d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54850/0 (socket says 172.21.15.67:54850) 2024-04-25T02:28:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.531+0000 7f0fbb7fe640 1 -- 172.21.15.67:0/281336009 learned_addr learned my addr 172.21.15.67:0/281336009 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.531+0000 7f0fc0c0a640 1 --1- 172.21.15.67:0/281336009 >> v1:172.21.15.67:6789/0 conn(0x7f0fbc0cecc0 0x7f0fbc0d3e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49436/0 (socket says 172.21.15.67:49436) 2024-04-25T02:28:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.531+0000 7f0fbbfff640 1 --2- 172.21.15.67:0/281336009 >> v2:172.21.15.176:3300/0 conn(0x7f0fbc15e210 0x7f0fbc06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.531+0000 7f0fbb7fe640 1 -- 172.21.15.67:0/281336009 >> v2:172.21.15.176:3300/0 conn(0x7f0fbc15e210 msgr2=0x7f0fbc06cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.531+0000 7f0fbb7fe640 1 --2- 172.21.15.67:0/281336009 >> v2:172.21.15.176:3300/0 conn(0x7f0fbc15e210 0x7f0fbc06cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.531+0000 7f0fbb7fe640 1 -- 172.21.15.67:0/281336009 >> v1:172.21.15.67:6789/0 conn(0x7f0fbc0cecc0 legacy=0x7f0fbc0d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.531+0000 7f0fbb7fe640 1 -- 172.21.15.67:0/281336009 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc06c0a0 con 0x7f0fbc15e5f0 2024-04-25T02:28:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.531+0000 7f0fbaffd640 1 -- 172.21.15.67:0/281336009 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1962322788 0 0) 0x7f0fbc0d2cc0 con 0x7f0fbc0cecc0 2024-04-25T02:28:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.531+0000 7f0fbbfff640 1 --2- 172.21.15.67:0/281336009 >> v2:172.21.15.176:3300/0 conn(0x7f0fbc15e210 0x7f0fbc06cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.531+0000 7f0fbb7fe640 1 --2- 172.21.15.67:0/281336009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fbc15e5f0 0x7f0fbc06d0c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009870 tx=0x7f0fb002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896bbfc8dc4ba39b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:40.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.532+0000 7f0fbaffd640 1 -- 172.21.15.67:0/281336009 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0037070 con 0x7f0fbc15e5f0 2024-04-25T02:28:40.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.532+0000 7f0fbaffd640 1 -- 172.21.15.67:0/281336009 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb0032440 con 0x7f0fbc15e5f0 2024-04-25T02:28:40.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.532+0000 7f0fbaffd640 1 -- 172.21.15.67:0/281336009 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0032810 con 0x7f0fbc15e5f0 2024-04-25T02:28:40.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.532+0000 7f0fc266d640 1 -- 172.21.15.67:0/281336009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fbc15e5f0 msgr2=0x7f0fbc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:40.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.532+0000 7f0fc266d640 1 --2- 172.21.15.67:0/281336009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fbc15e5f0 0x7f0fbc06d0c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009870 tx=0x7f0fb002a2a0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.532+0000 7f0fc266d640 1 -- 172.21.15.67:0/281336009 shutdown_connections 2024-04-25T02:28:40.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.532+0000 7f0fc266d640 1 --2- 172.21.15.67:0/281336009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fbc15e5f0 0x7f0fbc06d0c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.532+0000 7f0fc266d640 1 --2- 172.21.15.67:0/281336009 >> v2:172.21.15.176:3300/0 conn(0x7f0fbc15e210 0x7f0fbc06cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.532+0000 7f0fc266d640 1 -- 172.21.15.67:0/281336009 >> 172.21.15.67:0/281336009 conn(0x7f0fbc08dbb0 msgr2=0x7f0fbc09d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:40.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.532+0000 7f0fc266d640 1 -- 172.21.15.67:0/281336009 shutdown_connections 2024-04-25T02:28:40.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.532+0000 7f0fc266d640 1 -- 172.21.15.67:0/281336009 wait complete. 2024-04-25T02:28:40.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.533+0000 7f0fc266d640 1 Processor -- start 2024-04-25T02:28:40.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.533+0000 7f0fc266d640 1 -- start start 2024-04-25T02:28:40.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.534+0000 7f0fc266d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fbc0cecc0 0x7f0fbc1505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.534+0000 7f0fc266d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fbc15e210 0x7f0fbc1f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.534+0000 7f0fc266d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fbc15e5f0 0x7f0fbc160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.534+0000 7f0fc266d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc0d46f0 con 0x7f0fbc0cecc0 2024-04-25T02:28:40.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.534+0000 7f0fc266d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc0d4570 con 0x7f0fbc15e5f0 2024-04-25T02:28:40.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.534+0000 7f0fc266d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0fbc0d4870 con 0x7f0fbc15e210 2024-04-25T02:28:40.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.534+0000 7f0fbbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fbc0cecc0 0x7f0fbc1505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:40.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.534+0000 7f0fbbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fbc0cecc0 0x7f0fbc1505a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54858/0 (socket says 172.21.15.67:54858) 2024-04-25T02:28:40.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.534+0000 7f0fbbfff640 1 -- 172.21.15.67:0/2463239460 learned_addr learned my addr 172.21.15.67:0/2463239460 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:40.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.534+0000 7f0fbb7fe640 1 --2- 172.21.15.67:0/2463239460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fbc15e210 0x7f0fbc1f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:40.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.534+0000 7f0fc0c0a640 1 --2- 172.21.15.67:0/2463239460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fbc15e5f0 0x7f0fbc160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:40.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.535+0000 7f0fbbfff640 1 -- 172.21.15.67:0/2463239460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fbc15e210 msgr2=0x7f0fbc1f3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:40.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.535+0000 7f0fbbfff640 1 --2- 172.21.15.67:0/2463239460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fbc15e210 0x7f0fbc1f3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.535+0000 7f0fbbfff640 1 -- 172.21.15.67:0/2463239460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fbc15e5f0 msgr2=0x7f0fbc160bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:40.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.535+0000 7f0fbbfff640 1 --2- 172.21.15.67:0/2463239460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fbc15e5f0 0x7f0fbc160bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.535+0000 7f0fbbfff640 1 -- 172.21.15.67:0/2463239460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc1f46e0 con 0x7f0fbc0cecc0 2024-04-25T02:28:40.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.535+0000 7f0fbb7fe640 1 --2- 172.21.15.67:0/2463239460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fbc15e210 0x7f0fbc1f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:40.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.535+0000 7f0fc0c0a640 1 --2- 172.21.15.67:0/2463239460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fbc15e5f0 0x7f0fbc160bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:40.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.535+0000 7f0fbbfff640 1 --2- 172.21.15.67:0/2463239460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fbc0cecc0 0x7f0fbc1505a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00e810 tx=0x7f0fac00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:40.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.535+0000 7f0fb8ff9640 1 -- 172.21.15.67:0/2463239460 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac00f040 con 0x7f0fbc0cecc0 2024-04-25T02:28:40.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.535+0000 7f0fb8ff9640 1 -- 172.21.15.67:0/2463239460 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fac004030 con 0x7f0fbc0cecc0 2024-04-25T02:28:40.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.535+0000 7f0fb8ff9640 1 -- 172.21.15.67:0/2463239460 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac004400 con 0x7f0fbc0cecc0 2024-04-25T02:28:40.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.535+0000 7f0fc266d640 1 -- 172.21.15.67:0/2463239460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fbc1f49c0 con 0x7f0fbc0cecc0 2024-04-25T02:28:40.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.535+0000 7f0fc266d640 1 -- 172.21.15.67:0/2463239460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fbc15be80 con 0x7f0fbc0cecc0 2024-04-25T02:28:40.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.536+0000 7f0fc266d640 1 -- 172.21.15.67:0/2463239460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fbc069110 con 0x7f0fbc0cecc0 2024-04-25T02:28:40.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.536+0000 7f0fb8ff9640 1 -- 172.21.15.67:0/2463239460 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0fac00c6d0 con 0x7f0fbc0cecc0 2024-04-25T02:28:40.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.537+0000 7f0fb8ff9640 1 --2- 172.21.15.67:0/2463239460 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f0fa806be30 0x7f0fa806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.537+0000 7f0fb8ff9640 1 -- 172.21.15.67:0/2463239460 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0fac08abc0 con 0x7f0fbc0cecc0 2024-04-25T02:28:40.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.537+0000 7f0fbb7fe640 1 --2- 172.21.15.67:0/2463239460 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f0fa806be30 0x7f0fa806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:40.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.538+0000 7f0fbb7fe640 1 --2- 172.21.15.67:0/2463239460 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f0fa806be30 0x7f0fa806e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0034000 tx=0x7f0fb002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:40.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.541+0000 7f0fb8ff9640 1 -- 172.21.15.67:0/2463239460 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0fac017020 con 0x7f0fbc0cecc0 2024-04-25T02:28:40.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.725+0000 7f0fc266d640 1 -- 172.21.15.67:0/2463239460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0fbc06be80 con 0x7f0fbc0cecc0 2024-04-25T02:28:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.726+0000 7f0fb8ff9640 1 -- 172.21.15.67:0/2463239460 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f0fac059600 con 0x7f0fbc0cecc0 2024-04-25T02:28:40.731 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:40.731 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:27.819641+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:40.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.728+0000 7f0fc266d640 1 -- 172.21.15.67:0/2463239460 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f0fa806be30 msgr2=0x7f0fa806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:40.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.728+0000 7f0fc266d640 1 --2- 172.21.15.67:0/2463239460 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f0fa806be30 0x7f0fa806e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0034000 tx=0x7f0fb002e000 comp rx=0 tx=0).stop 2024-04-25T02:28:40.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.728+0000 7f0fc266d640 1 -- 172.21.15.67:0/2463239460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fbc0cecc0 msgr2=0x7f0fbc1505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:40.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.728+0000 7f0fc266d640 1 --2- 172.21.15.67:0/2463239460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fbc0cecc0 0x7f0fbc1505a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00e810 tx=0x7f0fac00ecd0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.728+0000 7f0fc266d640 1 -- 172.21.15.67:0/2463239460 shutdown_connections 2024-04-25T02:28:40.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.728+0000 7f0fc266d640 1 --2- 172.21.15.67:0/2463239460 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f0fa806be30 0x7f0fa806e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.728+0000 7f0fc266d640 1 --2- 172.21.15.67:0/2463239460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fbc15e5f0 0x7f0fbc160bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.728+0000 7f0fc266d640 1 --2- 172.21.15.67:0/2463239460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fbc15e210 0x7f0fbc1f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.728+0000 7f0fc266d640 1 --2- 172.21.15.67:0/2463239460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fbc0cecc0 0x7f0fbc1505a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.728+0000 7f0fc266d640 1 -- 172.21.15.67:0/2463239460 >> 172.21.15.67:0/2463239460 conn(0x7f0fbc08dbb0 msgr2=0x7f0fbc0c74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:40.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.729+0000 7f0fc266d640 1 -- 172.21.15.67:0/2463239460 shutdown_connections 2024-04-25T02:28:40.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.729+0000 7f0fc266d640 1 -- 172.21.15.67:0/2463239460 wait complete. 2024-04-25T02:28:40.744 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:28:40.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.840+0000 7f33b0eb3640 1 Processor -- start 2024-04-25T02:28:40.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.840+0000 7f33b0eb3640 1 -- start start 2024-04-25T02:28:40.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.841+0000 7f33b0eb3640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f33ac15c230 0x7f33ac071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.841+0000 7f33b0eb3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f33ac0acda0 0x7f33ac0aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.841+0000 7f33b0eb3640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33ac160b20 con 0x7f33ac0aef50 2024-04-25T02:28:40.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.841+0000 7f33b0eb3640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f33ac15c610 con 0x7f33ac0acda0 2024-04-25T02:28:40.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.841+0000 7f33b0eb3640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f33ac0ad230 con 0x7f33ac15c230 2024-04-25T02:28:40.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.841+0000 7f33a3fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f33ac0acda0 0x7f33ac0aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:40.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.841+0000 7f33a3fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f33ac0acda0 0x7f33ac0aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54874/0 (socket says 172.21.15.67:54874) 2024-04-25T02:28:40.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.841+0000 7f33a3fff640 1 -- 172.21.15.67:0/1026596536 learned_addr learned my addr 172.21.15.67:0/1026596536 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:40.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.841+0000 7f33aa59c640 1 --2- 172.21.15.67:0/1026596536 >> v2:172.21.15.176:3300/0 conn(0x7f33ac15c230 0x7f33ac071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:40.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.841+0000 7f33a3fff640 1 -- 172.21.15.67:0/1026596536 >> v2:172.21.15.176:3300/0 conn(0x7f33ac15c230 msgr2=0x7f33ac071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:40.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.841+0000 7f33a3fff640 1 --2- 172.21.15.67:0/1026596536 >> v2:172.21.15.176:3300/0 conn(0x7f33ac15c230 0x7f33ac071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.841+0000 7f33a3fff640 1 -- 172.21.15.67:0/1026596536 >> v1:172.21.15.176:6789/0 conn(0x7f33ac0aef50 legacy=0x7f33ac0722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:40.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.841+0000 7f33a3fff640 1 -- 172.21.15.67:0/1026596536 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33ac15fd60 con 0x7f33ac0acda0 2024-04-25T02:28:40.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.842+0000 7f33a3fff640 1 --2- 172.21.15.67:0/1026596536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33ac0acda0 0x7f33ac0aea10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f33ac06c070 tx=0x7f339402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b132fd5a534171 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:40.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.842+0000 7f33a9d9b640 1 -- 172.21.15.67:0/1026596536 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394037070 con 0x7f33ac0acda0 2024-04-25T02:28:40.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.842+0000 7f33a9d9b640 1 -- 172.21.15.67:0/1026596536 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3394032440 con 0x7f33ac0acda0 2024-04-25T02:28:40.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.842+0000 7f33a9d9b640 1 -- 172.21.15.67:0/1026596536 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394032810 con 0x7f33ac0acda0 2024-04-25T02:28:40.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.843+0000 7f33b0eb3640 1 -- 172.21.15.67:0/1026596536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33ac0acda0 msgr2=0x7f33ac0aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:40.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.843+0000 7f33b0eb3640 1 --2- 172.21.15.67:0/1026596536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33ac0acda0 0x7f33ac0aea10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f33ac06c070 tx=0x7f339402a230 comp rx=0 tx=0).stop 2024-04-25T02:28:40.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.843+0000 7f33b0eb3640 1 -- 172.21.15.67:0/1026596536 shutdown_connections 2024-04-25T02:28:40.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.843+0000 7f33b0eb3640 1 --2- 172.21.15.67:0/1026596536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33ac0acda0 0x7f33ac0aea10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.843+0000 7f33b0eb3640 1 --2- 172.21.15.67:0/1026596536 >> v2:172.21.15.176:3300/0 conn(0x7f33ac15c230 0x7f33ac071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.843+0000 7f33b0eb3640 1 -- 172.21.15.67:0/1026596536 >> 172.21.15.67:0/1026596536 conn(0x7f33ac0b19c0 msgr2=0x7f33ac0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:40.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.843+0000 7f33b0eb3640 1 -- 172.21.15.67:0/1026596536 shutdown_connections 2024-04-25T02:28:40.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.843+0000 7f33b0eb3640 1 -- 172.21.15.67:0/1026596536 wait complete. 2024-04-25T02:28:40.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.844+0000 7f33b0eb3640 1 Processor -- start 2024-04-25T02:28:40.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.844+0000 7f33b0eb3640 1 -- start start 2024-04-25T02:28:40.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.845+0000 7f33b0eb3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33ac0acda0 0x7f33ac15f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.845+0000 7f33b0eb3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33ac0aef50 0x7f33ac1467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.845+0000 7f33b0eb3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33ac15c230 0x7f33ac09d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.845+0000 7f33b0eb3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f33ac160600 con 0x7f33ac0aef50 2024-04-25T02:28:40.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.845+0000 7f33b0eb3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f33ac160320 con 0x7f33ac0acda0 2024-04-25T02:28:40.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.845+0000 7f33b0eb3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f33ac06db80 con 0x7f33ac15c230 2024-04-25T02:28:40.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.845+0000 7f33a3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33ac0aef50 0x7f33ac1467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:40.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.845+0000 7f33a3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33ac0aef50 0x7f33ac1467c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54890/0 (socket says 172.21.15.67:54890) 2024-04-25T02:28:40.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.845+0000 7f33a3fff640 1 -- 172.21.15.67:0/1701949094 learned_addr learned my addr 172.21.15.67:0/1701949094 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:40.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.845+0000 7f33aa59c640 1 --2- 172.21.15.67:0/1701949094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33ac0acda0 0x7f33ac15f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:40.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.845+0000 7f33aad9d640 1 --2- 172.21.15.67:0/1701949094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33ac15c230 0x7f33ac09d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:40.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.845+0000 7f33a3fff640 1 -- 172.21.15.67:0/1701949094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33ac15c230 msgr2=0x7f33ac09d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:40.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.845+0000 7f33a3fff640 1 --2- 172.21.15.67:0/1701949094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33ac15c230 0x7f33ac09d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.845+0000 7f33a3fff640 1 -- 172.21.15.67:0/1701949094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33ac0acda0 msgr2=0x7f33ac15f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:40.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.845+0000 7f33a3fff640 1 --2- 172.21.15.67:0/1701949094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33ac0acda0 0x7f33ac15f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.845+0000 7f33a3fff640 1 -- 172.21.15.67:0/1701949094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33ac09c1f0 con 0x7f33ac0aef50 2024-04-25T02:28:40.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.845+0000 7f33a3fff640 1 --2- 172.21.15.67:0/1701949094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33ac0aef50 0x7f33ac1467c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f339402a270 tx=0x7f33940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:40.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.846+0000 7f33a2ffd640 1 -- 172.21.15.67:0/1701949094 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394041020 con 0x7f33ac0aef50 2024-04-25T02:28:40.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.846+0000 7f33a2ffd640 1 -- 172.21.15.67:0/1701949094 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33940306c0 con 0x7f33ac0aef50 2024-04-25T02:28:40.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.846+0000 7f33b0eb3640 1 -- 172.21.15.67:0/1701949094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33ac09c4d0 con 0x7f33ac0aef50 2024-04-25T02:28:40.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.846+0000 7f33a2ffd640 1 -- 172.21.15.67:0/1701949094 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394037040 con 0x7f33ac0aef50 2024-04-25T02:28:40.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.846+0000 7f33b0eb3640 1 -- 172.21.15.67:0/1701949094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33ac09ca90 con 0x7f33ac0aef50 2024-04-25T02:28:40.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.847+0000 7f33b0eb3640 1 -- 172.21.15.67:0/1701949094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33ac069110 con 0x7f33ac0aef50 2024-04-25T02:28:40.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.847+0000 7f33a2ffd640 1 -- 172.21.15.67:0/1701949094 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3394044020 con 0x7f33ac0aef50 2024-04-25T02:28:40.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.848+0000 7f33a2ffd640 1 --2- 172.21.15.67:0/1701949094 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f338c06be30 0x7f338c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:40.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.848+0000 7f33a2ffd640 1 -- 172.21.15.67:0/1701949094 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f33940ab720 con 0x7f33ac0aef50 2024-04-25T02:28:40.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.848+0000 7f33aa59c640 1 --2- 172.21.15.67:0/1701949094 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f338c06be30 0x7f338c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:40.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.848+0000 7f33aa59c640 1 --2- 172.21.15.67:0/1701949094 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f338c06be30 0x7f338c06e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f339c006fd0 tx=0x7f339c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:40.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:40.852+0000 7f33a2ffd640 1 -- 172.21.15.67:0/1701949094 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f339404b030 con 0x7f33ac0aef50 2024-04-25T02:28:41.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.074+0000 7f33b0eb3640 1 -- 172.21.15.67:0/1701949094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33ac06e1b0 con 0x7f33ac0aef50 2024-04-25T02:28:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.075+0000 7f33a2ffd640 1 -- 172.21.15.67:0/1701949094 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5172 (secure 0 0 0) 0x7f339407a050 con 0x7f33ac0aef50 2024-04-25T02:28:41.079 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:41.079 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1246739775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1246739775},{"type":"v1","addr":"172.21.15.67:6835","nonce":1246739775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/267757090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":267757090},{"type":"v1","addr":"172.21.15.67:6833","nonce":267757090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/90768677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":90768677},{"type":"v1","addr":"172.21.15.176:6837","nonce":90768677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:28:26.184170+0000","modified":"2024-04-25T02:28:29.181464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/1058053785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1058053785},{"type":"v1","addr":"172.21.15.176:6836","nonce":1058053785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-25T02:28:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 7 2024-04-25T02:28:41.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.077+0000 7f33b0eb3640 1 -- 172.21.15.67:0/1701949094 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f338c06be30 msgr2=0x7f338c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:41.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.077+0000 7f33b0eb3640 1 --2- 172.21.15.67:0/1701949094 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f338c06be30 0x7f338c06e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f339c006fd0 tx=0x7f339c008040 comp rx=0 tx=0).stop 2024-04-25T02:28:41.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.077+0000 7f33b0eb3640 1 -- 172.21.15.67:0/1701949094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33ac0aef50 msgr2=0x7f33ac1467c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:41.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.077+0000 7f33b0eb3640 1 --2- 172.21.15.67:0/1701949094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33ac0aef50 0x7f33ac1467c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f339402a270 tx=0x7f33940046c0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.077+0000 7f33b0eb3640 1 -- 172.21.15.67:0/1701949094 shutdown_connections 2024-04-25T02:28:41.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.077+0000 7f33b0eb3640 1 --2- 172.21.15.67:0/1701949094 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f338c06be30 0x7f338c06e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.077+0000 7f33b0eb3640 1 --2- 172.21.15.67:0/1701949094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33ac15c230 0x7f33ac09d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.077+0000 7f33b0eb3640 1 --2- 172.21.15.67:0/1701949094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33ac0aef50 0x7f33ac1467c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.077+0000 7f33b0eb3640 1 --2- 172.21.15.67:0/1701949094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33ac0acda0 0x7f33ac15f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.077+0000 7f33b0eb3640 1 -- 172.21.15.67:0/1701949094 >> 172.21.15.67:0/1701949094 conn(0x7f33ac0b19c0 msgr2=0x7f33ac0cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:41.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.077+0000 7f33b0eb3640 1 -- 172.21.15.67:0/1701949094 shutdown_connections 2024-04-25T02:28:41.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.077+0000 7f33b0eb3640 1 -- 172.21.15.67:0/1701949094 wait complete. 2024-04-25T02:28:41.494 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:28:26.184170+0000', 'modified': '2024-04-25T02:28:29.181464+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.176:6836/1058053785', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6834', 'nonce': 1058053785}, {'type': 'v1', 'addr': '172.21.15.176:6836', 'nonce': 1058053785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4297, 'qdb_cluster': [4297]} 2024-04-25T02:28:41.495 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:28:41.495 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T02:28:41.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.594+0000 7fa7d4d63640 1 Processor -- start 2024-04-25T02:28:41.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.594+0000 7fa7d4d63640 1 -- start start 2024-04-25T02:28:41.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.595+0000 7fa7d4d63640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa7d00b3b30 0x7fa7d00d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.595+0000 7fa7d4d63640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa7d00d2cf0 0x7fa7d00cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.595+0000 7fa7d4d63640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7d00d0b30 con 0x7fa7d01619d0 2024-04-25T02:28:41.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.595+0000 7fa7d4d63640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa7d00d0e10 con 0x7fa7d00d2cf0 2024-04-25T02:28:41.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.595+0000 7fa7d4d63640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa7d00d10f0 con 0x7fa7d00b3b30 2024-04-25T02:28:41.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.595+0000 7fa7ced9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa7d00d2cf0 0x7fa7d00cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.595+0000 7fa7ced9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa7d00d2cf0 0x7fa7d00cf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54906/0 (socket says 172.21.15.67:54906) 2024-04-25T02:28:41.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.595+0000 7fa7ced9d640 1 -- 172.21.15.67:0/3613226955 learned_addr learned my addr 172.21.15.67:0/3613226955 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:41.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.595+0000 7fa7cdd9b640 1 --2- 172.21.15.67:0/3613226955 >> v2:172.21.15.176:3300/0 conn(0x7fa7d00b3b30 0x7fa7d00d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.595+0000 7fa7ced9d640 1 -- 172.21.15.67:0/3613226955 >> v2:172.21.15.176:3300/0 conn(0x7fa7d00b3b30 msgr2=0x7fa7d00d27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:41.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.595+0000 7fa7ced9d640 1 --2- 172.21.15.67:0/3613226955 >> v2:172.21.15.176:3300/0 conn(0x7fa7d00b3b30 0x7fa7d00d27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.595+0000 7fa7ced9d640 1 -- 172.21.15.67:0/3613226955 >> v1:172.21.15.176:6789/0 conn(0x7fa7d01619d0 legacy=0x7fa7d00d1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:41.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.595+0000 7fa7ced9d640 1 -- 172.21.15.67:0/3613226955 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d00d13d0 con 0x7fa7d00d2cf0 2024-04-25T02:28:41.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.596+0000 7fa7ced9d640 1 --2- 172.21.15.67:0/3613226955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d00d2cf0 0x7fa7d00cf230 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa7d008e6c0 tx=0x7fa7c802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55abd0b72f799a05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:41.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.596+0000 7fa7cd59a640 1 -- 172.21.15.67:0/3613226955 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8036070 con 0x7fa7d00d2cf0 2024-04-25T02:28:41.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.596+0000 7fa7cd59a640 1 -- 172.21.15.67:0/3613226955 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c8031600 con 0x7fa7d00d2cf0 2024-04-25T02:28:41.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.596+0000 7fa7cd59a640 1 -- 172.21.15.67:0/3613226955 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80319d0 con 0x7fa7d00d2cf0 2024-04-25T02:28:41.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.597+0000 7fa7d4d63640 1 -- 172.21.15.67:0/3613226955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d00d2cf0 msgr2=0x7fa7d00cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:41.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.597+0000 7fa7d4d63640 1 --2- 172.21.15.67:0/3613226955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d00d2cf0 0x7fa7d00cf230 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa7d008e6c0 tx=0x7fa7c802a730 comp rx=0 tx=0).stop 2024-04-25T02:28:41.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.597+0000 7fa7d4d63640 1 -- 172.21.15.67:0/3613226955 shutdown_connections 2024-04-25T02:28:41.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.597+0000 7fa7d4d63640 1 --2- 172.21.15.67:0/3613226955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d00d2cf0 0x7fa7d00cf230 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.597+0000 7fa7d4d63640 1 --2- 172.21.15.67:0/3613226955 >> v2:172.21.15.176:3300/0 conn(0x7fa7d00b3b30 0x7fa7d00d27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.597+0000 7fa7d4d63640 1 -- 172.21.15.67:0/3613226955 >> 172.21.15.67:0/3613226955 conn(0x7fa7d009d4b0 msgr2=0x7fa7d00d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:41.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.597+0000 7fa7d4d63640 1 -- 172.21.15.67:0/3613226955 shutdown_connections 2024-04-25T02:28:41.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.597+0000 7fa7d4d63640 1 -- 172.21.15.67:0/3613226955 wait complete. 2024-04-25T02:28:41.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.598+0000 7fa7d4d63640 1 Processor -- start 2024-04-25T02:28:41.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.598+0000 7fa7d4d63640 1 -- start start 2024-04-25T02:28:41.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.599+0000 7fa7d4d63640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d00b3b30 0x7fa7d015c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.599+0000 7fa7d4d63640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7d00d2cf0 0x7fa7d00b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.599+0000 7fa7d4d63640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d01619d0 0x7fa7d00b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.599+0000 7fa7d4d63640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d00d0800 con 0x7fa7d01619d0 2024-04-25T02:28:41.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.599+0000 7fa7d4d63640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d0161db0 con 0x7fa7d00b3b30 2024-04-25T02:28:41.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.599+0000 7fa7d4d63640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa7d00b3240 con 0x7fa7d00d2cf0 2024-04-25T02:28:41.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.599+0000 7fa7ced9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d01619d0 0x7fa7d00b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.599+0000 7fa7ced9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d01619d0 0x7fa7d00b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54912/0 (socket says 172.21.15.67:54912) 2024-04-25T02:28:41.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.599+0000 7fa7ced9d640 1 -- 172.21.15.67:0/2640841945 learned_addr learned my addr 172.21.15.67:0/2640841945 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:41.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.599+0000 7fa7cdd9b640 1 --2- 172.21.15.67:0/2640841945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7d00d2cf0 0x7fa7d00b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.599+0000 7fa7ce59c640 1 --2- 172.21.15.67:0/2640841945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d00b3b30 0x7fa7d015c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.599+0000 7fa7ced9d640 1 -- 172.21.15.67:0/2640841945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7d00d2cf0 msgr2=0x7fa7d00b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:41.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.599+0000 7fa7ced9d640 1 --2- 172.21.15.67:0/2640841945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7d00d2cf0 0x7fa7d00b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.599+0000 7fa7ced9d640 1 -- 172.21.15.67:0/2640841945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d00b3b30 msgr2=0x7fa7d015c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:41.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.599+0000 7fa7ced9d640 1 --2- 172.21.15.67:0/2640841945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d00b3b30 0x7fa7d015c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.599+0000 7fa7ced9d640 1 -- 172.21.15.67:0/2640841945 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d01447d0 con 0x7fa7d01619d0 2024-04-25T02:28:41.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.599+0000 7fa7ce59c640 1 --2- 172.21.15.67:0/2640841945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d00b3b30 0x7fa7d015c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:41.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.599+0000 7fa7cdd9b640 1 --2- 172.21.15.67:0/2640841945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7d00d2cf0 0x7fa7d00b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:41.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.600+0000 7fa7ced9d640 1 --2- 172.21.15.67:0/2640841945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d01619d0 0x7fa7d00b1e30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8034040 tx=0x7fa7c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:41.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.600+0000 7fa7beffd640 1 -- 172.21.15.67:0/2640841945 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8036050 con 0x7fa7d01619d0 2024-04-25T02:28:41.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.600+0000 7fa7beffd640 1 -- 172.21.15.67:0/2640841945 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c8042070 con 0x7fa7d01619d0 2024-04-25T02:28:41.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.600+0000 7fa7d4d63640 1 -- 172.21.15.67:0/2640841945 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d00c7fb0 con 0x7fa7d01619d0 2024-04-25T02:28:41.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.600+0000 7fa7beffd640 1 -- 172.21.15.67:0/2640841945 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8009510 con 0x7fa7d01619d0 2024-04-25T02:28:41.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.600+0000 7fa7d4d63640 1 -- 172.21.15.67:0/2640841945 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d01470b0 con 0x7fa7d01619d0 2024-04-25T02:28:41.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.601+0000 7fa7beffd640 1 -- 172.21.15.67:0/2640841945 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa7c8007bf0 con 0x7fa7d01619d0 2024-04-25T02:28:41.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.602+0000 7fa7beffd640 1 --2- 172.21.15.67:0/2640841945 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa7b006be30 0x7fa7b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.602+0000 7fa7beffd640 1 -- 172.21.15.67:0/2640841945 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa7c80abc90 con 0x7fa7d01619d0 2024-04-25T02:28:41.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.602+0000 7fa7ce59c640 1 --2- 172.21.15.67:0/2640841945 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa7b006be30 0x7fa7b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.603+0000 7fa7ce59c640 1 --2- 172.21.15.67:0/2640841945 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa7b006be30 0x7fa7b006e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0154180 tx=0x7fa7c0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:41.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.603+0000 7fa7d7a77740 1 Processor -- start 2024-04-25T02:28:41.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.603+0000 7fa7d7a77740 1 -- start start 2024-04-25T02:28:41.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7d7a77740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227d1b60 0x562e227844f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7d7a77740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227b4c80 0x562e227b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7d7a77740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227b4540 0x562e22789350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7d7a77740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562e226ecf00 con 0x562e227b4540 2024-04-25T02:28:41.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7d7a77740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562e22695750 con 0x562e227d1b60 2024-04-25T02:28:41.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7d7a77740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x562e226e8ec0 con 0x562e227b4c80 2024-04-25T02:28:41.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7ced9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227b4540 0x562e22789350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7ced9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227b4540 0x562e22789350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54920/0 (socket says 172.21.15.67:54920) 2024-04-25T02:28:41.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7ced9d640 1 -- 172.21.15.67:0/113607640 learned_addr learned my addr 172.21.15.67:0/113607640 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:41.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7ce59c640 1 --2- 172.21.15.67:0/113607640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227d1b60 0x562e227844f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7cdd9b640 1 --2- 172.21.15.67:0/113607640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227b4c80 0x562e227b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7ced9d640 1 -- 172.21.15.67:0/113607640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227b4c80 msgr2=0x562e227b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:41.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7ced9d640 1 --2- 172.21.15.67:0/113607640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227b4c80 0x562e227b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7ced9d640 1 -- 172.21.15.67:0/113607640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227d1b60 msgr2=0x562e227844f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:41.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7ced9d640 1 --2- 172.21.15.67:0/113607640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227d1b60 0x562e227844f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7ced9d640 1 -- 172.21.15.67:0/113607640 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e224012d0 con 0x562e227b4540 2024-04-25T02:28:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7ce59c640 1 --2- 172.21.15.67:0/113607640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227d1b60 0x562e227844f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7ced9d640 1 --2- 172.21.15.67:0/113607640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227b4540 0x562e22789350 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80aa1e0 tx=0x7fa7c8079b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58374488c80d4bb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7affff640 1 -- 172.21.15.67:0/113607640 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80a8070 con 0x562e227b4540 2024-04-25T02:28:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7affff640 1 -- 172.21.15.67:0/113607640 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c8037040 con 0x562e227b4540 2024-04-25T02:28:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.604+0000 7fa7affff640 1 -- 172.21.15.67:0/113607640 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8079f40 con 0x562e227b4540 2024-04-25T02:28:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.605+0000 7fa7d7a77740 1 -- 172.21.15.67:0/113607640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227b4540 msgr2=0x562e22789350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.605+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/113607640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227b4540 0x562e22789350 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80aa1e0 tx=0x7fa7c8079b40 comp rx=0 tx=0).stop 2024-04-25T02:28:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.605+0000 7fa7d7a77740 1 -- 172.21.15.67:0/113607640 shutdown_connections 2024-04-25T02:28:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.605+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/113607640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227b4540 0x562e22789350 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.605+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/113607640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227b4c80 0x562e227b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.605+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/113607640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227d1b60 0x562e227844f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.605+0000 7fa7d7a77740 1 -- 172.21.15.67:0/113607640 >> 172.21.15.67:0/113607640 conn(0x562e22786760 msgr2=0x562e227cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:41.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.605+0000 7fa7d7a77740 1 -- 172.21.15.67:0/113607640 shutdown_connections 2024-04-25T02:28:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.605+0000 7fa7d7a77740 1 -- 172.21.15.67:0/113607640 wait complete. 2024-04-25T02:28:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.606+0000 7fa7d7a77740 1 -- start start 2024-04-25T02:28:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.606+0000 7fa7d7a77740 1 Processor -- start 2024-04-25T02:28:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7d7a77740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227b4c80 0x562e227a1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7d7a77740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227d1b60 0x562e22783250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7d7a77740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 0x562e22783790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7d7a77740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562e226ecf00 con 0x562e227ce0d0 2024-04-25T02:28:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7d7a77740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562e226a8cf0 con 0x562e227b4c80 2024-04-25T02:28:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7d7a77740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x562e22788910 con 0x562e227d1b60 2024-04-25T02:28:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7d7a77740 10 client.0 _ll_register_callbacks cb 0x562e226a86e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:28:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7ced9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 0x562e22783790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7ced9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 0x562e22783790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54930/0 (socket says 172.21.15.67:54930) 2024-04-25T02:28:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7ced9d640 1 -- 172.21.15.67:0/1391549506 learned_addr learned my addr 172.21.15.67:0/1391549506 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7cdd9b640 1 --2- 172.21.15.67:0/1391549506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227d1b60 0x562e22783250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7ce59c640 1 --2- 172.21.15.67:0/1391549506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227b4c80 0x562e227a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7ced9d640 1 -- 172.21.15.67:0/1391549506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227d1b60 msgr2=0x562e22783250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7ced9d640 1 --2- 172.21.15.67:0/1391549506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227d1b60 0x562e22783250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7ced9d640 1 -- 172.21.15.67:0/1391549506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227b4c80 msgr2=0x562e227a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7ced9d640 1 --2- 172.21.15.67:0/1391549506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227b4c80 0x562e227a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7ced9d640 1 -- 172.21.15.67:0/1391549506 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e224cb6b0 con 0x562e227ce0d0 2024-04-25T02:28:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7ce59c640 1 --2- 172.21.15.67:0/1391549506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227b4c80 0x562e227a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7cdd9b640 1 --2- 172.21.15.67:0/1391549506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227d1b60 0x562e22783250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7ced9d640 1 --2- 172.21.15.67:0/1391549506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 0x562e22783790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8079ed0 tx=0x7fa7c8009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1ebaf4ee8dca5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-04-25T02:28:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7ad7fa640 1 -- 172.21.15.67:0/1391549506 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80a8070 con 0x562e227ce0d0 2024-04-25T02:28:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7ad7fa640 1 -- 172.21.15.67:0/1391549506 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa7c8079590 con 0x562e227ce0d0 2024-04-25T02:28:41.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7d7a77740 1 -- 172.21.15.67:0/1391549506 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7c8037040 con 0x562e227ce0d0 2024-04-25T02:28:41.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7ad7fa640 1 -- 172.21.15.67:0/1391549506 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fa7c807e2f0 con 0x562e227ce0d0 2024-04-25T02:28:41.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7d7a77740 10 client.4656 fetch_fsmap learned FSMap version 7 2024-04-25T02:28:41.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.607+0000 7fa7d7a77740 1 -- 172.21.15.67:0/1391549506 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x562e227e1ea0 con 0x562e227ce0d0 2024-04-25T02:28:41.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.608+0000 7fa7ad7fa640 1 -- 172.21.15.67:0/1391549506 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c8037040 con 0x562e227ce0d0 2024-04-25T02:28:41.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.608+0000 7fa7ad7fa640 1 -- 172.21.15.67:0/1391549506 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 7) ==== 3494+0+0 (secure 0 0 0) 0x7fa7c80a3b20 con 0x562e227ce0d0 2024-04-25T02:28:41.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.608+0000 7fa7d7a77740 10 client.4656 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T02:28:41.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.608+0000 7fa7d7a77740 10 client.4656 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T02:28:41.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.608+0000 7fa7d7a77740 20 client.4656 populate_metadata read hostname 'smithi067' 2024-04-25T02:28:41.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.608+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/1391549506 >> [v2:172.21.15.176:6834/1058053785,v1:172.21.15.176:6836/1058053785] conn(0x562e227b1550 0x562e227df130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.608+0000 7fa7d7a77740 4 client.4656 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:28:41.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.608+0000 7fa7d7a77740 1 -- 172.21.15.67:0/1391549506 --> [v2:172.21.15.176:6834/1058053785,v1:172.21.15.176:6836/1058053785] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e226fa440 con 0x562e227b1550 2024-04-25T02:28:41.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.608+0000 7fa7ce59c640 1 --2- 172.21.15.67:0/1391549506 >> [v2:172.21.15.176:6834/1058053785,v1:172.21.15.176:6836/1058053785] conn(0x562e227b1550 0x562e227df130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.608+0000 7fa7ad7fa640 10 client.4656 ms_handle_connect on v2:172.21.15.176:6834/1058053785 2024-04-25T02:28:41.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.608+0000 7fa7ce59c640 1 --2- 172.21.15.67:0/1391549506 >> [v2:172.21.15.176:6834/1058053785,v1:172.21.15.176:6836/1058053785] conn(0x562e227b1550 0x562e227df130 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd7cd807c8a5abef server_cookie=64b3545ce003eb2 in_seq=0 out_seq=0 2024-04-25T02:28:41.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.609+0000 7fa7ad7fa640 1 -- 172.21.15.67:0/1391549506 <== mds.0 v2:172.21.15.176:6834/1058053785 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562e226fa440 con 0x562e227b1550 2024-04-25T02:28:41.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.609+0000 7fa7ad7fa640 10 client.4656 handle_command_reply: tid=0 2024-04-25T02:28:41.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.609+0000 7fa7d7a77740 1 client.4656 shutdown 2024-04-25T02:28:41.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.609+0000 7fa7d7a77740 1 -- 172.21.15.67:0/1391549506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 msgr2=0x562e22783790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:41.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.609+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/1391549506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 0x562e22783790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8079ed0 tx=0x7fa7c8009810 comp rx=0 tx=0).stop 2024-04-25T02:28:41.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.609+0000 7fa7d7a77740 1 -- 172.21.15.67:0/1391549506 shutdown_connections 2024-04-25T02:28:41.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.609+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/1391549506 >> [v2:172.21.15.176:6834/1058053785,v1:172.21.15.176:6836/1058053785] conn(0x562e227b1550 0x562e227df130 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.609+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/1391549506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 0x562e22783790 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.609+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/1391549506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227d1b60 0x562e22783250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.609+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/1391549506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227b4c80 0x562e227a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.609+0000 7fa7ad7fa640 0 client.4656 ms_handle_reset on v2:172.21.15.176:6834/1058053785 2024-04-25T02:28:41.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.609+0000 7fa7d7a77740 1 -- 172.21.15.67:0/1391549506 >> 172.21.15.67:0/1391549506 conn(0x562e227b4540 msgr2=0x562e227b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:41.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.609+0000 7fa7d7a77740 1 -- 172.21.15.67:0/1391549506 shutdown_connections 2024-04-25T02:28:41.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.609+0000 7fa7d7a77740 1 -- 172.21.15.67:0/1391549506 wait complete. 2024-04-25T02:28:41.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.610+0000 7fa7d7a77740 20 client.4656 trim_cache size 0 max 16384 2024-04-25T02:28:41.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.628+0000 7fa7d7a77740 1 Processor -- start 2024-04-25T02:28:41.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.628+0000 7fa7d7a77740 1 -- start start 2024-04-25T02:28:41.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.628+0000 7fa7d7a77740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227b4c80 0x562e227de920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.628+0000 7fa7d7a77740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 0x562e227b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.628+0000 7fa7d7a77740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227d1b60 0x562e227842e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.628+0000 7fa7d7a77740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d01ff8f0 con 0x562e227ce0d0 2024-04-25T02:28:41.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.628+0000 7fa7d7a77740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d0153b30 con 0x562e227b4c80 2024-04-25T02:28:41.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.628+0000 7fa7d7a77740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa7d00ca850 con 0x562e227d1b60 2024-04-25T02:28:41.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.629+0000 7fa7cdd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 0x562e227b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.629+0000 7fa7cdd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 0x562e227b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54936/0 (socket says 172.21.15.67:54936) 2024-04-25T02:28:41.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.629+0000 7fa7cdd9b640 1 -- 172.21.15.67:0/687750281 learned_addr learned my addr 172.21.15.67:0/687750281 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:41.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.629+0000 7fa7ced9d640 1 --2- 172.21.15.67:0/687750281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227d1b60 0x562e227842e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.629+0000 7fa7cdd9b640 1 -- 172.21.15.67:0/687750281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227d1b60 msgr2=0x562e227842e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:41.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.629+0000 7fa7ce59c640 1 --2- 172.21.15.67:0/687750281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227b4c80 0x562e227de920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.629+0000 7fa7cdd9b640 1 --2- 172.21.15.67:0/687750281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227d1b60 0x562e227842e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.629+0000 7fa7cdd9b640 1 -- 172.21.15.67:0/687750281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227b4c80 msgr2=0x562e227de920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:41.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.629+0000 7fa7cdd9b640 1 --2- 172.21.15.67:0/687750281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227b4c80 0x562e227de920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.629+0000 7fa7cdd9b640 1 -- 172.21.15.67:0/687750281 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e2277f850 con 0x562e227ce0d0 2024-04-25T02:28:41.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.629+0000 7fa7cdd9b640 1 --2- 172.21.15.67:0/687750281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 0x562e227b3cd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400f9c0 tx=0x7fa7c400fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd862b831126914 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:41.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.629+0000 7fa7af7fe640 1 -- 172.21.15.67:0/687750281 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4011d10 con 0x562e227ce0d0 2024-04-25T02:28:41.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.629+0000 7fa7af7fe640 1 -- 172.21.15.67:0/687750281 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c4010040 con 0x562e227ce0d0 2024-04-25T02:28:41.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.629+0000 7fa7af7fe640 1 -- 172.21.15.67:0/687750281 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4015620 con 0x562e227ce0d0 2024-04-25T02:28:41.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.630+0000 7fa7d7a77740 1 -- 172.21.15.67:0/687750281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 msgr2=0x562e227b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:41.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.630+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/687750281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 0x562e227b3cd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400f9c0 tx=0x7fa7c400fe80 comp rx=0 tx=0).stop 2024-04-25T02:28:41.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.630+0000 7fa7d7a77740 1 -- 172.21.15.67:0/687750281 shutdown_connections 2024-04-25T02:28:41.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.630+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/687750281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227d1b60 0x562e227842e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.630+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/687750281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 0x562e227b3cd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.630+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/687750281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227b4c80 0x562e227de920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.630+0000 7fa7d7a77740 1 -- 172.21.15.67:0/687750281 >> 172.21.15.67:0/687750281 conn(0x562e227b4540 msgr2=0x562e227cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:41.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.630+0000 7fa7d7a77740 1 -- 172.21.15.67:0/687750281 shutdown_connections 2024-04-25T02:28:41.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.630+0000 7fa7d7a77740 1 -- 172.21.15.67:0/687750281 wait complete. 2024-04-25T02:28:41.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.630+0000 7fa7d7a77740 1 -- start start 2024-04-25T02:28:41.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.630+0000 7fa7d7a77740 1 Processor -- start 2024-04-25T02:28:41.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.631+0000 7fa7d7a77740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227b4c80 0x562e227a0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.631+0000 7fa7d7a77740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 0x562e227b7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.631+0000 7fa7d7a77740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227d1b60 0x562e227ae490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.631+0000 7fa7d7a77740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562e226ecf00 con 0x562e227ce0d0 2024-04-25T02:28:41.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.631+0000 7fa7d7a77740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562e22788910 con 0x562e227d1b60 2024-04-25T02:28:41.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.631+0000 7fa7d7a77740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x562e226a8cf0 con 0x562e227b4c80 2024-04-25T02:28:41.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.631+0000 7fa7d7a77740 10 client.0 _ll_register_callbacks cb 0x7fa7c8031700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:28:41.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.631+0000 7fa7cdd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 0x562e227b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.631+0000 7fa7cdd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 0x562e227b7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54940/0 (socket says 172.21.15.67:54940) 2024-04-25T02:28:41.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.631+0000 7fa7cdd9b640 1 -- 172.21.15.67:0/2429013830 learned_addr learned my addr 172.21.15.67:0/2429013830 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:41.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.631+0000 7fa7ce59c640 1 --2- 172.21.15.67:0/2429013830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227b4c80 0x562e227a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.631+0000 7fa7ced9d640 1 --2- 172.21.15.67:0/2429013830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227d1b60 0x562e227ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7cdd9b640 1 -- 172.21.15.67:0/2429013830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227b4c80 msgr2=0x562e227a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:41.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7cdd9b640 1 --2- 172.21.15.67:0/2429013830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227b4c80 0x562e227a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7cdd9b640 1 -- 172.21.15.67:0/2429013830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227d1b60 msgr2=0x562e227ae490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:41.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7cdd9b640 1 --2- 172.21.15.67:0/2429013830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227d1b60 0x562e227ae490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7cdd9b640 1 -- 172.21.15.67:0/2429013830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e227a0c50 con 0x562e227ce0d0 2024-04-25T02:28:41.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7cdd9b640 1 --2- 172.21.15.67:0/2429013830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 0x562e227b7180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x562e227afc00 tx=0x7fa7c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe32979cde6dd4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:41.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-04-25T02:28:41.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7ad7fa640 1 -- 172.21.15.67:0/2429013830 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c402c060 con 0x562e227ce0d0 2024-04-25T02:28:41.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7ad7fa640 1 -- 172.21.15.67:0/2429013830 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa7c4015610 con 0x562e227ce0d0 2024-04-25T02:28:41.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7d7a77740 1 -- 172.21.15.67:0/2429013830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7c4010040 con 0x562e227ce0d0 2024-04-25T02:28:41.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7ad7fa640 1 -- 172.21.15.67:0/2429013830 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fa7c4032050 con 0x562e227ce0d0 2024-04-25T02:28:41.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7d7a77740 10 client.4662 fetch_fsmap learned FSMap version 7 2024-04-25T02:28:41.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7d7a77740 1 -- 172.21.15.67:0/2429013830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x562e227b76c0 con 0x562e227ce0d0 2024-04-25T02:28:41.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7ad7fa640 1 -- 172.21.15.67:0/2429013830 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c4010040 con 0x562e227ce0d0 2024-04-25T02:28:41.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7ad7fa640 1 -- 172.21.15.67:0/2429013830 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 7) ==== 3494+0+0 (secure 0 0 0) 0x7fa7c4035020 con 0x562e227ce0d0 2024-04-25T02:28:41.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7d7a77740 10 client.4662 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T02:28:41.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7d7a77740 10 client.4662 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T02:28:41.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7d7a77740 20 client.4662 populate_metadata read hostname 'smithi067' 2024-04-25T02:28:41.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/2429013830 >> [v2:172.21.15.176:6834/1058053785,v1:172.21.15.176:6836/1058053785] conn(0x562e227f1b30 0x562e227f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:41.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7d7a77740 4 client.4662 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:28:41.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.632+0000 7fa7d7a77740 1 -- 172.21.15.67:0/2429013830 --> [v2:172.21.15.176:6834/1058053785,v1:172.21.15.176:6836/1058053785] -- command(tid 0: {"prefix": "status"}) -- 0x562e226f4790 con 0x562e227f1b30 2024-04-25T02:28:41.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.633+0000 7fa7ce59c640 1 --2- 172.21.15.67:0/2429013830 >> [v2:172.21.15.176:6834/1058053785,v1:172.21.15.176:6836/1058053785] conn(0x562e227f1b30 0x562e227f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:41.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.633+0000 7fa7ce59c640 1 --2- 172.21.15.67:0/2429013830 >> [v2:172.21.15.176:6834/1058053785,v1:172.21.15.176:6836/1058053785] conn(0x562e227f1b30 0x562e227f1f10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c724df6eef01bfd9 server_cookie=b756a04ad3137fee in_seq=0 out_seq=0 2024-04-25T02:28:41.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.633+0000 7fa7ad7fa640 10 client.4662 ms_handle_connect on v2:172.21.15.176:6834/1058053785 2024-04-25T02:28:41.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.633+0000 7fa7ad7fa640 1 -- 172.21.15.67:0/2429013830 <== mds.0 v2:172.21.15.176:6834/1058053785 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x562e226f4790 con 0x562e227f1b30 2024-04-25T02:28:41.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.633+0000 7fa7ad7fa640 10 client.4662 handle_command_reply: tid=0 2024-04-25T02:28:41.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.633+0000 7fa7d7a77740 1 client.4662 shutdown 2024-04-25T02:28:41.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.633+0000 7fa7d7a77740 1 -- 172.21.15.67:0/2429013830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 msgr2=0x562e227b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:41.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.633+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/2429013830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 0x562e227b7180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x562e227afc00 tx=0x7fa7c4004730 comp rx=0 tx=0).stop 2024-04-25T02:28:41.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.633+0000 7fa7d7a77740 1 -- 172.21.15.67:0/2429013830 shutdown_connections 2024-04-25T02:28:41.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.633+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/2429013830 >> [v2:172.21.15.176:6834/1058053785,v1:172.21.15.176:6836/1058053785] conn(0x562e227f1b30 0x562e227f1f10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.633+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/2429013830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562e227d1b60 0x562e227ae490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.633+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/2429013830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e227ce0d0 0x562e227b7180 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.633+0000 7fa7d7a77740 1 --2- 172.21.15.67:0/2429013830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562e227b4c80 0x562e227a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.633+0000 7fa7ad7fa640 0 client.4662 ms_handle_reset on v2:172.21.15.176:6834/1058053785 2024-04-25T02:28:41.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.633+0000 7fa7d7a77740 1 -- 172.21.15.67:0/2429013830 >> 172.21.15.67:0/2429013830 conn(0x562e227b4540 msgr2=0x562e227842e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:41.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.633+0000 7fa7d7a77740 1 -- 172.21.15.67:0/2429013830 shutdown_connections 2024-04-25T02:28:41.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.633+0000 7fa7d7a77740 1 -- 172.21.15.67:0/2429013830 wait complete. 2024-04-25T02:28:41.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.633+0000 7fa7d7a77740 20 client.4662 trim_cache size 0 max 16384 2024-04-25T02:28:41.644 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-25T02:28:41.644 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "84283662-9e10-4d0d-b377-8e43b1f6e3af", 2024-04-25T02:28:41.644 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-04-25T02:28:41.644 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 4297, 2024-04-25T02:28:41.644 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-04-25T02:28:41.644 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-04-25T02:28:41.644 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-04-25T02:28:41.644 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 14.813176177000001, 2024-04-25T02:28:41.644 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 7, 2024-04-25T02:28:41.644 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 20, 2024-04-25T02:28:41.645 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 20, 2024-04-25T02:28:41.645 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 21.709199277 2024-04-25T02:28:41.645 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-25T02:28:41.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.634+0000 7fa7d4d63640 1 -- 172.21.15.67:0/2640841945 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa7b006be30 msgr2=0x7fa7b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:41.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.634+0000 7fa7d4d63640 1 --2- 172.21.15.67:0/2640841945 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa7b006be30 0x7fa7b006e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0154180 tx=0x7fa7c0009040 comp rx=0 tx=0).stop 2024-04-25T02:28:41.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.634+0000 7fa7d4d63640 1 -- 172.21.15.67:0/2640841945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d01619d0 msgr2=0x7fa7d00b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:41.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.634+0000 7fa7d4d63640 1 --2- 172.21.15.67:0/2640841945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d01619d0 0x7fa7d00b1e30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8034040 tx=0x7fa7c8004a40 comp rx=0 tx=0).stop 2024-04-25T02:28:41.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.634+0000 7fa7d4d63640 1 -- 172.21.15.67:0/2640841945 shutdown_connections 2024-04-25T02:28:41.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.634+0000 7fa7d4d63640 1 --2- 172.21.15.67:0/2640841945 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa7b006be30 0x7fa7b006e2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.634+0000 7fa7d4d63640 1 --2- 172.21.15.67:0/2640841945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d01619d0 0x7fa7d00b1e30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.634+0000 7fa7d4d63640 1 --2- 172.21.15.67:0/2640841945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7d00d2cf0 0x7fa7d00b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.634+0000 7fa7d4d63640 1 --2- 172.21.15.67:0/2640841945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d00b3b30 0x7fa7d015c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:41.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.634+0000 7fa7d4d63640 1 -- 172.21.15.67:0/2640841945 >> 172.21.15.67:0/2640841945 conn(0x7fa7d009d4b0 msgr2=0x7fa7d006cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:41.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.634+0000 7fa7d4d63640 1 -- 172.21.15.67:0/2640841945 shutdown_connections 2024-04-25T02:28:41.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:41.634+0000 7fa7d4d63640 1 -- 172.21.15.67:0/2640841945 wait complete. 2024-04-25T02:28:41.649 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T02:28:41.659 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T02:28:41.659 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T02:28:41.659 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T02:28:41.659 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T02:28:41.711 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T02:28:41.712 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-25T02:28:41.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:41.712 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-04-25T02:28:41.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:41.728 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2024-04-25T02:28:41.794 INFO:teuthology.orchestra.run.smithi067.stderr:Cannot find device "ceph-brx" 2024-04-25T02:28:41.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:28:41.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:41.796 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-04-25T02:28:41.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:41.851 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2024-04-25T02:28:41.916 INFO:teuthology.orchestra.run.smithi067.stderr:Cannot find device "ceph-brx" 2024-04-25T02:28:41.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:28:41.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:41.917 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-04-25T02:28:41.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:41.936 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-04-25T02:28:42.007 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-04-25T02:28:42.008 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:28:42.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:42.009 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-04-25T02:28:42.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:42.066 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-04-25T02:28:42.134 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-04-25T02:28:42.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:28:42.135 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-25T02:28:42.136 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T02:28:42.136 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:28:42.136 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:28:42.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.233+0000 7f2d9a2f5640 1 Processor -- start 2024-04-25T02:28:42.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.233+0000 7f2d9a2f5640 1 -- start start 2024-04-25T02:28:42.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.233+0000 7f2d9a2f5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d9415e5f0 0x7f2d940cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:42.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.233+0000 7f2d9a2f5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2d940cf200 0x7f2d940d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:42.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.233+0000 7f2d9a2f5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d940d2cc0 con 0x7f2d9415e210 2024-04-25T02:28:42.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.233+0000 7f2d9a2f5640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2d9406c6f0 con 0x7f2d940cf200 2024-04-25T02:28:42.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.233+0000 7f2d9a2f5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2d940d2fa0 con 0x7f2d9415e5f0 2024-04-25T02:28:42.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d93fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2d9415e210 0x7f2d9406cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36110/0 (socket says 172.21.15.67:36110) 2024-04-25T02:28:42.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d93fff640 1 -- 172.21.15.67:0/1064268622 learned_addr learned my addr 172.21.15.67:0/1064268622 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:42.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d92ffd640 1 -- 172.21.15.67:0/1064268622 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 87909784 0 0) 0x7f2d940d2cc0 con 0x7f2d9415e210 2024-04-25T02:28:42.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d937fe640 1 --2- 172.21.15.67:0/1064268622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d9415e5f0 0x7f2d940cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:42.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d98892640 1 --2- 172.21.15.67:0/1064268622 >> v2:172.21.15.176:3300/0 conn(0x7f2d940cf200 0x7f2d940d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:42.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d92ffd640 1 -- 172.21.15.67:0/1064268622 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d7c003520 con 0x7f2d9415e210 2024-04-25T02:28:42.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d92ffd640 1 -- 172.21.15.67:0/1064268622 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 212844536 0 0) 0x7f2d7c003520 con 0x7f2d9415e210 2024-04-25T02:28:42.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d92ffd640 1 -- 172.21.15.67:0/1064268622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d9415e5f0 msgr2=0x7f2d940cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:42.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d92ffd640 1 --2- 172.21.15.67:0/1064268622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d9415e5f0 0x7f2d940cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:42.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d92ffd640 1 -- 172.21.15.67:0/1064268622 >> v2:172.21.15.176:3300/0 conn(0x7f2d940cf200 msgr2=0x7f2d940d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:42.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d92ffd640 1 --2- 172.21.15.67:0/1064268622 >> v2:172.21.15.176:3300/0 conn(0x7f2d940cf200 0x7f2d940d3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:42.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d92ffd640 1 -- 172.21.15.67:0/1064268622 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d9406c0a0 con 0x7f2d9415e210 2024-04-25T02:28:42.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d92ffd640 1 -- 172.21.15.67:0/1064268622 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f2d84001670 con 0x7f2d9415e210 2024-04-25T02:28:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d92ffd640 1 -- 172.21.15.67:0/1064268622 >> v1:172.21.15.67:6789/0 conn(0x7f2d9415e210 legacy=0x7f2d9406cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d92ffd640 1 --2- 172.21.15.67:0/1064268622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d7c0039b0 0x7f2d7c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d92ffd640 1 --2- 172.21.15.67:0/1064268622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d7c004800 0x7f2d7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d92ffd640 1 --2- 172.21.15.67:0/1064268622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d9415e5f0 0x7f2d7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d92ffd640 1 -- 172.21.15.67:0/1064268622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9406c6f0 con 0x7f2d7c0039b0 2024-04-25T02:28:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d92ffd640 1 -- 172.21.15.67:0/1064268622 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2d940d2fa0 con 0x7f2d7c004800 2024-04-25T02:28:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d92ffd640 1 -- 172.21.15.67:0/1064268622 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2d7c00b9c0 con 0x7f2d9415e5f0 2024-04-25T02:28:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d93fff640 1 --2- 172.21.15.67:0/1064268622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d7c0039b0 0x7f2d7c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d937fe640 1 --2- 172.21.15.67:0/1064268622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d7c004800 0x7f2d7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.234+0000 7f2d98892640 1 --2- 172.21.15.67:0/1064268622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d9415e5f0 0x7f2d7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.235+0000 7f2d93fff640 1 -- 172.21.15.67:0/1064268622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d9415e5f0 msgr2=0x7f2d7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.235+0000 7f2d93fff640 1 --2- 172.21.15.67:0/1064268622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d9415e5f0 0x7f2d7c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.235+0000 7f2d93fff640 1 -- 172.21.15.67:0/1064268622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d7c004800 msgr2=0x7f2d7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:42.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.235+0000 7f2d93fff640 1 --2- 172.21.15.67:0/1064268622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d7c004800 0x7f2d7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.235+0000 7f2d93fff640 1 -- 172.21.15.67:0/1064268622 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7c003520 con 0x7f2d7c0039b0 2024-04-25T02:28:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.235+0000 7f2d93fff640 1 --2- 172.21.15.67:0/1064268622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d7c0039b0 0x7f2d7c003dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400c240 tx=0x7f2d7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd197610b0e2c4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.235+0000 7f2d92ffd640 1 -- 172.21.15.67:0/1064268622 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d8402e070 con 0x7f2d7c0039b0 2024-04-25T02:28:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.235+0000 7f2d92ffd640 1 -- 172.21.15.67:0/1064268622 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d84005af0 con 0x7f2d7c0039b0 2024-04-25T02:28:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.235+0000 7f2d92ffd640 1 -- 172.21.15.67:0/1064268622 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d84007d30 con 0x7f2d7c0039b0 2024-04-25T02:28:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.236+0000 7f2d9a2f5640 1 -- 172.21.15.67:0/1064268622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d7c0039b0 msgr2=0x7f2d7c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.236+0000 7f2d9a2f5640 1 --2- 172.21.15.67:0/1064268622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d7c0039b0 0x7f2d7c003dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400c240 tx=0x7f2d7c005830 comp rx=0 tx=0).stop 2024-04-25T02:28:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.236+0000 7f2d98892640 1 -- 172.21.15.67:0/1064268622 reap_dead start 2024-04-25T02:28:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.236+0000 7f2d9a2f5640 1 -- 172.21.15.67:0/1064268622 shutdown_connections 2024-04-25T02:28:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.236+0000 7f2d9a2f5640 1 -- 172.21.15.67:0/1064268622 >> 172.21.15.67:0/1064268622 conn(0x7f2d9408dbb0 msgr2=0x7f2d9409d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.236+0000 7f2d9a2f5640 1 -- 172.21.15.67:0/1064268622 shutdown_connections 2024-04-25T02:28:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.236+0000 7f2d9a2f5640 1 -- 172.21.15.67:0/1064268622 wait complete. 2024-04-25T02:28:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.237+0000 7f2d9a2f5640 1 Processor -- start 2024-04-25T02:28:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.237+0000 7f2d9a2f5640 1 -- start start 2024-04-25T02:28:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.238+0000 7f2d9a2f5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d7c0039b0 0x7f2d9415ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.238+0000 7f2d9a2f5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d940b9730 0x7f2d94146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.238+0000 7f2d9a2f5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d940b50a0 0x7f2d940b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.238+0000 7f2d9a2f5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9406d410 con 0x7f2d940b9730 2024-04-25T02:28:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.238+0000 7f2d9a2f5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9406d290 con 0x7f2d940b50a0 2024-04-25T02:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.238+0000 7f2d9a2f5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2d940cecc0 con 0x7f2d7c0039b0 2024-04-25T02:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.238+0000 7f2d937fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d940b9730 0x7f2d94146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.238+0000 7f2d937fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d940b9730 0x7f2d94146eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42016/0 (socket says 172.21.15.67:42016) 2024-04-25T02:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.238+0000 7f2d937fe640 1 -- 172.21.15.67:0/3686618443 learned_addr learned my addr 172.21.15.67:0/3686618443 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.238+0000 7f2d93fff640 1 --2- 172.21.15.67:0/3686618443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d7c0039b0 0x7f2d9415ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.238+0000 7f2d98892640 1 --2- 172.21.15.67:0/3686618443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d940b50a0 0x7f2d940b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.239+0000 7f2d937fe640 1 -- 172.21.15.67:0/3686618443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d7c0039b0 msgr2=0x7f2d9415ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.239+0000 7f2d937fe640 1 --2- 172.21.15.67:0/3686618443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d7c0039b0 0x7f2d9415ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.239+0000 7f2d937fe640 1 -- 172.21.15.67:0/3686618443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d940b50a0 msgr2=0x7f2d940b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.239+0000 7f2d937fe640 1 --2- 172.21.15.67:0/3686618443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d940b50a0 0x7f2d940b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.239+0000 7f2d937fe640 1 -- 172.21.15.67:0/3686618443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d940b9bb0 con 0x7f2d940b9730 2024-04-25T02:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.239+0000 7f2d937fe640 1 --2- 172.21.15.67:0/3686618443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d940b9730 0x7f2d94146eb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2d880119c0 tx=0x7f2d88011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.239+0000 7f2d90ff9640 1 -- 172.21.15.67:0/3686618443 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d88019070 con 0x7f2d940b9730 2024-04-25T02:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.239+0000 7f2d90ff9640 1 -- 172.21.15.67:0/3686618443 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d88004240 con 0x7f2d940b9730 2024-04-25T02:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.239+0000 7f2d9a2f5640 1 -- 172.21.15.67:0/3686618443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d9415c0b0 con 0x7f2d940b9730 2024-04-25T02:28:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.239+0000 7f2d90ff9640 1 -- 172.21.15.67:0/3686618443 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d8800f880 con 0x7f2d940b9730 2024-04-25T02:28:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.239+0000 7f2d9a2f5640 1 -- 172.21.15.67:0/3686618443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d9415c670 con 0x7f2d940b9730 2024-04-25T02:28:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.240+0000 7f2d9a2f5640 1 -- 172.21.15.67:0/3686618443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d94069110 con 0x7f2d940b9730 2024-04-25T02:28:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.240+0000 7f2d90ff9640 1 -- 172.21.15.67:0/3686618443 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d8801c070 con 0x7f2d940b9730 2024-04-25T02:28:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.241+0000 7f2d90ff9640 1 --2- 172.21.15.67:0/3686618443 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2d8006be30 0x7f2d8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.241+0000 7f2d90ff9640 1 -- 172.21.15.67:0/3686618443 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2d8808b100 con 0x7f2d940b9730 2024-04-25T02:28:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.241+0000 7f2d93fff640 1 --2- 172.21.15.67:0/3686618443 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2d8006be30 0x7f2d8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.241+0000 7f2d93fff640 1 --2- 172.21.15.67:0/3686618443 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2d8006be30 0x7f2d8006e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2d84033000 tx=0x7f2d84009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.245+0000 7f2d90ff9640 1 -- 172.21.15.67:0/3686618443 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2d880594f0 con 0x7f2d940b9730 2024-04-25T02:28:42.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.473+0000 7f2d9a2f5640 1 -- 172.21.15.67:0/3686618443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2d9406be80 con 0x7f2d940b9730 2024-04-25T02:28:42.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.473+0000 7f2d90ff9640 1 -- 172.21.15.67:0/3686618443 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f2d8805d7f0 con 0x7f2d940b9730 2024-04-25T02:28:42.477 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:28:42.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.475+0000 7f2d9a2f5640 1 -- 172.21.15.67:0/3686618443 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2d8006be30 msgr2=0x7f2d8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:42.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.475+0000 7f2d9a2f5640 1 --2- 172.21.15.67:0/3686618443 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2d8006be30 0x7f2d8006e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2d84033000 tx=0x7f2d84009030 comp rx=0 tx=0).stop 2024-04-25T02:28:42.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.475+0000 7f2d9a2f5640 1 -- 172.21.15.67:0/3686618443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d940b9730 msgr2=0x7f2d94146eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:42.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.475+0000 7f2d9a2f5640 1 --2- 172.21.15.67:0/3686618443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d940b9730 0x7f2d94146eb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2d880119c0 tx=0x7f2d88011e80 comp rx=0 tx=0).stop 2024-04-25T02:28:42.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.475+0000 7f2d9a2f5640 1 -- 172.21.15.67:0/3686618443 shutdown_connections 2024-04-25T02:28:42.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.475+0000 7f2d9a2f5640 1 --2- 172.21.15.67:0/3686618443 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2d8006be30 0x7f2d8006e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:42.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.475+0000 7f2d9a2f5640 1 --2- 172.21.15.67:0/3686618443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d940b50a0 0x7f2d940b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:42.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.475+0000 7f2d9a2f5640 1 --2- 172.21.15.67:0/3686618443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d940b9730 0x7f2d94146eb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:42.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.475+0000 7f2d9a2f5640 1 --2- 172.21.15.67:0/3686618443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d7c0039b0 0x7f2d9415ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:42.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.475+0000 7f2d9a2f5640 1 -- 172.21.15.67:0/3686618443 >> 172.21.15.67:0/3686618443 conn(0x7f2d9408dbb0 msgr2=0x7f2d94160af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:42.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.475+0000 7f2d9a2f5640 1 -- 172.21.15.67:0/3686618443 shutdown_connections 2024-04-25T02:28:42.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42.475+0000 7f2d9a2f5640 1 -- 172.21.15.67:0/3686618443 wait complete. 2024-04-25T02:28:42.490 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T02:28:42.490 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:28:42.490 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-04-25T02:28:42.490 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:28:42.490 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:28:42.490 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T02:28:42.490 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T02:28:42.490 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:28:42.490 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:28:42.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:42.491 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-04-25T02:28:42.506 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:28:42.506 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:28:42.506 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:28:42.506 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:42.506 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-04-25T02:28:42.506 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:42.506 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:28:42.507 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-04-25T02:28:42.507 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-04-25T02:28:42.507 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:28:42.507 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-04-25T02:28:42.507 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-04-25T02:28:42.507 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:28:42.507 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:28:42.507 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:28:42.507 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:28:42.507 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:28:42.507 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42741sec preferred_lft 42741sec 2024-04-25T02:28:42.507 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::2c41:8a35:7b1b:25c3/64 scope link noprefixroute 2024-04-25T02:28:42.507 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:42.508 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T02:28:42.508 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:28:42.508 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-25T02:28:42.508 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add name ceph-brx type bridge 2024-04-25T02:28:42.508 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr flush dev ceph-brx 2024-04-25T02:28:42.508 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set ceph-brx up 2024-04-25T02:28:42.508 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T02:28:42.508 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-25T02:28:42.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:42.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:42.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:42.716 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:28:42.739 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-04-25T02:28:42.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:42.741 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-04-25T02:28:42.804 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-04-25T02:28:42.804 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:28:42.804 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:28:42.804 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:28:42.804 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:28:42.805 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:28:42.805 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-25T02:28:42.805 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:28:42.805 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:28:42.805 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:28:42.805 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-25T02:28:42.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:43.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:43.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:43.076 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-04-25T02:28:43.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:43.091 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list-id 2024-04-25T02:28:43.147 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:28:43.147 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-25T02:28:43.147 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:28:43.147 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T02:28:43.147 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-25T02:28:43.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:43.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:43.264 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T02:28:43.264 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:28:43.264 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-25T02:28:43.264 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T02:28:43.264 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T02:28:43.265 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T02:28:43.265 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T02:28:43.265 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T02:28:43.265 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-25T02:28:43.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:43.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:43.395 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:28:43.395 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-25T02:28:43.395 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-04-25T02:28:43.395 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T02:28:43.395 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-25T02:28:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:43.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:43.472 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:28:43.472 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:28:43.487 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:28:43.487 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:28:43.487 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:28:43.541 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:28:43.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:43.542 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:28:43.629 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:28:43.629 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:28:43.629 INFO:teuthology.orchestra.run.smithi067.stdout:invalid new device string format 2024-04-25T02:28:43.729 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:28:43.729 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:28:43.729 INFO:teuthology.orchestra.run.smithi067.stdout:invalid new device string format 2024-04-25T02:28:43.729 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-04-25T02:28:43.730 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:28:43.738 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:28:43.738 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:28:43.738 INFO:teuthology.orchestra.run.smithi067.stdout:invalid new device string format 2024-04-25T02:28:43.738 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-04-25T02:28:43.738 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:28:43.738 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-04-25T02:28:43.738 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.67:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-04-25T02:28:43.738 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=84283662-9e10-4d0d-b377-8e43b1f6e3af" will pass to kernel 2024-04-25T02:28:43.739 INFO:teuthology.orchestra.run.smithi067.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:28:43.739 INFO:teuthology.orchestra.run.smithi067.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:28:43.739 INFO:teuthology.orchestra.run.smithi067.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:28:43.739 INFO:teuthology.orchestra.run.smithi067.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:28:43.739 INFO:teuthology.orchestra.run.smithi067.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:28:43.740 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:28:43.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:43.741 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:28:43.765 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:28:43.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:28:43.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:43.869 INFO:teuthology.orchestra.run.smithi067.stdout:client4472 2024-04-25T02:28:43.869 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:28:43.869 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:28:43.884 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:28:43.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:28:43.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:43.988 INFO:teuthology.orchestra.run.smithi067.stdout:client4472 2024-04-25T02:28:43.988 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:28:44.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:28:44.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:44.050 INFO:teuthology.orchestra.run.smithi067.stdout:client4472 2024-04-25T02:28:44.050 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/84283662-9e10-4d0d-b377-8e43b1f6e3af.client4472/status') 2024-04-25T02:28:44.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:44.114 INFO:teuthology.orchestra.run.smithi067.stdout:instance: client.4472 (3)172.21.15.67:0/3896297376 2024-04-25T02:28:44.115 INFO:teuthology.orchestra.run.smithi067.stdout:blocklisted: false 2024-04-25T02:28:44.115 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2024-04-25T02:28:44.115 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2024-04-25T02:28:44.115 INFO:teuthology.orchestra.run.smithi067.stderr:70 bytes copied, 2.327e-05 s, 3.0 MB/s 2024-04-25T02:28:44.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:44.122 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-25T02:28:44.122 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T02:28:44.122 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T02:28:44.122 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:28:44.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.220+0000 7f4a0e638640 1 Processor -- start 2024-04-25T02:28:44.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.220+0000 7f4a0e638640 1 -- start start 2024-04-25T02:28:44.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.221+0000 7f4a0e638640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4a080d14a0 0x7f4a0806e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:44.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.221+0000 7f4a0e638640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a080b4470 con 0x7f4a08147040 2024-04-25T02:28:44.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.221+0000 7f4a0e638640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a08161f90 con 0x7f4a080d1010 2024-04-25T02:28:44.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.221+0000 7f4a0e638640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f4a081628c0 con 0x7f4a080d14a0 2024-04-25T02:28:44.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.221+0000 7f4a0cbd5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4a080d14a0 0x7f4a0806e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:44.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.221+0000 7f4a07fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f4a08147040 0x7f4a080b3d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36116/0 (socket says 172.21.15.67:36116) 2024-04-25T02:28:44.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.221+0000 7f4a0cbd5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4a080d14a0 0x7f4a0806e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42026/0 (socket says 172.21.15.67:42026) 2024-04-25T02:28:44.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.221+0000 7f4a07fff640 1 -- 172.21.15.67:0/89822652 learned_addr learned my addr 172.21.15.67:0/89822652 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:44.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.221+0000 7f4a0cbd5640 1 -- 172.21.15.67:0/89822652 >> v1:172.21.15.176:6789/0 conn(0x7f4a080d1010 legacy=0x7f4a0806dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:44.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.221+0000 7f4a0cbd5640 1 -- 172.21.15.67:0/89822652 >> v1:172.21.15.67:6789/0 conn(0x7f4a08147040 legacy=0x7f4a080b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:44.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.221+0000 7f4a06ffd640 1 -- 172.21.15.67:0/89822652 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175690514 0 0) 0x7f4a080b4470 con 0x7f4a08147040 2024-04-25T02:28:44.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.221+0000 7f4a0cbd5640 1 -- 172.21.15.67:0/89822652 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a08162270 con 0x7f4a080d14a0 2024-04-25T02:28:44.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.222+0000 7f4a0cbd5640 1 --2- 172.21.15.67:0/89822652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a080d14a0 0x7f4a0806e350 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009d90 tx=0x7f4a0002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9076613155f6cc89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:44.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.222+0000 7f4a06ffd640 1 -- 172.21.15.67:0/89822652 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00007740 con 0x7f4a080d14a0 2024-04-25T02:28:44.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.222+0000 7f4a06ffd640 1 -- 172.21.15.67:0/89822652 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a000078e0 con 0x7f4a080d14a0 2024-04-25T02:28:44.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.222+0000 7f4a06ffd640 1 -- 172.21.15.67:0/89822652 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00007cb0 con 0x7f4a080d14a0 2024-04-25T02:28:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.223+0000 7f4a0e638640 1 -- 172.21.15.67:0/89822652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a080d14a0 msgr2=0x7f4a0806e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.223+0000 7f4a0e638640 1 --2- 172.21.15.67:0/89822652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a080d14a0 0x7f4a0806e350 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009d90 tx=0x7f4a0002a660 comp rx=0 tx=0).stop 2024-04-25T02:28:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.223+0000 7f4a0e638640 1 -- 172.21.15.67:0/89822652 shutdown_connections 2024-04-25T02:28:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.223+0000 7f4a0e638640 1 --2- 172.21.15.67:0/89822652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a080d14a0 0x7f4a0806e350 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.223+0000 7f4a0e638640 1 -- 172.21.15.67:0/89822652 >> 172.21.15.67:0/89822652 conn(0x7f4a0806c3b0 msgr2=0x7f4a0806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.223+0000 7f4a0e638640 1 -- 172.21.15.67:0/89822652 shutdown_connections 2024-04-25T02:28:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.223+0000 7f4a0e638640 1 -- 172.21.15.67:0/89822652 wait complete. 2024-04-25T02:28:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.224+0000 7f4a0e638640 1 Processor -- start 2024-04-25T02:28:44.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.224+0000 7f4a0e638640 1 -- start start 2024-04-25T02:28:44.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.225+0000 7f4a0e638640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a080d1010 0x7f4a08161760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:44.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.225+0000 7f4a0e638640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a080d14a0 0x7f4a0815f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:44.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.225+0000 7f4a0e638640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a08147040 0x7f4a0815d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:44.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.225+0000 7f4a0e638640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4a08162d50 con 0x7f4a08147040 2024-04-25T02:28:44.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.225+0000 7f4a0e638640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4a080d18f0 con 0x7f4a080d1010 2024-04-25T02:28:44.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.225+0000 7f4a0e638640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a080b4740 con 0x7f4a080d14a0 2024-04-25T02:28:44.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.225+0000 7f4a0cbd5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a08147040 0x7f4a0815d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:44.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.225+0000 7f4a0cbd5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a08147040 0x7f4a0815d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42028/0 (socket says 172.21.15.67:42028) 2024-04-25T02:28:44.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.225+0000 7f4a0cbd5640 1 -- 172.21.15.67:0/272399142 learned_addr learned my addr 172.21.15.67:0/272399142 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:44.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.225+0000 7f4a077fe640 1 --2- 172.21.15.67:0/272399142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a080d14a0 0x7f4a0815f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:44.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.225+0000 7f4a07fff640 1 --2- 172.21.15.67:0/272399142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a080d1010 0x7f4a08161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:44.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.226+0000 7f4a0cbd5640 1 -- 172.21.15.67:0/272399142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a080d14a0 msgr2=0x7f4a0815f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:44.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.226+0000 7f4a0cbd5640 1 --2- 172.21.15.67:0/272399142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a080d14a0 0x7f4a0815f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:44.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.226+0000 7f4a0cbd5640 1 -- 172.21.15.67:0/272399142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a080d1010 msgr2=0x7f4a08161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:44.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.226+0000 7f4a0cbd5640 1 --2- 172.21.15.67:0/272399142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a080d1010 0x7f4a08161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:44.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.226+0000 7f4a0cbd5640 1 -- 172.21.15.67:0/272399142 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0815fcb0 con 0x7f4a08147040 2024-04-25T02:28:44.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.226+0000 7f4a077fe640 1 --2- 172.21.15.67:0/272399142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a080d14a0 0x7f4a0815f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:44.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.226+0000 7f4a0cbd5640 1 --2- 172.21.15.67:0/272399142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a08147040 0x7f4a0815d9f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009d90 tx=0x7f4a00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:44.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.226+0000 7f4a04ff9640 1 -- 172.21.15.67:0/272399142 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00040070 con 0x7f4a08147040 2024-04-25T02:28:44.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.226+0000 7f4a04ff9640 1 -- 172.21.15.67:0/272399142 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a00031c90 con 0x7f4a08147040 2024-04-25T02:28:44.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.226+0000 7f4a0e638640 1 -- 172.21.15.67:0/272399142 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0815ff90 con 0x7f4a08147040 2024-04-25T02:28:44.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.226+0000 7f4a04ff9640 1 -- 172.21.15.67:0/272399142 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0003c640 con 0x7f4a08147040 2024-04-25T02:28:44.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.226+0000 7f4a0e638640 1 -- 172.21.15.67:0/272399142 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a081336f0 con 0x7f4a08147040 2024-04-25T02:28:44.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.227+0000 7f4a0e638640 1 -- 172.21.15.67:0/272399142 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a08069110 con 0x7f4a08147040 2024-04-25T02:28:44.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.227+0000 7f4a04ff9640 1 -- 172.21.15.67:0/272399142 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a00039040 con 0x7f4a08147040 2024-04-25T02:28:44.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.228+0000 7f4a04ff9640 1 --2- 172.21.15.67:0/272399142 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f49f406be30 0x7f49f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:44.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.228+0000 7f4a04ff9640 1 -- 172.21.15.67:0/272399142 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4a000ac460 con 0x7f4a08147040 2024-04-25T02:28:44.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.229+0000 7f4a07fff640 1 --2- 172.21.15.67:0/272399142 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f49f406be30 0x7f49f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:44.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.229+0000 7f4a07fff640 1 --2- 172.21.15.67:0/272399142 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f49f406be30 0x7f49f406e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f49fc000f60 tx=0x7f49fc007d00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:44.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.232+0000 7f4a04ff9640 1 -- 172.21.15.67:0/272399142 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4a0007af60 con 0x7f4a08147040 2024-04-25T02:28:44.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.460+0000 7f4a0e638640 1 -- 172.21.15.67:0/272399142 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4a08072bb0 con 0x7f4a08147040 2024-04-25T02:28:44.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.460+0000 7f4a04ff9640 1 -- 172.21.15.67:0/272399142 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f4a0007a860 con 0x7f4a08147040 2024-04-25T02:28:44.463 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:28:44.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.462+0000 7f4a0e638640 1 -- 172.21.15.67:0/272399142 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f49f406be30 msgr2=0x7f49f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:44.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.462+0000 7f4a0e638640 1 --2- 172.21.15.67:0/272399142 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f49f406be30 0x7f49f406e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f49fc000f60 tx=0x7f49fc007d00 comp rx=0 tx=0).stop 2024-04-25T02:28:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.462+0000 7f4a0e638640 1 -- 172.21.15.67:0/272399142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a08147040 msgr2=0x7f4a0815d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.462+0000 7f4a0e638640 1 --2- 172.21.15.67:0/272399142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a08147040 0x7f4a0815d9f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009d90 tx=0x7f4a00004a40 comp rx=0 tx=0).stop 2024-04-25T02:28:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.462+0000 7f4a0e638640 1 -- 172.21.15.67:0/272399142 shutdown_connections 2024-04-25T02:28:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.462+0000 7f4a0e638640 1 --2- 172.21.15.67:0/272399142 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f49f406be30 0x7f49f406e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.462+0000 7f4a0e638640 1 --2- 172.21.15.67:0/272399142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a08147040 0x7f4a0815d9f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.462+0000 7f4a0e638640 1 --2- 172.21.15.67:0/272399142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a080d14a0 0x7f4a0815f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.462+0000 7f4a0e638640 1 --2- 172.21.15.67:0/272399142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a080d1010 0x7f4a08161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.462+0000 7f4a0e638640 1 -- 172.21.15.67:0/272399142 >> 172.21.15.67:0/272399142 conn(0x7f4a0806c3b0 msgr2=0x7f4a080b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.462+0000 7f4a0e638640 1 -- 172.21.15.67:0/272399142 shutdown_connections 2024-04-25T02:28:44.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44.462+0000 7f4a0e638640 1 -- 172.21.15.67:0/272399142 wait complete. 2024-04-25T02:28:44.477 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T02:28:44.477 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:28:44.477 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-04-25T02:28:44.477 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-25T02:28:44.477 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T02:28:44.477 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T02:28:44.477 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T02:28:44.477 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:28:44.477 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-25T02:28:44.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:44.478 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-04-25T02:28:44.493 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:28:44.493 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:28:44.493 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:28:44.493 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:44.493 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-04-25T02:28:44.493 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:44.494 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:28:44.494 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-04-25T02:28:44.494 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-04-25T02:28:44.494 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:28:44.494 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-04-25T02:28:44.494 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-04-25T02:28:44.494 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:28:44.494 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:28:44.494 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:28:44.494 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:28:44.494 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:28:44.494 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42739sec preferred_lft 42739sec 2024-04-25T02:28:44.494 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::2c41:8a35:7b1b:25c3/64 scope link noprefixroute 2024-04-25T02:28:44.494 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:44.495 INFO:teuthology.orchestra.run.smithi067.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:28:44.495 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 8a:24:38:07:b0:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T02:28:44.495 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:28:44.495 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:44.495 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::38fc:9dff:fe1d:572b/64 scope link tentative 2024-04-25T02:28:44.495 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:44.495 INFO:teuthology.orchestra.run.smithi067.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:28:44.495 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 8a:24:38:07:b0:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:28:44.495 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::8824:38ff:fe07:b0dc/64 scope link tentative 2024-04-25T02:28:44.495 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:44.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:44.495 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:28:44.557 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-04-25T02:28:44.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:44.559 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-04-25T02:28:44.615 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-04-25T02:28:44.615 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:28:44.615 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:28:44.615 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:28:44.615 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:28:44.615 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:28:44.615 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-25T02:28:44.616 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:28:44.616 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:28:44.616 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:28:44.616 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-25T02:28:44.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:44.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:44.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:44.741 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-04-25T02:28:44.756 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:28:44.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:44.756 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list-id 2024-04-25T02:28:44.812 INFO:teuthology.orchestra.run.smithi067.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-25T02:28:44.812 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:28:44.812 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-25T02:28:44.812 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:28:44.812 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-25T02:28:44.813 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-25T02:28:44.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:44.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:44.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:44.929 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T02:28:44.952 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:28:44.953 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:28:44.953 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:28:44.953 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:44.953 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-04-25T02:28:44.953 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:44.953 INFO:teuthology.orchestra.run.smithi067.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:28:44.953 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 6e:ce:2a:79:8d:9c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T02:28:44.953 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T02:28:44.953 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:44.953 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::6cce:2aff:fe79:8d9c/64 scope link 2024-04-25T02:28:44.953 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:44.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:44.955 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T02:28:45.019 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:28:45.019 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:28:45.019 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:28:45.019 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:45.019 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-04-25T02:28:45.019 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:45.019 INFO:teuthology.orchestra.run.smithi067.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:28:45.019 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 6e:ce:2a:79:8d:9c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T02:28:45.019 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T02:28:45.020 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:45.020 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::6cce:2aff:fe79:8d9c/64 scope link 2024-04-25T02:28:45.020 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:45.021 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-25T02:28:45.021 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:28:45.021 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-25T02:28:45.021 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-25T02:28:45.021 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T02:28:45.021 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-25T02:28:45.021 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-25T02:28:45.021 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-25T02:28:45.021 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-25T02:28:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:45.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:45.172 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:28:45.172 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-25T02:28:45.172 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.1 up 2024-04-25T02:28:45.172 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T02:28:45.172 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-25T02:28:45.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:45.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:45.248 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:28:45.249 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-25T02:28:45.263 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-25T02:28:45.264 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:28:45.264 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-25T02:28:45.323 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:28:45.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:45.323 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T02:28:45.406 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T02:28:45.406 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T02:28:45.407 INFO:teuthology.orchestra.run.smithi067.stdout:invalid new device string format 2024-04-25T02:28:45.415 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T02:28:45.415 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T02:28:45.415 INFO:teuthology.orchestra.run.smithi067.stdout:invalid new device string format 2024-04-25T02:28:45.415 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-04-25T02:28:45.415 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:28:45.432 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T02:28:45.433 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T02:28:45.433 INFO:teuthology.orchestra.run.smithi067.stdout:invalid new device string format 2024-04-25T02:28:45.433 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-04-25T02:28:45.433 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:28:45.433 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-04-25T02:28:45.433 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.67:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-04-25T02:28:45.433 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=84283662-9e10-4d0d-b377-8e43b1f6e3af" will pass to kernel 2024-04-25T02:28:45.434 INFO:teuthology.orchestra.run.smithi067.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-25T02:28:45.434 INFO:teuthology.orchestra.run.smithi067.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:28:45.434 INFO:teuthology.orchestra.run.smithi067.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:28:45.434 INFO:teuthology.orchestra.run.smithi067.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:28:45.434 INFO:teuthology.orchestra.run.smithi067.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:28:45.435 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:28:45.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:45.435 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-25T02:28:45.499 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:28:45.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:28:45.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:45.597 INFO:teuthology.orchestra.run.smithi067.stdout:client4680 2024-04-25T02:28:45.597 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:28:45.597 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:28:45.613 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:28:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:28:45.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:45.709 INFO:teuthology.orchestra.run.smithi067.stdout:client4680 2024-04-25T02:28:45.710 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:28:45.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:28:45.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:45.766 INFO:teuthology.orchestra.run.smithi067.stdout:client4680 2024-04-25T02:28:45.766 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/84283662-9e10-4d0d-b377-8e43b1f6e3af.client4680/status') 2024-04-25T02:28:45.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:45.826 INFO:teuthology.orchestra.run.smithi067.stdout:instance: client.4680 (3)192.168.0.2:0/3891666748 2024-04-25T02:28:45.826 INFO:teuthology.orchestra.run.smithi067.stdout:blocklisted: false 2024-04-25T02:28:45.826 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2024-04-25T02:28:45.826 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2024-04-25T02:28:45.826 INFO:teuthology.orchestra.run.smithi067.stderr:69 bytes copied, 2.6031e-05 s, 2.7 MB/s 2024-04-25T02:28:45.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:45.833 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-25T02:28:45.833 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T02:28:45.833 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T02:28:45.833 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:28:45.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.931+0000 7f11f0831640 1 Processor -- start 2024-04-25T02:28:45.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.931+0000 7f11f0831640 1 -- start start 2024-04-25T02:28:45.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.932+0000 7f11f0831640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f11ec15c0f0 0x7f11ec0ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:45.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.932+0000 7f11f0831640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11ec0ce860 0x7f11ec0b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:45.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.932+0000 7f11f0831640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11ec15ec10 con 0x7f11ec0cf410 2024-04-25T02:28:45.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.932+0000 7f11f0831640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f11ec0cf870 con 0x7f11ec15c0f0 2024-04-25T02:28:45.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.932+0000 7f11f0831640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f11ec15eef0 con 0x7f11ec0ce860 2024-04-25T02:28:45.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.932+0000 7f11ead9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11ec0ce860 0x7f11ec0b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:45.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.932+0000 7f11e3fff640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f11ec0cf410 0x7f11ec0ce150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:43160/0 (socket says 172.21.15.67:43160) 2024-04-25T02:28:45.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.932+0000 7f11ea59c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f11ec15c0f0 0x7f11ec0ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:45.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.932+0000 7f11ead9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11ec0ce860 0x7f11ec0b3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:45258/0 (socket says 172.21.15.67:45258) 2024-04-25T02:28:45.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.932+0000 7f11e3fff640 1 -- 172.21.15.67:0/2134168243 learned_addr learned my addr 172.21.15.67:0/2134168243 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:45.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.933+0000 7f11e9d9b640 1 -- 172.21.15.67:0/2134168243 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1750776884 0 0) 0x7f11ec15ec10 con 0x7f11ec0cf410 2024-04-25T02:28:45.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.933+0000 7f11ead9d640 1 -- 172.21.15.67:0/2134168243 >> v2:172.21.15.176:3300/0 conn(0x7f11ec15c0f0 msgr2=0x7f11ec0ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:45.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.933+0000 7f11ead9d640 1 --2- 172.21.15.67:0/2134168243 >> v2:172.21.15.176:3300/0 conn(0x7f11ec15c0f0 0x7f11ec0ceed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:45.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.933+0000 7f11ead9d640 1 -- 172.21.15.67:0/2134168243 >> v1:172.21.15.176:6789/0 conn(0x7f11ec0cf410 legacy=0x7f11ec0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:45.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.933+0000 7f11ead9d640 1 -- 172.21.15.67:0/2134168243 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ec15f1d0 con 0x7f11ec0ce860 2024-04-25T02:28:45.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.934+0000 7f11ead9d640 1 --2- 172.21.15.67:0/2134168243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11ec0ce860 0x7f11ec0b3e10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009d90 tx=0x7f11e402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=904edac010bddb11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:45.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.934+0000 7f11e9d9b640 1 -- 172.21.15.67:0/2134168243 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e4007740 con 0x7f11ec0ce860 2024-04-25T02:28:45.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.934+0000 7f11e9d9b640 1 -- 172.21.15.67:0/2134168243 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e40078e0 con 0x7f11ec0ce860 2024-04-25T02:28:45.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.934+0000 7f11e9d9b640 1 -- 172.21.15.67:0/2134168243 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e4007cb0 con 0x7f11ec0ce860 2024-04-25T02:28:45.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.934+0000 7f11f0831640 1 -- 172.21.15.67:0/2134168243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11ec0ce860 msgr2=0x7f11ec0b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:45.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.934+0000 7f11f0831640 1 --2- 172.21.15.67:0/2134168243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11ec0ce860 0x7f11ec0b3e10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009d90 tx=0x7f11e402a660 comp rx=0 tx=0).stop 2024-04-25T02:28:45.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.934+0000 7f11f0831640 1 -- 172.21.15.67:0/2134168243 shutdown_connections 2024-04-25T02:28:45.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.934+0000 7f11f0831640 1 --2- 172.21.15.67:0/2134168243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11ec0ce860 0x7f11ec0b3e10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:45.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.934+0000 7f11f0831640 1 --2- 172.21.15.67:0/2134168243 >> v2:172.21.15.176:3300/0 conn(0x7f11ec15c0f0 0x7f11ec0ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:45.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.934+0000 7f11f0831640 1 -- 172.21.15.67:0/2134168243 >> 172.21.15.67:0/2134168243 conn(0x7f11ec06b0c0 msgr2=0x7f11ec06b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:45.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.934+0000 7f11f0831640 1 -- 172.21.15.67:0/2134168243 shutdown_connections 2024-04-25T02:28:45.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.934+0000 7f11f0831640 1 -- 172.21.15.67:0/2134168243 wait complete. 2024-04-25T02:28:45.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.936+0000 7f11f0831640 1 Processor -- start 2024-04-25T02:28:45.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.936+0000 7f11f0831640 1 -- start start 2024-04-25T02:28:45.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.936+0000 7f11f0831640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11ec0ce860 0x7f11ec0c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:45.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.936+0000 7f11f0831640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11ec0cf410 0x7f11ec156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:45.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.936+0000 7f11f0831640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11ec1596e0 0x7f11ec160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:45.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11f0831640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f11ec0b4350 con 0x7f11ec1596e0 2024-04-25T02:28:45.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11f0831640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f11ec15e8c0 con 0x7f11ec0ce860 2024-04-25T02:28:45.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11f0831640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f11ec0b44d0 con 0x7f11ec0cf410 2024-04-25T02:28:45.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11ead9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11ec1596e0 0x7f11ec160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:45.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11ead9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11ec1596e0 0x7f11ec160b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42034/0 (socket says 172.21.15.67:42034) 2024-04-25T02:28:45.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11ead9d640 1 -- 172.21.15.67:0/675103890 learned_addr learned my addr 172.21.15.67:0/675103890 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:45.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11e3fff640 1 --2- 172.21.15.67:0/675103890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11ec0cf410 0x7f11ec156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:45.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11ea59c640 1 --2- 172.21.15.67:0/675103890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11ec0ce860 0x7f11ec0c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:45.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11ead9d640 1 -- 172.21.15.67:0/675103890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11ec0cf410 msgr2=0x7f11ec156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:45.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11ead9d640 1 --2- 172.21.15.67:0/675103890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11ec0cf410 0x7f11ec156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:45.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11ead9d640 1 -- 172.21.15.67:0/675103890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11ec0ce860 msgr2=0x7f11ec0c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:45.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11ead9d640 1 --2- 172.21.15.67:0/675103890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11ec0ce860 0x7f11ec0c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:45.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11ead9d640 1 -- 172.21.15.67:0/675103890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ec0c98b0 con 0x7f11ec1596e0 2024-04-25T02:28:45.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11ea59c640 1 --2- 172.21.15.67:0/675103890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11ec0ce860 0x7f11ec0c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:45.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11ead9d640 1 --2- 172.21.15.67:0/675103890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11ec1596e0 0x7f11ec160b80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009d90 tx=0x7f11e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:45.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11e2ffd640 1 -- 172.21.15.67:0/675103890 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e4040070 con 0x7f11ec1596e0 2024-04-25T02:28:45.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11e2ffd640 1 -- 172.21.15.67:0/675103890 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e4031c40 con 0x7f11ec1596e0 2024-04-25T02:28:45.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11f0831640 1 -- 172.21.15.67:0/675103890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11ec15a0a0 con 0x7f11ec1596e0 2024-04-25T02:28:45.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.937+0000 7f11e2ffd640 1 -- 172.21.15.67:0/675103890 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e4009450 con 0x7f11ec1596e0 2024-04-25T02:28:45.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.938+0000 7f11f0831640 1 -- 172.21.15.67:0/675103890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11ec15c940 con 0x7f11ec1596e0 2024-04-25T02:28:45.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.939+0000 7f11f0831640 1 -- 172.21.15.67:0/675103890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11ec069110 con 0x7f11ec1596e0 2024-04-25T02:28:45.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.939+0000 7f11e2ffd640 1 -- 172.21.15.67:0/675103890 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11e4039040 con 0x7f11ec1596e0 2024-04-25T02:28:45.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.939+0000 7f11e2ffd640 1 --2- 172.21.15.67:0/675103890 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f11cc06be30 0x7f11cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:45.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.939+0000 7f11e2ffd640 1 -- 172.21.15.67:0/675103890 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f11e40abc20 con 0x7f11ec1596e0 2024-04-25T02:28:45.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.940+0000 7f11ea59c640 1 --2- 172.21.15.67:0/675103890 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f11cc06be30 0x7f11cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:45.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.940+0000 7f11ea59c640 1 --2- 172.21.15.67:0/675103890 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f11cc06be30 0x7f11cc06e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009af0 tx=0x7f11dc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:45.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:45.943+0000 7f11e2ffd640 1 -- 172.21.15.67:0/675103890 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f11e4079f80 con 0x7f11ec1596e0 2024-04-25T02:28:46.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:46.163+0000 7f11f0831640 1 -- 172.21.15.67:0/675103890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f11ec0af6e0 con 0x7f11ec1596e0 2024-04-25T02:28:46.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:46.163+0000 7f11e2ffd640 1 -- 172.21.15.67:0/675103890 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f11e407e280 con 0x7f11ec1596e0 2024-04-25T02:28:46.167 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:28:46.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:46.165+0000 7f11f0831640 1 -- 172.21.15.67:0/675103890 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f11cc06be30 msgr2=0x7f11cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:46.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:46.165+0000 7f11f0831640 1 --2- 172.21.15.67:0/675103890 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f11cc06be30 0x7f11cc06e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009af0 tx=0x7f11dc008040 comp rx=0 tx=0).stop 2024-04-25T02:28:46.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:46.165+0000 7f11f0831640 1 -- 172.21.15.67:0/675103890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11ec1596e0 msgr2=0x7f11ec160b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:46.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:46.165+0000 7f11f0831640 1 --2- 172.21.15.67:0/675103890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11ec1596e0 0x7f11ec160b80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009d90 tx=0x7f11e4004a40 comp rx=0 tx=0).stop 2024-04-25T02:28:46.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:46.165+0000 7f11f0831640 1 -- 172.21.15.67:0/675103890 shutdown_connections 2024-04-25T02:28:46.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:46.165+0000 7f11f0831640 1 --2- 172.21.15.67:0/675103890 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f11cc06be30 0x7f11cc06e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:46.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:46.165+0000 7f11f0831640 1 --2- 172.21.15.67:0/675103890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11ec1596e0 0x7f11ec160b80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:46.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:46.165+0000 7f11f0831640 1 --2- 172.21.15.67:0/675103890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11ec0cf410 0x7f11ec156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:46.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:46.165+0000 7f11f0831640 1 --2- 172.21.15.67:0/675103890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11ec0ce860 0x7f11ec0c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:46.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:46.165+0000 7f11f0831640 1 -- 172.21.15.67:0/675103890 >> 172.21.15.67:0/675103890 conn(0x7f11ec06b0c0 msgr2=0x7f11ec06dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:46.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:46.165+0000 7f11f0831640 1 -- 172.21.15.67:0/675103890 shutdown_connections 2024-04-25T02:28:46.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:46.165+0000 7f11f0831640 1 -- 172.21.15.67:0/675103890 wait complete. 2024-04-25T02:28:46.179 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T02:28:46.179 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:28:46.179 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-04-25T02:28:46.179 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T02:28:46.179 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T02:28:46.179 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T02:28:46.179 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T02:28:46.179 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:28:46.179 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T02:28:46.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:46.180 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-04-25T02:28:46.198 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:28:46.198 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:28:46.198 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:28:46.198 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:46.198 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-04-25T02:28:46.198 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:46.198 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:28:46.199 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:28:46.199 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-04-25T02:28:46.199 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:28:46.199 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:28:46.199 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-04-25T02:28:46.199 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:28:46.199 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:28:46.199 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:28:46.199 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:28:46.199 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:28:46.199 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42728sec preferred_lft 42728sec 2024-04-25T02:28:46.199 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::f141:2e43:429e:fd86/64 scope link noprefixroute 2024-04-25T02:28:46.199 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:46.200 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T02:28:46.200 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:28:46.200 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-04-25T02:28:46.200 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add name ceph-brx type bridge 2024-04-25T02:28:46.200 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr flush dev ceph-brx 2024-04-25T02:28:46.200 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set ceph-brx up 2024-04-25T02:28:46.200 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T02:28:46.200 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-04-25T02:28:46.293 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:46.469 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:46.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:46.476 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:28:46.500 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-04-25T02:28:46.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:46.502 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-04-25T02:28:46.571 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-04-25T02:28:46.572 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:28:46.572 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:28:46.572 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:28:46.572 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:28:46.572 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:28:46.572 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-04-25T02:28:46.572 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:28:46.572 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:28:46.572 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:28:46.572 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-04-25T02:28:46.659 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:46.803 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:46.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:46.809 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-04-25T02:28:46.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:46.824 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2024-04-25T02:28:46.879 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:28:46.879 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-04-25T02:28:46.879 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T02:28:46.879 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T02:28:46.879 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-04-25T02:28:46.967 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:46.988 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:46.995 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T02:28:46.995 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:28:46.995 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-04-25T02:28:46.995 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T02:28:46.995 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T02:28:46.995 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T02:28:46.995 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T02:28:46.995 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T02:28:46.995 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-04-25T02:28:47.043 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:47.108 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:47.114 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:28:47.114 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-04-25T02:28:47.114 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-04-25T02:28:47.114 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T02:28:47.114 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-04-25T02:28:47.161 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:47.182 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:47.188 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:28:47.188 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T02:28:47.202 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T02:28:47.203 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:28:47.203 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T02:28:47.257 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:28:47.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:47.257 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T02:28:47.353 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T02:28:47.354 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T02:28:47.354 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-04-25T02:28:47.457 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T02:28:47.457 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T02:28:47.457 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-04-25T02:28:47.457 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-04-25T02:28:47.457 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:28:47.461 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T02:28:47.462 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T02:28:47.462 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-04-25T02:28:47.462 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-04-25T02:28:47.462 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:28:47.462 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.67:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-04-25T02:28:47.462 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.67:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-04-25T02:28:47.462 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=84283662-9e10-4d0d-b377-8e43b1f6e3af" will pass to kernel 2024-04-25T02:28:47.463 INFO:teuthology.orchestra.run.smithi176.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T02:28:47.463 INFO:teuthology.orchestra.run.smithi176.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:28:47.463 INFO:teuthology.orchestra.run.smithi176.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:28:47.463 INFO:teuthology.orchestra.run.smithi176.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:28:47.463 INFO:teuthology.orchestra.run.smithi176.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:28:47.465 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:28:47.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:47.465 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T02:28:47.487 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:28:47.576 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:28:47.578 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:47.583 INFO:teuthology.orchestra.run.smithi176.stdout:client4484 2024-04-25T02:28:47.583 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:28:47.583 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:28:47.599 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:28:47.687 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:28:47.688 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:47.694 INFO:teuthology.orchestra.run.smithi176.stdout:client4484 2024-04-25T02:28:47.694 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:28:47.741 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:28:47.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:47.748 INFO:teuthology.orchestra.run.smithi176.stdout:client4484 2024-04-25T02:28:47.748 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/84283662-9e10-4d0d-b377-8e43b1f6e3af.client4484/status') 2024-04-25T02:28:47.796 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:47.805 INFO:teuthology.orchestra.run.smithi176.stdout:instance: client.4484 (3)192.168.0.1:0/1013148703 2024-04-25T02:28:47.805 INFO:teuthology.orchestra.run.smithi176.stdout:blocklisted: false 2024-04-25T02:28:47.805 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records in 2024-04-25T02:28:47.806 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records out 2024-04-25T02:28:47.806 INFO:teuthology.orchestra.run.smithi176.stderr:69 bytes copied, 4.0021e-05 s, 1.7 MB/s 2024-04-25T02:28:47.806 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:47.813 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-25T02:28:47.813 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T02:28:47.813 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T02:28:47.813 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:28:47.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.923+0000 7f40a6d9e640 1 Processor -- start 2024-04-25T02:28:47.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.923+0000 7f40a6d9e640 1 -- start start 2024-04-25T02:28:47.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.924+0000 7f40a6d9e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40a015e2f0 0x7f40a00cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:47.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.924+0000 7f40a6d9e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f40a00d49a0 0x7f40a00cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:47.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.924+0000 7f40a6d9e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40a00cf7f0 con 0x7f40a015e6d0 2024-04-25T02:28:47.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.924+0000 7f40a6d9e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f40a00d0400 con 0x7f40a00d49a0 2024-04-25T02:28:47.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.924+0000 7f40a6d9e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f40a00cfad0 con 0x7f40a015e2f0 2024-04-25T02:28:47.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.924+0000 7f40a659d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f40a00d49a0 0x7f40a00cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:47.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.924+0000 7f40a559b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f40a015e6d0 0x7f40a00d4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36132/0 (socket says 172.21.15.67:36132) 2024-04-25T02:28:47.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.924+0000 7f40a559b640 1 -- 172.21.15.67:0/1952949601 learned_addr learned my addr 172.21.15.67:0/1952949601 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:47.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.924+0000 7f40a5d9c640 1 --2- 172.21.15.67:0/1952949601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40a015e2f0 0x7f40a00cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:47.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.924+0000 7f40a4d9a640 1 -- 172.21.15.67:0/1952949601 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4258256974 0 0) 0x7f40a00cf7f0 con 0x7f40a015e6d0 2024-04-25T02:28:47.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.924+0000 7f40a4d9a640 1 -- 172.21.15.67:0/1952949601 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f408c003520 con 0x7f40a015e6d0 2024-04-25T02:28:47.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.925+0000 7f40a659d640 1 -- 172.21.15.67:0/1952949601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40a015e2f0 msgr2=0x7f40a00cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:47.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.925+0000 7f40a659d640 1 --2- 172.21.15.67:0/1952949601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40a015e2f0 0x7f40a00cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:47.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.925+0000 7f40a659d640 1 -- 172.21.15.67:0/1952949601 >> v1:172.21.15.67:6789/0 conn(0x7f40a015e6d0 legacy=0x7f40a00d4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:47.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.925+0000 7f40a659d640 1 -- 172.21.15.67:0/1952949601 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a00cfdb0 con 0x7f40a00d49a0 2024-04-25T02:28:47.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.925+0000 7f40a659d640 1 --2- 172.21.15.67:0/1952949601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40a00d49a0 0x7f40a00cf170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4098009d90 tx=0x7f409802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e705f582d826cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:47.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.926+0000 7f40a4d9a640 1 -- 172.21.15.67:0/1952949601 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4098007740 con 0x7f40a00d49a0 2024-04-25T02:28:47.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.926+0000 7f40a4d9a640 1 -- 172.21.15.67:0/1952949601 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40980078e0 con 0x7f40a00d49a0 2024-04-25T02:28:47.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.926+0000 7f40a4d9a640 1 -- 172.21.15.67:0/1952949601 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4098007cb0 con 0x7f40a00d49a0 2024-04-25T02:28:47.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.926+0000 7f40a6d9e640 1 -- 172.21.15.67:0/1952949601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40a00d49a0 msgr2=0x7f40a00cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:47.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.926+0000 7f40a6d9e640 1 --2- 172.21.15.67:0/1952949601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40a00d49a0 0x7f40a00cf170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4098009d90 tx=0x7f409802a6f0 comp rx=0 tx=0).stop 2024-04-25T02:28:47.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.926+0000 7f40a6d9e640 1 -- 172.21.15.67:0/1952949601 shutdown_connections 2024-04-25T02:28:47.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.926+0000 7f40a6d9e640 1 --2- 172.21.15.67:0/1952949601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40a00d49a0 0x7f40a00cf170 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:47.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.926+0000 7f40a6d9e640 1 --2- 172.21.15.67:0/1952949601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40a015e2f0 0x7f40a00cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:47.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.926+0000 7f40a6d9e640 1 -- 172.21.15.67:0/1952949601 >> 172.21.15.67:0/1952949601 conn(0x7f40a0073220 msgr2=0x7f40a009d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:47.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.926+0000 7f40a6d9e640 1 -- 172.21.15.67:0/1952949601 shutdown_connections 2024-04-25T02:28:47.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.926+0000 7f40a6d9e640 1 -- 172.21.15.67:0/1952949601 wait complete. 2024-04-25T02:28:47.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.928+0000 7f40a6d9e640 1 Processor -- start 2024-04-25T02:28:47.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.928+0000 7f40a6d9e640 1 -- start start 2024-04-25T02:28:47.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.928+0000 7f40a6d9e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40a00d49a0 0x7f40a01572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:47.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.928+0000 7f40a6d9e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40a015e2f0 0x7f40a01610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:47.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.928+0000 7f40a6d9e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40a015e6d0 0x7f40a01615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:47.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.928+0000 7f40a6d9e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f40a00d0890 con 0x7f40a00d49a0 2024-04-25T02:28:47.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.928+0000 7f40a6d9e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f40a00d2a90 con 0x7f40a015e6d0 2024-04-25T02:28:47.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.928+0000 7f40a6d9e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f40a00d0a10 con 0x7f40a015e2f0 2024-04-25T02:28:47.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.929+0000 7f40a5d9c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40a00d49a0 0x7f40a01572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:47.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.929+0000 7f40a5d9c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40a00d49a0 0x7f40a01572d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42048/0 (socket says 172.21.15.67:42048) 2024-04-25T02:28:47.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.929+0000 7f40a5d9c640 1 -- 172.21.15.67:0/488446486 learned_addr learned my addr 172.21.15.67:0/488446486 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:47.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.929+0000 7f40a659d640 1 --2- 172.21.15.67:0/488446486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40a015e6d0 0x7f40a01615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:47.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.929+0000 7f40a559b640 1 --2- 172.21.15.67:0/488446486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40a015e2f0 0x7f40a01610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:47.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.929+0000 7f40a5d9c640 1 -- 172.21.15.67:0/488446486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40a015e2f0 msgr2=0x7f40a01610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:47.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.929+0000 7f40a5d9c640 1 --2- 172.21.15.67:0/488446486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40a015e2f0 0x7f40a01610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:47.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.929+0000 7f40a5d9c640 1 -- 172.21.15.67:0/488446486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40a015e6d0 msgr2=0x7f40a01615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:47.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.929+0000 7f40a5d9c640 1 --2- 172.21.15.67:0/488446486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40a015e6d0 0x7f40a01615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:47.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.929+0000 7f40a5d9c640 1 -- 172.21.15.67:0/488446486 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a0157810 con 0x7f40a00d49a0 2024-04-25T02:28:47.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.929+0000 7f40a5d9c640 1 --2- 172.21.15.67:0/488446486 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40a00d49a0 0x7f40a01572d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f409c00e9b0 tx=0x7f409c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:47.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.930+0000 7f40967fc640 1 -- 172.21.15.67:0/488446486 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c017070 con 0x7f40a00d49a0 2024-04-25T02:28:47.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.930+0000 7f40967fc640 1 -- 172.21.15.67:0/488446486 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f409c00c9a0 con 0x7f40a00d49a0 2024-04-25T02:28:47.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.930+0000 7f40a6d9e640 1 -- 172.21.15.67:0/488446486 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40a00b2a40 con 0x7f40a00d49a0 2024-04-25T02:28:47.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.930+0000 7f40967fc640 1 -- 172.21.15.67:0/488446486 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c00cd90 con 0x7f40a00d49a0 2024-04-25T02:28:47.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.930+0000 7f40a6d9e640 1 -- 172.21.15.67:0/488446486 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40a00b3000 con 0x7f40a00d49a0 2024-04-25T02:28:47.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.932+0000 7f40a6d9e640 1 -- 172.21.15.67:0/488446486 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40a0067e40 con 0x7f40a00d49a0 2024-04-25T02:28:47.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.932+0000 7f40967fc640 1 -- 172.21.15.67:0/488446486 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f409c01a070 con 0x7f40a00d49a0 2024-04-25T02:28:47.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.932+0000 7f40967fc640 1 --2- 172.21.15.67:0/488446486 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f408406be30 0x7f408406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:47.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.933+0000 7f40967fc640 1 -- 172.21.15.67:0/488446486 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f409c08ade0 con 0x7f40a00d49a0 2024-04-25T02:28:47.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.933+0000 7f40a559b640 1 --2- 172.21.15.67:0/488446486 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f408406be30 0x7f408406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:47.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.933+0000 7f40a559b640 1 --2- 172.21.15.67:0/488446486 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f408406be30 0x7f408406e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f40a01f74d0 tx=0x7f4090009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:47.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:47.937+0000 7f40967fc640 1 -- 172.21.15.67:0/488446486 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f409c059140 con 0x7f40a00d49a0 2024-04-25T02:28:48.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:48.163+0000 7f40a6d9e640 1 -- 172.21.15.67:0/488446486 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f40a00756b0 con 0x7f40a00d49a0 2024-04-25T02:28:48.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:48.163+0000 7f40967fc640 1 -- 172.21.15.67:0/488446486 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f409c05d440 con 0x7f40a00d49a0 2024-04-25T02:28:48.166 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:28:48.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:48.165+0000 7f40a6d9e640 1 -- 172.21.15.67:0/488446486 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f408406be30 msgr2=0x7f408406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:48.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:48.165+0000 7f40a6d9e640 1 --2- 172.21.15.67:0/488446486 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f408406be30 0x7f408406e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f40a01f74d0 tx=0x7f4090009040 comp rx=0 tx=0).stop 2024-04-25T02:28:48.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:48.165+0000 7f40a6d9e640 1 -- 172.21.15.67:0/488446486 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40a00d49a0 msgr2=0x7f40a01572d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:48.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:48.165+0000 7f40a6d9e640 1 --2- 172.21.15.67:0/488446486 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40a00d49a0 0x7f40a01572d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f409c00e9b0 tx=0x7f409c00ee70 comp rx=0 tx=0).stop 2024-04-25T02:28:48.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:48.165+0000 7f40a6d9e640 1 -- 172.21.15.67:0/488446486 shutdown_connections 2024-04-25T02:28:48.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:48.165+0000 7f40a6d9e640 1 --2- 172.21.15.67:0/488446486 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f408406be30 0x7f408406e2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:48.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:48.165+0000 7f40a6d9e640 1 --2- 172.21.15.67:0/488446486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40a015e6d0 0x7f40a01615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:48.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:48.165+0000 7f40a6d9e640 1 --2- 172.21.15.67:0/488446486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40a015e2f0 0x7f40a01610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:48.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:48.165+0000 7f40a6d9e640 1 --2- 172.21.15.67:0/488446486 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40a00d49a0 0x7f40a01572d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:48.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:48.165+0000 7f40a6d9e640 1 -- 172.21.15.67:0/488446486 >> 172.21.15.67:0/488446486 conn(0x7f40a0073220 msgr2=0x7f40a006d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:48.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:48.165+0000 7f40a6d9e640 1 -- 172.21.15.67:0/488446486 shutdown_connections 2024-04-25T02:28:48.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:48.165+0000 7f40a6d9e640 1 -- 172.21.15.67:0/488446486 wait complete. 2024-04-25T02:28:48.179 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T02:28:48.179 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:28:48.179 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-04-25T02:28:48.179 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-25T02:28:48.179 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T02:28:48.179 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T02:28:48.179 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T02:28:48.179 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:28:48.179 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-25T02:28:48.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:48.180 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-04-25T02:28:48.195 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:28:48.195 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:28:48.195 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:28:48.195 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:48.195 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-04-25T02:28:48.196 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:48.196 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:28:48.196 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:28:48.196 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-04-25T02:28:48.196 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:28:48.196 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:28:48.196 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-04-25T02:28:48.196 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:28:48.196 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:28:48.196 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:28:48.196 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:28:48.196 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:28:48.196 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42726sec preferred_lft 42726sec 2024-04-25T02:28:48.196 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::f141:2e43:429e:fd86/64 scope link noprefixroute 2024-04-25T02:28:48.197 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:48.197 INFO:teuthology.orchestra.run.smithi176.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:28:48.197 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 3a:53:89:77:09:90 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:28:48.197 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:28:48.197 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:48.197 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::904b:9cff:fe56:d77b/64 scope link 2024-04-25T02:28:48.197 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:48.197 INFO:teuthology.orchestra.run.smithi176.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:28:48.197 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 3a:53:89:77:09:90 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T02:28:48.197 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::3853:89ff:fe77:990/64 scope link tentative 2024-04-25T02:28:48.197 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:48.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:48.198 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:28:48.257 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-04-25T02:28:48.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:48.259 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-04-25T02:28:48.316 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-04-25T02:28:48.316 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:28:48.316 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:28:48.316 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:28:48.316 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:28:48.317 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:28:48.317 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-04-25T02:28:48.317 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:28:48.317 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:28:48.317 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:28:48.317 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-04-25T02:28:48.404 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:48.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:48.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:48.440 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-04-25T02:28:48.454 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T02:28:48.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:48.455 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2024-04-25T02:28:48.510 INFO:teuthology.orchestra.run.smithi176.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-25T02:28:48.510 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:28:48.510 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-04-25T02:28:48.510 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T02:28:48.510 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-25T02:28:48.510 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-04-25T02:28:48.597 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:48.619 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:48.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:48.625 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T02:28:48.648 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:28:48.648 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:28:48.648 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:28:48.648 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:48.648 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-04-25T02:28:48.648 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:48.648 INFO:teuthology.orchestra.run.smithi176.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:28:48.649 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 36:fc:f1:1a:7c:17 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T02:28:48.649 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T02:28:48.649 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:48.649 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::34fc:f1ff:fe1a:7c17/64 scope link tentative 2024-04-25T02:28:48.649 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:48.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:48.650 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T02:28:48.713 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:28:48.713 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:28:48.714 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:28:48.714 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:48.714 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-04-25T02:28:48.714 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:48.714 INFO:teuthology.orchestra.run.smithi176.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:28:48.714 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 36:fc:f1:1a:7c:17 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T02:28:48.714 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T02:28:48.714 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:48.714 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::34fc:f1ff:fe1a:7c17/64 scope link 2024-04-25T02:28:48.714 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:28:48.715 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-25T02:28:48.716 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:28:48.716 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-04-25T02:28:48.716 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-25T02:28:48.716 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T02:28:48.716 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-25T02:28:48.716 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-25T02:28:48.716 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-25T02:28:48.716 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-04-25T02:28:48.804 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:48.857 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:48.866 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:28:48.866 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-04-25T02:28:48.867 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.1 up 2024-04-25T02:28:48.867 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T02:28:48.867 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-04-25T02:28:48.914 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:48.935 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:48.941 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:28:48.942 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-25T02:28:48.957 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-25T02:28:48.957 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:28:48.957 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-25T02:28:49.012 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:28:49.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:49.012 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T02:28:49.093 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T02:28:49.093 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T02:28:49.094 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-04-25T02:28:49.102 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T02:28:49.102 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T02:28:49.102 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-04-25T02:28:49.102 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-04-25T02:28:49.102 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:28:49.107 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T02:28:49.107 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T02:28:49.107 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-04-25T02:28:49.107 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-04-25T02:28:49.107 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:28:49.107 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.67:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-04-25T02:28:49.107 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.67:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-04-25T02:28:49.107 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=84283662-9e10-4d0d-b377-8e43b1f6e3af" will pass to kernel 2024-04-25T02:28:49.108 INFO:teuthology.orchestra.run.smithi176.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-25T02:28:49.108 INFO:teuthology.orchestra.run.smithi176.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:28:49.108 INFO:teuthology.orchestra.run.smithi176.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:28:49.108 INFO:teuthology.orchestra.run.smithi176.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:28:49.108 INFO:teuthology.orchestra.run.smithi176.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:28:49.109 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:28:49.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:49.110 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-25T02:28:49.174 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:28:49.262 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:28:49.264 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:49.270 INFO:teuthology.orchestra.run.smithi176.stdout:client4493 2024-04-25T02:28:49.270 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:28:49.270 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:28:49.286 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:28:49.375 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:28:49.376 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:49.381 INFO:teuthology.orchestra.run.smithi176.stdout:client4493 2024-04-25T02:28:49.381 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:28:49.429 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:28:49.431 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:49.436 INFO:teuthology.orchestra.run.smithi176.stdout:client4493 2024-04-25T02:28:49.436 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/84283662-9e10-4d0d-b377-8e43b1f6e3af.client4493/status') 2024-04-25T02:28:49.484 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:28:49.493 INFO:teuthology.orchestra.run.smithi176.stdout:instance: client.4493 (3)192.168.0.2:0/2341459610 2024-04-25T02:28:49.493 INFO:teuthology.orchestra.run.smithi176.stdout:blocklisted: false 2024-04-25T02:28:49.494 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records in 2024-04-25T02:28:49.494 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records out 2024-04-25T02:28:49.494 INFO:teuthology.orchestra.run.smithi176.stderr:69 bytes copied, 2.2386e-05 s, 3.1 MB/s 2024-04-25T02:28:49.494 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:28:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:28:49.500 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-25T02:28:49.548 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-25T02:28:49.705 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:49.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.815+0000 7f8040e64640 1 Processor -- start 2024-04-25T02:28:49.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.815+0000 7f8040e64640 1 -- start start 2024-04-25T02:28:49.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.816+0000 7f8040e64640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f803c15e210 0x7f803c06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:49.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.816+0000 7f8040e64640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f803c15e5f0 0x7f803c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:49.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.816+0000 7f8040e64640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f803c0d2cc0 con 0x7f803c0cecc0 2024-04-25T02:28:49.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.816+0000 7f8040e64640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f803c06c6f0 con 0x7f803c15e210 2024-04-25T02:28:49.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.816+0000 7f8040e64640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f803c0d2fa0 con 0x7f803c15e5f0 2024-04-25T02:28:49.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.817+0000 7f803a59c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f803c15e210 0x7f803c06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:49.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.817+0000 7f8039d9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f803c15e5f0 0x7f803c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:49.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.817+0000 7f803ad9d640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f803c0cecc0 0x7f803c0d3e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:43172/0 (socket says 172.21.15.67:43172) 2024-04-25T02:28:49.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.817+0000 7f803ad9d640 1 -- 172.21.15.67:0/571562010 learned_addr learned my addr 172.21.15.67:0/571562010 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:49.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.817+0000 7f803959a640 1 -- 172.21.15.67:0/571562010 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081204698 0 0) 0x7f803c0d2cc0 con 0x7f803c0cecc0 2024-04-25T02:28:49.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.817+0000 7f803959a640 1 -- 172.21.15.67:0/571562010 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8024003520 con 0x7f803c0cecc0 2024-04-25T02:28:49.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.817+0000 7f8039d9b640 1 -- 172.21.15.67:0/571562010 >> v2:172.21.15.176:3300/0 conn(0x7f803c15e210 msgr2=0x7f803c06cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:49.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.817+0000 7f8039d9b640 1 --2- 172.21.15.67:0/571562010 >> v2:172.21.15.176:3300/0 conn(0x7f803c15e210 0x7f803c06cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:49.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.817+0000 7f8039d9b640 1 -- 172.21.15.67:0/571562010 >> v1:172.21.15.176:6789/0 conn(0x7f803c0cecc0 legacy=0x7f803c0d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:49.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.817+0000 7f8039d9b640 1 -- 172.21.15.67:0/571562010 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803c06c0a0 con 0x7f803c15e5f0 2024-04-25T02:28:49.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.817+0000 7f803a59c640 1 --2- 172.21.15.67:0/571562010 >> v2:172.21.15.176:3300/0 conn(0x7f803c15e210 0x7f803c06cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:49.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.818+0000 7f8039d9b640 1 --2- 172.21.15.67:0/571562010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f803c15e5f0 0x7f803c06d0c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f80300097a0 tx=0x7f803002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90c1c223fe5cea6f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:49.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.818+0000 7f803959a640 1 -- 172.21.15.67:0/571562010 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8030037070 con 0x7f803c15e5f0 2024-04-25T02:28:49.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.818+0000 7f803959a640 1 -- 172.21.15.67:0/571562010 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8030032440 con 0x7f803c15e5f0 2024-04-25T02:28:49.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.818+0000 7f803959a640 1 -- 172.21.15.67:0/571562010 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8030032810 con 0x7f803c15e5f0 2024-04-25T02:28:49.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.819+0000 7f8040e64640 1 -- 172.21.15.67:0/571562010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f803c15e5f0 msgr2=0x7f803c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:49.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.819+0000 7f8040e64640 1 --2- 172.21.15.67:0/571562010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f803c15e5f0 0x7f803c06d0c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f80300097a0 tx=0x7f803002a180 comp rx=0 tx=0).stop 2024-04-25T02:28:49.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.819+0000 7f8040e64640 1 -- 172.21.15.67:0/571562010 shutdown_connections 2024-04-25T02:28:49.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.819+0000 7f8040e64640 1 --2- 172.21.15.67:0/571562010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f803c15e5f0 0x7f803c06d0c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:49.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.819+0000 7f8040e64640 1 --2- 172.21.15.67:0/571562010 >> v2:172.21.15.176:3300/0 conn(0x7f803c15e210 0x7f803c06cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:49.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.819+0000 7f8040e64640 1 -- 172.21.15.67:0/571562010 >> 172.21.15.67:0/571562010 conn(0x7f803c08dbb0 msgr2=0x7f803c09d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:49.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.819+0000 7f8040e64640 1 -- 172.21.15.67:0/571562010 shutdown_connections 2024-04-25T02:28:49.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.819+0000 7f8040e64640 1 -- 172.21.15.67:0/571562010 wait complete. 2024-04-25T02:28:49.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.821+0000 7f8040e64640 1 Processor -- start 2024-04-25T02:28:49.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.821+0000 7f8040e64640 1 -- start start 2024-04-25T02:28:49.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.821+0000 7f8040e64640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f803c0cecc0 0x7f803c0cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:49.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.821+0000 7f8040e64640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f803c15e210 0x7f803c15c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:49.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.821+0000 7f8040e64640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f803c15e5f0 0x7f803c15cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:49.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.821+0000 7f8040e64640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f803c0d46f0 con 0x7f803c0cecc0 2024-04-25T02:28:49.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.821+0000 7f8040e64640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f803c0d4570 con 0x7f803c15e210 2024-04-25T02:28:49.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.821+0000 7f8040e64640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f803c0d4870 con 0x7f803c15e5f0 2024-04-25T02:28:49.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.821+0000 7f803a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f803c0cecc0 0x7f803c0cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:49.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.822+0000 7f803a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f803c0cecc0 0x7f803c0cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42050/0 (socket says 172.21.15.67:42050) 2024-04-25T02:28:49.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.822+0000 7f803a59c640 1 -- 172.21.15.67:0/304977667 learned_addr learned my addr 172.21.15.67:0/304977667 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:49.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.822+0000 7f8039d9b640 1 --2- 172.21.15.67:0/304977667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f803c15e210 0x7f803c15c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:49.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.822+0000 7f803ad9d640 1 --2- 172.21.15.67:0/304977667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f803c15e5f0 0x7f803c15cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:49.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.822+0000 7f803a59c640 1 -- 172.21.15.67:0/304977667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f803c15e5f0 msgr2=0x7f803c15cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:49.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.822+0000 7f803a59c640 1 --2- 172.21.15.67:0/304977667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f803c15e5f0 0x7f803c15cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.822+0000 7f803a59c640 1 -- 172.21.15.67:0/304977667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f803c15e210 msgr2=0x7f803c15c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.822+0000 7f803a59c640 1 --2- 172.21.15.67:0/304977667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f803c15e210 0x7f803c15c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.822+0000 7f803a59c640 1 -- 172.21.15.67:0/304977667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803c0cd8c0 con 0x7f803c0cecc0 2024-04-25T02:28:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.822+0000 7f8039d9b640 1 --2- 172.21.15.67:0/304977667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f803c15e210 0x7f803c15c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.822+0000 7f803ad9d640 1 --2- 172.21.15.67:0/304977667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f803c15e5f0 0x7f803c15cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.822+0000 7f803a59c640 1 --2- 172.21.15.67:0/304977667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f803c0cecc0 0x7f803c0cd020 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f803400ebe0 tx=0x7f803400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.822+0000 7f802affd640 1 -- 172.21.15.67:0/304977667 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8034017070 con 0x7f803c0cecc0 2024-04-25T02:28:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.822+0000 7f802affd640 1 -- 172.21.15.67:0/304977667 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803400cbd0 con 0x7f803c0cecc0 2024-04-25T02:28:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.822+0000 7f802affd640 1 -- 172.21.15.67:0/304977667 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8034013470 con 0x7f803c0cecc0 2024-04-25T02:28:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.822+0000 7f8040e64640 1 -- 172.21.15.67:0/304977667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f803c0cdba0 con 0x7f803c0cecc0 2024-04-25T02:28:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.822+0000 7f8040e64640 1 -- 172.21.15.67:0/304977667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f803c0b7e80 con 0x7f803c0cecc0 2024-04-25T02:28:49.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.823+0000 7f8040e64640 1 -- 172.21.15.67:0/304977667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f803c0b7c90 con 0x7f803c0cecc0 2024-04-25T02:28:49.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.824+0000 7f802affd640 1 -- 172.21.15.67:0/304977667 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f803401a070 con 0x7f803c0cecc0 2024-04-25T02:28:49.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.824+0000 7f802affd640 1 --2- 172.21.15.67:0/304977667 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f801c06be30 0x7f801c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:49.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.825+0000 7f802affd640 1 -- 172.21.15.67:0/304977667 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f803408b080 con 0x7f803c0cecc0 2024-04-25T02:28:49.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.825+0000 7f8039d9b640 1 --2- 172.21.15.67:0/304977667 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f801c06be30 0x7f801c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:49.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.825+0000 7f8039d9b640 1 --2- 172.21.15.67:0/304977667 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f801c06be30 0x7f801c06e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8030034000 tx=0x7f803002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:49.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:49.829+0000 7f802affd640 1 -- 172.21.15.67:0/304977667 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f80340593e0 con 0x7f803c0cecc0 2024-04-25T02:28:50.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.015+0000 7f8040e64640 1 -- 172.21.15.67:0/304977667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f803c069110 con 0x7f803c0cecc0 2024-04-25T02:28:50.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.016+0000 7f802affd640 1 -- 172.21.15.67:0/304977667 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f803405d6e0 con 0x7f803c0cecc0 2024-04-25T02:28:50.020 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:50.020 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:27.819641+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:50.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.019+0000 7f8040e64640 1 -- 172.21.15.67:0/304977667 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f801c06be30 msgr2=0x7f801c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.019+0000 7f8040e64640 1 --2- 172.21.15.67:0/304977667 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f801c06be30 0x7f801c06e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8030034000 tx=0x7f803002e000 comp rx=0 tx=0).stop 2024-04-25T02:28:50.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.019+0000 7f8040e64640 1 -- 172.21.15.67:0/304977667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f803c0cecc0 msgr2=0x7f803c0cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.019+0000 7f8040e64640 1 --2- 172.21.15.67:0/304977667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f803c0cecc0 0x7f803c0cd020 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f803400ebe0 tx=0x7f803400c520 comp rx=0 tx=0).stop 2024-04-25T02:28:50.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.019+0000 7f8040e64640 1 -- 172.21.15.67:0/304977667 shutdown_connections 2024-04-25T02:28:50.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.019+0000 7f8040e64640 1 --2- 172.21.15.67:0/304977667 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f801c06be30 0x7f801c06e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.019+0000 7f8040e64640 1 --2- 172.21.15.67:0/304977667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f803c15e5f0 0x7f803c15cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.019+0000 7f8040e64640 1 --2- 172.21.15.67:0/304977667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f803c15e210 0x7f803c15c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.019+0000 7f8040e64640 1 --2- 172.21.15.67:0/304977667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f803c0cecc0 0x7f803c0cd020 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.019+0000 7f8040e64640 1 -- 172.21.15.67:0/304977667 >> 172.21.15.67:0/304977667 conn(0x7f803c08dbb0 msgr2=0x7f803c15e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:50.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.019+0000 7f8040e64640 1 -- 172.21.15.67:0/304977667 shutdown_connections 2024-04-25T02:28:50.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.019+0000 7f8040e64640 1 -- 172.21.15.67:0/304977667 wait complete. 2024-04-25T02:28:50.033 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:28:24.445606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:28:25.161619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:28:50.033 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:28:50.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.134+0000 7f8bca6f5640 1 Processor -- start 2024-04-25T02:28:50.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.134+0000 7f8bca6f5640 1 -- start start 2024-04-25T02:28:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.135+0000 7f8bca6f5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8bc40d0a00 0x7f8bc406b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.135+0000 7f8bca6f5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc4071e70 0x7f8bc4072300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.135+0000 7f8bca6f5640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bc406b7a0 con 0x7f8bc40cd1d0 2024-04-25T02:28:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.135+0000 7f8bca6f5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8bc406c040 con 0x7f8bc40d0a00 2024-04-25T02:28:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.135+0000 7f8bca6f5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc40cef50 con 0x7f8bc4071e70 2024-04-25T02:28:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.135+0000 7f8bc3fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8bc40d0a00 0x7f8bc406b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:50.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.135+0000 7f8bc3fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8bc40d0a00 0x7f8bc406b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42058/0 (socket says 172.21.15.67:42058) 2024-04-25T02:28:50.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.135+0000 7f8bc3fff640 1 -- 172.21.15.67:0/1562313206 learned_addr learned my addr 172.21.15.67:0/1562313206 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:50.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.135+0000 7f8bc8c92640 1 --2- 172.21.15.67:0/1562313206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc4071e70 0x7f8bc4072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:50.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.135+0000 7f8bc3fff640 1 -- 172.21.15.67:0/1562313206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc4071e70 msgr2=0x7f8bc4072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:50.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.135+0000 7f8bc3fff640 1 --2- 172.21.15.67:0/1562313206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc4071e70 0x7f8bc4072300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.135+0000 7f8bc3fff640 1 -- 172.21.15.67:0/1562313206 >> v1:172.21.15.176:6789/0 conn(0x7f8bc40cd1d0 legacy=0x7f8bc40cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.135+0000 7f8bc3fff640 1 -- 172.21.15.67:0/1562313206 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc406ba80 con 0x7f8bc40d0a00 2024-04-25T02:28:50.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.136+0000 7f8bc3fff640 1 --2- 172.21.15.67:0/1562313206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bc40d0a00 0x7f8bc406b0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009870 tx=0x7f8bb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0dd200627520c86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:50.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.136+0000 7f8bc2ffd640 1 -- 172.21.15.67:0/1562313206 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4037070 con 0x7f8bc40d0a00 2024-04-25T02:28:50.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.136+0000 7f8bc2ffd640 1 -- 172.21.15.67:0/1562313206 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb4032440 con 0x7f8bc40d0a00 2024-04-25T02:28:50.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.136+0000 7f8bc2ffd640 1 -- 172.21.15.67:0/1562313206 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4032810 con 0x7f8bc40d0a00 2024-04-25T02:28:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.137+0000 7f8bca6f5640 1 -- 172.21.15.67:0/1562313206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bc40d0a00 msgr2=0x7f8bc406b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.137+0000 7f8bca6f5640 1 --2- 172.21.15.67:0/1562313206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bc40d0a00 0x7f8bc406b0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009870 tx=0x7f8bb402a270 comp rx=0 tx=0).stop 2024-04-25T02:28:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.137+0000 7f8bca6f5640 1 -- 172.21.15.67:0/1562313206 shutdown_connections 2024-04-25T02:28:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.137+0000 7f8bca6f5640 1 --2- 172.21.15.67:0/1562313206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc4071e70 0x7f8bc4072300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.137+0000 7f8bca6f5640 1 --2- 172.21.15.67:0/1562313206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bc40d0a00 0x7f8bc406b0c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.137+0000 7f8bca6f5640 1 -- 172.21.15.67:0/1562313206 >> 172.21.15.67:0/1562313206 conn(0x7f8bc40d0e20 msgr2=0x7f8bc40d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.137+0000 7f8bca6f5640 1 -- 172.21.15.67:0/1562313206 shutdown_connections 2024-04-25T02:28:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.137+0000 7f8bca6f5640 1 -- 172.21.15.67:0/1562313206 wait complete. 2024-04-25T02:28:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.138+0000 7f8bca6f5640 1 Processor -- start 2024-04-25T02:28:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.138+0000 7f8bca6f5640 1 -- start start 2024-04-25T02:28:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.139+0000 7f8bca6f5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc4071e70 0x7f8bc41596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.139+0000 7f8bca6f5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bc40cd1d0 0x7f8bc40addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.139+0000 7f8bca6f5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc40d0a00 0x7f8bc40ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.139+0000 7f8bca6f5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc40cfaf0 con 0x7f8bc40cd1d0 2024-04-25T02:28:50.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.139+0000 7f8bca6f5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc40cd660 con 0x7f8bc4071e70 2024-04-25T02:28:50.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.139+0000 7f8bca6f5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc40cfc70 con 0x7f8bc40d0a00 2024-04-25T02:28:50.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.139+0000 7f8bc37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bc40cd1d0 0x7f8bc40addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:50.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.139+0000 7f8bc37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bc40cd1d0 0x7f8bc40addb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42064/0 (socket says 172.21.15.67:42064) 2024-04-25T02:28:50.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.139+0000 7f8bc37fe640 1 -- 172.21.15.67:0/2410269844 learned_addr learned my addr 172.21.15.67:0/2410269844 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:50.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.139+0000 7f8bc3fff640 1 --2- 172.21.15.67:0/2410269844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc4071e70 0x7f8bc41596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:50.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.139+0000 7f8bc8c92640 1 --2- 172.21.15.67:0/2410269844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc40d0a00 0x7f8bc40ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:50.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.139+0000 7f8bc37fe640 1 -- 172.21.15.67:0/2410269844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc40d0a00 msgr2=0x7f8bc40ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.139+0000 7f8bc37fe640 1 --2- 172.21.15.67:0/2410269844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc40d0a00 0x7f8bc40ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.139+0000 7f8bc37fe640 1 -- 172.21.15.67:0/2410269844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc4071e70 msgr2=0x7f8bc41596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.139+0000 7f8bc37fe640 1 --2- 172.21.15.67:0/2410269844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc4071e70 0x7f8bc41596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.139+0000 7f8bc37fe640 1 -- 172.21.15.67:0/2410269844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc4159c10 con 0x7f8bc40cd1d0 2024-04-25T02:28:50.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.139+0000 7f8bc8c92640 1 --2- 172.21.15.67:0/2410269844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc40d0a00 0x7f8bc40ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:50.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.140+0000 7f8bc37fe640 1 --2- 172.21.15.67:0/2410269844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bc40cd1d0 0x7f8bc40addb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00c400 tx=0x7f8bac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:50.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.140+0000 7f8bc0ff9640 1 -- 172.21.15.67:0/2410269844 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bac0052d0 con 0x7f8bc40cd1d0 2024-04-25T02:28:50.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.140+0000 7f8bc0ff9640 1 -- 172.21.15.67:0/2410269844 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bac005490 con 0x7f8bc40cd1d0 2024-04-25T02:28:50.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.140+0000 7f8bca6f5640 1 -- 172.21.15.67:0/2410269844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc41f7970 con 0x7f8bc40cd1d0 2024-04-25T02:28:50.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.140+0000 7f8bc0ff9640 1 -- 172.21.15.67:0/2410269844 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bac007260 con 0x7f8bc40cd1d0 2024-04-25T02:28:50.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.140+0000 7f8bca6f5640 1 -- 172.21.15.67:0/2410269844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc41f7f30 con 0x7f8bc40cd1d0 2024-04-25T02:28:50.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.141+0000 7f8bca6f5640 1 -- 172.21.15.67:0/2410269844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bc4067e40 con 0x7f8bc40cd1d0 2024-04-25T02:28:50.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.141+0000 7f8bc0ff9640 1 -- 172.21.15.67:0/2410269844 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8bac007400 con 0x7f8bc40cd1d0 2024-04-25T02:28:50.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.142+0000 7f8bc0ff9640 1 --2- 172.21.15.67:0/2410269844 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8ba406be30 0x7f8ba406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:50.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.142+0000 7f8bc0ff9640 1 -- 172.21.15.67:0/2410269844 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8bac08a260 con 0x7f8bc40cd1d0 2024-04-25T02:28:50.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.142+0000 7f8bc3fff640 1 --2- 172.21.15.67:0/2410269844 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8ba406be30 0x7f8ba406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:50.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.142+0000 7f8bc3fff640 1 --2- 172.21.15.67:0/2410269844 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8ba406be30 0x7f8ba406e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4034000 tx=0x7f8bb402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:50.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.146+0000 7f8bc0ff9640 1 -- 172.21.15.67:0/2410269844 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8bac058650 con 0x7f8bc40cd1d0 2024-04-25T02:28:50.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.326+0000 7f8bca6f5640 1 -- 172.21.15.67:0/2410269844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8bc4069110 con 0x7f8bc40cd1d0 2024-04-25T02:28:50.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.327+0000 7f8bc0ff9640 1 -- 172.21.15.67:0/2410269844 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f8bac05c950 con 0x7f8bc40cd1d0 2024-04-25T02:28:50.330 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:28:50.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.328+0000 7f8bca6f5640 1 -- 172.21.15.67:0/2410269844 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8ba406be30 msgr2=0x7f8ba406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.328+0000 7f8bca6f5640 1 --2- 172.21.15.67:0/2410269844 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8ba406be30 0x7f8ba406e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4034000 tx=0x7f8bb402e000 comp rx=0 tx=0).stop 2024-04-25T02:28:50.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.328+0000 7f8bca6f5640 1 -- 172.21.15.67:0/2410269844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bc40cd1d0 msgr2=0x7f8bc40addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.328+0000 7f8bca6f5640 1 --2- 172.21.15.67:0/2410269844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bc40cd1d0 0x7f8bc40addb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00c400 tx=0x7f8bac00c8c0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.329+0000 7f8bca6f5640 1 -- 172.21.15.67:0/2410269844 shutdown_connections 2024-04-25T02:28:50.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.329+0000 7f8bca6f5640 1 --2- 172.21.15.67:0/2410269844 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f8ba406be30 0x7f8ba406e2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.329+0000 7f8bca6f5640 1 --2- 172.21.15.67:0/2410269844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc40d0a00 0x7f8bc40ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.329+0000 7f8bca6f5640 1 --2- 172.21.15.67:0/2410269844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bc40cd1d0 0x7f8bc40addb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.329+0000 7f8bca6f5640 1 --2- 172.21.15.67:0/2410269844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc4071e70 0x7f8bc41596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.329+0000 7f8bca6f5640 1 -- 172.21.15.67:0/2410269844 >> 172.21.15.67:0/2410269844 conn(0x7f8bc40d0e20 msgr2=0x7f8bc40c6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:50.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.329+0000 7f8bca6f5640 1 -- 172.21.15.67:0/2410269844 shutdown_connections 2024-04-25T02:28:50.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.329+0000 7f8bca6f5640 1 -- 172.21.15.67:0/2410269844 wait complete. 2024-04-25T02:28:50.343 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:28:50.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.443+0000 7f6d06a7b640 1 Processor -- start 2024-04-25T02:28:50.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.443+0000 7f6d06a7b640 1 -- start start 2024-04-25T02:28:50.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.444+0000 7f6d06a7b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d000cf060 0x7f6d000d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:50.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.444+0000 7f6d06a7b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6d000b2da0 0x7f6d0006c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:50.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.444+0000 7f6d06a7b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d000b3570 con 0x7f6d0006cd80 2024-04-25T02:28:50.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.444+0000 7f6d06a7b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6d000d05d0 con 0x7f6d000b2da0 2024-04-25T02:28:50.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.444+0000 7f6d06a7b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6d000cff80 con 0x7f6d000cf060 2024-04-25T02:28:50.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.444+0000 7f6cfffff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6d000b2da0 0x7f6d0006c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:50.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.444+0000 7f6d04817640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d000cf060 0x7f6d000d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:50.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.444+0000 7f6cfffff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6d000b2da0 0x7f6d0006c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:48538/0 (socket says 172.21.15.67:48538) 2024-04-25T02:28:50.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.444+0000 7f6cfffff640 1 -- 172.21.15.67:0/4060594175 learned_addr learned my addr 172.21.15.67:0/4060594175 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:50.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.444+0000 7f6d05018640 1 --1- 172.21.15.67:0/4060594175 >> v1:172.21.15.176:6789/0 conn(0x7f6d0006cd80 0x7f6d000aed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:43190/0 (socket says 172.21.15.67:43190) 2024-04-25T02:28:50.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.445+0000 7f6cfffff640 1 -- 172.21.15.67:0/4060594175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d000cf060 msgr2=0x7f6d000d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:50.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.445+0000 7f6cfffff640 1 --2- 172.21.15.67:0/4060594175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d000cf060 0x7f6d000d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.445+0000 7f6cfffff640 1 -- 172.21.15.67:0/4060594175 >> v1:172.21.15.176:6789/0 conn(0x7f6d0006cd80 legacy=0x7f6d000aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.445+0000 7f6cfffff640 1 -- 172.21.15.67:0/4060594175 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d000d0260 con 0x7f6d000b2da0 2024-04-25T02:28:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.445+0000 7f6cfffff640 1 --2- 172.21.15.67:0/4060594175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d000b2da0 0x7f6d0006c840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009870 tx=0x7f6cf402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86b8dddb0af9880a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.445+0000 7f6cff7fe640 1 -- 172.21.15.67:0/4060594175 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4037070 con 0x7f6d000b2da0 2024-04-25T02:28:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.446+0000 7f6cff7fe640 1 -- 172.21.15.67:0/4060594175 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf4032440 con 0x7f6d000b2da0 2024-04-25T02:28:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.446+0000 7f6cff7fe640 1 -- 172.21.15.67:0/4060594175 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4032810 con 0x7f6d000b2da0 2024-04-25T02:28:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.446+0000 7f6d06a7b640 1 -- 172.21.15.67:0/4060594175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d000b2da0 msgr2=0x7f6d0006c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.446+0000 7f6d06a7b640 1 --2- 172.21.15.67:0/4060594175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d000b2da0 0x7f6d0006c840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009870 tx=0x7f6cf402a250 comp rx=0 tx=0).stop 2024-04-25T02:28:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.446+0000 7f6d06a7b640 1 -- 172.21.15.67:0/4060594175 shutdown_connections 2024-04-25T02:28:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.446+0000 7f6d06a7b640 1 --2- 172.21.15.67:0/4060594175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d000b2da0 0x7f6d0006c840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.446+0000 7f6d06a7b640 1 --2- 172.21.15.67:0/4060594175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d000cf060 0x7f6d000d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.446+0000 7f6d06a7b640 1 -- 172.21.15.67:0/4060594175 >> 172.21.15.67:0/4060594175 conn(0x7f6d000b3a70 msgr2=0x7f6d000b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:50.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.446+0000 7f6d06a7b640 1 -- 172.21.15.67:0/4060594175 shutdown_connections 2024-04-25T02:28:50.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.446+0000 7f6d06a7b640 1 -- 172.21.15.67:0/4060594175 wait complete. 2024-04-25T02:28:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.447+0000 7f6d06a7b640 1 Processor -- start 2024-04-25T02:28:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.447+0000 7f6d06a7b640 1 -- start start 2024-04-25T02:28:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.448+0000 7f6d06a7b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d0006cd80 0x7f6d00160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.448+0000 7f6d06a7b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d000b2da0 0x7f6d001e6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.448+0000 7f6d06a7b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d000cf060 0x7f6d000b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.448+0000 7f6d06a7b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6d000b3260 con 0x7f6d000cf060 2024-04-25T02:28:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.448+0000 7f6d06a7b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0006d210 con 0x7f6d000b2da0 2024-04-25T02:28:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.448+0000 7f6d06a7b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6d000b2670 con 0x7f6d0006cd80 2024-04-25T02:28:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.448+0000 7f6d05018640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d000cf060 0x7f6d000b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.448+0000 7f6d05018640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d000cf060 0x7f6d000b0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42076/0 (socket says 172.21.15.67:42076) 2024-04-25T02:28:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.448+0000 7f6d05018640 1 -- 172.21.15.67:0/3371700316 learned_addr learned my addr 172.21.15.67:0/3371700316 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.448+0000 7f6d04817640 1 --2- 172.21.15.67:0/3371700316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d0006cd80 0x7f6d00160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.448+0000 7f6cfffff640 1 --2- 172.21.15.67:0/3371700316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d000b2da0 0x7f6d001e6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.449+0000 7f6d05018640 1 -- 172.21.15.67:0/3371700316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d0006cd80 msgr2=0x7f6d00160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.449+0000 7f6d05018640 1 --2- 172.21.15.67:0/3371700316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d0006cd80 0x7f6d00160e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.449+0000 7f6d05018640 1 -- 172.21.15.67:0/3371700316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d000b2da0 msgr2=0x7f6d001e6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.449+0000 7f6d05018640 1 --2- 172.21.15.67:0/3371700316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d000b2da0 0x7f6d001e6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.449+0000 7f6d05018640 1 -- 172.21.15.67:0/3371700316 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d001e79f0 con 0x7f6d000cf060 2024-04-25T02:28:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.449+0000 7f6d05018640 1 --2- 172.21.15.67:0/3371700316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d000cf060 0x7f6d000b0f20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800c780 tx=0x7f6cf800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.449+0000 7f6cfd7fa640 1 -- 172.21.15.67:0/3371700316 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8017070 con 0x7f6d000cf060 2024-04-25T02:28:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.449+0000 7f6cfd7fa640 1 -- 172.21.15.67:0/3371700316 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf800a640 con 0x7f6d000cf060 2024-04-25T02:28:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.449+0000 7f6d06a7b640 1 -- 172.21.15.67:0/3371700316 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d001e7430 con 0x7f6d000cf060 2024-04-25T02:28:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.449+0000 7f6cfd7fa640 1 -- 172.21.15.67:0/3371700316 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf800aa30 con 0x7f6d000cf060 2024-04-25T02:28:50.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.449+0000 7f6d06a7b640 1 -- 172.21.15.67:0/3371700316 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d0009e3c0 con 0x7f6d000cf060 2024-04-25T02:28:50.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.450+0000 7f6d06a7b640 1 -- 172.21.15.67:0/3371700316 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d00069110 con 0x7f6d000cf060 2024-04-25T02:28:50.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.451+0000 7f6cfd7fa640 1 -- 172.21.15.67:0/3371700316 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6cf801a070 con 0x7f6d000cf060 2024-04-25T02:28:50.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.451+0000 7f6cfd7fa640 1 --2- 172.21.15.67:0/3371700316 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6cec06be30 0x7f6cec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:50.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.451+0000 7f6cfd7fa640 1 -- 172.21.15.67:0/3371700316 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6cf808a370 con 0x7f6d000cf060 2024-04-25T02:28:50.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.451+0000 7f6d04817640 1 --2- 172.21.15.67:0/3371700316 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6cec06be30 0x7f6cec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:50.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.452+0000 7f6d04817640 1 --2- 172.21.15.67:0/3371700316 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6cec06be30 0x7f6cec06e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009aa0 tx=0x7f6cf0009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:50.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.455+0000 7f6cfd7fa640 1 -- 172.21.15.67:0/3371700316 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6cf80586d0 con 0x7f6d000cf060 2024-04-25T02:28:50.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.636+0000 7f6d06a7b640 1 -- 172.21.15.67:0/3371700316 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6d000b6980 con 0x7f6d000cf060 2024-04-25T02:28:50.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.637+0000 7f6cfd7fa640 1 -- 172.21.15.67:0/3371700316 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f6cf805c9d0 con 0x7f6d000cf060 2024-04-25T02:28:50.640 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-25T02:28:50.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.638+0000 7f6d06a7b640 1 -- 172.21.15.67:0/3371700316 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6cec06be30 msgr2=0x7f6cec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.638+0000 7f6d06a7b640 1 --2- 172.21.15.67:0/3371700316 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6cec06be30 0x7f6cec06e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009aa0 tx=0x7f6cf0009190 comp rx=0 tx=0).stop 2024-04-25T02:28:50.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.638+0000 7f6d06a7b640 1 -- 172.21.15.67:0/3371700316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d000cf060 msgr2=0x7f6d000b0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.638+0000 7f6d06a7b640 1 --2- 172.21.15.67:0/3371700316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d000cf060 0x7f6d000b0f20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800c780 tx=0x7f6cf800cc40 comp rx=0 tx=0).stop 2024-04-25T02:28:50.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.639+0000 7f6d06a7b640 1 -- 172.21.15.67:0/3371700316 shutdown_connections 2024-04-25T02:28:50.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.639+0000 7f6d06a7b640 1 --2- 172.21.15.67:0/3371700316 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6cec06be30 0x7f6cec06e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.639+0000 7f6d06a7b640 1 --2- 172.21.15.67:0/3371700316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d000cf060 0x7f6d000b0f20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.639+0000 7f6d06a7b640 1 --2- 172.21.15.67:0/3371700316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d000b2da0 0x7f6d001e6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.639+0000 7f6d06a7b640 1 --2- 172.21.15.67:0/3371700316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d0006cd80 0x7f6d00160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.639+0000 7f6d06a7b640 1 -- 172.21.15.67:0/3371700316 >> 172.21.15.67:0/3371700316 conn(0x7f6d000b3a70 msgr2=0x7f6d000c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:50.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.639+0000 7f6d06a7b640 1 -- 172.21.15.67:0/3371700316 shutdown_connections 2024-04-25T02:28:50.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.639+0000 7f6d06a7b640 1 -- 172.21.15.67:0/3371700316 wait complete. 2024-04-25T02:28:50.652 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:28:50.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.753+0000 7fcbf8729640 1 Processor -- start 2024-04-25T02:28:50.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.753+0000 7fcbf8729640 1 -- start start 2024-04-25T02:28:50.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.754+0000 7fcbf8729640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcbf00d0a00 0x7fcbf006b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:50.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.754+0000 7fcbf8729640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcbf0071e70 0x7fcbf0072300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:50.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.754+0000 7fcbf8729640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbf006b7a0 con 0x7fcbf00cd1d0 2024-04-25T02:28:50.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.754+0000 7fcbf8729640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fcbf006c040 con 0x7fcbf00d0a00 2024-04-25T02:28:50.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.754+0000 7fcbf8729640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fcbf00cef50 con 0x7fcbf0071e70 2024-04-25T02:28:50.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.754+0000 7fcbf64c5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcbf00d0a00 0x7fcbf006b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:50.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.754+0000 7fcbf64c5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcbf00d0a00 0x7fcbf006b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42092/0 (socket says 172.21.15.67:42092) 2024-04-25T02:28:50.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.754+0000 7fcbf64c5640 1 -- 172.21.15.67:0/3672765515 learned_addr learned my addr 172.21.15.67:0/3672765515 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:50.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.754+0000 7fcbf6cc6640 1 --2- 172.21.15.67:0/3672765515 >> v2:172.21.15.176:3300/0 conn(0x7fcbf0071e70 0x7fcbf0072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:50.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.754+0000 7fcbf64c5640 1 -- 172.21.15.67:0/3672765515 >> v2:172.21.15.176:3300/0 conn(0x7fcbf0071e70 msgr2=0x7fcbf0072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:50.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.754+0000 7fcbf64c5640 1 --2- 172.21.15.67:0/3672765515 >> v2:172.21.15.176:3300/0 conn(0x7fcbf0071e70 0x7fcbf0072300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.754+0000 7fcbf64c5640 1 -- 172.21.15.67:0/3672765515 >> v1:172.21.15.176:6789/0 conn(0x7fcbf00cd1d0 legacy=0x7fcbf00cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:50.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.754+0000 7fcbf64c5640 1 -- 172.21.15.67:0/3672765515 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf006ba80 con 0x7fcbf00d0a00 2024-04-25T02:28:50.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.754+0000 7fcbf6cc6640 1 --2- 172.21.15.67:0/3672765515 >> v2:172.21.15.176:3300/0 conn(0x7fcbf0071e70 0x7fcbf0072300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:50.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.755+0000 7fcbf64c5640 1 --2- 172.21.15.67:0/3672765515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbf00d0a00 0x7fcbf006b0c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0072f70 tx=0x7fcbe402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36f24ce9df90406 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:50.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.755+0000 7fcbf54c3640 1 -- 172.21.15.67:0/3672765515 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4037070 con 0x7fcbf00d0a00 2024-04-25T02:28:50.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.755+0000 7fcbf54c3640 1 -- 172.21.15.67:0/3672765515 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe4032440 con 0x7fcbf00d0a00 2024-04-25T02:28:50.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.755+0000 7fcbf54c3640 1 -- 172.21.15.67:0/3672765515 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4032810 con 0x7fcbf00d0a00 2024-04-25T02:28:50.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.755+0000 7fcbf8729640 1 -- 172.21.15.67:0/3672765515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbf00d0a00 msgr2=0x7fcbf006b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.755+0000 7fcbf8729640 1 --2- 172.21.15.67:0/3672765515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbf00d0a00 0x7fcbf006b0c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0072f70 tx=0x7fcbe402a230 comp rx=0 tx=0).stop 2024-04-25T02:28:50.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.756+0000 7fcbf8729640 1 -- 172.21.15.67:0/3672765515 shutdown_connections 2024-04-25T02:28:50.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.756+0000 7fcbf8729640 1 --2- 172.21.15.67:0/3672765515 >> v2:172.21.15.176:3300/0 conn(0x7fcbf0071e70 0x7fcbf0072300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.756+0000 7fcbf8729640 1 --2- 172.21.15.67:0/3672765515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbf00d0a00 0x7fcbf006b0c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.756+0000 7fcbf8729640 1 -- 172.21.15.67:0/3672765515 >> 172.21.15.67:0/3672765515 conn(0x7fcbf00d0e20 msgr2=0x7fcbf00d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:50.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.756+0000 7fcbf8729640 1 -- 172.21.15.67:0/3672765515 shutdown_connections 2024-04-25T02:28:50.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.756+0000 7fcbf8729640 1 -- 172.21.15.67:0/3672765515 wait complete. 2024-04-25T02:28:50.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.757+0000 7fcbf8729640 1 Processor -- start 2024-04-25T02:28:50.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.757+0000 7fcbf8729640 1 -- start start 2024-04-25T02:28:50.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.757+0000 7fcbf8729640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf0071e70 0x7fcbf00c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:50.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.757+0000 7fcbf8729640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbf00cd1d0 0x7fcbf0161170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:50.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.757+0000 7fcbf8729640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbf00d0a00 0x7fcbf01e7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:50.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.757+0000 7fcbf8729640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf00cfaf0 con 0x7fcbf00d0a00 2024-04-25T02:28:50.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.757+0000 7fcbf8729640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf00cd660 con 0x7fcbf0071e70 2024-04-25T02:28:50.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.757+0000 7fcbf8729640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcbf00cfc70 con 0x7fcbf00cd1d0 2024-04-25T02:28:50.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.758+0000 7fcbf6cc6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbf00d0a00 0x7fcbf01e7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:50.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.758+0000 7fcbf6cc6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbf00d0a00 0x7fcbf01e7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42100/0 (socket says 172.21.15.67:42100) 2024-04-25T02:28:50.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.758+0000 7fcbf6cc6640 1 -- 172.21.15.67:0/2092298276 learned_addr learned my addr 172.21.15.67:0/2092298276 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:50.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.758+0000 7fcbf64c5640 1 --2- 172.21.15.67:0/2092298276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf0071e70 0x7fcbf00c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:50.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.758+0000 7fcbf5cc4640 1 --2- 172.21.15.67:0/2092298276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbf00cd1d0 0x7fcbf0161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:50.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.758+0000 7fcbf6cc6640 1 -- 172.21.15.67:0/2092298276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbf00cd1d0 msgr2=0x7fcbf0161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.758+0000 7fcbf6cc6640 1 --2- 172.21.15.67:0/2092298276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbf00cd1d0 0x7fcbf0161170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.758+0000 7fcbf6cc6640 1 -- 172.21.15.67:0/2092298276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf0071e70 msgr2=0x7fcbf00c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.758+0000 7fcbf6cc6640 1 --2- 172.21.15.67:0/2092298276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf0071e70 0x7fcbf00c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.758+0000 7fcbf6cc6640 1 -- 172.21.15.67:0/2092298276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf00c8a00 con 0x7fcbf00d0a00 2024-04-25T02:28:50.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.758+0000 7fcbf5cc4640 1 --2- 172.21.15.67:0/2092298276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbf00cd1d0 0x7fcbf0161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:50.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.758+0000 7fcbf64c5640 1 --2- 172.21.15.67:0/2092298276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf0071e70 0x7fcbf00c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:50.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.758+0000 7fcbf6cc6640 1 --2- 172.21.15.67:0/2092298276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbf00d0a00 0x7fcbf01e7fb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800cef0 tx=0x7fcbe800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:50.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.758+0000 7fcbe2ffd640 1 -- 172.21.15.67:0/2092298276 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe801a070 con 0x7fcbf00d0a00 2024-04-25T02:28:50.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.758+0000 7fcbe2ffd640 1 -- 172.21.15.67:0/2092298276 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe800d860 con 0x7fcbf00d0a00 2024-04-25T02:28:50.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.758+0000 7fcbf8729640 1 -- 172.21.15.67:0/2092298276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf00c8ce0 con 0x7fcbf00d0a00 2024-04-25T02:28:50.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.758+0000 7fcbe2ffd640 1 -- 172.21.15.67:0/2092298276 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe800dc50 con 0x7fcbf00d0a00 2024-04-25T02:28:50.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.758+0000 7fcbf8729640 1 -- 172.21.15.67:0/2092298276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf00c92a0 con 0x7fcbf00d0a00 2024-04-25T02:28:50.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.759+0000 7fcbf8729640 1 -- 172.21.15.67:0/2092298276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf0069110 con 0x7fcbf00d0a00 2024-04-25T02:28:50.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.760+0000 7fcbe2ffd640 1 -- 172.21.15.67:0/2092298276 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcbe801d070 con 0x7fcbf00d0a00 2024-04-25T02:28:50.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.760+0000 7fcbe2ffd640 1 --2- 172.21.15.67:0/2092298276 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fcbd406be30 0x7fcbd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:50.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.760+0000 7fcbe2ffd640 1 -- 172.21.15.67:0/2092298276 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcbe808b740 con 0x7fcbf00d0a00 2024-04-25T02:28:50.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.760+0000 7fcbf64c5640 1 --2- 172.21.15.67:0/2092298276 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fcbd406be30 0x7fcbd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:50.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.761+0000 7fcbf64c5640 1 --2- 172.21.15.67:0/2092298276 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fcbd406be30 0x7fcbd406e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4034000 tx=0x7fcbe402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:50.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.764+0000 7fcbe2ffd640 1 -- 172.21.15.67:0/2092298276 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcbe805a1b0 con 0x7fcbf00d0a00 2024-04-25T02:28:50.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.949+0000 7fcbf8729640 1 -- 172.21.15.67:0/2092298276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcbf0072fc0 con 0x7fcbf00d0a00 2024-04-25T02:28:50.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.949+0000 7fcbe2ffd640 1 -- 172.21.15.67:0/2092298276 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fcbe8059ab0 con 0x7fcbf00d0a00 2024-04-25T02:28:50.952 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-25T02:28:50.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.951+0000 7fcbf8729640 1 -- 172.21.15.67:0/2092298276 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fcbd406be30 msgr2=0x7fcbd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.951+0000 7fcbf8729640 1 --2- 172.21.15.67:0/2092298276 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fcbd406be30 0x7fcbd406e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4034000 tx=0x7fcbe402e000 comp rx=0 tx=0).stop 2024-04-25T02:28:50.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.951+0000 7fcbf8729640 1 -- 172.21.15.67:0/2092298276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbf00d0a00 msgr2=0x7fcbf01e7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:50.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.951+0000 7fcbf8729640 1 --2- 172.21.15.67:0/2092298276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbf00d0a00 0x7fcbf01e7fb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800cef0 tx=0x7fcbe800a710 comp rx=0 tx=0).stop 2024-04-25T02:28:50.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.951+0000 7fcbf8729640 1 -- 172.21.15.67:0/2092298276 shutdown_connections 2024-04-25T02:28:50.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.951+0000 7fcbf8729640 1 --2- 172.21.15.67:0/2092298276 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fcbd406be30 0x7fcbd406e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.951+0000 7fcbf8729640 1 --2- 172.21.15.67:0/2092298276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbf00d0a00 0x7fcbf01e7fb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.951+0000 7fcbf8729640 1 --2- 172.21.15.67:0/2092298276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbf00cd1d0 0x7fcbf0161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.951+0000 7fcbf8729640 1 --2- 172.21.15.67:0/2092298276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf0071e70 0x7fcbf00c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:50.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.951+0000 7fcbf8729640 1 -- 172.21.15.67:0/2092298276 >> 172.21.15.67:0/2092298276 conn(0x7fcbf00d0e20 msgr2=0x7fcbf00c3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:50.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.951+0000 7fcbf8729640 1 -- 172.21.15.67:0/2092298276 shutdown_connections 2024-04-25T02:28:50.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:50.952+0000 7fcbf8729640 1 -- 172.21.15.67:0/2092298276 wait complete. 2024-04-25T02:28:50.965 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:51.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.062+0000 7fe6a6db7640 1 Processor -- start 2024-04-25T02:28:51.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.062+0000 7fe6a6db7640 1 -- start start 2024-04-25T02:28:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.063+0000 7fe6a6db7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6a009b180 0x7fe6a00b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.063+0000 7fe6a6db7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6a00b49e0 con 0x7fe6a00b3020 2024-04-25T02:28:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.063+0000 7fe6a6db7640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6a00d0a10 con 0x7fe6a015e630 2024-04-25T02:28:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.063+0000 7fe6a6db7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a006ca00 con 0x7fe6a009b180 2024-04-25T02:28:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.063+0000 7fe69ffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe6a00b3020 0x7fe6a006ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36146/0 (socket says 172.21.15.67:36146) 2024-04-25T02:28:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.063+0000 7fe69ffff640 1 -- 172.21.15.67:0/1613033769 learned_addr learned my addr 172.21.15.67:0/1613033769 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe69f7fe640 1 -- 172.21.15.67:0/1613033769 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2009018219 0 0) 0x7fe6a00b49e0 con 0x7fe6a00b3020 2024-04-25T02:28:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe69f7fe640 1 -- 172.21.15.67:0/1613033769 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe68c003520 con 0x7fe6a00b3020 2024-04-25T02:28:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe6a5354640 1 --2- 172.21.15.67:0/1613033769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6a009b180 0x7fe6a00b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe69f7fe640 1 -- 172.21.15.67:0/1613033769 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2944691712 0 0) 0x7fe68c003520 con 0x7fe6a00b3020 2024-04-25T02:28:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe69f7fe640 1 -- 172.21.15.67:0/1613033769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6a009b180 msgr2=0x7fe6a00b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe69f7fe640 1 --2- 172.21.15.67:0/1613033769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6a009b180 0x7fe6a00b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe69f7fe640 1 -- 172.21.15.67:0/1613033769 >> v1:172.21.15.176:6789/0 conn(0x7fe6a015e630 legacy=0x7fe6a009aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe69f7fe640 1 -- 172.21.15.67:0/1613033769 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a00d0cf0 con 0x7fe6a00b3020 2024-04-25T02:28:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe69f7fe640 1 -- 172.21.15.67:0/1613033769 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7fe690001670 con 0x7fe6a00b3020 2024-04-25T02:28:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe69f7fe640 1 -- 172.21.15.67:0/1613033769 >> v1:172.21.15.67:6789/0 conn(0x7fe6a00b3020 legacy=0x7fe6a006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe69f7fe640 1 --2- 172.21.15.67:0/1613033769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe68c0039e0 0x7fe68c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe69f7fe640 1 --2- 172.21.15.67:0/1613033769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6a009b180 0x7fe68c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe69f7fe640 1 --2- 172.21.15.67:0/1613033769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe68c004d40 0x7fe68c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe69f7fe640 1 -- 172.21.15.67:0/1613033769 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a006ca00 con 0x7fe68c0039e0 2024-04-25T02:28:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe69f7fe640 1 -- 172.21.15.67:0/1613033769 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c00bb20 con 0x7fe68c004d40 2024-04-25T02:28:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe69f7fe640 1 -- 172.21.15.67:0/1613033769 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe68c00bd20 con 0x7fe6a009b180 2024-04-25T02:28:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe6a4b53640 1 --2- 172.21.15.67:0/1613033769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe68c0039e0 0x7fe68c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe69ffff640 1 --2- 172.21.15.67:0/1613033769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6a009b180 0x7fe68c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe6a5354640 1 --2- 172.21.15.67:0/1613033769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe68c004d40 0x7fe68c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe6a4b53640 1 -- 172.21.15.67:0/1613033769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6a009b180 msgr2=0x7fe68c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe6a4b53640 1 --2- 172.21.15.67:0/1613033769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6a009b180 0x7fe68c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe6a4b53640 1 -- 172.21.15.67:0/1613033769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe68c004d40 msgr2=0x7fe68c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe6a4b53640 1 --2- 172.21.15.67:0/1613033769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe68c004d40 0x7fe68c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe6a4b53640 1 -- 172.21.15.67:0/1613033769 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68c003520 con 0x7fe68c0039e0 2024-04-25T02:28:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.064+0000 7fe69ffff640 1 --2- 172.21.15.67:0/1613033769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6a009b180 0x7fe68c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.065+0000 7fe6a4b53640 1 --2- 172.21.15.67:0/1613033769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe68c0039e0 0x7fe68c003e00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe698001e50 tx=0x7fe68c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a251c6b34453bc6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.065+0000 7fe69f7fe640 1 -- 172.21.15.67:0/1613033769 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe698001a70 con 0x7fe68c0039e0 2024-04-25T02:28:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.065+0000 7fe69f7fe640 1 -- 172.21.15.67:0/1613033769 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe69802ada0 con 0x7fe68c0039e0 2024-04-25T02:28:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.065+0000 7fe69f7fe640 1 -- 172.21.15.67:0/1613033769 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe698003bb0 con 0x7fe68c0039e0 2024-04-25T02:28:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.066+0000 7fe6a6db7640 1 -- 172.21.15.67:0/1613033769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe68c0039e0 msgr2=0x7fe68c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.066+0000 7fe6a6db7640 1 --2- 172.21.15.67:0/1613033769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe68c0039e0 0x7fe68c003e00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe698001e50 tx=0x7fe68c005830 comp rx=0 tx=0).stop 2024-04-25T02:28:51.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.066+0000 7fe6a5354640 1 -- 172.21.15.67:0/1613033769 reap_dead start 2024-04-25T02:28:51.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.066+0000 7fe6a6db7640 1 -- 172.21.15.67:0/1613033769 shutdown_connections 2024-04-25T02:28:51.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.066+0000 7fe6a6db7640 1 -- 172.21.15.67:0/1613033769 >> 172.21.15.67:0/1613033769 conn(0x7fe6a00b3ae0 msgr2=0x7fe6a00b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:51.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.066+0000 7fe6a6db7640 1 -- 172.21.15.67:0/1613033769 shutdown_connections 2024-04-25T02:28:51.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.066+0000 7fe6a6db7640 1 -- 172.21.15.67:0/1613033769 wait complete. 2024-04-25T02:28:51.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.067+0000 7fe6a6db7640 1 Processor -- start 2024-04-25T02:28:51.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.067+0000 7fe6a6db7640 1 -- start start 2024-04-25T02:28:51.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.068+0000 7fe6a6db7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe68c0039e0 0x7fe6a0160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.068+0000 7fe6a6db7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6a0161b50 0x7fe6a01482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.068+0000 7fe6a6db7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6a0148800 0x7fe6a00ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.068+0000 7fe6a6db7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a00d1150 con 0x7fe68c0039e0 2024-04-25T02:28:51.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.068+0000 7fe6a6db7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a00d0fd0 con 0x7fe6a0148800 2024-04-25T02:28:51.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.068+0000 7fe6a6db7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a015ea10 con 0x7fe6a0161b50 2024-04-25T02:28:51.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.068+0000 7fe6a4b53640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe68c0039e0 0x7fe6a0160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.068+0000 7fe6a4b53640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe68c0039e0 0x7fe6a0160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42116/0 (socket says 172.21.15.67:42116) 2024-04-25T02:28:51.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.068+0000 7fe6a4b53640 1 -- 172.21.15.67:0/2631747992 learned_addr learned my addr 172.21.15.67:0/2631747992 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:51.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.068+0000 7fe69ffff640 1 --2- 172.21.15.67:0/2631747992 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6a0161b50 0x7fe6a01482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.068+0000 7fe6a5354640 1 --2- 172.21.15.67:0/2631747992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6a0148800 0x7fe6a00ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.068+0000 7fe6a4b53640 1 -- 172.21.15.67:0/2631747992 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6a0161b50 msgr2=0x7fe6a01482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.068+0000 7fe6a4b53640 1 --2- 172.21.15.67:0/2631747992 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6a0161b50 0x7fe6a01482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.068+0000 7fe6a4b53640 1 -- 172.21.15.67:0/2631747992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6a0148800 msgr2=0x7fe6a00ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.068+0000 7fe6a4b53640 1 --2- 172.21.15.67:0/2631747992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6a0148800 0x7fe6a00ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.068+0000 7fe6a4b53640 1 -- 172.21.15.67:0/2631747992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a0160ab0 con 0x7fe68c0039e0 2024-04-25T02:28:51.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.069+0000 7fe6a4b53640 1 --2- 172.21.15.67:0/2631747992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe68c0039e0 0x7fe6a0160280 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe698001eb0 tx=0x7fe6980014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:51.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.069+0000 7fe69d7fa640 1 -- 172.21.15.67:0/2631747992 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69803f030 con 0x7fe68c0039e0 2024-04-25T02:28:51.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.069+0000 7fe69d7fa640 1 -- 172.21.15.67:0/2631747992 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe69802aba0 con 0x7fe68c0039e0 2024-04-25T02:28:51.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.069+0000 7fe6a6db7640 1 -- 172.21.15.67:0/2631747992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a0160d90 con 0x7fe68c0039e0 2024-04-25T02:28:51.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.069+0000 7fe69d7fa640 1 -- 172.21.15.67:0/2631747992 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe698037040 con 0x7fe68c0039e0 2024-04-25T02:28:51.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.069+0000 7fe6a6db7640 1 -- 172.21.15.67:0/2631747992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a0161350 con 0x7fe68c0039e0 2024-04-25T02:28:51.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.070+0000 7fe6a6db7640 1 -- 172.21.15.67:0/2631747992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a0069110 con 0x7fe68c0039e0 2024-04-25T02:28:51.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.070+0000 7fe69d7fa640 1 -- 172.21.15.67:0/2631747992 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe698042070 con 0x7fe68c0039e0 2024-04-25T02:28:51.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.071+0000 7fe69d7fa640 1 --2- 172.21.15.67:0/2631747992 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe68006be30 0x7fe68006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.071+0000 7fe69d7fa640 1 -- 172.21.15.67:0/2631747992 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe6980aaaa0 con 0x7fe68c0039e0 2024-04-25T02:28:51.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.071+0000 7fe69ffff640 1 --2- 172.21.15.67:0/2631747992 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe68006be30 0x7fe68006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.071+0000 7fe69ffff640 1 --2- 172.21.15.67:0/2631747992 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe68006be30 0x7fe68006e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe6900017e0 tx=0x7fe690007040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:51.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.075+0000 7fe69d7fa640 1 -- 172.21.15.67:0/2631747992 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe698078e70 con 0x7fe68c0039e0 2024-04-25T02:28:51.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.261+0000 7fe6a6db7640 1 -- 172.21.15.67:0/2631747992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6a006df10 con 0x7fe68c0039e0 2024-04-25T02:28:51.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.262+0000 7fe69d7fa640 1 -- 172.21.15.67:0/2631747992 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7fe69807d170 con 0x7fe68c0039e0 2024-04-25T02:28:51.265 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:51.265 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:27.819641+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:51.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.264+0000 7fe6a6db7640 1 -- 172.21.15.67:0/2631747992 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe68006be30 msgr2=0x7fe68006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.264+0000 7fe6a6db7640 1 --2- 172.21.15.67:0/2631747992 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe68006be30 0x7fe68006e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe6900017e0 tx=0x7fe690007040 comp rx=0 tx=0).stop 2024-04-25T02:28:51.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.264+0000 7fe6a6db7640 1 -- 172.21.15.67:0/2631747992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe68c0039e0 msgr2=0x7fe6a0160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.264+0000 7fe6a6db7640 1 --2- 172.21.15.67:0/2631747992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe68c0039e0 0x7fe6a0160280 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe698001eb0 tx=0x7fe6980014a0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.264+0000 7fe6a6db7640 1 -- 172.21.15.67:0/2631747992 shutdown_connections 2024-04-25T02:28:51.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.264+0000 7fe6a6db7640 1 --2- 172.21.15.67:0/2631747992 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe68006be30 0x7fe68006e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.264+0000 7fe6a6db7640 1 --2- 172.21.15.67:0/2631747992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6a0148800 0x7fe6a00ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.264+0000 7fe6a6db7640 1 --2- 172.21.15.67:0/2631747992 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6a0161b50 0x7fe6a01482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.264+0000 7fe6a6db7640 1 --2- 172.21.15.67:0/2631747992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe68c0039e0 0x7fe6a0160280 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.264+0000 7fe6a6db7640 1 -- 172.21.15.67:0/2631747992 >> 172.21.15.67:0/2631747992 conn(0x7fe6a00b3ae0 msgr2=0x7fe6a009aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:51.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.264+0000 7fe6a6db7640 1 -- 172.21.15.67:0/2631747992 shutdown_connections 2024-04-25T02:28:51.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.264+0000 7fe6a6db7640 1 -- 172.21.15.67:0/2631747992 wait complete. 2024-04-25T02:28:51.279 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:28:24.445606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:28:25.161619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:28:51.279 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:28:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.380+0000 7f62a8ed6640 1 Processor -- start 2024-04-25T02:28:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.380+0000 7f62a8ed6640 1 -- start start 2024-04-25T02:28:51.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.381+0000 7f62a8ed6640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f62a415b090 0x7f62a409db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.381+0000 7f62a8ed6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f62a40b2cc0 0x7f62a406e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.381+0000 7f62a8ed6640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62a40ad820 con 0x7f62a406ea70 2024-04-25T02:28:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.381+0000 7f62a8ed6640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f62a406eea0 con 0x7f62a40b2cc0 2024-04-25T02:28:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.381+0000 7f62a8ed6640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f62a40b3260 con 0x7f62a415b090 2024-04-25T02:28:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.381+0000 7f6299d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f62a40b2cc0 0x7f62a406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.381+0000 7f6299d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f62a40b2cc0 0x7f62a406e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42132/0 (socket says 172.21.15.67:42132) 2024-04-25T02:28:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.381+0000 7f6299d9b640 1 -- 172.21.15.67:0/1279428864 learned_addr learned my addr 172.21.15.67:0/1279428864 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.381+0000 7f62a259c640 1 --2- 172.21.15.67:0/1279428864 >> v2:172.21.15.176:3300/0 conn(0x7f62a415b090 0x7f62a409db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.381+0000 7f6299d9b640 1 -- 172.21.15.67:0/1279428864 >> v2:172.21.15.176:3300/0 conn(0x7f62a415b090 msgr2=0x7f62a409db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.381+0000 7f6299d9b640 1 --2- 172.21.15.67:0/1279428864 >> v2:172.21.15.176:3300/0 conn(0x7f62a415b090 0x7f62a409db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.381+0000 7f6299d9b640 1 -- 172.21.15.67:0/1279428864 >> v1:172.21.15.176:6789/0 conn(0x7f62a406ea70 legacy=0x7f62a415ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.381+0000 7f6299d9b640 1 -- 172.21.15.67:0/1279428864 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a40b3540 con 0x7f62a40b2cc0 2024-04-25T02:28:51.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.382+0000 7f6299d9b640 1 --2- 172.21.15.67:0/1279428864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a40b2cc0 0x7f62a406e530 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f62a40709b0 tx=0x7f628c02c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2999b5082e121a48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:51.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.382+0000 7f62a1d9b640 1 -- 172.21.15.67:0/1279428864 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c0325a0 con 0x7f62a40b2cc0 2024-04-25T02:28:51.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.382+0000 7f62a1d9b640 1 -- 172.21.15.67:0/1279428864 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f628c038070 con 0x7f62a40b2cc0 2024-04-25T02:28:51.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.382+0000 7f62a1d9b640 1 -- 172.21.15.67:0/1279428864 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c032960 con 0x7f62a40b2cc0 2024-04-25T02:28:51.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.383+0000 7f62a8ed6640 1 -- 172.21.15.67:0/1279428864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a40b2cc0 msgr2=0x7f62a406e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.383+0000 7f62a8ed6640 1 --2- 172.21.15.67:0/1279428864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a40b2cc0 0x7f62a406e530 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f62a40709b0 tx=0x7f628c02c8e0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.383+0000 7f62a8ed6640 1 -- 172.21.15.67:0/1279428864 shutdown_connections 2024-04-25T02:28:51.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.383+0000 7f62a8ed6640 1 --2- 172.21.15.67:0/1279428864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a40b2cc0 0x7f62a406e530 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.383+0000 7f62a8ed6640 1 --2- 172.21.15.67:0/1279428864 >> v2:172.21.15.176:3300/0 conn(0x7f62a415b090 0x7f62a409db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.383+0000 7f62a8ed6640 1 -- 172.21.15.67:0/1279428864 >> 172.21.15.67:0/1279428864 conn(0x7f62a40b19c0 msgr2=0x7f62a40b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:51.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.383+0000 7f62a8ed6640 1 -- 172.21.15.67:0/1279428864 shutdown_connections 2024-04-25T02:28:51.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.383+0000 7f62a8ed6640 1 -- 172.21.15.67:0/1279428864 wait complete. 2024-04-25T02:28:51.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.384+0000 7f62a8ed6640 1 Processor -- start 2024-04-25T02:28:51.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.384+0000 7f62a8ed6640 1 -- start start 2024-04-25T02:28:51.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.385+0000 7f62a8ed6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a406ea70 0x7f62a4150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.385+0000 7f62a8ed6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62a40b2cc0 0x7f62a40ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.385+0000 7f62a8ed6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62a415b090 0x7f62a406d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.385+0000 7f62a8ed6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f62a40b4f70 con 0x7f62a406ea70 2024-04-25T02:28:51.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.385+0000 7f62a8ed6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f62a40b3b00 con 0x7f62a415b090 2024-04-25T02:28:51.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.385+0000 7f62a8ed6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f62a415b470 con 0x7f62a40b2cc0 2024-04-25T02:28:51.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.385+0000 7f62a259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a406ea70 0x7f62a4150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.385+0000 7f62a259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a406ea70 0x7f62a4150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42140/0 (socket says 172.21.15.67:42140) 2024-04-25T02:28:51.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.385+0000 7f62a259c640 1 -- 172.21.15.67:0/1544272884 learned_addr learned my addr 172.21.15.67:0/1544272884 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.385+0000 7f6299d9b640 1 --2- 172.21.15.67:0/1544272884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62a40b2cc0 0x7f62a40ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.385+0000 7f62a2d9d640 1 --2- 172.21.15.67:0/1544272884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62a415b090 0x7f62a406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.385+0000 7f62a259c640 1 -- 172.21.15.67:0/1544272884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62a40b2cc0 msgr2=0x7f62a40ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.385+0000 7f62a259c640 1 --2- 172.21.15.67:0/1544272884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62a40b2cc0 0x7f62a40ceee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.385+0000 7f62a259c640 1 -- 172.21.15.67:0/1544272884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62a415b090 msgr2=0x7f62a406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.385+0000 7f62a259c640 1 --2- 172.21.15.67:0/1544272884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62a415b090 0x7f62a406d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.385+0000 7f62a259c640 1 -- 172.21.15.67:0/1544272884 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a409d2b0 con 0x7f62a406ea70 2024-04-25T02:28:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.385+0000 7f6299d9b640 1 --2- 172.21.15.67:0/1544272884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62a40b2cc0 0x7f62a40ceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.385+0000 7f62a2d9d640 1 --2- 172.21.15.67:0/1544272884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62a415b090 0x7f62a406d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.386+0000 7f62a259c640 1 --2- 172.21.15.67:0/1544272884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a406ea70 0x7f62a4150d20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f629400d5f0 tx=0x7f629400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.386+0000 7f629b7fe640 1 -- 172.21.15.67:0/1544272884 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62940125f0 con 0x7f62a406ea70 2024-04-25T02:28:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.386+0000 7f629b7fe640 1 -- 172.21.15.67:0/1544272884 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6294019070 con 0x7f62a406ea70 2024-04-25T02:28:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.386+0000 7f62a8ed6640 1 -- 172.21.15.67:0/1544272884 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a40cf850 con 0x7f62a406ea70 2024-04-25T02:28:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.386+0000 7f629b7fe640 1 -- 172.21.15.67:0/1544272884 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62940129d0 con 0x7f62a406ea70 2024-04-25T02:28:51.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.386+0000 7f62a8ed6640 1 -- 172.21.15.67:0/1544272884 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a409cab0 con 0x7f62a406ea70 2024-04-25T02:28:51.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.387+0000 7f62a8ed6640 1 -- 172.21.15.67:0/1544272884 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62a4069110 con 0x7f62a406ea70 2024-04-25T02:28:51.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.387+0000 7f629b7fe640 1 -- 172.21.15.67:0/1544272884 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6294012b70 con 0x7f62a406ea70 2024-04-25T02:28:51.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.388+0000 7f629b7fe640 1 --2- 172.21.15.67:0/1544272884 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f628406be30 0x7f628406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.388+0000 7f629b7fe640 1 -- 172.21.15.67:0/1544272884 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f629408b270 con 0x7f62a406ea70 2024-04-25T02:28:51.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.388+0000 7f6299d9b640 1 --2- 172.21.15.67:0/1544272884 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f628406be30 0x7f628406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.389+0000 7f6299d9b640 1 --2- 172.21.15.67:0/1544272884 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f628406be30 0x7f628406e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f628c037000 tx=0x7f628c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:51.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.392+0000 7f629b7fe640 1 -- 172.21.15.67:0/1544272884 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6294059c20 con 0x7f62a406ea70 2024-04-25T02:28:51.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.573+0000 7f62a8ed6640 1 -- 172.21.15.67:0/1544272884 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f62a406cdd0 con 0x7f62a406ea70 2024-04-25T02:28:51.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.574+0000 7f629b7fe640 1 -- 172.21.15.67:0/1544272884 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f6294059520 con 0x7f62a406ea70 2024-04-25T02:28:51.577 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:28:51.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.576+0000 7f62a8ed6640 1 -- 172.21.15.67:0/1544272884 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f628406be30 msgr2=0x7f628406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.576+0000 7f62a8ed6640 1 --2- 172.21.15.67:0/1544272884 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f628406be30 0x7f628406e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f628c037000 tx=0x7f628c032000 comp rx=0 tx=0).stop 2024-04-25T02:28:51.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.576+0000 7f62a8ed6640 1 -- 172.21.15.67:0/1544272884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a406ea70 msgr2=0x7f62a4150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.576+0000 7f62a8ed6640 1 --2- 172.21.15.67:0/1544272884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a406ea70 0x7f62a4150d20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f629400d5f0 tx=0x7f629400dab0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.576+0000 7f62a8ed6640 1 -- 172.21.15.67:0/1544272884 shutdown_connections 2024-04-25T02:28:51.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.576+0000 7f62a8ed6640 1 --2- 172.21.15.67:0/1544272884 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f628406be30 0x7f628406e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.576+0000 7f62a8ed6640 1 --2- 172.21.15.67:0/1544272884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62a415b090 0x7f62a406d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.576+0000 7f62a8ed6640 1 --2- 172.21.15.67:0/1544272884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62a40b2cc0 0x7f62a40ceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.576+0000 7f62a8ed6640 1 --2- 172.21.15.67:0/1544272884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a406ea70 0x7f62a4150d20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.576+0000 7f62a8ed6640 1 -- 172.21.15.67:0/1544272884 >> 172.21.15.67:0/1544272884 conn(0x7f62a40b19c0 msgr2=0x7f62a41562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:51.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.576+0000 7f62a8ed6640 1 -- 172.21.15.67:0/1544272884 shutdown_connections 2024-04-25T02:28:51.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.576+0000 7f62a8ed6640 1 -- 172.21.15.67:0/1544272884 wait complete. 2024-04-25T02:28:51.590 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:28:51.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.691+0000 7f171c05d640 1 Processor -- start 2024-04-25T02:28:51.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.691+0000 7f171c05d640 1 -- start start 2024-04-25T02:28:51.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.692+0000 7f171c05d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17140726d0 0x7f1714072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.692+0000 7f171c05d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f171415f750 con 0x7f17141551c0 2024-04-25T02:28:51.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.692+0000 7f171c05d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f171415ef00 con 0x7f171406edb0 2024-04-25T02:28:51.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.692+0000 7f171c05d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f171415f190 con 0x7f17140726d0 2024-04-25T02:28:51.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.692+0000 7f1719df9640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f17141551c0 0x7f171415e7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55812/0 (socket says 172.21.15.67:55812) 2024-04-25T02:28:51.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.692+0000 7f1719df9640 1 -- 172.21.15.67:0/1331017722 learned_addr learned my addr 172.21.15.67:0/1331017722 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:51.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.692+0000 7f171a5fa640 1 --2- 172.21.15.67:0/1331017722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17140726d0 0x7f1714072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.693+0000 7f1718df7640 1 -- 172.21.15.67:0/1331017722 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2737818717 0 0) 0x7f171415f750 con 0x7f17141551c0 2024-04-25T02:28:51.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.693+0000 7f1718df7640 1 -- 172.21.15.67:0/1331017722 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16fc003520 con 0x7f17141551c0 2024-04-25T02:28:51.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.693+0000 7f1718df7640 1 -- 172.21.15.67:0/1331017722 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2907749416 0 0) 0x7f171415ef00 con 0x7f171406edb0 2024-04-25T02:28:51.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.693+0000 7f1718df7640 1 -- 172.21.15.67:0/1331017722 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f171415f750 con 0x7f171406edb0 2024-04-25T02:28:51.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.693+0000 7f171a5fa640 1 -- 172.21.15.67:0/1331017722 >> v1:172.21.15.176:6789/0 conn(0x7f171406edb0 legacy=0x7f17140b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.693+0000 7f171a5fa640 1 -- 172.21.15.67:0/1331017722 >> v1:172.21.15.67:6789/0 conn(0x7f17141551c0 legacy=0x7f171415e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.693+0000 7f171a5fa640 1 -- 172.21.15.67:0/1331017722 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f171415f470 con 0x7f17140726d0 2024-04-25T02:28:51.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.694+0000 7f171a5fa640 1 --2- 172.21.15.67:0/1331017722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17140726d0 0x7f1714072b80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f170c0097d0 tx=0x7f170c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0865ccc8856deff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:51.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.694+0000 7f1718df7640 1 -- 172.21.15.67:0/1331017722 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c037070 con 0x7f17140726d0 2024-04-25T02:28:51.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.694+0000 7f1718df7640 1 -- 172.21.15.67:0/1331017722 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f170c032440 con 0x7f17140726d0 2024-04-25T02:28:51.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.694+0000 7f1718df7640 1 -- 172.21.15.67:0/1331017722 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c032810 con 0x7f17140726d0 2024-04-25T02:28:51.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.694+0000 7f171c05d640 1 -- 172.21.15.67:0/1331017722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17140726d0 msgr2=0x7f1714072b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.694+0000 7f171c05d640 1 --2- 172.21.15.67:0/1331017722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17140726d0 0x7f1714072b80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f170c0097d0 tx=0x7f170c02a180 comp rx=0 tx=0).stop 2024-04-25T02:28:51.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.694+0000 7f171c05d640 1 -- 172.21.15.67:0/1331017722 shutdown_connections 2024-04-25T02:28:51.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.694+0000 7f171c05d640 1 --2- 172.21.15.67:0/1331017722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17140726d0 0x7f1714072b80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.694+0000 7f171c05d640 1 -- 172.21.15.67:0/1331017722 >> 172.21.15.67:0/1331017722 conn(0x7f17140b19c0 msgr2=0x7f17140b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:51.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.695+0000 7f171c05d640 1 -- 172.21.15.67:0/1331017722 shutdown_connections 2024-04-25T02:28:51.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.695+0000 7f171c05d640 1 -- 172.21.15.67:0/1331017722 wait complete. 2024-04-25T02:28:51.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.696+0000 7f171c05d640 1 Processor -- start 2024-04-25T02:28:51.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.696+0000 7f171c05d640 1 -- start start 2024-04-25T02:28:51.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.696+0000 7f171c05d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f171406edb0 0x7f17141543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.696+0000 7f171c05d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17140726d0 0x7f17141e90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.696+0000 7f171c05d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17141551c0 0x7f17141e9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.696+0000 7f171c05d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f17140b33d0 con 0x7f17140726d0 2024-04-25T02:28:51.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.696+0000 7f171c05d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1714071430 con 0x7f17141551c0 2024-04-25T02:28:51.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.696+0000 7f171c05d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f17141555a0 con 0x7f171406edb0 2024-04-25T02:28:51.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.697+0000 7f17195f8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17140726d0 0x7f17141e90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.697+0000 7f17195f8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17140726d0 0x7f17141e90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46716/0 (socket says 172.21.15.67:46716) 2024-04-25T02:28:51.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.697+0000 7f17195f8640 1 -- 172.21.15.67:0/1935060057 learned_addr learned my addr 172.21.15.67:0/1935060057 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:51.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.697+0000 7f17195f8640 1 -- 172.21.15.67:0/1935060057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f171406edb0 msgr2=0x7f17141543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.697+0000 7f1719df9640 1 --2- 172.21.15.67:0/1935060057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f171406edb0 0x7f17141543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.697+0000 7f171a5fa640 1 --2- 172.21.15.67:0/1935060057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17141551c0 0x7f17141e9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.697+0000 7f17195f8640 1 --2- 172.21.15.67:0/1935060057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f171406edb0 0x7f17141543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.697+0000 7f17195f8640 1 -- 172.21.15.67:0/1935060057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17141551c0 msgr2=0x7f17141e9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.697+0000 7f17195f8640 1 --2- 172.21.15.67:0/1935060057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17141551c0 0x7f17141e9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.697+0000 7f17195f8640 1 -- 172.21.15.67:0/1935060057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17141f7860 con 0x7f17140726d0 2024-04-25T02:28:51.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.697+0000 7f17195f8640 1 --2- 172.21.15.67:0/1935060057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17140726d0 0x7f17141e90d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f170800c500 tx=0x7f170800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:51.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.697+0000 7f17127fc640 1 -- 172.21.15.67:0/1935060057 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17080052d0 con 0x7f17140726d0 2024-04-25T02:28:51.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.697+0000 7f17127fc640 1 -- 172.21.15.67:0/1935060057 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1708005490 con 0x7f17140726d0 2024-04-25T02:28:51.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.697+0000 7f171c05d640 1 -- 172.21.15.67:0/1935060057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17141577c0 con 0x7f17140726d0 2024-04-25T02:28:51.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.697+0000 7f17127fc640 1 -- 172.21.15.67:0/1935060057 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1708012870 con 0x7f17140726d0 2024-04-25T02:28:51.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.697+0000 7f171c05d640 1 -- 172.21.15.67:0/1935060057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1714157d80 con 0x7f17140726d0 2024-04-25T02:28:51.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.698+0000 7f171c05d640 1 -- 172.21.15.67:0/1935060057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17140689c0 con 0x7f17140726d0 2024-04-25T02:28:51.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.699+0000 7f17127fc640 1 -- 172.21.15.67:0/1935060057 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1708012a10 con 0x7f17140726d0 2024-04-25T02:28:51.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.699+0000 7f17127fc640 1 --2- 172.21.15.67:0/1935060057 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f170006be30 0x7f170006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:51.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.699+0000 7f17127fc640 1 -- 172.21.15.67:0/1935060057 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f170808ab30 con 0x7f17140726d0 2024-04-25T02:28:51.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.700+0000 7f1719df9640 1 --2- 172.21.15.67:0/1935060057 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f170006be30 0x7f170006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:51.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.700+0000 7f1719df9640 1 --2- 172.21.15.67:0/1935060057 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f170006be30 0x7f170006e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1704001560 tx=0x7f1704009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:51.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.704+0000 7f17127fc640 1 -- 172.21.15.67:0/1935060057 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f17140689c0 con 0x7f17140726d0 2024-04-25T02:28:51.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.885+0000 7f171c05d640 1 -- 172.21.15.67:0/1935060057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1714069110 con 0x7f17140726d0 2024-04-25T02:28:51.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.886+0000 7f17127fc640 1 -- 172.21.15.67:0/1935060057 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f17080594f0 con 0x7f17140726d0 2024-04-25T02:28:51.889 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-25T02:28:51.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.887+0000 7f171c05d640 1 -- 172.21.15.67:0/1935060057 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f170006be30 msgr2=0x7f170006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.887+0000 7f171c05d640 1 --2- 172.21.15.67:0/1935060057 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f170006be30 0x7f170006e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1704001560 tx=0x7f1704009040 comp rx=0 tx=0).stop 2024-04-25T02:28:51.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.888+0000 7f171c05d640 1 -- 172.21.15.67:0/1935060057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17140726d0 msgr2=0x7f17141e90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:51.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.888+0000 7f171c05d640 1 --2- 172.21.15.67:0/1935060057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17140726d0 0x7f17141e90d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f170800c500 tx=0x7f170800c9c0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.888+0000 7f171c05d640 1 -- 172.21.15.67:0/1935060057 shutdown_connections 2024-04-25T02:28:51.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.888+0000 7f171c05d640 1 --2- 172.21.15.67:0/1935060057 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f170006be30 0x7f170006e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.888+0000 7f171c05d640 1 --2- 172.21.15.67:0/1935060057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17141551c0 0x7f17141e9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.888+0000 7f171c05d640 1 --2- 172.21.15.67:0/1935060057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17140726d0 0x7f17141e90d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.888+0000 7f171c05d640 1 --2- 172.21.15.67:0/1935060057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f171406edb0 0x7f17141543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:51.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.888+0000 7f171c05d640 1 -- 172.21.15.67:0/1935060057 >> 172.21.15.67:0/1935060057 conn(0x7f17140b19c0 msgr2=0x7f17140ace80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:51.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.888+0000 7f171c05d640 1 -- 172.21.15.67:0/1935060057 shutdown_connections 2024-04-25T02:28:51.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:51.888+0000 7f171c05d640 1 -- 172.21.15.67:0/1935060057 wait complete. 2024-04-25T02:28:51.901 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:28:52.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.002+0000 7fee85777640 1 Processor -- start 2024-04-25T02:28:52.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.002+0000 7fee85777640 1 -- start start 2024-04-25T02:28:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.003+0000 7fee85777640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fee8015e670 0x7fee800d4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.003+0000 7fee85777640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fee800b5180 0x7fee800c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.003+0000 7fee85777640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee800d2a30 con 0x7fee800d07d0 2024-04-25T02:28:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.003+0000 7fee85777640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fee800d2d10 con 0x7fee8015e670 2024-04-25T02:28:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.003+0000 7fee85777640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fee800cee50 con 0x7fee800b5180 2024-04-25T02:28:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.003+0000 7fee7effd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fee8015e670 0x7fee800d4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.003+0000 7fee7effd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fee8015e670 0x7fee800d4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46724/0 (socket says 172.21.15.67:46724) 2024-04-25T02:28:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.003+0000 7fee7effd640 1 -- 172.21.15.67:0/3164220248 learned_addr learned my addr 172.21.15.67:0/3164220248 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.004+0000 7fee7e7fc640 1 --2- 172.21.15.67:0/3164220248 >> v2:172.21.15.176:3300/0 conn(0x7fee800b5180 0x7fee800c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.004+0000 7fee7effd640 1 -- 172.21.15.67:0/3164220248 >> v2:172.21.15.176:3300/0 conn(0x7fee800b5180 msgr2=0x7fee800c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:52.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.004+0000 7fee7effd640 1 --2- 172.21.15.67:0/3164220248 >> v2:172.21.15.176:3300/0 conn(0x7fee800b5180 0x7fee800c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.004+0000 7fee7effd640 1 -- 172.21.15.67:0/3164220248 >> v1:172.21.15.176:6789/0 conn(0x7fee800d07d0 legacy=0x7fee800cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.004+0000 7fee7effd640 1 -- 172.21.15.67:0/3164220248 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee800cf130 con 0x7fee8015e670 2024-04-25T02:28:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.004+0000 7fee7effd640 1 --2- 172.21.15.67:0/3164220248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee8015e670 0x7fee800d4b90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fee80068e70 tx=0x7fee7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba22b3bb9040798 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.005+0000 7fee7dffb640 1 -- 172.21.15.67:0/3164220248 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee78037070 con 0x7fee8015e670 2024-04-25T02:28:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.005+0000 7fee7dffb640 1 -- 172.21.15.67:0/3164220248 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee78032440 con 0x7fee8015e670 2024-04-25T02:28:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.005+0000 7fee7dffb640 1 -- 172.21.15.67:0/3164220248 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee78032810 con 0x7fee8015e670 2024-04-25T02:28:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.005+0000 7fee85777640 1 -- 172.21.15.67:0/3164220248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee8015e670 msgr2=0x7fee800d4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.005+0000 7fee85777640 1 --2- 172.21.15.67:0/3164220248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee8015e670 0x7fee800d4b90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fee80068e70 tx=0x7fee7802a270 comp rx=0 tx=0).stop 2024-04-25T02:28:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.005+0000 7fee85777640 1 -- 172.21.15.67:0/3164220248 shutdown_connections 2024-04-25T02:28:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.005+0000 7fee85777640 1 --2- 172.21.15.67:0/3164220248 >> v2:172.21.15.176:3300/0 conn(0x7fee800b5180 0x7fee800c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.005+0000 7fee85777640 1 --2- 172.21.15.67:0/3164220248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee8015e670 0x7fee800d4b90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.005+0000 7fee85777640 1 -- 172.21.15.67:0/3164220248 >> 172.21.15.67:0/3164220248 conn(0x7fee800d40a0 msgr2=0x7fee800d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:52.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.005+0000 7fee85777640 1 -- 172.21.15.67:0/3164220248 shutdown_connections 2024-04-25T02:28:52.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.005+0000 7fee85777640 1 -- 172.21.15.67:0/3164220248 wait complete. 2024-04-25T02:28:52.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.007+0000 7fee85777640 1 Processor -- start 2024-04-25T02:28:52.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.007+0000 7fee85777640 1 -- start start 2024-04-25T02:28:52.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.007+0000 7fee85777640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee800b5180 0x7fee800a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.007+0000 7fee85777640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee800d07d0 0x7fee800b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.007+0000 7fee85777640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee8015e670 0x7fee80152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.007+0000 7fee85777640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fee800c82b0 con 0x7fee8015e670 2024-04-25T02:28:52.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.007+0000 7fee85777640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fee800c8130 con 0x7fee800d07d0 2024-04-25T02:28:52.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.007+0000 7fee85777640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fee800d2ff0 con 0x7fee800b5180 2024-04-25T02:28:52.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.007+0000 7fee7f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee8015e670 0x7fee80152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.008+0000 7fee7f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee8015e670 0x7fee80152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46738/0 (socket says 172.21.15.67:46738) 2024-04-25T02:28:52.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.008+0000 7fee7f7fe640 1 -- 172.21.15.67:0/3643959109 learned_addr learned my addr 172.21.15.67:0/3643959109 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:52.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.008+0000 7fee7effd640 1 --2- 172.21.15.67:0/3643959109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee800b5180 0x7fee800a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.008+0000 7fee7e7fc640 1 --2- 172.21.15.67:0/3643959109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee800d07d0 0x7fee800b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.008+0000 7fee7f7fe640 1 -- 172.21.15.67:0/3643959109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee800b5180 msgr2=0x7fee800a11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.008+0000 7fee7f7fe640 1 --2- 172.21.15.67:0/3643959109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee800b5180 0x7fee800a11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.008+0000 7fee7f7fe640 1 -- 172.21.15.67:0/3643959109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee800d07d0 msgr2=0x7fee800b96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.008+0000 7fee7f7fe640 1 --2- 172.21.15.67:0/3643959109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee800d07d0 0x7fee800b96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.008+0000 7fee7f7fe640 1 -- 172.21.15.67:0/3643959109 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee800a1850 con 0x7fee8015e670 2024-04-25T02:28:52.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.008+0000 7fee7f7fe640 1 --2- 172.21.15.67:0/3643959109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee8015e670 0x7fee80152590 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fee7000c7a0 tx=0x7fee7000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:52.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.008+0000 7fee777fe640 1 -- 172.21.15.67:0/3643959109 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70003b70 con 0x7fee8015e670 2024-04-25T02:28:52.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.008+0000 7fee777fe640 1 -- 172.21.15.67:0/3643959109 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee70003d30 con 0x7fee8015e670 2024-04-25T02:28:52.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.008+0000 7fee85777640 1 -- 172.21.15.67:0/3643959109 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee800b6660 con 0x7fee8015e670 2024-04-25T02:28:52.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.008+0000 7fee777fe640 1 -- 172.21.15.67:0/3643959109 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7000aa90 con 0x7fee8015e670 2024-04-25T02:28:52.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.008+0000 7fee85777640 1 -- 172.21.15.67:0/3643959109 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee800b6be0 con 0x7fee8015e670 2024-04-25T02:28:52.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.009+0000 7fee85777640 1 -- 172.21.15.67:0/3643959109 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee800681f0 con 0x7fee8015e670 2024-04-25T02:28:52.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.010+0000 7fee777fe640 1 -- 172.21.15.67:0/3643959109 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee7000ac30 con 0x7fee8015e670 2024-04-25T02:28:52.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.010+0000 7fee777fe640 1 --2- 172.21.15.67:0/3643959109 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fee6006be60 0x7fee6006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.010+0000 7fee777fe640 1 -- 172.21.15.67:0/3643959109 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fee7008aba0 con 0x7fee8015e670 2024-04-25T02:28:52.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.010+0000 7fee7effd640 1 --2- 172.21.15.67:0/3643959109 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fee6006be60 0x7fee6006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.011+0000 7fee7effd640 1 --2- 172.21.15.67:0/3643959109 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fee6006be60 0x7fee6006e320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fee78034000 tx=0x7fee7802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:52.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.014+0000 7fee777fe640 1 -- 172.21.15.67:0/3643959109 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fee70058f90 con 0x7fee8015e670 2024-04-25T02:28:52.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.196+0000 7fee85777640 1 -- 172.21.15.67:0/3643959109 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fee8015dc40 con 0x7fee8015e670 2024-04-25T02:28:52.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.196+0000 7fee777fe640 1 -- 172.21.15.67:0/3643959109 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fee7005d290 con 0x7fee8015e670 2024-04-25T02:28:52.200 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-25T02:28:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.198+0000 7fee85777640 1 -- 172.21.15.67:0/3643959109 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fee6006be60 msgr2=0x7fee6006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.198+0000 7fee85777640 1 --2- 172.21.15.67:0/3643959109 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fee6006be60 0x7fee6006e320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fee78034000 tx=0x7fee7802e000 comp rx=0 tx=0).stop 2024-04-25T02:28:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.198+0000 7fee85777640 1 -- 172.21.15.67:0/3643959109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee8015e670 msgr2=0x7fee80152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.198+0000 7fee85777640 1 --2- 172.21.15.67:0/3643959109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee8015e670 0x7fee80152590 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fee7000c7a0 tx=0x7fee7000cc60 comp rx=0 tx=0).stop 2024-04-25T02:28:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.198+0000 7fee85777640 1 -- 172.21.15.67:0/3643959109 shutdown_connections 2024-04-25T02:28:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.198+0000 7fee85777640 1 --2- 172.21.15.67:0/3643959109 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fee6006be60 0x7fee6006e320 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.198+0000 7fee85777640 1 --2- 172.21.15.67:0/3643959109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee8015e670 0x7fee80152590 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.198+0000 7fee85777640 1 --2- 172.21.15.67:0/3643959109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee800d07d0 0x7fee800b96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.198+0000 7fee85777640 1 --2- 172.21.15.67:0/3643959109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee800b5180 0x7fee800a11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.198+0000 7fee85777640 1 -- 172.21.15.67:0/3643959109 >> 172.21.15.67:0/3643959109 conn(0x7fee800d40a0 msgr2=0x7fee800cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:52.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.198+0000 7fee85777640 1 -- 172.21.15.67:0/3643959109 shutdown_connections 2024-04-25T02:28:52.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.198+0000 7fee85777640 1 -- 172.21.15.67:0/3643959109 wait complete. 2024-04-25T02:28:52.212 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.310+0000 7f43a3f3b640 1 Processor -- start 2024-04-25T02:28:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.310+0000 7f43a3f3b640 1 -- start start 2024-04-25T02:28:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.311+0000 7f43a3f3b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f439c15e5f0 0x7f439c0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.311+0000 7f43a3f3b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f439c0cf200 0x7f439c0d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.311+0000 7f43a3f3b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f439c0d2cc0 con 0x7f439c15e210 2024-04-25T02:28:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.311+0000 7f43a3f3b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f439c0cf650 con 0x7f439c15e5f0 2024-04-25T02:28:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.311+0000 7f43a3f3b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f439c06c6f0 con 0x7f439c0cf200 2024-04-25T02:28:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.311+0000 7f43a14d6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f439c15e5f0 0x7f439c0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.311+0000 7f43a14d6640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f439c15e5f0 0x7f439c0cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46754/0 (socket says 172.21.15.67:46754) 2024-04-25T02:28:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.311+0000 7f43a14d6640 1 -- 172.21.15.67:0/3100134350 learned_addr learned my addr 172.21.15.67:0/3100134350 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.312+0000 7f43a24d8640 1 --2- 172.21.15.67:0/3100134350 >> v2:172.21.15.176:3300/0 conn(0x7f439c0cf200 0x7f439c0d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.312+0000 7f43a14d6640 1 -- 172.21.15.67:0/3100134350 >> v2:172.21.15.176:3300/0 conn(0x7f439c0cf200 msgr2=0x7f439c0d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:52.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.312+0000 7f43a14d6640 1 --2- 172.21.15.67:0/3100134350 >> v2:172.21.15.176:3300/0 conn(0x7f439c0cf200 0x7f439c0d3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.312+0000 7f43a14d6640 1 -- 172.21.15.67:0/3100134350 >> v1:172.21.15.176:6789/0 conn(0x7f439c15e210 legacy=0x7f439c06cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:52.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.312+0000 7f43a14d6640 1 -- 172.21.15.67:0/3100134350 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439c0d2fa0 con 0x7f439c15e5f0 2024-04-25T02:28:52.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.312+0000 7f43a24d8640 1 --2- 172.21.15.67:0/3100134350 >> v2:172.21.15.176:3300/0 conn(0x7f439c0cf200 0x7f439c0d3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:52.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.312+0000 7f43a14d6640 1 --2- 172.21.15.67:0/3100134350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f439c15e5f0 0x7f439c0cecc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f439c08e0d0 tx=0x7f439002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b131f6d1ccf006 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:52.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.313+0000 7f43a0cd5640 1 -- 172.21.15.67:0/3100134350 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4390037070 con 0x7f439c15e5f0 2024-04-25T02:28:52.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.313+0000 7f43a0cd5640 1 -- 172.21.15.67:0/3100134350 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4390032440 con 0x7f439c15e5f0 2024-04-25T02:28:52.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.313+0000 7f43a0cd5640 1 -- 172.21.15.67:0/3100134350 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4390032810 con 0x7f439c15e5f0 2024-04-25T02:28:52.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.313+0000 7f43a3f3b640 1 -- 172.21.15.67:0/3100134350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f439c15e5f0 msgr2=0x7f439c0cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.313+0000 7f43a3f3b640 1 --2- 172.21.15.67:0/3100134350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f439c15e5f0 0x7f439c0cecc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f439c08e0d0 tx=0x7f439002a230 comp rx=0 tx=0).stop 2024-04-25T02:28:52.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.313+0000 7f43a3f3b640 1 -- 172.21.15.67:0/3100134350 shutdown_connections 2024-04-25T02:28:52.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.313+0000 7f43a3f3b640 1 --2- 172.21.15.67:0/3100134350 >> v2:172.21.15.176:3300/0 conn(0x7f439c0cf200 0x7f439c0d3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.313+0000 7f43a3f3b640 1 --2- 172.21.15.67:0/3100134350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f439c15e5f0 0x7f439c0cecc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.313+0000 7f43a3f3b640 1 -- 172.21.15.67:0/3100134350 >> 172.21.15.67:0/3100134350 conn(0x7f439c08dbb0 msgr2=0x7f439c09d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:52.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.313+0000 7f43a3f3b640 1 -- 172.21.15.67:0/3100134350 shutdown_connections 2024-04-25T02:28:52.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.313+0000 7f43a3f3b640 1 -- 172.21.15.67:0/3100134350 wait complete. 2024-04-25T02:28:52.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.314+0000 7f43a3f3b640 1 Processor -- start 2024-04-25T02:28:52.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.315+0000 7f43a3f3b640 1 -- start start 2024-04-25T02:28:52.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.315+0000 7f43a3f3b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f439c0cf200 0x7f439c15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.315+0000 7f43a3f3b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f439c15e210 0x7f439c15a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.315+0000 7f43a3f3b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f439c15e5f0 0x7f439c0b8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.315+0000 7f43a3f3b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f439c06d290 con 0x7f439c15e210 2024-04-25T02:28:52.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.315+0000 7f43a3f3b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f439c06c380 con 0x7f439c0cf200 2024-04-25T02:28:52.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.315+0000 7f43a3f3b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f439c06d410 con 0x7f439c15e5f0 2024-04-25T02:28:52.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.315+0000 7f43a14d6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f439c15e210 0x7f439c15a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.315+0000 7f43a14d6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f439c15e210 0x7f439c15a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46770/0 (socket says 172.21.15.67:46770) 2024-04-25T02:28:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.315+0000 7f43a14d6640 1 -- 172.21.15.67:0/3916122596 learned_addr learned my addr 172.21.15.67:0/3916122596 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.315+0000 7f43a1cd7640 1 --2- 172.21.15.67:0/3916122596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f439c0cf200 0x7f439c15ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.316+0000 7f43a24d8640 1 --2- 172.21.15.67:0/3916122596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f439c15e5f0 0x7f439c0b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.316+0000 7f43a14d6640 1 -- 172.21.15.67:0/3916122596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f439c15e5f0 msgr2=0x7f439c0b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.316+0000 7f43a14d6640 1 --2- 172.21.15.67:0/3916122596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f439c15e5f0 0x7f439c0b8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.316+0000 7f43a14d6640 1 -- 172.21.15.67:0/3916122596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f439c0cf200 msgr2=0x7f439c15ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.316+0000 7f43a14d6640 1 --2- 172.21.15.67:0/3916122596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f439c0cf200 0x7f439c15ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.316+0000 7f43a14d6640 1 -- 172.21.15.67:0/3916122596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439c15cda0 con 0x7f439c15e210 2024-04-25T02:28:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.316+0000 7f43a24d8640 1 --2- 172.21.15.67:0/3916122596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f439c15e5f0 0x7f439c0b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.316+0000 7f43a14d6640 1 --2- 172.21.15.67:0/3916122596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f439c15e210 0x7f439c15a000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4390000c00 tx=0x7f43900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.316+0000 7f439a7fc640 1 -- 172.21.15.67:0/3916122596 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4390041020 con 0x7f439c15e210 2024-04-25T02:28:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.316+0000 7f439a7fc640 1 -- 172.21.15.67:0/3916122596 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4390030970 con 0x7f439c15e210 2024-04-25T02:28:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.316+0000 7f43a3f3b640 1 -- 172.21.15.67:0/3916122596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f439c15d080 con 0x7f439c15e210 2024-04-25T02:28:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.316+0000 7f439a7fc640 1 -- 172.21.15.67:0/3916122596 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4390037040 con 0x7f439c15e210 2024-04-25T02:28:52.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.316+0000 7f43a3f3b640 1 -- 172.21.15.67:0/3916122596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f439c0b6eb0 con 0x7f439c15e210 2024-04-25T02:28:52.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.317+0000 7f43a3f3b640 1 -- 172.21.15.67:0/3916122596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f439c069110 con 0x7f439c15e210 2024-04-25T02:28:52.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.318+0000 7f439a7fc640 1 -- 172.21.15.67:0/3916122596 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4390044020 con 0x7f439c15e210 2024-04-25T02:28:52.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.318+0000 7f439a7fc640 1 --2- 172.21.15.67:0/3916122596 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f438806be30 0x7f438806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.318+0000 7f439a7fc640 1 -- 172.21.15.67:0/3916122596 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f43900ab810 con 0x7f439c15e210 2024-04-25T02:28:52.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.318+0000 7f43a1cd7640 1 --2- 172.21.15.67:0/3916122596 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f438806be30 0x7f438806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.319+0000 7f43a1cd7640 1 --2- 172.21.15.67:0/3916122596 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f438806be30 0x7f438806e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4394004ea0 tx=0x7f4394009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:52.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.322+0000 7f439a7fc640 1 -- 172.21.15.67:0/3916122596 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f439004b030 con 0x7f439c15e210 2024-04-25T02:28:52.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.508+0000 7f43a3f3b640 1 -- 172.21.15.67:0/3916122596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f439c06be80 con 0x7f439c15e210 2024-04-25T02:28:52.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.509+0000 7f439a7fc640 1 -- 172.21.15.67:0/3916122596 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f439007a250 con 0x7f439c15e210 2024-04-25T02:28:52.512 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:52.513 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:27.819641+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:52.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.511+0000 7f43a3f3b640 1 -- 172.21.15.67:0/3916122596 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f438806be30 msgr2=0x7f438806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.511+0000 7f43a3f3b640 1 --2- 172.21.15.67:0/3916122596 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f438806be30 0x7f438806e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4394004ea0 tx=0x7f4394009040 comp rx=0 tx=0).stop 2024-04-25T02:28:52.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.511+0000 7f43a3f3b640 1 -- 172.21.15.67:0/3916122596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f439c15e210 msgr2=0x7f439c15a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.511+0000 7f43a3f3b640 1 --2- 172.21.15.67:0/3916122596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f439c15e210 0x7f439c15a000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4390000c00 tx=0x7f43900046c0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.511+0000 7f43a3f3b640 1 -- 172.21.15.67:0/3916122596 shutdown_connections 2024-04-25T02:28:52.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.511+0000 7f43a3f3b640 1 --2- 172.21.15.67:0/3916122596 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f438806be30 0x7f438806e2f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.511+0000 7f43a3f3b640 1 --2- 172.21.15.67:0/3916122596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f439c15e5f0 0x7f439c0b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.511+0000 7f43a3f3b640 1 --2- 172.21.15.67:0/3916122596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f439c15e210 0x7f439c15a000 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.511+0000 7f43a3f3b640 1 --2- 172.21.15.67:0/3916122596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f439c0cf200 0x7f439c15ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.511+0000 7f43a3f3b640 1 -- 172.21.15.67:0/3916122596 >> 172.21.15.67:0/3916122596 conn(0x7f439c08dbb0 msgr2=0x7f439c06cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:52.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.511+0000 7f43a3f3b640 1 -- 172.21.15.67:0/3916122596 shutdown_connections 2024-04-25T02:28:52.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.511+0000 7f43a3f3b640 1 -- 172.21.15.67:0/3916122596 wait complete. 2024-04-25T02:28:52.525 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:28:24.445606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:28:25.161619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:28:52.526 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:28:52.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.627+0000 7f2ddd7f4640 1 Processor -- start 2024-04-25T02:28:52.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.627+0000 7f2ddd7f4640 1 -- start start 2024-04-25T02:28:52.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.628+0000 7f2ddd7f4640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2dd80b3b30 0x7f2dd80d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.628+0000 7f2ddd7f4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dd80d2cf0 0x7f2dd80cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.628+0000 7f2ddd7f4640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dd80d0b30 con 0x7f2dd81619d0 2024-04-25T02:28:52.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.628+0000 7f2ddd7f4640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2dd80d0e10 con 0x7f2dd80b3b30 2024-04-25T02:28:52.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.628+0000 7f2ddd7f4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd80d10f0 con 0x7f2dd80d2cf0 2024-04-25T02:28:52.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.628+0000 7f2dd67fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2dd80b3b30 0x7f2dd80d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.628+0000 7f2dd77fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dd80d2cf0 0x7f2dd80cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.628+0000 7f2dd67fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2dd80b3b30 0x7f2dd80d27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:53740/0 (socket says 172.21.15.67:53740) 2024-04-25T02:28:52.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.628+0000 7f2dd67fc640 1 -- 172.21.15.67:0/950282416 learned_addr learned my addr 172.21.15.67:0/950282416 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:52.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.628+0000 7f2dd6ffd640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f2dd81619d0 0x7f2dd80d1fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:43982/0 (socket says 172.21.15.67:43982) 2024-04-25T02:28:52.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.629+0000 7f2dd67fc640 1 -- 172.21.15.67:0/950282416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dd80d2cf0 msgr2=0x7f2dd80cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:52.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.629+0000 7f2dd67fc640 1 --2- 172.21.15.67:0/950282416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dd80d2cf0 0x7f2dd80cf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.629+0000 7f2dd67fc640 1 -- 172.21.15.67:0/950282416 >> v1:172.21.15.176:6789/0 conn(0x7f2dd81619d0 legacy=0x7f2dd80d1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.629+0000 7f2dd67fc640 1 -- 172.21.15.67:0/950282416 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd80d13d0 con 0x7f2dd80b3b30 2024-04-25T02:28:52.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.629+0000 7f2dd5ffb640 1 -- 172.21.15.67:0/950282416 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2707741372 0 0) 0x7f2dd80d0b30 con 0x7f2dd81619d0 2024-04-25T02:28:52.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.629+0000 7f2dd67fc640 1 --2- 172.21.15.67:0/950282416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dd80b3b30 0x7f2dd80d27b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc009870 tx=0x7f2dcc02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b62610d821bbd35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:52.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.630+0000 7f2dd5ffb640 1 -- 172.21.15.67:0/950282416 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc037070 con 0x7f2dd80b3b30 2024-04-25T02:28:52.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.630+0000 7f2dd5ffb640 1 -- 172.21.15.67:0/950282416 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dcc032440 con 0x7f2dd80b3b30 2024-04-25T02:28:52.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.630+0000 7f2dd5ffb640 1 -- 172.21.15.67:0/950282416 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc032810 con 0x7f2dd80b3b30 2024-04-25T02:28:52.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.630+0000 7f2ddd7f4640 1 -- 172.21.15.67:0/950282416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dd80b3b30 msgr2=0x7f2dd80d27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.630+0000 7f2ddd7f4640 1 --2- 172.21.15.67:0/950282416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dd80b3b30 0x7f2dd80d27b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc009870 tx=0x7f2dcc02a270 comp rx=0 tx=0).stop 2024-04-25T02:28:52.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.630+0000 7f2ddd7f4640 1 -- 172.21.15.67:0/950282416 shutdown_connections 2024-04-25T02:28:52.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.630+0000 7f2ddd7f4640 1 --2- 172.21.15.67:0/950282416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dd80d2cf0 0x7f2dd80cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.630+0000 7f2ddd7f4640 1 --2- 172.21.15.67:0/950282416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dd80b3b30 0x7f2dd80d27b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.630+0000 7f2ddd7f4640 1 -- 172.21.15.67:0/950282416 >> 172.21.15.67:0/950282416 conn(0x7f2dd809d4b0 msgr2=0x7f2dd80d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:52.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.630+0000 7f2ddd7f4640 1 -- 172.21.15.67:0/950282416 shutdown_connections 2024-04-25T02:28:52.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.630+0000 7f2ddd7f4640 1 -- 172.21.15.67:0/950282416 wait complete. 2024-04-25T02:28:52.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.631+0000 7f2ddd7f4640 1 Processor -- start 2024-04-25T02:28:52.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.631+0000 7f2ddd7f4640 1 -- start start 2024-04-25T02:28:52.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.632+0000 7f2ddd7f4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dd80b3b30 0x7f2dd80ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.632+0000 7f2ddd7f4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dd80d2cf0 0x7f2dd81e6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.632+0000 7f2ddd7f4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dd81619d0 0x7f2dd81e7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.632+0000 7f2ddd7f4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd80d0800 con 0x7f2dd80b3b30 2024-04-25T02:28:52.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.632+0000 7f2ddd7f4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd8161db0 con 0x7f2dd81619d0 2024-04-25T02:28:52.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.632+0000 7f2ddd7f4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd80b3240 con 0x7f2dd80d2cf0 2024-04-25T02:28:52.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.632+0000 7f2dd6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dd80b3b30 0x7f2dd80ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.632+0000 7f2dd6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dd80b3b30 0x7f2dd80ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46774/0 (socket says 172.21.15.67:46774) 2024-04-25T02:28:52.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.632+0000 7f2dd6ffd640 1 -- 172.21.15.67:0/729989801 learned_addr learned my addr 172.21.15.67:0/729989801 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:52.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.632+0000 7f2dd67fc640 1 --2- 172.21.15.67:0/729989801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dd80d2cf0 0x7f2dd81e6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.632+0000 7f2dd77fe640 1 --2- 172.21.15.67:0/729989801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dd81619d0 0x7f2dd81e7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.633+0000 7f2dd6ffd640 1 -- 172.21.15.67:0/729989801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dd80d2cf0 msgr2=0x7f2dd81e6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.633+0000 7f2dd6ffd640 1 --2- 172.21.15.67:0/729989801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dd80d2cf0 0x7f2dd81e6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.633+0000 7f2dd6ffd640 1 -- 172.21.15.67:0/729989801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dd81619d0 msgr2=0x7f2dd81e7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.633+0000 7f2dd6ffd640 1 --2- 172.21.15.67:0/729989801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dd81619d0 0x7f2dd81e7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.633+0000 7f2dd6ffd640 1 -- 172.21.15.67:0/729989801 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd80cc5d0 con 0x7f2dd80b3b30 2024-04-25T02:28:52.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.633+0000 7f2dd6ffd640 1 --2- 172.21.15.67:0/729989801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dd80b3b30 0x7f2dd80ca7d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800c430 tx=0x7f2dc800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:52.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.633+0000 7f2dbf7fe640 1 -- 172.21.15.67:0/729989801 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc80074e0 con 0x7f2dd80b3b30 2024-04-25T02:28:52.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.633+0000 7f2dbf7fe640 1 -- 172.21.15.67:0/729989801 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc80047e0 con 0x7f2dd80b3b30 2024-04-25T02:28:52.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.633+0000 7f2dbf7fe640 1 -- 172.21.15.67:0/729989801 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8004bd0 con 0x7f2dd80b3b30 2024-04-25T02:28:52.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.633+0000 7f2ddd7f4640 1 -- 172.21.15.67:0/729989801 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd80cc8b0 con 0x7f2dd80b3b30 2024-04-25T02:28:52.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.633+0000 7f2ddd7f4640 1 -- 172.21.15.67:0/729989801 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd80cce70 con 0x7f2dd80b3b30 2024-04-25T02:28:52.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.634+0000 7f2ddd7f4640 1 -- 172.21.15.67:0/729989801 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd8069110 con 0x7f2dd80b3b30 2024-04-25T02:28:52.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.634+0000 7f2dbf7fe640 1 -- 172.21.15.67:0/729989801 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2dc8011070 con 0x7f2dd80b3b30 2024-04-25T02:28:52.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.635+0000 7f2dbf7fe640 1 --2- 172.21.15.67:0/729989801 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2dc406be30 0x7f2dc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.635+0000 7f2dbf7fe640 1 -- 172.21.15.67:0/729989801 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2dc808a9a0 con 0x7f2dd80b3b30 2024-04-25T02:28:52.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.635+0000 7f2dd67fc640 1 --2- 172.21.15.67:0/729989801 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2dc406be30 0x7f2dc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.636+0000 7f2dd67fc640 1 --2- 172.21.15.67:0/729989801 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2dc406be30 0x7f2dc406e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc034000 tx=0x7f2dcc02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:52.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.639+0000 7f2dbf7fe640 1 -- 172.21.15.67:0/729989801 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2dc8058d00 con 0x7f2dd80b3b30 2024-04-25T02:28:52.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.823+0000 7f2ddd7f4640 1 -- 172.21.15.67:0/729989801 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2dd80d1780 con 0x7f2dd80b3b30 2024-04-25T02:28:52.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.824+0000 7f2dbf7fe640 1 -- 172.21.15.67:0/729989801 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f2dc805d000 con 0x7f2dd80b3b30 2024-04-25T02:28:52.827 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:28:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.825+0000 7f2ddd7f4640 1 -- 172.21.15.67:0/729989801 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2dc406be30 msgr2=0x7f2dc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.825+0000 7f2ddd7f4640 1 --2- 172.21.15.67:0/729989801 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2dc406be30 0x7f2dc406e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc034000 tx=0x7f2dcc02e000 comp rx=0 tx=0).stop 2024-04-25T02:28:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.826+0000 7f2ddd7f4640 1 -- 172.21.15.67:0/729989801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dd80b3b30 msgr2=0x7f2dd80ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.826+0000 7f2ddd7f4640 1 --2- 172.21.15.67:0/729989801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dd80b3b30 0x7f2dd80ca7d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800c430 tx=0x7f2dc800c8f0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.826+0000 7f2ddd7f4640 1 -- 172.21.15.67:0/729989801 shutdown_connections 2024-04-25T02:28:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.826+0000 7f2ddd7f4640 1 --2- 172.21.15.67:0/729989801 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2dc406be30 0x7f2dc406e2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.826+0000 7f2ddd7f4640 1 --2- 172.21.15.67:0/729989801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dd81619d0 0x7f2dd81e7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.826+0000 7f2ddd7f4640 1 --2- 172.21.15.67:0/729989801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dd80d2cf0 0x7f2dd81e6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.826+0000 7f2ddd7f4640 1 --2- 172.21.15.67:0/729989801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dd80b3b30 0x7f2dd80ca7d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.826+0000 7f2ddd7f4640 1 -- 172.21.15.67:0/729989801 >> 172.21.15.67:0/729989801 conn(0x7f2dd809d4b0 msgr2=0x7f2dd80cf130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:52.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.826+0000 7f2ddd7f4640 1 -- 172.21.15.67:0/729989801 shutdown_connections 2024-04-25T02:28:52.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.826+0000 7f2ddd7f4640 1 -- 172.21.15.67:0/729989801 wait complete. 2024-04-25T02:28:52.839 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:28:52.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.940+0000 7fed08309640 1 Processor -- start 2024-04-25T02:28:52.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.940+0000 7fed08309640 1 -- start start 2024-04-25T02:28:52.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.941+0000 7fed08309640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fed0006b0c0 0x7fed000cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.941+0000 7fed08309640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fed00071e70 0x7fed00072300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.941+0000 7fed08309640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed0006b7a0 con 0x7fed000d0a00 2024-04-25T02:28:52.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.941+0000 7fed08309640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fed0006c040 con 0x7fed0006b0c0 2024-04-25T02:28:52.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.941+0000 7fed08309640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fed000cef50 con 0x7fed00071e70 2024-04-25T02:28:52.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.941+0000 7fed058a4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fed0006b0c0 0x7fed000cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.941+0000 7fed058a4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fed0006b0c0 0x7fed000cd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46780/0 (socket says 172.21.15.67:46780) 2024-04-25T02:28:52.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.941+0000 7fed058a4640 1 -- 172.21.15.67:0/1406212259 learned_addr learned my addr 172.21.15.67:0/1406212259 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:52.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.941+0000 7fed068a6640 1 --2- 172.21.15.67:0/1406212259 >> v2:172.21.15.176:3300/0 conn(0x7fed00071e70 0x7fed00072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.941+0000 7fed058a4640 1 -- 172.21.15.67:0/1406212259 >> v2:172.21.15.176:3300/0 conn(0x7fed00071e70 msgr2=0x7fed00072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:52.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.941+0000 7fed058a4640 1 --2- 172.21.15.67:0/1406212259 >> v2:172.21.15.176:3300/0 conn(0x7fed00071e70 0x7fed00072300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.941+0000 7fed058a4640 1 -- 172.21.15.67:0/1406212259 >> v1:172.21.15.176:6789/0 conn(0x7fed000d0a00 legacy=0x7fed000cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:52.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.941+0000 7fed058a4640 1 -- 172.21.15.67:0/1406212259 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0006ba80 con 0x7fed0006b0c0 2024-04-25T02:28:52.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.942+0000 7fed058a4640 1 --2- 172.21.15.67:0/1406212259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed0006b0c0 0x7fed000cd1d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fed00072f70 tx=0x7fecf402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93a7a56f785b3ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:52.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.942+0000 7fed050a3640 1 -- 172.21.15.67:0/1406212259 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4037070 con 0x7fed0006b0c0 2024-04-25T02:28:52.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.942+0000 7fed050a3640 1 -- 172.21.15.67:0/1406212259 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf4032440 con 0x7fed0006b0c0 2024-04-25T02:28:52.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.942+0000 7fed050a3640 1 -- 172.21.15.67:0/1406212259 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4032810 con 0x7fed0006b0c0 2024-04-25T02:28:52.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.942+0000 7fed08309640 1 -- 172.21.15.67:0/1406212259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed0006b0c0 msgr2=0x7fed000cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.943+0000 7fed08309640 1 --2- 172.21.15.67:0/1406212259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed0006b0c0 0x7fed000cd1d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fed00072f70 tx=0x7fecf402a230 comp rx=0 tx=0).stop 2024-04-25T02:28:52.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.943+0000 7fed08309640 1 -- 172.21.15.67:0/1406212259 shutdown_connections 2024-04-25T02:28:52.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.943+0000 7fed08309640 1 --2- 172.21.15.67:0/1406212259 >> v2:172.21.15.176:3300/0 conn(0x7fed00071e70 0x7fed00072300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.943+0000 7fed08309640 1 --2- 172.21.15.67:0/1406212259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed0006b0c0 0x7fed000cd1d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.943+0000 7fed08309640 1 -- 172.21.15.67:0/1406212259 >> 172.21.15.67:0/1406212259 conn(0x7fed000d0e20 msgr2=0x7fed000d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:52.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.943+0000 7fed08309640 1 -- 172.21.15.67:0/1406212259 shutdown_connections 2024-04-25T02:28:52.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.943+0000 7fed08309640 1 -- 172.21.15.67:0/1406212259 wait complete. 2024-04-25T02:28:52.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.944+0000 7fed08309640 1 Processor -- start 2024-04-25T02:28:52.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.944+0000 7fed08309640 1 -- start start 2024-04-25T02:28:52.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed08309640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed0006b0c0 0x7fed001e9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed08309640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed00071e70 0x7fed001ea520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed08309640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed000d0a00 0x7fed001f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed08309640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fed000cfaf0 con 0x7fed000d0a00 2024-04-25T02:28:52.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed08309640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fed0006b550 con 0x7fed00071e70 2024-04-25T02:28:52.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed08309640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fed000cfc70 con 0x7fed0006b0c0 2024-04-25T02:28:52.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed068a6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed000d0a00 0x7fed001f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed068a6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed000d0a00 0x7fed001f7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46792/0 (socket says 172.21.15.67:46792) 2024-04-25T02:28:52.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed068a6640 1 -- 172.21.15.67:0/1079472560 learned_addr learned my addr 172.21.15.67:0/1079472560 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:52.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed058a4640 1 --2- 172.21.15.67:0/1079472560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed00071e70 0x7fed001ea520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed060a5640 1 --2- 172.21.15.67:0/1079472560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed0006b0c0 0x7fed001e9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed068a6640 1 -- 172.21.15.67:0/1079472560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed0006b0c0 msgr2=0x7fed001e9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed068a6640 1 --2- 172.21.15.67:0/1079472560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed0006b0c0 0x7fed001e9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed068a6640 1 -- 172.21.15.67:0/1079472560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed00071e70 msgr2=0x7fed001ea520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:52.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed068a6640 1 --2- 172.21.15.67:0/1079472560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed00071e70 0x7fed001ea520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:52.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed068a6640 1 -- 172.21.15.67:0/1079472560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0015f830 con 0x7fed000d0a00 2024-04-25T02:28:52.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed068a6640 1 --2- 172.21.15.67:0/1079472560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed000d0a00 0x7fed001f7ea0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fecf8007e40 tx=0x7fecf800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:52.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fecf2ffd640 1 -- 172.21.15.67:0/1079472560 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf8014620 con 0x7fed000d0a00 2024-04-25T02:28:52.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fecf2ffd640 1 -- 172.21.15.67:0/1079472560 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf8019070 con 0x7fed000d0a00 2024-04-25T02:28:52.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed08309640 1 -- 172.21.15.67:0/1079472560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed001e7680 con 0x7fed000d0a00 2024-04-25T02:28:52.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fecf2ffd640 1 -- 172.21.15.67:0/1079472560 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf8014a20 con 0x7fed000d0a00 2024-04-25T02:28:52.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.945+0000 7fed08309640 1 -- 172.21.15.67:0/1079472560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed001e7c40 con 0x7fed000d0a00 2024-04-25T02:28:52.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.946+0000 7fed08309640 1 -- 172.21.15.67:0/1079472560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed00069110 con 0x7fed000d0a00 2024-04-25T02:28:52.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.947+0000 7fecf2ffd640 1 -- 172.21.15.67:0/1079472560 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fecf8014bc0 con 0x7fed000d0a00 2024-04-25T02:28:52.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.947+0000 7fecf2ffd640 1 --2- 172.21.15.67:0/1079472560 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fece406be30 0x7fece406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:52.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.948+0000 7fecf2ffd640 1 -- 172.21.15.67:0/1079472560 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fecf808b650 con 0x7fed000d0a00 2024-04-25T02:28:52.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.948+0000 7fed060a5640 1 --2- 172.21.15.67:0/1079472560 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fece406be30 0x7fece406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:52.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.948+0000 7fed060a5640 1 --2- 172.21.15.67:0/1079472560 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fece406be30 0x7fece406e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fecfc006fd0 tx=0x7fecfc009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:52.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:52.952+0000 7fecf2ffd640 1 -- 172.21.15.67:0/1079472560 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fecf80599b0 con 0x7fed000d0a00 2024-04-25T02:28:53.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.138+0000 7fed08309640 1 -- 172.21.15.67:0/1079472560 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fed000b0640 con 0x7fed000d0a00 2024-04-25T02:28:53.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.138+0000 7fecf2ffd640 1 -- 172.21.15.67:0/1079472560 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fecf805dcb0 con 0x7fed000d0a00 2024-04-25T02:28:53.141 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-25T02:28:53.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.140+0000 7fed08309640 1 -- 172.21.15.67:0/1079472560 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fece406be30 msgr2=0x7fece406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.140+0000 7fed08309640 1 --2- 172.21.15.67:0/1079472560 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fece406be30 0x7fece406e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fecfc006fd0 tx=0x7fecfc009060 comp rx=0 tx=0).stop 2024-04-25T02:28:53.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.140+0000 7fed08309640 1 -- 172.21.15.67:0/1079472560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed000d0a00 msgr2=0x7fed001f7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.140+0000 7fed08309640 1 --2- 172.21.15.67:0/1079472560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed000d0a00 0x7fed001f7ea0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fecf8007e40 tx=0x7fecf800e4b0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.140+0000 7fed08309640 1 -- 172.21.15.67:0/1079472560 shutdown_connections 2024-04-25T02:28:53.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.140+0000 7fed08309640 1 --2- 172.21.15.67:0/1079472560 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fece406be30 0x7fece406e2f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.140+0000 7fed08309640 1 --2- 172.21.15.67:0/1079472560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed000d0a00 0x7fed001f7ea0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.140+0000 7fed08309640 1 --2- 172.21.15.67:0/1079472560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed00071e70 0x7fed001ea520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.140+0000 7fed08309640 1 --2- 172.21.15.67:0/1079472560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed0006b0c0 0x7fed001e9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.140+0000 7fed08309640 1 -- 172.21.15.67:0/1079472560 >> 172.21.15.67:0/1079472560 conn(0x7fed000d0e20 msgr2=0x7fed000ae680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:53.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.140+0000 7fed08309640 1 -- 172.21.15.67:0/1079472560 shutdown_connections 2024-04-25T02:28:53.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.140+0000 7fed08309640 1 -- 172.21.15.67:0/1079472560 wait complete. 2024-04-25T02:28:53.154 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:28:53.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.255+0000 7fa6a9c15640 1 Processor -- start 2024-04-25T02:28:53.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.255+0000 7fa6a9c15640 1 -- start start 2024-04-25T02:28:53.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.255+0000 7fa6a9c15640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa6a406b0c0 0x7fa6a40cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.255+0000 7fa6a9c15640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6a406b7a0 con 0x7fa6a40d0a00 2024-04-25T02:28:53.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a9c15640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6a406ba80 con 0x7fa6a4071e70 2024-04-25T02:28:53.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a9c15640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa6a406c040 con 0x7fa6a406b0c0 2024-04-25T02:28:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a37fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa6a40d0a00 0x7fa6a40cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55814/0 (socket says 172.21.15.67:55814) 2024-04-25T02:28:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a37fe640 1 -- 172.21.15.67:0/3087526464 learned_addr learned my addr 172.21.15.67:0/3087526464 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a27fc640 1 -- 172.21.15.67:0/3087526464 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 731172614 0 0) 0x7fa6a406b7a0 con 0x7fa6a40d0a00 2024-04-25T02:28:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a2ffd640 1 --2- 172.21.15.67:0/3087526464 >> v2:172.21.15.176:3300/0 conn(0x7fa6a406b0c0 0x7fa6a40cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a27fc640 1 -- 172.21.15.67:0/3087526464 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa68c003520 con 0x7fa6a40d0a00 2024-04-25T02:28:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a27fc640 1 -- 172.21.15.67:0/3087526464 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2014989014 0 0) 0x7fa68c003520 con 0x7fa6a40d0a00 2024-04-25T02:28:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a27fc640 1 -- 172.21.15.67:0/3087526464 >> v2:172.21.15.176:3300/0 conn(0x7fa6a406b0c0 msgr2=0x7fa6a40cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a27fc640 1 --2- 172.21.15.67:0/3087526464 >> v2:172.21.15.176:3300/0 conn(0x7fa6a406b0c0 0x7fa6a40cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a27fc640 1 -- 172.21.15.67:0/3087526464 >> v1:172.21.15.176:6789/0 conn(0x7fa6a4071e70 legacy=0x7fa6a406f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a27fc640 1 -- 172.21.15.67:0/3087526464 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a406bd60 con 0x7fa6a40d0a00 2024-04-25T02:28:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a27fc640 1 -- 172.21.15.67:0/3087526464 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7fa698001670 con 0x7fa6a40d0a00 2024-04-25T02:28:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a27fc640 1 -- 172.21.15.67:0/3087526464 >> v1:172.21.15.67:6789/0 conn(0x7fa6a40d0a00 legacy=0x7fa6a40cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a27fc640 1 --2- 172.21.15.67:0/3087526464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa68c0039b0 0x7fa68c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a27fc640 1 --2- 172.21.15.67:0/3087526464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa68c004800 0x7fa68c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a27fc640 1 --2- 172.21.15.67:0/3087526464 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa68c0051c0 0x7fa68c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a27fc640 1 -- 172.21.15.67:0/3087526464 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c00c030 con 0x7fa68c004800 2024-04-25T02:28:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a27fc640 1 -- 172.21.15.67:0/3087526464 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c00c1e0 con 0x7fa68c0039b0 2024-04-25T02:28:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a27fc640 1 -- 172.21.15.67:0/3087526464 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa68c00c3e0 con 0x7fa68c0051c0 2024-04-25T02:28:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.256+0000 7fa6a2ffd640 1 --2- 172.21.15.67:0/3087526464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa68c004800 0x7fa68c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.257+0000 7fa6a37fe640 1 --2- 172.21.15.67:0/3087526464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa68c0039b0 0x7fa68c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.257+0000 7fa6a3fff640 1 --2- 172.21.15.67:0/3087526464 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa68c0051c0 0x7fa68c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.257+0000 7fa6a2ffd640 1 -- 172.21.15.67:0/3087526464 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa68c0051c0 msgr2=0x7fa68c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.257+0000 7fa6a2ffd640 1 --2- 172.21.15.67:0/3087526464 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa68c0051c0 0x7fa68c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.257+0000 7fa6a2ffd640 1 -- 172.21.15.67:0/3087526464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa68c0039b0 msgr2=0x7fa68c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.257+0000 7fa6a2ffd640 1 --2- 172.21.15.67:0/3087526464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa68c0039b0 0x7fa68c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.257+0000 7fa6a2ffd640 1 -- 172.21.15.67:0/3087526464 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68c003520 con 0x7fa68c004800 2024-04-25T02:28:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.257+0000 7fa6a3fff640 1 -- 172.21.15.67:0/3087526464 reap_dead start 2024-04-25T02:28:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.257+0000 7fa6a2ffd640 1 --2- 172.21.15.67:0/3087526464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa68c004800 0x7fa68c004c80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa694009ac0 tx=0x7fa68c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2805c8f28950c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:53.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.258+0000 7fa6a27fc640 1 -- 172.21.15.67:0/3087526464 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694036070 con 0x7fa68c004800 2024-04-25T02:28:53.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.258+0000 7fa6a27fc640 1 -- 172.21.15.67:0/3087526464 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa694031400 con 0x7fa68c004800 2024-04-25T02:28:53.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.258+0000 7fa6a27fc640 1 -- 172.21.15.67:0/3087526464 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694009690 con 0x7fa68c004800 2024-04-25T02:28:53.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.258+0000 7fa6a9c15640 1 -- 172.21.15.67:0/3087526464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa68c004800 msgr2=0x7fa68c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.258+0000 7fa6a9c15640 1 --2- 172.21.15.67:0/3087526464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa68c004800 0x7fa68c004c80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa694009ac0 tx=0x7fa68c005830 comp rx=0 tx=0).stop 2024-04-25T02:28:53.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.258+0000 7fa6a9c15640 1 -- 172.21.15.67:0/3087526464 shutdown_connections 2024-04-25T02:28:53.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.258+0000 7fa6a9c15640 1 --2- 172.21.15.67:0/3087526464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa68c004800 0x7fa68c004c80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.258+0000 7fa6a9c15640 1 -- 172.21.15.67:0/3087526464 >> 172.21.15.67:0/3087526464 conn(0x7fa6a40d0e20 msgr2=0x7fa6a40d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:53.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.258+0000 7fa6a9c15640 1 -- 172.21.15.67:0/3087526464 shutdown_connections 2024-04-25T02:28:53.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.258+0000 7fa6a9c15640 1 -- 172.21.15.67:0/3087526464 wait complete. 2024-04-25T02:28:53.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.259+0000 7fa6a9c15640 1 Processor -- start 2024-04-25T02:28:53.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.259+0000 7fa6a9c15640 1 -- start start 2024-04-25T02:28:53.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.260+0000 7fa6a9c15640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa68c004800 0x7fa6a414d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.260+0000 7fa6a9c15640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6a415baa0 0x7fa6a415a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.260+0000 7fa6a9c15640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6a415a580 0x7fa6a415c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.260+0000 7fa6a9c15640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a4072690 con 0x7fa6a415baa0 2024-04-25T02:28:53.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.260+0000 7fa6a9c15640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a4072510 con 0x7fa6a415a580 2024-04-25T02:28:53.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.260+0000 7fa6a9c15640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a40cef50 con 0x7fa68c004800 2024-04-25T02:28:53.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.260+0000 7fa6a2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6a415baa0 0x7fa6a415a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.260+0000 7fa6a2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6a415baa0 0x7fa6a415a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46802/0 (socket says 172.21.15.67:46802) 2024-04-25T02:28:53.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.260+0000 7fa6a2ffd640 1 -- 172.21.15.67:0/4150812484 learned_addr learned my addr 172.21.15.67:0/4150812484 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:53.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.260+0000 7fa6a3fff640 1 --2- 172.21.15.67:0/4150812484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6a415a580 0x7fa6a415c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.260+0000 7fa6a37fe640 1 --2- 172.21.15.67:0/4150812484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa68c004800 0x7fa6a414d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.261+0000 7fa6a2ffd640 1 -- 172.21.15.67:0/4150812484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa68c004800 msgr2=0x7fa6a414d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.261+0000 7fa6a2ffd640 1 --2- 172.21.15.67:0/4150812484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa68c004800 0x7fa6a414d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.261+0000 7fa6a2ffd640 1 -- 172.21.15.67:0/4150812484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6a415a580 msgr2=0x7fa6a415c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.261+0000 7fa6a2ffd640 1 --2- 172.21.15.67:0/4150812484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6a415a580 0x7fa6a415c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.261+0000 7fa6a2ffd640 1 -- 172.21.15.67:0/4150812484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a415aa00 con 0x7fa6a415baa0 2024-04-25T02:28:53.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.261+0000 7fa6a37fe640 1 --2- 172.21.15.67:0/4150812484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa68c004800 0x7fa6a414d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:53.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.261+0000 7fa6a2ffd640 1 --2- 172.21.15.67:0/4150812484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6a415baa0 0x7fa6a415a040 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa694034040 tx=0x7fa694004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:53.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.261+0000 7fa68bfff640 1 -- 172.21.15.67:0/4150812484 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69403f020 con 0x7fa6a415baa0 2024-04-25T02:28:53.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.261+0000 7fa68bfff640 1 -- 172.21.15.67:0/4150812484 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa694037040 con 0x7fa6a415baa0 2024-04-25T02:28:53.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.261+0000 7fa6a9c15640 1 -- 172.21.15.67:0/4150812484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a415ace0 con 0x7fa6a415baa0 2024-04-25T02:28:53.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.261+0000 7fa68bfff640 1 -- 172.21.15.67:0/4150812484 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694036070 con 0x7fa6a415baa0 2024-04-25T02:28:53.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.261+0000 7fa6a9c15640 1 -- 172.21.15.67:0/4150812484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a415b2a0 con 0x7fa6a415baa0 2024-04-25T02:28:53.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.262+0000 7fa6a9c15640 1 -- 172.21.15.67:0/4150812484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a4067e40 con 0x7fa6a415baa0 2024-04-25T02:28:53.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.262+0000 7fa68bfff640 1 -- 172.21.15.67:0/4150812484 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa694042020 con 0x7fa6a415baa0 2024-04-25T02:28:53.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.263+0000 7fa68bfff640 1 --2- 172.21.15.67:0/4150812484 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa69006be30 0x7fa69006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.263+0000 7fa68bfff640 1 -- 172.21.15.67:0/4150812484 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa6940aae00 con 0x7fa6a415baa0 2024-04-25T02:28:53.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.263+0000 7fa6a37fe640 1 --2- 172.21.15.67:0/4150812484 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa69006be30 0x7fa69006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.264+0000 7fa6a37fe640 1 --2- 172.21.15.67:0/4150812484 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa69006be30 0x7fa69006e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa698001eb0 tx=0x7fa698009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:53.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.267+0000 7fa68bfff640 1 -- 172.21.15.67:0/4150812484 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa694049030 con 0x7fa6a415baa0 2024-04-25T02:28:53.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.448+0000 7fa6a9c15640 1 -- 172.21.15.67:0/4150812484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa6a4069110 con 0x7fa6a415baa0 2024-04-25T02:28:53.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.449+0000 7fa68bfff640 1 -- 172.21.15.67:0/4150812484 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fa6940792b0 con 0x7fa6a415baa0 2024-04-25T02:28:53.452 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-25T02:28:53.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.451+0000 7fa6a9c15640 1 -- 172.21.15.67:0/4150812484 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa69006be30 msgr2=0x7fa69006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.451+0000 7fa6a9c15640 1 --2- 172.21.15.67:0/4150812484 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa69006be30 0x7fa69006e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa698001eb0 tx=0x7fa698009040 comp rx=0 tx=0).stop 2024-04-25T02:28:53.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.451+0000 7fa6a9c15640 1 -- 172.21.15.67:0/4150812484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6a415baa0 msgr2=0x7fa6a415a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.451+0000 7fa6a9c15640 1 --2- 172.21.15.67:0/4150812484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6a415baa0 0x7fa6a415a040 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa694034040 tx=0x7fa694004730 comp rx=0 tx=0).stop 2024-04-25T02:28:53.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.451+0000 7fa6a9c15640 1 -- 172.21.15.67:0/4150812484 shutdown_connections 2024-04-25T02:28:53.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.451+0000 7fa6a9c15640 1 --2- 172.21.15.67:0/4150812484 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa69006be30 0x7fa69006e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.451+0000 7fa6a9c15640 1 --2- 172.21.15.67:0/4150812484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6a415a580 0x7fa6a415c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.451+0000 7fa6a9c15640 1 --2- 172.21.15.67:0/4150812484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6a415baa0 0x7fa6a415a040 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.451+0000 7fa6a9c15640 1 --2- 172.21.15.67:0/4150812484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa68c004800 0x7fa6a414d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.451+0000 7fa6a9c15640 1 -- 172.21.15.67:0/4150812484 >> 172.21.15.67:0/4150812484 conn(0x7fa6a40d0e20 msgr2=0x7fa6a40af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:53.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.451+0000 7fa6a9c15640 1 -- 172.21.15.67:0/4150812484 shutdown_connections 2024-04-25T02:28:53.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.451+0000 7fa6a9c15640 1 -- 172.21.15.67:0/4150812484 wait complete. 2024-04-25T02:28:53.465 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:53.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.563+0000 7f289ad42640 1 Processor -- start 2024-04-25T02:28:53.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.563+0000 7f289ad42640 1 -- start start 2024-04-25T02:28:53.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.564+0000 7f289ad42640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2894070df0 0x7f289415f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.564+0000 7f289ad42640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28940b2cc0 0x7f28940b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.564+0000 7f289ad42640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28940713d0 con 0x7f289415b220 2024-04-25T02:28:53.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.564+0000 7f289ad42640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f28940aee00 con 0x7f2894070df0 2024-04-25T02:28:53.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.564+0000 7f289ad42640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f28940ae4d0 con 0x7f28940b2cc0 2024-04-25T02:28:53.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.564+0000 7f2893fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2894070df0 0x7f289415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.564+0000 7f2898ade640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f289415b220 0x7f289415ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55816/0 (socket says 172.21.15.67:55816) 2024-04-25T02:28:53.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.564+0000 7f2898ade640 1 -- 172.21.15.67:0/2640960117 learned_addr learned my addr 172.21.15.67:0/2640960117 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:53.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.564+0000 7f2893fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2894070df0 0x7f289415f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46812/0 (socket says 172.21.15.67:46812) 2024-04-25T02:28:53.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.564+0000 7f28992df640 1 --2- 172.21.15.67:0/2640960117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28940b2cc0 0x7f28940b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.564+0000 7f2893fff640 1 -- 172.21.15.67:0/2640960117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28940b2cc0 msgr2=0x7f28940b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:53.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.564+0000 7f2893fff640 1 --2- 172.21.15.67:0/2640960117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28940b2cc0 0x7f28940b3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.565+0000 7f2893fff640 1 -- 172.21.15.67:0/2640960117 >> v1:172.21.15.67:6789/0 conn(0x7f289415b220 legacy=0x7f289415ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.565+0000 7f2893fff640 1 -- 172.21.15.67:0/2640960117 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28940ae7b0 con 0x7f2894070df0 2024-04-25T02:28:53.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.565+0000 7f28937fe640 1 -- 172.21.15.67:0/2640960117 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 768691763 0 0) 0x7f28940713d0 con 0x7f289415b220 2024-04-25T02:28:53.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.565+0000 7f2893fff640 1 --2- 172.21.15.67:0/2640960117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2894070df0 0x7f289415f380 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f28800097a0 tx=0x7f288002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841cc07366cccd4c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:53.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.565+0000 7f28937fe640 1 -- 172.21.15.67:0/2640960117 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2880037070 con 0x7f2894070df0 2024-04-25T02:28:53.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.565+0000 7f28937fe640 1 -- 172.21.15.67:0/2640960117 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2880032440 con 0x7f2894070df0 2024-04-25T02:28:53.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.565+0000 7f28937fe640 1 -- 172.21.15.67:0/2640960117 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2880032810 con 0x7f2894070df0 2024-04-25T02:28:53.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.566+0000 7f289ad42640 1 -- 172.21.15.67:0/2640960117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2894070df0 msgr2=0x7f289415f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.566+0000 7f289ad42640 1 --2- 172.21.15.67:0/2640960117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2894070df0 0x7f289415f380 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f28800097a0 tx=0x7f288002a180 comp rx=0 tx=0).stop 2024-04-25T02:28:53.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.566+0000 7f289ad42640 1 -- 172.21.15.67:0/2640960117 shutdown_connections 2024-04-25T02:28:53.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.566+0000 7f289ad42640 1 --2- 172.21.15.67:0/2640960117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28940b2cc0 0x7f28940b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.566+0000 7f289ad42640 1 --2- 172.21.15.67:0/2640960117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2894070df0 0x7f289415f380 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.566+0000 7f289ad42640 1 -- 172.21.15.67:0/2640960117 >> 172.21.15.67:0/2640960117 conn(0x7f28940b19c0 msgr2=0x7f28940b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:53.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.566+0000 7f289ad42640 1 -- 172.21.15.67:0/2640960117 shutdown_connections 2024-04-25T02:28:53.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.566+0000 7f289ad42640 1 -- 172.21.15.67:0/2640960117 wait complete. 2024-04-25T02:28:53.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.567+0000 7f289ad42640 1 Processor -- start 2024-04-25T02:28:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.567+0000 7f289ad42640 1 -- start start 2024-04-25T02:28:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.568+0000 7f289ad42640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2894070df0 0x7f28941458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.568+0000 7f289ad42640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28940b2cc0 0x7f2894152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.568+0000 7f289ad42640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f289415b220 0x7f2894153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.568+0000 7f289ad42640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f289406ed10 con 0x7f2894070df0 2024-04-25T02:28:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.568+0000 7f289ad42640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f289406eb90 con 0x7f289415b220 2024-04-25T02:28:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.568+0000 7f289ad42640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f289415f8c0 con 0x7f28940b2cc0 2024-04-25T02:28:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.568+0000 7f2898ade640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2894070df0 0x7f28941458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.568+0000 7f2898ade640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2894070df0 0x7f28941458d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46814/0 (socket says 172.21.15.67:46814) 2024-04-25T02:28:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.568+0000 7f2898ade640 1 -- 172.21.15.67:0/2839267220 learned_addr learned my addr 172.21.15.67:0/2839267220 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.568+0000 7f28992df640 1 --2- 172.21.15.67:0/2839267220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f289415b220 0x7f2894153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.568+0000 7f2893fff640 1 --2- 172.21.15.67:0/2839267220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28940b2cc0 0x7f2894152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.569+0000 7f2898ade640 1 -- 172.21.15.67:0/2839267220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28940b2cc0 msgr2=0x7f2894152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.569+0000 7f2898ade640 1 --2- 172.21.15.67:0/2839267220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28940b2cc0 0x7f2894152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.569+0000 7f2898ade640 1 -- 172.21.15.67:0/2839267220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f289415b220 msgr2=0x7f2894153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.569+0000 7f2898ade640 1 --2- 172.21.15.67:0/2839267220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f289415b220 0x7f2894153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.569+0000 7f2898ade640 1 -- 172.21.15.67:0/2839267220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2894154c50 con 0x7f2894070df0 2024-04-25T02:28:53.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.569+0000 7f28992df640 1 --2- 172.21.15.67:0/2839267220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f289415b220 0x7f2894153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:53.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.569+0000 7f2893fff640 1 --2- 172.21.15.67:0/2839267220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28940b2cc0 0x7f2894152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:53.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.569+0000 7f2898ade640 1 --2- 172.21.15.67:0/2839267220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2894070df0 0x7f28941458d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f288800c430 tx=0x7f288800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:53.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.569+0000 7f28917fa640 1 -- 172.21.15.67:0/2839267220 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28880074e0 con 0x7f2894070df0 2024-04-25T02:28:53.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.569+0000 7f28917fa640 1 -- 172.21.15.67:0/2839267220 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28880047e0 con 0x7f2894070df0 2024-04-25T02:28:53.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.569+0000 7f289ad42640 1 -- 172.21.15.67:0/2839267220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2894154f30 con 0x7f2894070df0 2024-04-25T02:28:53.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.569+0000 7f28917fa640 1 -- 172.21.15.67:0/2839267220 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888004bd0 con 0x7f2894070df0 2024-04-25T02:28:53.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.569+0000 7f289ad42640 1 -- 172.21.15.67:0/2839267220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28941554f0 con 0x7f2894070df0 2024-04-25T02:28:53.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.570+0000 7f289ad42640 1 -- 172.21.15.67:0/2839267220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2894069110 con 0x7f2894070df0 2024-04-25T02:28:53.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.570+0000 7f28917fa640 1 -- 172.21.15.67:0/2839267220 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2888011070 con 0x7f2894070df0 2024-04-25T02:28:53.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.571+0000 7f28917fa640 1 --2- 172.21.15.67:0/2839267220 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f287806be30 0x7f287806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.571+0000 7f28917fa640 1 -- 172.21.15.67:0/2839267220 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f288808aa70 con 0x7f2894070df0 2024-04-25T02:28:53.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.571+0000 7f2893fff640 1 --2- 172.21.15.67:0/2839267220 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f287806be30 0x7f287806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.572+0000 7f2893fff640 1 --2- 172.21.15.67:0/2839267220 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f287806be30 0x7f287806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2880034000 tx=0x7f288002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:53.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.575+0000 7f28917fa640 1 -- 172.21.15.67:0/2839267220 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f28880594b0 con 0x7f2894070df0 2024-04-25T02:28:53.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.759+0000 7f289ad42640 1 -- 172.21.15.67:0/2839267220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f289406e610 con 0x7f2894070df0 2024-04-25T02:28:53.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.760+0000 7f28917fa640 1 -- 172.21.15.67:0/2839267220 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f2888058db0 con 0x7f2894070df0 2024-04-25T02:28:53.763 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:53.763 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:27.819641+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:53.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.762+0000 7f289ad42640 1 -- 172.21.15.67:0/2839267220 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f287806be30 msgr2=0x7f287806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.762+0000 7f289ad42640 1 --2- 172.21.15.67:0/2839267220 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f287806be30 0x7f287806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2880034000 tx=0x7f288002e000 comp rx=0 tx=0).stop 2024-04-25T02:28:53.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.762+0000 7f289ad42640 1 -- 172.21.15.67:0/2839267220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2894070df0 msgr2=0x7f28941458d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.762+0000 7f289ad42640 1 --2- 172.21.15.67:0/2839267220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2894070df0 0x7f28941458d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f288800c430 tx=0x7f288800c8f0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.762+0000 7f289ad42640 1 -- 172.21.15.67:0/2839267220 shutdown_connections 2024-04-25T02:28:53.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.762+0000 7f289ad42640 1 --2- 172.21.15.67:0/2839267220 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f287806be30 0x7f287806e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.762+0000 7f289ad42640 1 --2- 172.21.15.67:0/2839267220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f289415b220 0x7f2894153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.762+0000 7f289ad42640 1 --2- 172.21.15.67:0/2839267220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28940b2cc0 0x7f2894152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.762+0000 7f289ad42640 1 --2- 172.21.15.67:0/2839267220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2894070df0 0x7f28941458d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.762+0000 7f289ad42640 1 -- 172.21.15.67:0/2839267220 >> 172.21.15.67:0/2839267220 conn(0x7f28940b19c0 msgr2=0x7f289415e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:53.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.762+0000 7f289ad42640 1 -- 172.21.15.67:0/2839267220 shutdown_connections 2024-04-25T02:28:53.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.762+0000 7f289ad42640 1 -- 172.21.15.67:0/2839267220 wait complete. 2024-04-25T02:28:53.776 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:28:24.445606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:28:25.161619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:28:53.776 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:28:53.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.877+0000 7f32f5ff9640 1 Processor -- start 2024-04-25T02:28:53.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.877+0000 7f32f5ff9640 1 -- start start 2024-04-25T02:28:53.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.878+0000 7f32f5ff9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32f015e3b0 0x7f32f00d2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.878+0000 7f32f5ff9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f32f00d11c0 0x7f32f00cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.878+0000 7f32f5ff9640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32f00d1d10 con 0x7f32f00cf780 2024-04-25T02:28:53.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.878+0000 7f32f5ff9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f32f015e790 con 0x7f32f015e3b0 2024-04-25T02:28:53.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.878+0000 7f32f5ff9640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f32f00d1ff0 con 0x7f32f00d11c0 2024-04-25T02:28:53.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.878+0000 7f32ef7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32f015e3b0 0x7f32f00d2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.878+0000 7f32eeffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f32f00cf780 0x7f32f00d0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55822/0 (socket says 172.21.15.67:55822) 2024-04-25T02:28:53.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.878+0000 7f32ef7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32f015e3b0 0x7f32f00d2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46824/0 (socket says 172.21.15.67:46824) 2024-04-25T02:28:53.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.878+0000 7f32eeffd640 1 -- 172.21.15.67:0/3896308915 learned_addr learned my addr 172.21.15.67:0/3896308915 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:53.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.878+0000 7f32ef7fe640 1 -- 172.21.15.67:0/3896308915 >> v2:172.21.15.176:3300/0 conn(0x7f32f00d11c0 msgr2=0x7f32f00cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:53.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.878+0000 7f32ef7fe640 1 --2- 172.21.15.67:0/3896308915 >> v2:172.21.15.176:3300/0 conn(0x7f32f00d11c0 0x7f32f00cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.878+0000 7f32ef7fe640 1 -- 172.21.15.67:0/3896308915 >> v1:172.21.15.67:6789/0 conn(0x7f32f00cf780 legacy=0x7f32f00d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.878+0000 7f32ef7fe640 1 -- 172.21.15.67:0/3896308915 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f00d22d0 con 0x7f32f015e3b0 2024-04-25T02:28:53.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.878+0000 7f32ee7fc640 1 -- 172.21.15.67:0/3896308915 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1853300146 0 0) 0x7f32f00d1d10 con 0x7f32f00cf780 2024-04-25T02:28:53.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.879+0000 7f32ef7fe640 1 --2- 172.21.15.67:0/3896308915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f015e3b0 0x7f32f00d2db0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f32f006baf0 tx=0x7f32e002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281d7624abf9807f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:53.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.879+0000 7f32ee7fc640 1 -- 172.21.15.67:0/3896308915 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e0037070 con 0x7f32f015e3b0 2024-04-25T02:28:53.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.879+0000 7f32ee7fc640 1 -- 172.21.15.67:0/3896308915 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e0032440 con 0x7f32f015e3b0 2024-04-25T02:28:53.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.879+0000 7f32ee7fc640 1 -- 172.21.15.67:0/3896308915 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e0032810 con 0x7f32f015e3b0 2024-04-25T02:28:53.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.880+0000 7f32f5ff9640 1 -- 172.21.15.67:0/3896308915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f015e3b0 msgr2=0x7f32f00d2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.880+0000 7f32f5ff9640 1 --2- 172.21.15.67:0/3896308915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f015e3b0 0x7f32f00d2db0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f32f006baf0 tx=0x7f32e002a1c0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.880+0000 7f32f5ff9640 1 -- 172.21.15.67:0/3896308915 shutdown_connections 2024-04-25T02:28:53.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.880+0000 7f32f5ff9640 1 --2- 172.21.15.67:0/3896308915 >> v2:172.21.15.176:3300/0 conn(0x7f32f00d11c0 0x7f32f00cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.880+0000 7f32f5ff9640 1 --2- 172.21.15.67:0/3896308915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f015e3b0 0x7f32f00d2db0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.880+0000 7f32f5ff9640 1 -- 172.21.15.67:0/3896308915 >> 172.21.15.67:0/3896308915 conn(0x7f32f009d450 msgr2=0x7f32f00d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:53.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.880+0000 7f32f5ff9640 1 -- 172.21.15.67:0/3896308915 shutdown_connections 2024-04-25T02:28:53.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.880+0000 7f32f5ff9640 1 -- 172.21.15.67:0/3896308915 wait complete. 2024-04-25T02:28:53.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.881+0000 7f32f5ff9640 1 Processor -- start 2024-04-25T02:28:53.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.881+0000 7f32f5ff9640 1 -- start start 2024-04-25T02:28:53.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32f5ff9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32f00cf780 0x7f32f01f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32f5ff9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f00d11c0 0x7f32f00c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32f5ff9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32f015e3b0 0x7f32f00cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32f5ff9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f32f00d4da0 con 0x7f32f00d11c0 2024-04-25T02:28:53.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32f5ff9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f32f00d2890 con 0x7f32f015e3b0 2024-04-25T02:28:53.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32f5ff9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f32f00b3870 con 0x7f32f00cf780 2024-04-25T02:28:53.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32eeffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f00d11c0 0x7f32f00c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32eeffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f00d11c0 0x7f32f00c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46828/0 (socket says 172.21.15.67:46828) 2024-04-25T02:28:53.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32eeffd640 1 -- 172.21.15.67:0/2911450142 learned_addr learned my addr 172.21.15.67:0/2911450142 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:53.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32effff640 1 --2- 172.21.15.67:0/2911450142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32f015e3b0 0x7f32f00cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32ef7fe640 1 --2- 172.21.15.67:0/2911450142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32f00cf780 0x7f32f01f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32eeffd640 1 -- 172.21.15.67:0/2911450142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32f00cf780 msgr2=0x7f32f01f35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32eeffd640 1 --2- 172.21.15.67:0/2911450142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32f00cf780 0x7f32f01f35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32eeffd640 1 -- 172.21.15.67:0/2911450142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32f015e3b0 msgr2=0x7f32f00cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:53.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32eeffd640 1 --2- 172.21.15.67:0/2911450142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32f015e3b0 0x7f32f00cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:53.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32eeffd640 1 -- 172.21.15.67:0/2911450142 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f01f3b00 con 0x7f32f00d11c0 2024-04-25T02:28:53.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32effff640 1 --2- 172.21.15.67:0/2911450142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32f015e3b0 0x7f32f00cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:53.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32eeffd640 1 --2- 172.21.15.67:0/2911450142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f00d11c0 0x7f32f00c8fe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f32e400c4d0 tx=0x7f32e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:53.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.882+0000 7f32d7fff640 1 -- 172.21.15.67:0/2911450142 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4018070 con 0x7f32f00d11c0 2024-04-25T02:28:53.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.883+0000 7f32d7fff640 1 -- 172.21.15.67:0/2911450142 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e4007500 con 0x7f32f00d11c0 2024-04-25T02:28:53.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.883+0000 7f32f5ff9640 1 -- 172.21.15.67:0/2911450142 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f00cc630 con 0x7f32f00d11c0 2024-04-25T02:28:53.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.883+0000 7f32d7fff640 1 -- 172.21.15.67:0/2911450142 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4004a20 con 0x7f32f00d11c0 2024-04-25T02:28:53.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.883+0000 7f32f5ff9640 1 -- 172.21.15.67:0/2911450142 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f00b82d0 con 0x7f32f00d11c0 2024-04-25T02:28:53.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.884+0000 7f32f5ff9640 1 -- 172.21.15.67:0/2911450142 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f0069110 con 0x7f32f00d11c0 2024-04-25T02:28:53.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.884+0000 7f32d7fff640 1 -- 172.21.15.67:0/2911450142 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32e401b070 con 0x7f32f00d11c0 2024-04-25T02:28:53.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.885+0000 7f32d7fff640 1 --2- 172.21.15.67:0/2911450142 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f32dc06be30 0x7f32dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:53.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.885+0000 7f32d7fff640 1 -- 172.21.15.67:0/2911450142 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f32e408a100 con 0x7f32f00d11c0 2024-04-25T02:28:53.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.885+0000 7f32ef7fe640 1 --2- 172.21.15.67:0/2911450142 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f32dc06be30 0x7f32dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:53.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.886+0000 7f32ef7fe640 1 --2- 172.21.15.67:0/2911450142 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f32dc06be30 0x7f32dc06e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f32e0034000 tx=0x7f32e002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:53.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:53.889+0000 7f32d7fff640 1 -- 172.21.15.67:0/2911450142 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f32e4058b40 con 0x7f32f00d11c0 2024-04-25T02:28:54.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.072+0000 7f32f5ff9640 1 -- 172.21.15.67:0/2911450142 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f32f00d1800 con 0x7f32f00d11c0 2024-04-25T02:28:54.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.072+0000 7f32d7fff640 1 -- 172.21.15.67:0/2911450142 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f32e4058440 con 0x7f32f00d11c0 2024-04-25T02:28:54.075 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:28:54.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.074+0000 7f32f5ff9640 1 -- 172.21.15.67:0/2911450142 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f32dc06be30 msgr2=0x7f32dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:54.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.074+0000 7f32f5ff9640 1 --2- 172.21.15.67:0/2911450142 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f32dc06be30 0x7f32dc06e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f32e0034000 tx=0x7f32e002e000 comp rx=0 tx=0).stop 2024-04-25T02:28:54.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.074+0000 7f32f5ff9640 1 -- 172.21.15.67:0/2911450142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f00d11c0 msgr2=0x7f32f00c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:54.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.074+0000 7f32f5ff9640 1 --2- 172.21.15.67:0/2911450142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f00d11c0 0x7f32f00c8fe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f32e400c4d0 tx=0x7f32e400c990 comp rx=0 tx=0).stop 2024-04-25T02:28:54.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.074+0000 7f32f5ff9640 1 -- 172.21.15.67:0/2911450142 shutdown_connections 2024-04-25T02:28:54.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.074+0000 7f32f5ff9640 1 --2- 172.21.15.67:0/2911450142 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f32dc06be30 0x7f32dc06e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.074+0000 7f32f5ff9640 1 --2- 172.21.15.67:0/2911450142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32f015e3b0 0x7f32f00cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.074+0000 7f32f5ff9640 1 --2- 172.21.15.67:0/2911450142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32f00d11c0 0x7f32f00c8fe0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.074+0000 7f32f5ff9640 1 --2- 172.21.15.67:0/2911450142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32f00cf780 0x7f32f01f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.074+0000 7f32f5ff9640 1 -- 172.21.15.67:0/2911450142 >> 172.21.15.67:0/2911450142 conn(0x7f32f009d450 msgr2=0x7f32f00d3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:54.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.074+0000 7f32f5ff9640 1 -- 172.21.15.67:0/2911450142 shutdown_connections 2024-04-25T02:28:54.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.074+0000 7f32f5ff9640 1 -- 172.21.15.67:0/2911450142 wait complete. 2024-04-25T02:28:54.088 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:28:54.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.188+0000 7f41407ed640 1 Processor -- start 2024-04-25T02:28:54.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.189+0000 7f41407ed640 1 -- start start 2024-04-25T02:28:54.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.189+0000 7f41407ed640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413815b090 0x7f413809db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.189+0000 7f41407ed640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f413806ec40 0x7f41380add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.189+0000 7f41407ed640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41380ad820 con 0x7f41380b2cc0 2024-04-25T02:28:54.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.189+0000 7f41407ed640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f41380b3260 con 0x7f413806ec40 2024-04-25T02:28:54.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.189+0000 7f41407ed640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f41380b3540 con 0x7f413815b090 2024-04-25T02:28:54.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.190+0000 7f413ed8a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f413806ec40 0x7f41380add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.190+0000 7f413ed8a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f413806ec40 0x7f41380add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46836/0 (socket says 172.21.15.67:46836) 2024-04-25T02:28:54.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.190+0000 7f413ed8a640 1 -- 172.21.15.67:0/3595879572 learned_addr learned my addr 172.21.15.67:0/3595879572 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:54.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.190+0000 7f413e589640 1 --2- 172.21.15.67:0/3595879572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413815b090 0x7f413809db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.190+0000 7f413ed8a640 1 -- 172.21.15.67:0/3595879572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413815b090 msgr2=0x7f413809db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:54.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.190+0000 7f413ed8a640 1 --2- 172.21.15.67:0/3595879572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413815b090 0x7f413809db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.190+0000 7f413ed8a640 1 -- 172.21.15.67:0/3595879572 >> v1:172.21.15.176:6789/0 conn(0x7f41380b2cc0 legacy=0x7f413806e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:54.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.190+0000 7f413ed8a640 1 -- 172.21.15.67:0/3595879572 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41380b3820 con 0x7f413806ec40 2024-04-25T02:28:54.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.190+0000 7f413e589640 1 --2- 172.21.15.67:0/3595879572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413815b090 0x7f413809db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:54.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.191+0000 7f413ed8a640 1 --2- 172.21.15.67:0/3595879572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f413806ec40 0x7f41380add00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4130009e50 tx=0x7f413002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc19401bcb43dfe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:54.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.191+0000 7f413d587640 1 -- 172.21.15.67:0/3595879572 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130036070 con 0x7f413806ec40 2024-04-25T02:28:54.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.191+0000 7f413d587640 1 -- 172.21.15.67:0/3595879572 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4130031600 con 0x7f413806ec40 2024-04-25T02:28:54.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.191+0000 7f413d587640 1 -- 172.21.15.67:0/3595879572 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41300319d0 con 0x7f413806ec40 2024-04-25T02:28:54.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.191+0000 7f41407ed640 1 -- 172.21.15.67:0/3595879572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f413806ec40 msgr2=0x7f41380add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:54.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.191+0000 7f41407ed640 1 --2- 172.21.15.67:0/3595879572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f413806ec40 0x7f41380add00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4130009e50 tx=0x7f413002a6c0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.191+0000 7f41407ed640 1 -- 172.21.15.67:0/3595879572 shutdown_connections 2024-04-25T02:28:54.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.191+0000 7f41407ed640 1 --2- 172.21.15.67:0/3595879572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f413806ec40 0x7f41380add00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.191+0000 7f41407ed640 1 --2- 172.21.15.67:0/3595879572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413815b090 0x7f413809db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.191+0000 7f41407ed640 1 -- 172.21.15.67:0/3595879572 >> 172.21.15.67:0/3595879572 conn(0x7f41380b19c0 msgr2=0x7f41380b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:54.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.191+0000 7f41407ed640 1 -- 172.21.15.67:0/3595879572 shutdown_connections 2024-04-25T02:28:54.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.192+0000 7f41407ed640 1 -- 172.21.15.67:0/3595879572 wait complete. 2024-04-25T02:28:54.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.193+0000 7f41407ed640 1 Processor -- start 2024-04-25T02:28:54.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.193+0000 7f41407ed640 1 -- start start 2024-04-25T02:28:54.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.193+0000 7f41407ed640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413806ec40 0x7f413809cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.193+0000 7f41407ed640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41380b2cc0 0x7f413806d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.193+0000 7f41407ed640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f413815b090 0x7f4138148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.193+0000 7f41407ed640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f413815b470 con 0x7f413815b090 2024-04-25T02:28:54.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.193+0000 7f41407ed640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f41380b4f70 con 0x7f41380b2cc0 2024-04-25T02:28:54.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.193+0000 7f41407ed640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4138070e10 con 0x7f413806ec40 2024-04-25T02:28:54.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.193+0000 7f413ed8a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f413815b090 0x7f4138148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.194+0000 7f413ed8a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f413815b090 0x7f4138148340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46844/0 (socket says 172.21.15.67:46844) 2024-04-25T02:28:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.194+0000 7f413ed8a640 1 -- 172.21.15.67:0/2141306787 learned_addr learned my addr 172.21.15.67:0/2141306787 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.194+0000 7f413dd88640 1 --2- 172.21.15.67:0/2141306787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41380b2cc0 0x7f413806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.194+0000 7f413e589640 1 --2- 172.21.15.67:0/2141306787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413806ec40 0x7f413809cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.194+0000 7f413ed8a640 1 -- 172.21.15.67:0/2141306787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413806ec40 msgr2=0x7f413809cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.194+0000 7f413ed8a640 1 --2- 172.21.15.67:0/2141306787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413806ec40 0x7f413809cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.194+0000 7f413ed8a640 1 -- 172.21.15.67:0/2141306787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41380b2cc0 msgr2=0x7f413806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.194+0000 7f413ed8a640 1 --2- 172.21.15.67:0/2141306787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41380b2cc0 0x7f413806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.194+0000 7f413ed8a640 1 -- 172.21.15.67:0/2141306787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413814f280 con 0x7f413815b090 2024-04-25T02:28:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.194+0000 7f413dd88640 1 --2- 172.21.15.67:0/2141306787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41380b2cc0 0x7f413806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.194+0000 7f413ed8a640 1 --2- 172.21.15.67:0/2141306787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f413815b090 0x7f4138148340 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4130009e50 tx=0x7f4130004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.194+0000 7f412affd640 1 -- 172.21.15.67:0/2141306787 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130036050 con 0x7f413815b090 2024-04-25T02:28:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.194+0000 7f412affd640 1 -- 172.21.15.67:0/2141306787 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4130042070 con 0x7f413815b090 2024-04-25T02:28:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.194+0000 7f41407ed640 1 -- 172.21.15.67:0/2141306787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41381f7800 con 0x7f413815b090 2024-04-25T02:28:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.194+0000 7f412affd640 1 -- 172.21.15.67:0/2141306787 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130009510 con 0x7f413815b090 2024-04-25T02:28:54.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.194+0000 7f41407ed640 1 -- 172.21.15.67:0/2141306787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41381f80a0 con 0x7f413815b090 2024-04-25T02:28:54.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.195+0000 7f41407ed640 1 -- 172.21.15.67:0/2141306787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4138069110 con 0x7f413815b090 2024-04-25T02:28:54.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.196+0000 7f412affd640 1 -- 172.21.15.67:0/2141306787 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4130007bd0 con 0x7f413815b090 2024-04-25T02:28:54.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.196+0000 7f412affd640 1 --2- 172.21.15.67:0/2141306787 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f411c06be30 0x7f411c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.196+0000 7f412affd640 1 -- 172.21.15.67:0/2141306787 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f41300abd80 con 0x7f413815b090 2024-04-25T02:28:54.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.196+0000 7f413e589640 1 --2- 172.21.15.67:0/2141306787 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f411c06be30 0x7f411c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.197+0000 7f413e589640 1 --2- 172.21.15.67:0/2141306787 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f411c06be30 0x7f411c06e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f412c00a950 tx=0x7f412c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:54.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.201+0000 7f412affd640 1 -- 172.21.15.67:0/2141306787 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f413007a7c0 con 0x7f413815b090 2024-04-25T02:28:54.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.384+0000 7f41407ed640 1 -- 172.21.15.67:0/2141306787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f413806cdd0 con 0x7f413815b090 2024-04-25T02:28:54.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.384+0000 7f412affd640 1 -- 172.21.15.67:0/2141306787 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f413007a0c0 con 0x7f413815b090 2024-04-25T02:28:54.387 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-25T02:28:54.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.386+0000 7f41407ed640 1 -- 172.21.15.67:0/2141306787 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f411c06be30 msgr2=0x7f411c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:54.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.386+0000 7f41407ed640 1 --2- 172.21.15.67:0/2141306787 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f411c06be30 0x7f411c06e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f412c00a950 tx=0x7f412c008040 comp rx=0 tx=0).stop 2024-04-25T02:28:54.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.386+0000 7f41407ed640 1 -- 172.21.15.67:0/2141306787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f413815b090 msgr2=0x7f4138148340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:54.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.386+0000 7f41407ed640 1 --2- 172.21.15.67:0/2141306787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f413815b090 0x7f4138148340 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4130009e50 tx=0x7f4130004a40 comp rx=0 tx=0).stop 2024-04-25T02:28:54.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.386+0000 7f41407ed640 1 -- 172.21.15.67:0/2141306787 shutdown_connections 2024-04-25T02:28:54.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.386+0000 7f41407ed640 1 --2- 172.21.15.67:0/2141306787 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f411c06be30 0x7f411c06e2f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.386+0000 7f41407ed640 1 --2- 172.21.15.67:0/2141306787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f413815b090 0x7f4138148340 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.386+0000 7f41407ed640 1 --2- 172.21.15.67:0/2141306787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41380b2cc0 0x7f413806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.386+0000 7f41407ed640 1 --2- 172.21.15.67:0/2141306787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413806ec40 0x7f413809cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.386+0000 7f41407ed640 1 -- 172.21.15.67:0/2141306787 >> 172.21.15.67:0/2141306787 conn(0x7f41380b19c0 msgr2=0x7f41380b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:54.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.386+0000 7f41407ed640 1 -- 172.21.15.67:0/2141306787 shutdown_connections 2024-04-25T02:28:54.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.386+0000 7f41407ed640 1 -- 172.21.15.67:0/2141306787 wait complete. 2024-04-25T02:28:54.400 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:28:54.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.501+0000 7fa008ce7640 1 Processor -- start 2024-04-25T02:28:54.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.501+0000 7fa008ce7640 1 -- start start 2024-04-25T02:28:54.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.502+0000 7fa008ce7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0040b2da0 0x7fa0040b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.502+0000 7fa008ce7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0040b3570 con 0x7fa00406c840 2024-04-25T02:28:54.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.502+0000 7fa008ce7640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0040cff80 con 0x7fa0040cf060 2024-04-25T02:28:54.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.502+0000 7fa008ce7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa0040d05d0 con 0x7fa0040b2da0 2024-04-25T02:28:54.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.502+0000 7fa002d9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa00406c840 0x7fa00406ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55824/0 (socket says 172.21.15.67:55824) 2024-04-25T02:28:54.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.502+0000 7fa002d9d640 1 -- 172.21.15.67:0/4180620639 learned_addr learned my addr 172.21.15.67:0/4180620639 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:54.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.502+0000 7fa00159a640 1 -- 172.21.15.67:0/4180620639 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 802746370 0 0) 0x7fa0040b3570 con 0x7fa00406c840 2024-04-25T02:28:54.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.502+0000 7fa00159a640 1 -- 172.21.15.67:0/4180620639 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ff0003520 con 0x7fa00406c840 2024-04-25T02:28:54.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00159a640 1 -- 172.21.15.67:0/4180620639 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2830778856 0 0) 0x7f9ff0003520 con 0x7fa00406c840 2024-04-25T02:28:54.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00159a640 1 -- 172.21.15.67:0/4180620639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0040b2da0 msgr2=0x7fa0040b2670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T02:28:54.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00159a640 1 --2- 172.21.15.67:0/4180620639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0040b2da0 0x7fa0040b2670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00159a640 1 -- 172.21.15.67:0/4180620639 >> v1:172.21.15.176:6789/0 conn(0x7fa0040cf060 legacy=0x7fa0040d0ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T02:28:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00159a640 1 -- 172.21.15.67:0/4180620639 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0040d0260 con 0x7fa00406c840 2024-04-25T02:28:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00159a640 1 -- 172.21.15.67:0/4180620639 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f9ffc001670 con 0x7fa00406c840 2024-04-25T02:28:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00159a640 1 -- 172.21.15.67:0/4180620639 >> v1:172.21.15.67:6789/0 conn(0x7fa00406c840 legacy=0x7fa00406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00159a640 1 --2- 172.21.15.67:0/4180620639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ff00039e0 0x7f9ff0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00159a640 1 --2- 172.21.15.67:0/4180620639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0040b2da0 0x7f9ff0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00159a640 1 --2- 172.21.15.67:0/4180620639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ff0004e60 0x7f9ff000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00159a640 1 -- 172.21.15.67:0/4180620639 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa0040d05d0 con 0x7f9ff00039e0 2024-04-25T02:28:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00159a640 1 -- 172.21.15.67:0/4180620639 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff0005580 con 0x7f9ff0004e60 2024-04-25T02:28:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00159a640 1 -- 172.21.15.67:0/4180620639 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9ff000bf00 con 0x7fa0040b2da0 2024-04-25T02:28:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00259c640 1 --2- 172.21.15.67:0/4180620639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ff00039e0 0x7f9ff0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00259c640 1 -- 172.21.15.67:0/4180620639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0040b2da0 msgr2=0x7f9ff0004800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T02:28:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00259c640 1 --2- 172.21.15.67:0/4180620639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0040b2da0 0x7f9ff0004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00259c640 1 -- 172.21.15.67:0/4180620639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ff0004e60 msgr2=0x7f9ff000b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T02:28:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00259c640 1 --2- 172.21.15.67:0/4180620639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ff0004e60 0x7f9ff000b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.503+0000 7fa00259c640 1 -- 172.21.15.67:0/4180620639 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff0003520 con 0x7f9ff00039e0 2024-04-25T02:28:54.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.504+0000 7fa00259c640 1 --2- 172.21.15.67:0/4180620639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ff00039e0 0x7f9ff0003de0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009e90 tx=0x7f9ff0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e182158740a20779 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:54.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.504+0000 7fa00159a640 1 -- 172.21.15.67:0/4180620639 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4033070 con 0x7f9ff00039e0 2024-04-25T02:28:54.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.504+0000 7fa00159a640 1 -- 172.21.15.67:0/4180620639 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff402f620 con 0x7f9ff00039e0 2024-04-25T02:28:54.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.504+0000 7fa00159a640 1 -- 172.21.15.67:0/4180620639 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4009a30 con 0x7f9ff00039e0 2024-04-25T02:28:54.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.504+0000 7fa008ce7640 1 -- 172.21.15.67:0/4180620639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ff00039e0 msgr2=0x7f9ff0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:54.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.504+0000 7fa008ce7640 1 --2- 172.21.15.67:0/4180620639 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ff00039e0 0x7f9ff0003de0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009e90 tx=0x7f9ff0005830 comp rx=0 tx=0).stop 2024-04-25T02:28:54.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.505+0000 7fa002d9d640 1 -- 172.21.15.67:0/4180620639 reap_dead start 2024-04-25T02:28:54.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.505+0000 7fa008ce7640 1 -- 172.21.15.67:0/4180620639 shutdown_connections 2024-04-25T02:28:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.505+0000 7fa008ce7640 1 -- 172.21.15.67:0/4180620639 >> 172.21.15.67:0/4180620639 conn(0x7fa0040b3a70 msgr2=0x7fa0040b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.505+0000 7fa008ce7640 1 -- 172.21.15.67:0/4180620639 shutdown_connections 2024-04-25T02:28:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.505+0000 7fa008ce7640 1 -- 172.21.15.67:0/4180620639 wait complete. 2024-04-25T02:28:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.506+0000 7fa008ce7640 1 Processor -- start 2024-04-25T02:28:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.506+0000 7fa008ce7640 1 -- start start 2024-04-25T02:28:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.507+0000 7fa008ce7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ff00039e0 0x7fa0040b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.507+0000 7fa008ce7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0040b0f20 0x7fa0040b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.507+0000 7fa008ce7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0041f70f0 0x7fa0041f7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.507+0000 7fa008ce7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa0040b27f0 con 0x7fa0040b0f20 2024-04-25T02:28:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.507+0000 7fa008ce7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa0040b2670 con 0x7fa0041f70f0 2024-04-25T02:28:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.507+0000 7fa008ce7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa0040b2970 con 0x7f9ff00039e0 2024-04-25T02:28:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.507+0000 7fa001d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0040b0f20 0x7fa0040b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.507+0000 7fa001d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0040b0f20 0x7fa0040b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46852/0 (socket says 172.21.15.67:46852) 2024-04-25T02:28:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.507+0000 7fa001d9b640 1 -- 172.21.15.67:0/4101749353 learned_addr learned my addr 172.21.15.67:0/4101749353 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:54.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.507+0000 7fa002d9d640 1 --2- 172.21.15.67:0/4101749353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0041f70f0 0x7fa0041f7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.507+0000 7fa00259c640 1 --2- 172.21.15.67:0/4101749353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ff00039e0 0x7fa0040b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.507+0000 7fa001d9b640 1 -- 172.21.15.67:0/4101749353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ff00039e0 msgr2=0x7fa0040b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.507+0000 7fa001d9b640 1 --2- 172.21.15.67:0/4101749353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ff00039e0 0x7fa0040b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.507+0000 7fa001d9b640 1 -- 172.21.15.67:0/4101749353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0041f70f0 msgr2=0x7fa0041f7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.507+0000 7fa001d9b640 1 --2- 172.21.15.67:0/4101749353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0041f70f0 0x7fa0041f7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.507+0000 7fa001d9b640 1 -- 172.21.15.67:0/4101749353 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0040c8fb0 con 0x7fa0040b0f20 2024-04-25T02:28:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.507+0000 7fa001d9b640 1 --2- 172.21.15.67:0/4101749353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0040b0f20 0x7fa0040b13a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00b410 tx=0x7f9fec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.508+0000 7f9ffaffd640 1 -- 172.21.15.67:0/4101749353 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec015020 con 0x7fa0040b0f20 2024-04-25T02:28:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.508+0000 7f9ffaffd640 1 -- 172.21.15.67:0/4101749353 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fec011830 con 0x7fa0040b0f20 2024-04-25T02:28:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.508+0000 7fa008ce7640 1 -- 172.21.15.67:0/4101749353 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0040c9290 con 0x7fa0040b0f20 2024-04-25T02:28:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.508+0000 7f9ffaffd640 1 -- 172.21.15.67:0/4101749353 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec011c00 con 0x7fa0040b0f20 2024-04-25T02:28:54.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.508+0000 7fa008ce7640 1 -- 172.21.15.67:0/4101749353 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0040c9850 con 0x7fa0040b0f20 2024-04-25T02:28:54.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.509+0000 7fa008ce7640 1 -- 172.21.15.67:0/4101749353 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa004069110 con 0x7fa0040b0f20 2024-04-25T02:28:54.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.509+0000 7f9ffaffd640 1 -- 172.21.15.67:0/4101749353 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9fec018020 con 0x7fa0040b0f20 2024-04-25T02:28:54.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.510+0000 7f9ffaffd640 1 --2- 172.21.15.67:0/4101749353 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9fe406be30 0x7f9fe406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.510+0000 7f9ffaffd640 1 -- 172.21.15.67:0/4101749353 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9fec08ade0 con 0x7fa0040b0f20 2024-04-25T02:28:54.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.510+0000 7fa00259c640 1 --2- 172.21.15.67:0/4101749353 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9fe406be30 0x7f9fe406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.510+0000 7fa00259c640 1 --2- 172.21.15.67:0/4101749353 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9fe406be30 0x7f9fe406e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4035000 tx=0x7f9ff4030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:54.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.514+0000 7f9ffaffd640 1 -- 172.21.15.67:0/4101749353 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9fec01f020 con 0x7fa0040b0f20 2024-04-25T02:28:54.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.696+0000 7fa008ce7640 1 -- 172.21.15.67:0/4101749353 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa0040c8c70 con 0x7fa0040b0f20 2024-04-25T02:28:54.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.696+0000 7f9ffaffd640 1 -- 172.21.15.67:0/4101749353 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f9fec0172c0 con 0x7fa0040b0f20 2024-04-25T02:28:54.699 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-25T02:28:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.698+0000 7fa008ce7640 1 -- 172.21.15.67:0/4101749353 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9fe406be30 msgr2=0x7f9fe406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.698+0000 7fa008ce7640 1 --2- 172.21.15.67:0/4101749353 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9fe406be30 0x7f9fe406e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4035000 tx=0x7f9ff4030000 comp rx=0 tx=0).stop 2024-04-25T02:28:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.698+0000 7fa008ce7640 1 -- 172.21.15.67:0/4101749353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0040b0f20 msgr2=0x7fa0040b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.698+0000 7fa008ce7640 1 --2- 172.21.15.67:0/4101749353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0040b0f20 0x7fa0040b13a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00b410 tx=0x7f9fec00b8d0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.698+0000 7fa008ce7640 1 -- 172.21.15.67:0/4101749353 shutdown_connections 2024-04-25T02:28:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.698+0000 7fa008ce7640 1 --2- 172.21.15.67:0/4101749353 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9fe406be30 0x7f9fe406e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.698+0000 7fa008ce7640 1 --2- 172.21.15.67:0/4101749353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0041f70f0 0x7fa0041f7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.698+0000 7fa008ce7640 1 --2- 172.21.15.67:0/4101749353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0040b0f20 0x7fa0040b13a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.698+0000 7fa008ce7640 1 --2- 172.21.15.67:0/4101749353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ff00039e0 0x7fa0040b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.698+0000 7fa008ce7640 1 -- 172.21.15.67:0/4101749353 >> 172.21.15.67:0/4101749353 conn(0x7fa0040b3a70 msgr2=0x7fa00406ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.699+0000 7fa008ce7640 1 -- 172.21.15.67:0/4101749353 shutdown_connections 2024-04-25T02:28:54.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.699+0000 7fa008ce7640 1 -- 172.21.15.67:0/4101749353 wait complete. 2024-04-25T02:28:54.834 INFO:tasks.cephfs_test_runner:Starting test: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2024-04-25T02:28:54.834 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:54.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.932+0000 7f3b942ee640 1 Processor -- start 2024-04-25T02:28:54.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.932+0000 7f3b942ee640 1 -- start start 2024-04-25T02:28:54.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.933+0000 7f3b942ee640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b8c15b220 0x7f3b8c070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.933+0000 7f3b942ee640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8c0713d0 con 0x7f3b8c15ec70 2024-04-25T02:28:54.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.933+0000 7f3b942ee640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8c0ae4d0 con 0x7f3b8c15f800 2024-04-25T02:28:54.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.933+0000 7f3b942ee640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b8c0aee00 con 0x7f3b8c15b220 2024-04-25T02:28:54.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91889640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3b8c15ec70 0x7f3b8c15f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55840/0 (socket says 172.21.15.67:55840) 2024-04-25T02:28:54.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91889640 1 -- 172.21.15.67:0/3447407730 learned_addr learned my addr 172.21.15.67:0/3447407730 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:54.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b9208a640 1 --2- 172.21.15.67:0/3447407730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b8c15b220 0x7f3b8c070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91088640 1 -- 172.21.15.67:0/3447407730 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1211764117 0 0) 0x7f3b8c0713d0 con 0x7f3b8c15ec70 2024-04-25T02:28:54.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91088640 1 -- 172.21.15.67:0/3447407730 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b78003520 con 0x7f3b8c15ec70 2024-04-25T02:28:54.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91088640 1 -- 172.21.15.67:0/3447407730 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2412197355 0 0) 0x7f3b8c0ae4d0 con 0x7f3b8c15f800 2024-04-25T02:28:54.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91088640 1 -- 172.21.15.67:0/3447407730 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b8c0713d0 con 0x7f3b8c15f800 2024-04-25T02:28:54.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91088640 1 -- 172.21.15.67:0/3447407730 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 99128572 0 0) 0x7f3b78003520 con 0x7f3b8c15ec70 2024-04-25T02:28:54.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91088640 1 -- 172.21.15.67:0/3447407730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b8c15b220 msgr2=0x7f3b8c070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:54.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91088640 1 --2- 172.21.15.67:0/3447407730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b8c15b220 0x7f3b8c070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91088640 1 -- 172.21.15.67:0/3447407730 >> v1:172.21.15.176:6789/0 conn(0x7f3b8c15f800 legacy=0x7f3b8c0b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:54.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91088640 1 -- 172.21.15.67:0/3447407730 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c0ae7b0 con 0x7f3b8c15ec70 2024-04-25T02:28:54.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91088640 1 -- 172.21.15.67:0/3447407730 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f3b88001670 con 0x7f3b8c15ec70 2024-04-25T02:28:54.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91088640 1 -- 172.21.15.67:0/3447407730 >> v1:172.21.15.67:6789/0 conn(0x7f3b8c15ec70 legacy=0x7f3b8c15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:54.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91088640 1 --2- 172.21.15.67:0/3447407730 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b78003b70 0x7f3b78003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91088640 1 --2- 172.21.15.67:0/3447407730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b8c15b220 0x7f3b78004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91088640 1 --2- 172.21.15.67:0/3447407730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b78004d40 0x7f3b780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91088640 1 -- 172.21.15.67:0/3447407730 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c0aee00 con 0x7f3b78003b70 2024-04-25T02:28:54.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91088640 1 -- 172.21.15.67:0/3447407730 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7800ba70 con 0x7f3b78004d40 2024-04-25T02:28:54.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91088640 1 -- 172.21.15.67:0/3447407730 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b7800bc70 con 0x7f3b8c15b220 2024-04-25T02:28:54.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b9208a640 1 --2- 172.21.15.67:0/3447407730 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b78003b70 0x7f3b78003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b91889640 1 --2- 172.21.15.67:0/3447407730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b8c15b220 0x7f3b78004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.934+0000 7f3b9288b640 1 --2- 172.21.15.67:0/3447407730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b78004d40 0x7f3b780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.935+0000 7f3b9208a640 1 -- 172.21.15.67:0/3447407730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b8c15b220 msgr2=0x7f3b78004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:54.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.935+0000 7f3b9208a640 1 --2- 172.21.15.67:0/3447407730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b8c15b220 0x7f3b78004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.935+0000 7f3b9208a640 1 -- 172.21.15.67:0/3447407730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b78004d40 msgr2=0x7f3b780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:54.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.935+0000 7f3b9208a640 1 --2- 172.21.15.67:0/3447407730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b78004d40 0x7f3b780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.935+0000 7f3b9208a640 1 -- 172.21.15.67:0/3447407730 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b78003520 con 0x7f3b78003b70 2024-04-25T02:28:54.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.935+0000 7f3b9208a640 1 --2- 172.21.15.67:0/3447407730 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b78003b70 0x7f3b78003f70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009ac0 tx=0x7f3b78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbe457d8a93066b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:54.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.935+0000 7f3b91088640 1 -- 172.21.15.67:0/3447407730 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c036070 con 0x7f3b78003b70 2024-04-25T02:28:54.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.935+0000 7f3b91088640 1 -- 172.21.15.67:0/3447407730 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b7c031400 con 0x7f3b78003b70 2024-04-25T02:28:54.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.935+0000 7f3b91088640 1 -- 172.21.15.67:0/3447407730 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c009690 con 0x7f3b78003b70 2024-04-25T02:28:54.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.936+0000 7f3b942ee640 1 -- 172.21.15.67:0/3447407730 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b78003b70 msgr2=0x7f3b78003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:54.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.936+0000 7f3b942ee640 1 --2- 172.21.15.67:0/3447407730 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b78003b70 0x7f3b78003f70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009ac0 tx=0x7f3b78005830 comp rx=0 tx=0).stop 2024-04-25T02:28:54.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.936+0000 7f3b9288b640 1 -- 172.21.15.67:0/3447407730 reap_dead start 2024-04-25T02:28:54.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.936+0000 7f3b942ee640 1 -- 172.21.15.67:0/3447407730 shutdown_connections 2024-04-25T02:28:54.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.936+0000 7f3b942ee640 1 -- 172.21.15.67:0/3447407730 >> 172.21.15.67:0/3447407730 conn(0x7f3b8c0b19c0 msgr2=0x7f3b8c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:54.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.936+0000 7f3b942ee640 1 -- 172.21.15.67:0/3447407730 shutdown_connections 2024-04-25T02:28:54.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.936+0000 7f3b942ee640 1 -- 172.21.15.67:0/3447407730 wait complete. 2024-04-25T02:28:54.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.937+0000 7f3b942ee640 1 Processor -- start 2024-04-25T02:28:54.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.937+0000 7f3b942ee640 1 -- start start 2024-04-25T02:28:54.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.938+0000 7f3b942ee640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b78003b70 0x7f3b8c1575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.938+0000 7f3b942ee640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b8c1f2280 0x7f3b8c1f2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.938+0000 7f3b942ee640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b8c1e5480 0x7f3b8c1e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.938+0000 7f3b942ee640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c06ed10 con 0x7f3b8c1f2280 2024-04-25T02:28:54.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.938+0000 7f3b942ee640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c06eb90 con 0x7f3b78003b70 2024-04-25T02:28:54.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.938+0000 7f3b942ee640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b8c070df0 con 0x7f3b8c1e5480 2024-04-25T02:28:54.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.938+0000 7f3b91889640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b8c1f2280 0x7f3b8c1f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.938+0000 7f3b91889640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b8c1f2280 0x7f3b8c1f2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46880/0 (socket says 172.21.15.67:46880) 2024-04-25T02:28:54.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.938+0000 7f3b91889640 1 -- 172.21.15.67:0/17705782 learned_addr learned my addr 172.21.15.67:0/17705782 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:54.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.938+0000 7f3b9288b640 1 --2- 172.21.15.67:0/17705782 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b8c1e5480 0x7f3b8c1e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.938+0000 7f3b9208a640 1 --2- 172.21.15.67:0/17705782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b78003b70 0x7f3b8c1575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.938+0000 7f3b91889640 1 -- 172.21.15.67:0/17705782 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b8c1e5480 msgr2=0x7f3b8c1e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:54.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.938+0000 7f3b91889640 1 --2- 172.21.15.67:0/17705782 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b8c1e5480 0x7f3b8c1e5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.938+0000 7f3b91889640 1 -- 172.21.15.67:0/17705782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b78003b70 msgr2=0x7f3b8c1575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:54.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.938+0000 7f3b91889640 1 --2- 172.21.15.67:0/17705782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b78003b70 0x7f3b8c1575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:54.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.938+0000 7f3b91889640 1 -- 172.21.15.67:0/17705782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c09d3a0 con 0x7f3b8c1f2280 2024-04-25T02:28:54.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.938+0000 7f3b9208a640 1 --2- 172.21.15.67:0/17705782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b78003b70 0x7f3b8c1575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:54.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.939+0000 7f3b91889640 1 --2- 172.21.15.67:0/17705782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b8c1f2280 0x7f3b8c1f2700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3b880011e0 tx=0x7f3b88007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:54.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.939+0000 7f3b82ffd640 1 -- 172.21.15.67:0/17705782 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8800f990 con 0x7f3b8c1f2280 2024-04-25T02:28:54.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.939+0000 7f3b82ffd640 1 -- 172.21.15.67:0/17705782 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b88018070 con 0x7f3b8c1f2280 2024-04-25T02:28:54.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.939+0000 7f3b942ee640 1 -- 172.21.15.67:0/17705782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8c09aba0 con 0x7f3b8c1f2280 2024-04-25T02:28:54.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.939+0000 7f3b82ffd640 1 -- 172.21.15.67:0/17705782 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8800fd70 con 0x7f3b8c1f2280 2024-04-25T02:28:54.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.939+0000 7f3b942ee640 1 -- 172.21.15.67:0/17705782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b8c09b160 con 0x7f3b8c1f2280 2024-04-25T02:28:54.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.940+0000 7f3b942ee640 1 -- 172.21.15.67:0/17705782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b8c069110 con 0x7f3b8c1f2280 2024-04-25T02:28:54.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.940+0000 7f3b82ffd640 1 -- 172.21.15.67:0/17705782 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b8801d460 con 0x7f3b8c1f2280 2024-04-25T02:28:54.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.941+0000 7f3b82ffd640 1 --2- 172.21.15.67:0/17705782 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3b7006be30 0x7f3b7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:54.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.941+0000 7f3b82ffd640 1 -- 172.21.15.67:0/17705782 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3b8808ae90 con 0x7f3b8c1f2280 2024-04-25T02:28:54.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.941+0000 7f3b9208a640 1 --2- 172.21.15.67:0/17705782 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3b7006be30 0x7f3b7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:54.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.942+0000 7f3b9208a640 1 --2- 172.21.15.67:0/17705782 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3b7006be30 0x7f3b7006e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c033000 tx=0x7f3b7c008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:54.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:54.945+0000 7f3b82ffd640 1 -- 172.21.15.67:0/17705782 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3b880598d0 con 0x7f3b8c1f2280 2024-04-25T02:28:55.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.128+0000 7f3b942ee640 1 -- 172.21.15.67:0/17705782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b8c06cd90 con 0x7f3b8c1f2280 2024-04-25T02:28:55.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.129+0000 7f3b82ffd640 1 -- 172.21.15.67:0/17705782 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f3b880591d0 con 0x7f3b8c1f2280 2024-04-25T02:28:55.133 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:55.133 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:27.819641+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:55.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.131+0000 7f3b942ee640 1 -- 172.21.15.67:0/17705782 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3b7006be30 msgr2=0x7f3b7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.131+0000 7f3b942ee640 1 --2- 172.21.15.67:0/17705782 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3b7006be30 0x7f3b7006e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c033000 tx=0x7f3b7c008030 comp rx=0 tx=0).stop 2024-04-25T02:28:55.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.131+0000 7f3b942ee640 1 -- 172.21.15.67:0/17705782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b8c1f2280 msgr2=0x7f3b8c1f2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.131+0000 7f3b942ee640 1 --2- 172.21.15.67:0/17705782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b8c1f2280 0x7f3b8c1f2700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3b880011e0 tx=0x7f3b88007720 comp rx=0 tx=0).stop 2024-04-25T02:28:55.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.131+0000 7f3b942ee640 1 -- 172.21.15.67:0/17705782 shutdown_connections 2024-04-25T02:28:55.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.131+0000 7f3b942ee640 1 --2- 172.21.15.67:0/17705782 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3b7006be30 0x7f3b7006e2f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.131+0000 7f3b942ee640 1 --2- 172.21.15.67:0/17705782 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b8c1e5480 0x7f3b8c1e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.131+0000 7f3b942ee640 1 --2- 172.21.15.67:0/17705782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b8c1f2280 0x7f3b8c1f2700 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.131+0000 7f3b942ee640 1 --2- 172.21.15.67:0/17705782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b78003b70 0x7f3b8c1575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.131+0000 7f3b942ee640 1 -- 172.21.15.67:0/17705782 >> 172.21.15.67:0/17705782 conn(0x7f3b8c0b19c0 msgr2=0x7f3b8c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:55.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.131+0000 7f3b942ee640 1 -- 172.21.15.67:0/17705782 shutdown_connections 2024-04-25T02:28:55.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.131+0000 7f3b942ee640 1 -- 172.21.15.67:0/17705782 wait complete. 2024-04-25T02:28:55.145 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:28:24.445606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:28:25.161619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:28:55.146 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:28:55.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.246+0000 7faa7c7ce640 1 Processor -- start 2024-04-25T02:28:55.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.246+0000 7faa7c7ce640 1 -- start start 2024-04-25T02:28:55.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.247+0000 7faa7c7ce640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7415b090 0x7faa7409db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.247+0000 7faa7c7ce640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa740ad820 con 0x7faa7406ec40 2024-04-25T02:28:55.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.247+0000 7faa7c7ce640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa740b3260 con 0x7faa740b2cc0 2024-04-25T02:28:55.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.247+0000 7faa7c7ce640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faa740b3540 con 0x7faa7415b090 2024-04-25T02:28:55.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.247+0000 7faa7ad6b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7faa7406ec40 0x7faa740add00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55844/0 (socket says 172.21.15.67:55844) 2024-04-25T02:28:55.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.247+0000 7faa7ad6b640 1 -- 172.21.15.67:0/2367912530 learned_addr learned my addr 172.21.15.67:0/2367912530 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:55.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.247+0000 7faa7a56a640 1 --2- 172.21.15.67:0/2367912530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7415b090 0x7faa7409db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:55.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.247+0000 7faa79568640 1 -- 172.21.15.67:0/2367912530 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1014062637 0 0) 0x7faa740ad820 con 0x7faa7406ec40 2024-04-25T02:28:55.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.247+0000 7faa79568640 1 -- 172.21.15.67:0/2367912530 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa60003520 con 0x7faa7406ec40 2024-04-25T02:28:55.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.247+0000 7faa79568640 1 -- 172.21.15.67:0/2367912530 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4203764618 0 0) 0x7faa740b3260 con 0x7faa740b2cc0 2024-04-25T02:28:55.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.247+0000 7faa79568640 1 -- 172.21.15.67:0/2367912530 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa740ad820 con 0x7faa740b2cc0 2024-04-25T02:28:55.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.247+0000 7faa7a56a640 1 -- 172.21.15.67:0/2367912530 >> v1:172.21.15.176:6789/0 conn(0x7faa740b2cc0 legacy=0x7faa7406e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.247+0000 7faa7a56a640 1 -- 172.21.15.67:0/2367912530 >> v1:172.21.15.67:6789/0 conn(0x7faa7406ec40 legacy=0x7faa740add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.247+0000 7faa7a56a640 1 -- 172.21.15.67:0/2367912530 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa740b3820 con 0x7faa7415b090 2024-04-25T02:28:55.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.248+0000 7faa7a56a640 1 --2- 172.21.15.67:0/2367912530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7415b090 0x7faa7409db30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faa700097d0 tx=0x7faa7002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd6441cd2caa4f6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:55.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.248+0000 7faa79568640 1 -- 172.21.15.67:0/2367912530 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa70037070 con 0x7faa7415b090 2024-04-25T02:28:55.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.248+0000 7faa79568640 1 -- 172.21.15.67:0/2367912530 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa70032440 con 0x7faa7415b090 2024-04-25T02:28:55.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.248+0000 7faa79568640 1 -- 172.21.15.67:0/2367912530 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa70032810 con 0x7faa7415b090 2024-04-25T02:28:55.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.249+0000 7faa7c7ce640 1 -- 172.21.15.67:0/2367912530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7415b090 msgr2=0x7faa7409db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.249+0000 7faa7c7ce640 1 --2- 172.21.15.67:0/2367912530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7415b090 0x7faa7409db30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faa700097d0 tx=0x7faa7002a210 comp rx=0 tx=0).stop 2024-04-25T02:28:55.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.249+0000 7faa7c7ce640 1 -- 172.21.15.67:0/2367912530 shutdown_connections 2024-04-25T02:28:55.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.249+0000 7faa7c7ce640 1 --2- 172.21.15.67:0/2367912530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7415b090 0x7faa7409db30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.249+0000 7faa7c7ce640 1 -- 172.21.15.67:0/2367912530 >> 172.21.15.67:0/2367912530 conn(0x7faa740b19c0 msgr2=0x7faa740b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:55.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.249+0000 7faa7c7ce640 1 -- 172.21.15.67:0/2367912530 shutdown_connections 2024-04-25T02:28:55.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.249+0000 7faa7c7ce640 1 -- 172.21.15.67:0/2367912530 wait complete. 2024-04-25T02:28:55.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.250+0000 7faa7c7ce640 1 Processor -- start 2024-04-25T02:28:55.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.250+0000 7faa7c7ce640 1 -- start start 2024-04-25T02:28:55.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.251+0000 7faa7c7ce640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7406ec40 0x7faa740c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.251+0000 7faa7c7ce640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa740b2cc0 0x7faa74146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.251+0000 7faa7c7ce640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa7415b090 0x7faa74155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.251+0000 7faa7c7ce640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7faa7415b470 con 0x7faa7415b090 2024-04-25T02:28:55.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.251+0000 7faa7c7ce640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faa740b4f70 con 0x7faa7406ec40 2024-04-25T02:28:55.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.251+0000 7faa7c7ce640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faa74070e10 con 0x7faa740b2cc0 2024-04-25T02:28:55.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.251+0000 7faa7ad6b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa7415b090 0x7faa74155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:55.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.251+0000 7faa7ad6b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa7415b090 0x7faa74155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46886/0 (socket says 172.21.15.67:46886) 2024-04-25T02:28:55.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.251+0000 7faa7ad6b640 1 -- 172.21.15.67:0/3969940795 learned_addr learned my addr 172.21.15.67:0/3969940795 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:55.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.251+0000 7faa79d69640 1 --2- 172.21.15.67:0/3969940795 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa740b2cc0 0x7faa74146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:55.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.251+0000 7faa7a56a640 1 --2- 172.21.15.67:0/3969940795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7406ec40 0x7faa740c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:55.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.251+0000 7faa7ad6b640 1 -- 172.21.15.67:0/3969940795 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa740b2cc0 msgr2=0x7faa74146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.251+0000 7faa7ad6b640 1 --2- 172.21.15.67:0/3969940795 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa740b2cc0 0x7faa74146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.251+0000 7faa7ad6b640 1 -- 172.21.15.67:0/3969940795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7406ec40 msgr2=0x7faa740c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.252+0000 7faa7ad6b640 1 --2- 172.21.15.67:0/3969940795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7406ec40 0x7faa740c5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.252+0000 7faa7ad6b640 1 -- 172.21.15.67:0/3969940795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa74147780 con 0x7faa7415b090 2024-04-25T02:28:55.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.252+0000 7faa7a56a640 1 --2- 172.21.15.67:0/3969940795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7406ec40 0x7faa740c5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:55.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.252+0000 7faa7ad6b640 1 --2- 172.21.15.67:0/3969940795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa7415b090 0x7faa74155240 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00cbd0 tx=0x7faa6c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:55.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.252+0000 7faa6affd640 1 -- 172.21.15.67:0/3969940795 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c017070 con 0x7faa7415b090 2024-04-25T02:28:55.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.252+0000 7faa6affd640 1 -- 172.21.15.67:0/3969940795 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6c00ac70 con 0x7faa7415b090 2024-04-25T02:28:55.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.252+0000 7faa7c7ce640 1 -- 172.21.15.67:0/3969940795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa74147a60 con 0x7faa7415b090 2024-04-25T02:28:55.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.252+0000 7faa6affd640 1 -- 172.21.15.67:0/3969940795 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c012620 con 0x7faa7415b090 2024-04-25T02:28:55.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.252+0000 7faa7c7ce640 1 -- 172.21.15.67:0/3969940795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa74147490 con 0x7faa7415b090 2024-04-25T02:28:55.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.253+0000 7faa7c7ce640 1 -- 172.21.15.67:0/3969940795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa74069110 con 0x7faa7415b090 2024-04-25T02:28:55.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.253+0000 7faa6affd640 1 -- 172.21.15.67:0/3969940795 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa6c01a070 con 0x7faa7415b090 2024-04-25T02:28:55.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.254+0000 7faa6affd640 1 --2- 172.21.15.67:0/3969940795 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7faa5806be30 0x7faa5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.254+0000 7faa6affd640 1 -- 172.21.15.67:0/3969940795 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faa6c08aba0 con 0x7faa7415b090 2024-04-25T02:28:55.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.254+0000 7faa7a56a640 1 --2- 172.21.15.67:0/3969940795 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7faa5806be30 0x7faa5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:55.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.254+0000 7faa7a56a640 1 --2- 172.21.15.67:0/3969940795 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7faa5806be30 0x7faa5806e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faa70034000 tx=0x7faa7002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:55.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.258+0000 7faa6affd640 1 -- 172.21.15.67:0/3969940795 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faa6c00ae20 con 0x7faa7415b090 2024-04-25T02:28:55.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.438+0000 7faa7c7ce640 1 -- 172.21.15.67:0/3969940795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faa7406cdd0 con 0x7faa7415b090 2024-04-25T02:28:55.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.439+0000 7faa6affd640 1 -- 172.21.15.67:0/3969940795 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7faa6c0595e0 con 0x7faa7415b090 2024-04-25T02:28:55.442 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:28:55.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.440+0000 7faa7c7ce640 1 -- 172.21.15.67:0/3969940795 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7faa5806be30 msgr2=0x7faa5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.440+0000 7faa7c7ce640 1 --2- 172.21.15.67:0/3969940795 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7faa5806be30 0x7faa5806e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faa70034000 tx=0x7faa7002e000 comp rx=0 tx=0).stop 2024-04-25T02:28:55.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.440+0000 7faa7c7ce640 1 -- 172.21.15.67:0/3969940795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa7415b090 msgr2=0x7faa74155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.440+0000 7faa7c7ce640 1 --2- 172.21.15.67:0/3969940795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa7415b090 0x7faa74155240 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00cbd0 tx=0x7faa6c00a060 comp rx=0 tx=0).stop 2024-04-25T02:28:55.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.440+0000 7faa7c7ce640 1 -- 172.21.15.67:0/3969940795 shutdown_connections 2024-04-25T02:28:55.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.440+0000 7faa7c7ce640 1 --2- 172.21.15.67:0/3969940795 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7faa5806be30 0x7faa5806e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.440+0000 7faa7c7ce640 1 --2- 172.21.15.67:0/3969940795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa7415b090 0x7faa74155240 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.440+0000 7faa7c7ce640 1 --2- 172.21.15.67:0/3969940795 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa740b2cc0 0x7faa74146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.440+0000 7faa7c7ce640 1 --2- 172.21.15.67:0/3969940795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7406ec40 0x7faa740c5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.440+0000 7faa7c7ce640 1 -- 172.21.15.67:0/3969940795 >> 172.21.15.67:0/3969940795 conn(0x7faa740b19c0 msgr2=0x7faa740aedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:55.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.441+0000 7faa7c7ce640 1 -- 172.21.15.67:0/3969940795 shutdown_connections 2024-04-25T02:28:55.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.441+0000 7faa7c7ce640 1 -- 172.21.15.67:0/3969940795 wait complete. 2024-04-25T02:28:55.454 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:28:55.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.555+0000 7f964825d640 1 Processor -- start 2024-04-25T02:28:55.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.555+0000 7f964825d640 1 -- start start 2024-04-25T02:28:55.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.556+0000 7f964825d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f96400d0a00 0x7f964006b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.556+0000 7f964825d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9640071e70 0x7f9640072300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.556+0000 7f964825d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f964006b7a0 con 0x7f96400cd1d0 2024-04-25T02:28:55.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.556+0000 7f964825d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f964006c040 con 0x7f96400d0a00 2024-04-25T02:28:55.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.556+0000 7f964825d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f96400cef50 con 0x7f9640071e70 2024-04-25T02:28:55.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.556+0000 7f96457f8640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f96400cd1d0 0x7f96400cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55852/0 (socket says 172.21.15.67:55852) 2024-04-25T02:28:55.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.556+0000 7f96457f8640 1 -- 172.21.15.67:0/2684999995 learned_addr learned my addr 172.21.15.67:0/2684999995 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:55.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.556+0000 7f9644ff7640 1 -- 172.21.15.67:0/2684999995 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3056517443 0 0) 0x7f964006b7a0 con 0x7f96400cd1d0 2024-04-25T02:28:55.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.556+0000 7f96467fa640 1 --2- 172.21.15.67:0/2684999995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9640071e70 0x7f9640072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:55.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.556+0000 7f9644ff7640 1 -- 172.21.15.67:0/2684999995 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f962c003520 con 0x7f96400cd1d0 2024-04-25T02:28:55.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.556+0000 7f9645ff9640 1 --2- 172.21.15.67:0/2684999995 >> v2:172.21.15.176:3300/0 conn(0x7f96400d0a00 0x7f964006b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:55.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9644ff7640 1 -- 172.21.15.67:0/2684999995 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4178742543 0 0) 0x7f962c003520 con 0x7f96400cd1d0 2024-04-25T02:28:55.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9644ff7640 1 -- 172.21.15.67:0/2684999995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9640071e70 msgr2=0x7f9640072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:55.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9644ff7640 1 --2- 172.21.15.67:0/2684999995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9640071e70 0x7f9640072300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9644ff7640 1 -- 172.21.15.67:0/2684999995 >> v2:172.21.15.176:3300/0 conn(0x7f96400d0a00 msgr2=0x7f964006b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:55.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9644ff7640 1 --2- 172.21.15.67:0/2684999995 >> v2:172.21.15.176:3300/0 conn(0x7f96400d0a00 0x7f964006b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9644ff7640 1 -- 172.21.15.67:0/2684999995 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964006ba80 con 0x7f96400cd1d0 2024-04-25T02:28:55.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9644ff7640 1 -- 172.21.15.67:0/2684999995 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f9630001670 con 0x7f96400cd1d0 2024-04-25T02:28:55.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9644ff7640 1 -- 172.21.15.67:0/2684999995 >> v1:172.21.15.67:6789/0 conn(0x7f96400cd1d0 legacy=0x7f96400cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9644ff7640 1 --2- 172.21.15.67:0/2684999995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f962c0039b0 0x7f962c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9644ff7640 1 --2- 172.21.15.67:0/2684999995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9640071e70 0x7f962c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9644ff7640 1 --2- 172.21.15.67:0/2684999995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f962c004d40 0x7f962c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9644ff7640 1 -- 172.21.15.67:0/2684999995 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f96400cef50 con 0x7f962c0039b0 2024-04-25T02:28:55.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9644ff7640 1 -- 172.21.15.67:0/2684999995 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f962c00b9c0 con 0x7f962c004d40 2024-04-25T02:28:55.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9644ff7640 1 -- 172.21.15.67:0/2684999995 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f962c00bb40 con 0x7f9640071e70 2024-04-25T02:28:55.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9645ff9640 1 --2- 172.21.15.67:0/2684999995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f962c0039b0 0x7f962c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:55.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f96457f8640 1 --2- 172.21.15.67:0/2684999995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9640071e70 0x7f962c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:55.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f96467fa640 1 --2- 172.21.15.67:0/2684999995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f962c004d40 0x7f962c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:55.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9645ff9640 1 -- 172.21.15.67:0/2684999995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9640071e70 msgr2=0x7f962c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:55.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9645ff9640 1 --2- 172.21.15.67:0/2684999995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9640071e70 0x7f962c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9645ff9640 1 -- 172.21.15.67:0/2684999995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f962c004d40 msgr2=0x7f962c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:55.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9645ff9640 1 --2- 172.21.15.67:0/2684999995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f962c004d40 0x7f962c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.557+0000 7f9645ff9640 1 -- 172.21.15.67:0/2684999995 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f962c003520 con 0x7f962c0039b0 2024-04-25T02:28:55.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.558+0000 7f9645ff9640 1 --2- 172.21.15.67:0/2684999995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f962c0039b0 0x7f962c003dd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f963c009af0 tx=0x7f962c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae560216681bb15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:55.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.558+0000 7f9644ff7640 1 -- 172.21.15.67:0/2684999995 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c036070 con 0x7f962c0039b0 2024-04-25T02:28:55.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.558+0000 7f9644ff7640 1 -- 172.21.15.67:0/2684999995 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f963c031400 con 0x7f962c0039b0 2024-04-25T02:28:55.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.558+0000 7f9644ff7640 1 -- 172.21.15.67:0/2684999995 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c009690 con 0x7f962c0039b0 2024-04-25T02:28:55.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.558+0000 7f964825d640 1 -- 172.21.15.67:0/2684999995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f962c0039b0 msgr2=0x7f962c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.558+0000 7f964825d640 1 --2- 172.21.15.67:0/2684999995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f962c0039b0 0x7f962c003dd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f963c009af0 tx=0x7f962c005830 comp rx=0 tx=0).stop 2024-04-25T02:28:55.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.558+0000 7f96467fa640 1 -- 172.21.15.67:0/2684999995 reap_dead start 2024-04-25T02:28:55.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.558+0000 7f964825d640 1 -- 172.21.15.67:0/2684999995 shutdown_connections 2024-04-25T02:28:55.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.558+0000 7f964825d640 1 -- 172.21.15.67:0/2684999995 >> 172.21.15.67:0/2684999995 conn(0x7f96400d0e20 msgr2=0x7f96400d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:55.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.559+0000 7f964825d640 1 -- 172.21.15.67:0/2684999995 shutdown_connections 2024-04-25T02:28:55.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.559+0000 7f964825d640 1 -- 172.21.15.67:0/2684999995 wait complete. 2024-04-25T02:28:55.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.560+0000 7f964825d640 1 Processor -- start 2024-04-25T02:28:55.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.560+0000 7f964825d640 1 -- start start 2024-04-25T02:28:55.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.560+0000 7f964825d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f962c0039b0 0x7f9640150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.560+0000 7f964825d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96400c8b50 0x7f96400b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.560+0000 7f964825d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96400c8fd0 0x7f96400b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.560+0000 7f964825d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f96400cfaf0 con 0x7f96400c8b50 2024-04-25T02:28:55.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.560+0000 7f964825d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f96400cd660 con 0x7f96400c8fd0 2024-04-25T02:28:55.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.560+0000 7f964825d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f96400cfc70 con 0x7f962c0039b0 2024-04-25T02:28:55.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.560+0000 7f96457f8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96400c8b50 0x7f96400b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:55.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.561+0000 7f96457f8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96400c8b50 0x7f96400b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46892/0 (socket says 172.21.15.67:46892) 2024-04-25T02:28:55.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.561+0000 7f96457f8640 1 -- 172.21.15.67:0/2107879277 learned_addr learned my addr 172.21.15.67:0/2107879277 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:55.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.561+0000 7f9645ff9640 1 --2- 172.21.15.67:0/2107879277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f962c0039b0 0x7f9640150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:55.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.561+0000 7f96467fa640 1 --2- 172.21.15.67:0/2107879277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96400c8fd0 0x7f96400b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:55.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.561+0000 7f96457f8640 1 -- 172.21.15.67:0/2107879277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f962c0039b0 msgr2=0x7f9640150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.561+0000 7f96457f8640 1 --2- 172.21.15.67:0/2107879277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f962c0039b0 0x7f9640150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.561+0000 7f96457f8640 1 -- 172.21.15.67:0/2107879277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96400c8fd0 msgr2=0x7f96400b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.561+0000 7f96457f8640 1 --2- 172.21.15.67:0/2107879277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96400c8fd0 0x7f96400b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.561+0000 7f96457f8640 1 -- 172.21.15.67:0/2107879277 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9640161880 con 0x7f96400c8b50 2024-04-25T02:28:55.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.561+0000 7f96457f8640 1 --2- 172.21.15.67:0/2107879277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96400c8b50 0x7f96400b1db0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f963000e700 tx=0x7f963000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:55.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.561+0000 7f96367fc640 1 -- 172.21.15.67:0/2107879277 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963000c660 con 0x7f96400c8b50 2024-04-25T02:28:55.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.561+0000 7f96367fc640 1 -- 172.21.15.67:0/2107879277 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9630018070 con 0x7f96400c8b50 2024-04-25T02:28:55.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.561+0000 7f964825d640 1 -- 172.21.15.67:0/2107879277 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96400c8070 con 0x7f96400c8b50 2024-04-25T02:28:55.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.561+0000 7f96367fc640 1 -- 172.21.15.67:0/2107879277 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963000ca60 con 0x7f96400c8b50 2024-04-25T02:28:55.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.561+0000 7f964825d640 1 -- 172.21.15.67:0/2107879277 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96400c8630 con 0x7f96400c8b50 2024-04-25T02:28:55.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.562+0000 7f964825d640 1 -- 172.21.15.67:0/2107879277 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9640067e40 con 0x7f96400c8b50 2024-04-25T02:28:55.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.563+0000 7f96367fc640 1 -- 172.21.15.67:0/2107879277 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f963000cc00 con 0x7f96400c8b50 2024-04-25T02:28:55.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.563+0000 7f96367fc640 1 --2- 172.21.15.67:0/2107879277 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f962406be60 0x7f962406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.563+0000 7f96367fc640 1 -- 172.21.15.67:0/2107879277 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f963008a7d0 con 0x7f96400c8b50 2024-04-25T02:28:55.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.563+0000 7f9645ff9640 1 --2- 172.21.15.67:0/2107879277 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f962406be60 0x7f962406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:55.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.564+0000 7f9645ff9640 1 --2- 172.21.15.67:0/2107879277 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f962406be60 0x7f962406e320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f963c033000 tx=0x7f963c008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:55.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.567+0000 7f96367fc640 1 -- 172.21.15.67:0/2107879277 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9630058b30 con 0x7f96400c8b50 2024-04-25T02:28:55.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.750+0000 7f964825d640 1 -- 172.21.15.67:0/2107879277 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9640069110 con 0x7f96400c8b50 2024-04-25T02:28:55.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.750+0000 7f96367fc640 1 -- 172.21.15.67:0/2107879277 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f963005ce30 con 0x7f96400c8b50 2024-04-25T02:28:55.754 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-25T02:28:55.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.752+0000 7f964825d640 1 -- 172.21.15.67:0/2107879277 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f962406be60 msgr2=0x7f962406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.752+0000 7f964825d640 1 --2- 172.21.15.67:0/2107879277 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f962406be60 0x7f962406e320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f963c033000 tx=0x7f963c008030 comp rx=0 tx=0).stop 2024-04-25T02:28:55.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.752+0000 7f964825d640 1 -- 172.21.15.67:0/2107879277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96400c8b50 msgr2=0x7f96400b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.752+0000 7f964825d640 1 --2- 172.21.15.67:0/2107879277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96400c8b50 0x7f96400b1db0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f963000e700 tx=0x7f963000ebc0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.752+0000 7f964825d640 1 -- 172.21.15.67:0/2107879277 shutdown_connections 2024-04-25T02:28:55.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.752+0000 7f964825d640 1 --2- 172.21.15.67:0/2107879277 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f962406be60 0x7f962406e320 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.752+0000 7f964825d640 1 --2- 172.21.15.67:0/2107879277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96400c8fd0 0x7f96400b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.752+0000 7f964825d640 1 --2- 172.21.15.67:0/2107879277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96400c8b50 0x7f96400b1db0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.752+0000 7f964825d640 1 --2- 172.21.15.67:0/2107879277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f962c0039b0 0x7f9640150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.752+0000 7f964825d640 1 -- 172.21.15.67:0/2107879277 >> 172.21.15.67:0/2107879277 conn(0x7f96400d0e20 msgr2=0x7f96400cc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:55.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.752+0000 7f964825d640 1 -- 172.21.15.67:0/2107879277 shutdown_connections 2024-04-25T02:28:55.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.752+0000 7f964825d640 1 -- 172.21.15.67:0/2107879277 wait complete. 2024-04-25T02:28:55.767 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:28:55.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.873+0000 7f14c41ed640 1 Processor -- start 2024-04-25T02:28:55.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.873+0000 7f14c41ed640 1 -- start start 2024-04-25T02:28:55.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.874+0000 7f14c41ed640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f14bc06ec40 0x7f14bc09db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.874+0000 7f14c41ed640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f14bc0b2cc0 0x7f14bc0add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.874+0000 7f14c41ed640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14bc0ad820 con 0x7f14bc15b090 2024-04-25T02:28:55.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.874+0000 7f14c41ed640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f14bc0b3260 con 0x7f14bc0b2cc0 2024-04-25T02:28:55.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.874+0000 7f14c41ed640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f14bc0b3540 con 0x7f14bc06ec40 2024-04-25T02:28:55.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.874+0000 7f14c278a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f14bc0b2cc0 0x7f14bc0add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:55.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.874+0000 7f14c278a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f14bc0b2cc0 0x7f14bc0add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46896/0 (socket says 172.21.15.67:46896) 2024-04-25T02:28:55.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.874+0000 7f14c278a640 1 -- 172.21.15.67:0/4190554453 learned_addr learned my addr 172.21.15.67:0/4190554453 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:55.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.874+0000 7f14c1788640 1 --2- 172.21.15.67:0/4190554453 >> v2:172.21.15.176:3300/0 conn(0x7f14bc06ec40 0x7f14bc09db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:55.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.874+0000 7f14c278a640 1 -- 172.21.15.67:0/4190554453 >> v2:172.21.15.176:3300/0 conn(0x7f14bc06ec40 msgr2=0x7f14bc09db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:55.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.874+0000 7f14c278a640 1 --2- 172.21.15.67:0/4190554453 >> v2:172.21.15.176:3300/0 conn(0x7f14bc06ec40 0x7f14bc09db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.874+0000 7f14c278a640 1 -- 172.21.15.67:0/4190554453 >> v1:172.21.15.176:6789/0 conn(0x7f14bc15b090 legacy=0x7f14bc06e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.874+0000 7f14c278a640 1 -- 172.21.15.67:0/4190554453 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14bc0b3820 con 0x7f14bc0b2cc0 2024-04-25T02:28:55.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.874+0000 7f14c1788640 1 --2- 172.21.15.67:0/4190554453 >> v2:172.21.15.176:3300/0 conn(0x7f14bc06ec40 0x7f14bc09db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:55.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.875+0000 7f14c278a640 1 --2- 172.21.15.67:0/4190554453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14bc0b2cc0 0x7f14bc0add00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f14bc070980 tx=0x7f14b402c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7680cd922a6f25a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:55.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.875+0000 7f14c0f87640 1 -- 172.21.15.67:0/4190554453 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b400b2e0 con 0x7f14bc0b2cc0 2024-04-25T02:28:55.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.875+0000 7f14c0f87640 1 -- 172.21.15.67:0/4190554453 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b4037070 con 0x7f14bc0b2cc0 2024-04-25T02:28:55.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.875+0000 7f14c0f87640 1 -- 172.21.15.67:0/4190554453 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b400b480 con 0x7f14bc0b2cc0 2024-04-25T02:28:55.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.875+0000 7f14c41ed640 1 -- 172.21.15.67:0/4190554453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14bc0b2cc0 msgr2=0x7f14bc0add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.875+0000 7f14c41ed640 1 --2- 172.21.15.67:0/4190554453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14bc0b2cc0 0x7f14bc0add00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f14bc070980 tx=0x7f14b402c940 comp rx=0 tx=0).stop 2024-04-25T02:28:55.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.875+0000 7f14c41ed640 1 -- 172.21.15.67:0/4190554453 shutdown_connections 2024-04-25T02:28:55.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.875+0000 7f14c41ed640 1 --2- 172.21.15.67:0/4190554453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14bc0b2cc0 0x7f14bc0add00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.875+0000 7f14c41ed640 1 --2- 172.21.15.67:0/4190554453 >> v2:172.21.15.176:3300/0 conn(0x7f14bc06ec40 0x7f14bc09db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.875+0000 7f14c41ed640 1 -- 172.21.15.67:0/4190554453 >> 172.21.15.67:0/4190554453 conn(0x7f14bc0b19c0 msgr2=0x7f14bc0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:55.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.876+0000 7f14c41ed640 1 -- 172.21.15.67:0/4190554453 shutdown_connections 2024-04-25T02:28:55.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.876+0000 7f14c41ed640 1 -- 172.21.15.67:0/4190554453 wait complete. 2024-04-25T02:28:55.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.877+0000 7f14c41ed640 1 Processor -- start 2024-04-25T02:28:55.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.877+0000 7f14c41ed640 1 -- start start 2024-04-25T02:28:55.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.877+0000 7f14c41ed640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14bc06ec40 0x7f14bc156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.877+0000 7f14c41ed640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14bc0b2cc0 0x7f14bc1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.877+0000 7f14c41ed640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14bc15b090 0x7f14bc158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:55.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.877+0000 7f14c41ed640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f14bc15b470 con 0x7f14bc0b2cc0 2024-04-25T02:28:55.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.877+0000 7f14c41ed640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f14bc0b4f70 con 0x7f14bc06ec40 2024-04-25T02:28:55.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.877+0000 7f14c41ed640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f14bc070e10 con 0x7f14bc15b090 2024-04-25T02:28:55.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.878+0000 7f14c1788640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14bc0b2cc0 0x7f14bc1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:55.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.878+0000 7f14c1788640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14bc0b2cc0 0x7f14bc1571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46900/0 (socket says 172.21.15.67:46900) 2024-04-25T02:28:55.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.878+0000 7f14c1788640 1 -- 172.21.15.67:0/3414614217 learned_addr learned my addr 172.21.15.67:0/3414614217 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:55.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.878+0000 7f14c1f89640 1 --2- 172.21.15.67:0/3414614217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14bc06ec40 0x7f14bc156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:55.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.878+0000 7f14c1788640 1 -- 172.21.15.67:0/3414614217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14bc15b090 msgr2=0x7f14bc158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.878+0000 7f14c1788640 1 --2- 172.21.15.67:0/3414614217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14bc15b090 0x7f14bc158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.878+0000 7f14c1788640 1 -- 172.21.15.67:0/3414614217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14bc06ec40 msgr2=0x7f14bc156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:55.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.878+0000 7f14c1788640 1 --2- 172.21.15.67:0/3414614217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14bc06ec40 0x7f14bc156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:55.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.878+0000 7f14c1788640 1 -- 172.21.15.67:0/3414614217 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14bc09b350 con 0x7f14bc0b2cc0 2024-04-25T02:28:55.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.878+0000 7f14c1f89640 1 --2- 172.21.15.67:0/3414614217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14bc06ec40 0x7f14bc156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:56.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.878+0000 7f14c1788640 1 --2- 172.21.15.67:0/3414614217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14bc0b2cc0 0x7f14bc1571f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f14b800e810 tx=0x7f14b800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:56.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.878+0000 7f14ae7fc640 1 -- 172.21.15.67:0/3414614217 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b800f040 con 0x7f14bc0b2cc0 2024-04-25T02:28:56.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.878+0000 7f14ae7fc640 1 -- 172.21.15.67:0/3414614217 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b8004030 con 0x7f14bc0b2cc0 2024-04-25T02:28:56.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.878+0000 7f14ae7fc640 1 -- 172.21.15.67:0/3414614217 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b8004400 con 0x7f14bc0b2cc0 2024-04-25T02:28:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.878+0000 7f14c41ed640 1 -- 172.21.15.67:0/3414614217 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14bc09b5c0 con 0x7f14bc0b2cc0 2024-04-25T02:28:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.878+0000 7f14c41ed640 1 -- 172.21.15.67:0/3414614217 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14bc09bb80 con 0x7f14bc0b2cc0 2024-04-25T02:28:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.879+0000 7f14c41ed640 1 -- 172.21.15.67:0/3414614217 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14bc069110 con 0x7f14bc0b2cc0 2024-04-25T02:28:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.880+0000 7f14ae7fc640 1 -- 172.21.15.67:0/3414614217 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f14b800c6d0 con 0x7f14bc0b2cc0 2024-04-25T02:28:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.880+0000 7f14ae7fc640 1 --2- 172.21.15.67:0/3414614217 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f14a006be30 0x7f14a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.880+0000 7f14ae7fc640 1 -- 172.21.15.67:0/3414614217 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f14b808ac90 con 0x7f14bc0b2cc0 2024-04-25T02:28:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.880+0000 7f14c1f89640 1 --2- 172.21.15.67:0/3414614217 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f14a006be30 0x7f14a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.881+0000 7f14c1f89640 1 --2- 172.21.15.67:0/3414614217 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f14a006be30 0x7f14a006e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f14b00015e0 tx=0x7f14b0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:55.884+0000 7f14ae7fc640 1 -- 172.21.15.67:0/3414614217 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f14b8017020 con 0x7f14bc0b2cc0 2024-04-25T02:28:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.069+0000 7f14c41ed640 1 -- 172.21.15.67:0/3414614217 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f14bc06cdd0 con 0x7f14bc0b2cc0 2024-04-25T02:28:56.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.069+0000 7f14ae7fc640 1 -- 172.21.15.67:0/3414614217 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f14b80595b0 con 0x7f14bc0b2cc0 2024-04-25T02:28:56.095 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-25T02:28:56.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.071+0000 7f14c41ed640 1 -- 172.21.15.67:0/3414614217 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f14a006be30 msgr2=0x7f14a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:56.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.071+0000 7f14c41ed640 1 --2- 172.21.15.67:0/3414614217 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f14a006be30 0x7f14a006e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f14b00015e0 tx=0x7f14b0009040 comp rx=0 tx=0).stop 2024-04-25T02:28:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.071+0000 7f14c41ed640 1 -- 172.21.15.67:0/3414614217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14bc0b2cc0 msgr2=0x7f14bc1571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.071+0000 7f14c41ed640 1 --2- 172.21.15.67:0/3414614217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14bc0b2cc0 0x7f14bc1571f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f14b800e810 tx=0x7f14b800ecd0 comp rx=0 tx=0).stop 2024-04-25T02:28:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.071+0000 7f14c41ed640 1 -- 172.21.15.67:0/3414614217 shutdown_connections 2024-04-25T02:28:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.071+0000 7f14c41ed640 1 --2- 172.21.15.67:0/3414614217 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f14a006be30 0x7f14a006e2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.071+0000 7f14c41ed640 1 --2- 172.21.15.67:0/3414614217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14bc15b090 0x7f14bc158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.071+0000 7f14c41ed640 1 --2- 172.21.15.67:0/3414614217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14bc0b2cc0 0x7f14bc1571f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.071+0000 7f14c41ed640 1 --2- 172.21.15.67:0/3414614217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14bc06ec40 0x7f14bc156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.071+0000 7f14c41ed640 1 -- 172.21.15.67:0/3414614217 >> 172.21.15.67:0/3414614217 conn(0x7f14bc0b19c0 msgr2=0x7f14bc0ae460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.071+0000 7f14c41ed640 1 -- 172.21.15.67:0/3414614217 shutdown_connections 2024-04-25T02:28:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.071+0000 7f14c41ed640 1 -- 172.21.15.67:0/3414614217 wait complete. 2024-04-25T02:28:56.098 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2024-04-25T02:28:56.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.196+0000 7f85b0ff9640 1 Processor -- start 2024-04-25T02:28:56.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.196+0000 7f85b0ff9640 1 -- start start 2024-04-25T02:28:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.197+0000 7f85b0ff9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f85ac15ee50 0x7f85ac0d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.197+0000 7f85b0ff9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85ac15f230 0x7f85ac0d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.197+0000 7f85b0ff9640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85ac15fba0 con 0x7f85ac0d2a30 2024-04-25T02:28:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.197+0000 7f85b0ff9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f85ac0d4eb0 con 0x7f85ac15ee50 2024-04-25T02:28:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.197+0000 7f85b0ff9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f85ac15fe40 con 0x7f85ac15f230 2024-04-25T02:28:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.197+0000 7f85aa59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f85ac15ee50 0x7f85ac0d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.197+0000 7f85aa59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f85ac15ee50 0x7f85ac0d47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46906/0 (socket says 172.21.15.67:46906) 2024-04-25T02:28:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.197+0000 7f85aa59c640 1 -- 172.21.15.67:0/2790308111 learned_addr learned my addr 172.21.15.67:0/2790308111 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.198+0000 7f85a9d9b640 1 --2- 172.21.15.67:0/2790308111 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85ac15f230 0x7f85ac0d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.198+0000 7f85aa59c640 1 -- 172.21.15.67:0/2790308111 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85ac15f230 msgr2=0x7f85ac0d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.198+0000 7f85aa59c640 1 --2- 172.21.15.67:0/2790308111 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85ac15f230 0x7f85ac0d24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:56.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.198+0000 7f85aa59c640 1 -- 172.21.15.67:0/2790308111 >> v1:172.21.15.176:6789/0 conn(0x7f85ac0d2a30 legacy=0x7f85ac161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:56.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.198+0000 7f85aa59c640 1 -- 172.21.15.67:0/2790308111 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ac160120 con 0x7f85ac15ee50 2024-04-25T02:28:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.198+0000 7f85aa59c640 1 --2- 172.21.15.67:0/2790308111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85ac15ee50 0x7f85ac0d47b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f859c009e50 tx=0x7f859c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e859d31ba101d8eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.198+0000 7f85a959a640 1 -- 172.21.15.67:0/2790308111 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c036070 con 0x7f85ac15ee50 2024-04-25T02:28:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.199+0000 7f85a959a640 1 -- 172.21.15.67:0/2790308111 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f859c031600 con 0x7f85ac15ee50 2024-04-25T02:28:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.199+0000 7f85a959a640 1 -- 172.21.15.67:0/2790308111 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c0319d0 con 0x7f85ac15ee50 2024-04-25T02:28:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.199+0000 7f85b0ff9640 1 -- 172.21.15.67:0/2790308111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85ac15ee50 msgr2=0x7f85ac0d47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.199+0000 7f85b0ff9640 1 --2- 172.21.15.67:0/2790308111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85ac15ee50 0x7f85ac0d47b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f859c009e50 tx=0x7f859c02a6c0 comp rx=0 tx=0).stop 2024-04-25T02:28:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.199+0000 7f85b0ff9640 1 -- 172.21.15.67:0/2790308111 shutdown_connections 2024-04-25T02:28:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.199+0000 7f85b0ff9640 1 --2- 172.21.15.67:0/2790308111 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85ac15f230 0x7f85ac0d24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.199+0000 7f85b0ff9640 1 --2- 172.21.15.67:0/2790308111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85ac15ee50 0x7f85ac0d47b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.199+0000 7f85b0ff9640 1 -- 172.21.15.67:0/2790308111 >> 172.21.15.67:0/2790308111 conn(0x7f85ac09d450 msgr2=0x7f85ac0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.199+0000 7f85b0ff9640 1 -- 172.21.15.67:0/2790308111 shutdown_connections 2024-04-25T02:28:56.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.199+0000 7f85b0ff9640 1 -- 172.21.15.67:0/2790308111 wait complete. 2024-04-25T02:28:56.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.200+0000 7f85b0ff9640 1 Processor -- start 2024-04-25T02:28:56.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.200+0000 7f85b0ff9640 1 -- start start 2024-04-25T02:28:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.201+0000 7f85b0ff9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85ac0d2a30 0x7f85ac14ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.201+0000 7f85b0ff9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85ac15ee50 0x7f85ac0b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.201+0000 7f85b0ff9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85ac15f230 0x7f85ac0cd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.201+0000 7f85b0ff9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac15f810 con 0x7f85ac15f230 2024-04-25T02:28:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.201+0000 7f85b0ff9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac15f690 con 0x7f85ac15ee50 2024-04-25T02:28:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.201+0000 7f85b0ff9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f85ac161930 con 0x7f85ac0d2a30 2024-04-25T02:28:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.201+0000 7f85aad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85ac15f230 0x7f85ac0cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.201+0000 7f85aad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85ac15f230 0x7f85ac0cd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46914/0 (socket says 172.21.15.67:46914) 2024-04-25T02:28:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.201+0000 7f85aad9d640 1 -- 172.21.15.67:0/1935934406 learned_addr learned my addr 172.21.15.67:0/1935934406 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.201+0000 7f85a9d9b640 1 --2- 172.21.15.67:0/1935934406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85ac15ee50 0x7f85ac0b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.201+0000 7f85aa59c640 1 --2- 172.21.15.67:0/1935934406 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85ac0d2a30 0x7f85ac14ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.202+0000 7f85aad9d640 1 -- 172.21.15.67:0/1935934406 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85ac0d2a30 msgr2=0x7f85ac14ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.202+0000 7f85aad9d640 1 --2- 172.21.15.67:0/1935934406 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85ac0d2a30 0x7f85ac14ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.202+0000 7f85aad9d640 1 -- 172.21.15.67:0/1935934406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85ac15ee50 msgr2=0x7f85ac0b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.202+0000 7f85aad9d640 1 --2- 172.21.15.67:0/1935934406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85ac15ee50 0x7f85ac0b6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.202+0000 7f85aad9d640 1 -- 172.21.15.67:0/1935934406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ac0b7680 con 0x7f85ac15f230 2024-04-25T02:28:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.202+0000 7f85aad9d640 1 --2- 172.21.15.67:0/1935934406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85ac15f230 0x7f85ac0cd590 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f85a400b440 tx=0x7f85a400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.202+0000 7f85a2ffd640 1 -- 172.21.15.67:0/1935934406 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a4015020 con 0x7f85ac15f230 2024-04-25T02:28:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.202+0000 7f85a2ffd640 1 -- 172.21.15.67:0/1935934406 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a4011830 con 0x7f85ac15f230 2024-04-25T02:28:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.202+0000 7f85b0ff9640 1 -- 172.21.15.67:0/1935934406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ac0b7960 con 0x7f85ac15f230 2024-04-25T02:28:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.202+0000 7f85a2ffd640 1 -- 172.21.15.67:0/1935934406 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a4011c20 con 0x7f85ac15f230 2024-04-25T02:28:56.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.202+0000 7f85b0ff9640 1 -- 172.21.15.67:0/1935934406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ac0cb610 con 0x7f85ac15f230 2024-04-25T02:28:56.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.203+0000 7f85b0ff9640 1 -- 172.21.15.67:0/1935934406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85ac069110 con 0x7f85ac15f230 2024-04-25T02:28:56.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.203+0000 7f85a2ffd640 1 -- 172.21.15.67:0/1935934406 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85a4018020 con 0x7f85ac15f230 2024-04-25T02:28:56.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.204+0000 7f85a2ffd640 1 --2- 172.21.15.67:0/1935934406 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f858c06be30 0x7f858c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:56.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.204+0000 7f85a2ffd640 1 -- 172.21.15.67:0/1935934406 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f85a408a990 con 0x7f85ac15f230 2024-04-25T02:28:56.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.204+0000 7f85aa59c640 1 --2- 172.21.15.67:0/1935934406 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f858c06be30 0x7f858c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:56.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.204+0000 7f85aa59c640 1 --2- 172.21.15.67:0/1935934406 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f858c06be30 0x7f858c06e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f859c033000 tx=0x7f859c009000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:56.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.208+0000 7f85a2ffd640 1 -- 172.21.15.67:0/1935934406 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f85a401f030 con 0x7f85ac15f230 2024-04-25T02:28:56.318 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:28:56.320 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:28:56.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.462+0000 7f85b0ff9640 1 -- 172.21.15.67:0/1935934406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) -- 0x7f85ac15ad80 con 0x7f85ac15f230 2024-04-25T02:28:56.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.969+0000 7f85a2ffd640 1 -- 172.21.15.67:0/1935934406 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v54) ==== 170+0+0 (secure 0 0 0) 0x7f85a40172c0 con 0x7f85ac15f230 2024-04-25T02:28:56.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.972+0000 7f85b0ff9640 1 -- 172.21.15.67:0/1935934406 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f858c06be30 msgr2=0x7f858c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:56.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.972+0000 7f85b0ff9640 1 --2- 172.21.15.67:0/1935934406 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f858c06be30 0x7f858c06e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f859c033000 tx=0x7f859c009000 comp rx=0 tx=0).stop 2024-04-25T02:28:56.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.972+0000 7f85b0ff9640 1 -- 172.21.15.67:0/1935934406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85ac15f230 msgr2=0x7f85ac0cd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:56.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.972+0000 7f85b0ff9640 1 --2- 172.21.15.67:0/1935934406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85ac15f230 0x7f85ac0cd590 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f85a400b440 tx=0x7f85a400b900 comp rx=0 tx=0).stop 2024-04-25T02:28:56.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.972+0000 7f85b0ff9640 1 -- 172.21.15.67:0/1935934406 shutdown_connections 2024-04-25T02:28:56.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.972+0000 7f85b0ff9640 1 --2- 172.21.15.67:0/1935934406 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f858c06be30 0x7f858c06e2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:56.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.972+0000 7f85b0ff9640 1 --2- 172.21.15.67:0/1935934406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85ac15f230 0x7f85ac0cd590 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:56.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.972+0000 7f85b0ff9640 1 --2- 172.21.15.67:0/1935934406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85ac15ee50 0x7f85ac0b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:56.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.972+0000 7f85b0ff9640 1 --2- 172.21.15.67:0/1935934406 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85ac0d2a30 0x7f85ac14ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:56.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.972+0000 7f85b0ff9640 1 -- 172.21.15.67:0/1935934406 >> 172.21.15.67:0/1935934406 conn(0x7f85ac09d450 msgr2=0x7f85ac0b5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:56.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.972+0000 7f85b0ff9640 1 -- 172.21.15.67:0/1935934406 shutdown_connections 2024-04-25T02:28:56.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:56.972+0000 7f85b0ff9640 1 -- 172.21.15.67:0/1935934406 wait complete. 2024-04-25T02:28:56.988 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T02:28:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.094+0000 7f2d14c8c640 1 Processor -- start 2024-04-25T02:28:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.094+0000 7f2d14c8c640 1 -- start start 2024-04-25T02:28:57.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.095+0000 7f2d14c8c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2d100b3b30 0x7f2d100d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:57.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.095+0000 7f2d14c8c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2d100d2cf0 0x7f2d100cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:57.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.095+0000 7f2d14c8c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d100d0b30 con 0x7f2d101619d0 2024-04-25T02:28:57.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.095+0000 7f2d14c8c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f2d100d0e10 con 0x7f2d100b3b30 2024-04-25T02:28:57.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.095+0000 7f2d14c8c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2d100d10f0 con 0x7f2d100d2cf0 2024-04-25T02:28:57.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.095+0000 7f2d0dd9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2d100b3b30 0x7f2d100d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:57.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.095+0000 7f2d0e59c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2d101619d0 0x7f2d100d1fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55854/0 (socket says 172.21.15.67:55854) 2024-04-25T02:28:57.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.095+0000 7f2d0dd9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2d100b3b30 0x7f2d100d27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46920/0 (socket says 172.21.15.67:46920) 2024-04-25T02:28:57.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.095+0000 7f2d0e59c640 1 -- 172.21.15.67:0/3480542719 learned_addr learned my addr 172.21.15.67:0/3480542719 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:57.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.095+0000 7f2d0dd9b640 1 -- 172.21.15.67:0/3480542719 >> v2:172.21.15.176:3300/0 conn(0x7f2d100d2cf0 msgr2=0x7f2d100cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:57.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.095+0000 7f2d0dd9b640 1 --2- 172.21.15.67:0/3480542719 >> v2:172.21.15.176:3300/0 conn(0x7f2d100d2cf0 0x7f2d100cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.095+0000 7f2d0dd9b640 1 -- 172.21.15.67:0/3480542719 >> v1:172.21.15.67:6789/0 conn(0x7f2d101619d0 legacy=0x7f2d100d1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:57.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.095+0000 7f2d0dd9b640 1 -- 172.21.15.67:0/3480542719 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d100d13d0 con 0x7f2d100b3b30 2024-04-25T02:28:57.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.096+0000 7f2d0dd9b640 1 --2- 172.21.15.67:0/3480542719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100b3b30 0x7f2d100d27b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2d1008e420 tx=0x7f2d0402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ef06abb5820318 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:57.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.096+0000 7f2d0d59a640 1 -- 172.21.15.67:0/3480542719 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04037070 con 0x7f2d100b3b30 2024-04-25T02:28:57.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.096+0000 7f2d0d59a640 1 -- 172.21.15.67:0/3480542719 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d04032440 con 0x7f2d100b3b30 2024-04-25T02:28:57.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.096+0000 7f2d0d59a640 1 -- 172.21.15.67:0/3480542719 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04032810 con 0x7f2d100b3b30 2024-04-25T02:28:57.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.097+0000 7f2d14c8c640 1 -- 172.21.15.67:0/3480542719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100b3b30 msgr2=0x7f2d100d27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:57.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.097+0000 7f2d14c8c640 1 --2- 172.21.15.67:0/3480542719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100b3b30 0x7f2d100d27b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2d1008e420 tx=0x7f2d0402a1a0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.097+0000 7f2d14c8c640 1 -- 172.21.15.67:0/3480542719 shutdown_connections 2024-04-25T02:28:57.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.097+0000 7f2d14c8c640 1 --2- 172.21.15.67:0/3480542719 >> v2:172.21.15.176:3300/0 conn(0x7f2d100d2cf0 0x7f2d100cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.097+0000 7f2d14c8c640 1 --2- 172.21.15.67:0/3480542719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100b3b30 0x7f2d100d27b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.097+0000 7f2d14c8c640 1 -- 172.21.15.67:0/3480542719 >> 172.21.15.67:0/3480542719 conn(0x7f2d1009d4b0 msgr2=0x7f2d100d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:57.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.097+0000 7f2d14c8c640 1 -- 172.21.15.67:0/3480542719 shutdown_connections 2024-04-25T02:28:57.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.097+0000 7f2d14c8c640 1 -- 172.21.15.67:0/3480542719 wait complete. 2024-04-25T02:28:57.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.098+0000 7f2d14c8c640 1 Processor -- start 2024-04-25T02:28:57.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.098+0000 7f2d14c8c640 1 -- start start 2024-04-25T02:28:57.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.099+0000 7f2d14c8c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d100b3b30 0x7f2d1015fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:57.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.099+0000 7f2d14c8c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100d2cf0 0x7f2d100c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.099+0000 7f2d14c8c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d101619d0 0x7f2d10153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.099+0000 7f2d14c8c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2d100d0800 con 0x7f2d100d2cf0 2024-04-25T02:28:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.099+0000 7f2d14c8c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2d10161db0 con 0x7f2d101619d0 2024-04-25T02:28:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.099+0000 7f2d14c8c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2d100b3240 con 0x7f2d100b3b30 2024-04-25T02:28:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.099+0000 7f2d0dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100d2cf0 0x7f2d100c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.099+0000 7f2d0dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100d2cf0 0x7f2d100c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46936/0 (socket says 172.21.15.67:46936) 2024-04-25T02:28:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.099+0000 7f2d0dd9b640 1 -- 172.21.15.67:0/2726213669 learned_addr learned my addr 172.21.15.67:0/2726213669 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.099+0000 7f2d0ed9d640 1 --2- 172.21.15.67:0/2726213669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d101619d0 0x7f2d10153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.100+0000 7f2d0e59c640 1 --2- 172.21.15.67:0/2726213669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d100b3b30 0x7f2d1015fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.100+0000 7f2d0dd9b640 1 -- 172.21.15.67:0/2726213669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d100b3b30 msgr2=0x7f2d1015fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.100+0000 7f2d0dd9b640 1 --2- 172.21.15.67:0/2726213669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d100b3b30 0x7f2d1015fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.100+0000 7f2d0dd9b640 1 -- 172.21.15.67:0/2726213669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d101619d0 msgr2=0x7f2d10153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.100+0000 7f2d0dd9b640 1 --2- 172.21.15.67:0/2726213669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d101619d0 0x7f2d10153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.100+0000 7f2d0dd9b640 1 -- 172.21.15.67:0/2726213669 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d10160370 con 0x7f2d100d2cf0 2024-04-25T02:28:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.100+0000 7f2d0dd9b640 1 --2- 172.21.15.67:0/2726213669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100d2cf0 0x7f2d100c84d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2d04009890 tx=0x7f2d040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.100+0000 7f2cfeffd640 1 -- 172.21.15.67:0/2726213669 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04037040 con 0x7f2d100d2cf0 2024-04-25T02:28:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.100+0000 7f2cfeffd640 1 -- 172.21.15.67:0/2726213669 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d04042070 con 0x7f2d100d2cf0 2024-04-25T02:28:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.100+0000 7f2cfeffd640 1 -- 172.21.15.67:0/2726213669 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04030a50 con 0x7f2d100d2cf0 2024-04-25T02:28:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.100+0000 7f2d14c8c640 1 -- 172.21.15.67:0/2726213669 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d10160650 con 0x7f2d100d2cf0 2024-04-25T02:28:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.100+0000 7f2d14c8c640 1 -- 172.21.15.67:0/2726213669 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d100cc300 con 0x7f2d100d2cf0 2024-04-25T02:28:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.101+0000 7f2d14c8c640 1 -- 172.21.15.67:0/2726213669 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d100cc100 con 0x7f2d100d2cf0 2024-04-25T02:28:57.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.101+0000 7f2cfeffd640 1 -- 172.21.15.67:0/2726213669 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d04030bf0 con 0x7f2d100d2cf0 2024-04-25T02:28:57.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.102+0000 7f2cfeffd640 1 --2- 172.21.15.67:0/2726213669 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2cf006be30 0x7f2cf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:57.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.102+0000 7f2cfeffd640 1 -- 172.21.15.67:0/2726213669 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2d040ab880 con 0x7f2d100d2cf0 2024-04-25T02:28:57.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.102+0000 7f2d0e59c640 1 --2- 172.21.15.67:0/2726213669 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2cf006be30 0x7f2cf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:57.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.103+0000 7f2d0e59c640 1 --2- 172.21.15.67:0/2726213669 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2cf006be30 0x7f2cf006e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2d00000f60 tx=0x7f2d00009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:57.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.106+0000 7f2cfeffd640 1 -- 172.21.15.67:0/2726213669 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2d0407a2c0 con 0x7f2d100d2cf0 2024-04-25T02:28:57.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.294+0000 7f2d14c8c640 1 -- 172.21.15.67:0/2726213669 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2d100cc4d0 con 0x7f2d100d2cf0 2024-04-25T02:28:57.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.297+0000 7f2cfeffd640 1 -- 172.21.15.67:0/2726213669 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f2d04079bc0 con 0x7f2d100d2cf0 2024-04-25T02:28:57.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.299+0000 7f2d14c8c640 1 -- 172.21.15.67:0/2726213669 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2cf006be30 msgr2=0x7f2cf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:57.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.299+0000 7f2d14c8c640 1 --2- 172.21.15.67:0/2726213669 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2cf006be30 0x7f2cf006e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2d00000f60 tx=0x7f2d00009040 comp rx=0 tx=0).stop 2024-04-25T02:28:57.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.299+0000 7f2d14c8c640 1 -- 172.21.15.67:0/2726213669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100d2cf0 msgr2=0x7f2d100c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:57.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.299+0000 7f2d14c8c640 1 --2- 172.21.15.67:0/2726213669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100d2cf0 0x7f2d100c84d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2d04009890 tx=0x7f2d040046c0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.299+0000 7f2d14c8c640 1 -- 172.21.15.67:0/2726213669 shutdown_connections 2024-04-25T02:28:57.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.299+0000 7f2d14c8c640 1 --2- 172.21.15.67:0/2726213669 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2cf006be30 0x7f2cf006e2f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.299+0000 7f2d14c8c640 1 --2- 172.21.15.67:0/2726213669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d101619d0 0x7f2d10153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.299+0000 7f2d14c8c640 1 --2- 172.21.15.67:0/2726213669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d100d2cf0 0x7f2d100c84d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.299+0000 7f2d14c8c640 1 --2- 172.21.15.67:0/2726213669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d100b3b30 0x7f2d1015fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.299+0000 7f2d14c8c640 1 -- 172.21.15.67:0/2726213669 >> 172.21.15.67:0/2726213669 conn(0x7f2d1009d4b0 msgr2=0x7f2d100cf080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:57.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.299+0000 7f2d14c8c640 1 -- 172.21.15.67:0/2726213669 shutdown_connections 2024-04-25T02:28:57.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.299+0000 7f2d14c8c640 1 -- 172.21.15.67:0/2726213669 wait complete. 2024-04-25T02:28:57.313 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T02:28:57.313 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:28:57.355 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:28:57.405 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T02:28:57.405 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:28:57.405 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:28:57.421 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:28:57.421 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:28:57.476 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:28:57.476 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:28:57.531 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:57.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.668+0000 7fa2369b0640 1 Processor -- start 2024-04-25T02:28:57.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.668+0000 7fa2369b0640 1 -- start start 2024-04-25T02:28:57.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.669+0000 7fa2369b0640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa23015e210 0x7fa23006cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:57.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.669+0000 7fa2369b0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa2300cf3d0 0x7fa23006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:57.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.669+0000 7fa2369b0640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2300d2cc0 con 0x7fa23015e5f0 2024-04-25T02:28:57.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.669+0000 7fa2369b0640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa23006c6f0 con 0x7fa2300cf3d0 2024-04-25T02:28:57.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.669+0000 7fa2369b0640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa2300d2fa0 con 0x7fa23015e210 2024-04-25T02:28:57.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.669+0000 7fa234f4d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa2300cf3d0 0x7fa23006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:57.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.669+0000 7fa22f7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa23015e5f0 0x7fa2300cecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55868/0 (socket says 172.21.15.67:55868) 2024-04-25T02:28:57.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.669+0000 7fa22f7fe640 1 -- 172.21.15.67:0/757994147 learned_addr learned my addr 172.21.15.67:0/757994147 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:57.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.670+0000 7fa234f4d640 1 -- 172.21.15.67:0/757994147 >> v2:172.21.15.176:3300/0 conn(0x7fa23015e210 msgr2=0x7fa23006cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:57.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.670+0000 7fa22ffff640 1 --2- 172.21.15.67:0/757994147 >> v2:172.21.15.176:3300/0 conn(0x7fa23015e210 0x7fa23006cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:57.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.670+0000 7fa234f4d640 1 --2- 172.21.15.67:0/757994147 >> v2:172.21.15.176:3300/0 conn(0x7fa23015e210 0x7fa23006cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.670+0000 7fa234f4d640 1 -- 172.21.15.67:0/757994147 >> v1:172.21.15.67:6789/0 conn(0x7fa23015e5f0 legacy=0x7fa2300cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:57.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.670+0000 7fa22effd640 1 -- 172.21.15.67:0/757994147 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3935834291 0 0) 0x7fa2300d2cc0 con 0x7fa23015e5f0 2024-04-25T02:28:57.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.670+0000 7fa234f4d640 1 -- 172.21.15.67:0/757994147 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23006c0a0 con 0x7fa2300cf3d0 2024-04-25T02:28:57.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.670+0000 7fa22ffff640 1 --2- 172.21.15.67:0/757994147 >> v2:172.21.15.176:3300/0 conn(0x7fa23015e210 0x7fa23006cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:57.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.670+0000 7fa234f4d640 1 --2- 172.21.15.67:0/757994147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2300cf3d0 0x7fa23006d0c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa2300d1c90 tx=0x7fa22802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334db58a185ccfd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:57.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.671+0000 7fa22effd640 1 -- 172.21.15.67:0/757994147 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa228007740 con 0x7fa2300cf3d0 2024-04-25T02:28:57.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.671+0000 7fa22effd640 1 -- 172.21.15.67:0/757994147 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2280078e0 con 0x7fa2300cf3d0 2024-04-25T02:28:57.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.671+0000 7fa22effd640 1 -- 172.21.15.67:0/757994147 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa228007cb0 con 0x7fa2300cf3d0 2024-04-25T02:28:57.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.671+0000 7fa2369b0640 1 -- 172.21.15.67:0/757994147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2300cf3d0 msgr2=0x7fa23006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:57.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.671+0000 7fa2369b0640 1 --2- 172.21.15.67:0/757994147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2300cf3d0 0x7fa23006d0c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa2300d1c90 tx=0x7fa22802a680 comp rx=0 tx=0).stop 2024-04-25T02:28:57.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.671+0000 7fa2369b0640 1 -- 172.21.15.67:0/757994147 shutdown_connections 2024-04-25T02:28:57.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.671+0000 7fa2369b0640 1 --2- 172.21.15.67:0/757994147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2300cf3d0 0x7fa23006d0c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.671+0000 7fa2369b0640 1 --2- 172.21.15.67:0/757994147 >> v2:172.21.15.176:3300/0 conn(0x7fa23015e210 0x7fa23006cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.671+0000 7fa2369b0640 1 -- 172.21.15.67:0/757994147 >> 172.21.15.67:0/757994147 conn(0x7fa23008dbb0 msgr2=0x7fa23009d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:57.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.671+0000 7fa2369b0640 1 -- 172.21.15.67:0/757994147 shutdown_connections 2024-04-25T02:28:57.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.671+0000 7fa2369b0640 1 -- 172.21.15.67:0/757994147 wait complete. 2024-04-25T02:28:57.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.672+0000 7fa2369b0640 1 Processor -- start 2024-04-25T02:28:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.673+0000 7fa2369b0640 1 -- start start 2024-04-25T02:28:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.673+0000 7fa2369b0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2300cf3d0 0x7fa23015a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.673+0000 7fa2369b0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa23015e210 0x7fa2300cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.673+0000 7fa2369b0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa23015e5f0 0x7fa2300cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.673+0000 7fa2369b0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa2300d3fe0 con 0x7fa23015e5f0 2024-04-25T02:28:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.673+0000 7fa2369b0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa2300d3e60 con 0x7fa23015e210 2024-04-25T02:28:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.673+0000 7fa2369b0640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa2300d4160 con 0x7fa2300cf3d0 2024-04-25T02:28:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.673+0000 7fa234f4d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa23015e5f0 0x7fa2300cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.673+0000 7fa234f4d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa23015e5f0 0x7fa2300cfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46950/0 (socket says 172.21.15.67:46950) 2024-04-25T02:28:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.673+0000 7fa234f4d640 1 -- 172.21.15.67:0/2956327196 learned_addr learned my addr 172.21.15.67:0/2956327196 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.674+0000 7fa22f7fe640 1 --2- 172.21.15.67:0/2956327196 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa23015e210 0x7fa2300cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.674+0000 7fa22ffff640 1 --2- 172.21.15.67:0/2956327196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2300cf3d0 0x7fa23015a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.674+0000 7fa234f4d640 1 -- 172.21.15.67:0/2956327196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2300cf3d0 msgr2=0x7fa23015a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.674+0000 7fa234f4d640 1 --2- 172.21.15.67:0/2956327196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2300cf3d0 0x7fa23015a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.674+0000 7fa234f4d640 1 -- 172.21.15.67:0/2956327196 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa23015e210 msgr2=0x7fa2300cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.674+0000 7fa234f4d640 1 --2- 172.21.15.67:0/2956327196 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa23015e210 0x7fa2300cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.674+0000 7fa234f4d640 1 -- 172.21.15.67:0/2956327196 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2301f71a0 con 0x7fa23015e5f0 2024-04-25T02:28:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.674+0000 7fa22f7fe640 1 --2- 172.21.15.67:0/2956327196 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa23015e210 0x7fa2300cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.674+0000 7fa234f4d640 1 --2- 172.21.15.67:0/2956327196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa23015e5f0 0x7fa2300cfcf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa22802ac70 tx=0x7fa228004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.674+0000 7fa22cff9640 1 -- 172.21.15.67:0/2956327196 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa228040070 con 0x7fa23015e5f0 2024-04-25T02:28:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.674+0000 7fa22cff9640 1 -- 172.21.15.67:0/2956327196 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa228031c90 con 0x7fa23015e5f0 2024-04-25T02:28:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.674+0000 7fa2369b0640 1 -- 172.21.15.67:0/2956327196 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2301f7480 con 0x7fa23015e5f0 2024-04-25T02:28:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.674+0000 7fa22cff9640 1 -- 172.21.15.67:0/2956327196 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa228045680 con 0x7fa23015e5f0 2024-04-25T02:28:57.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.674+0000 7fa2369b0640 1 -- 172.21.15.67:0/2956327196 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2301f7a40 con 0x7fa23015e5f0 2024-04-25T02:28:57.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.675+0000 7fa2369b0640 1 -- 172.21.15.67:0/2956327196 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa230069110 con 0x7fa23015e5f0 2024-04-25T02:28:57.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.676+0000 7fa22cff9640 1 -- 172.21.15.67:0/2956327196 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa228039040 con 0x7fa23015e5f0 2024-04-25T02:28:57.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.676+0000 7fa22cff9640 1 --2- 172.21.15.67:0/2956327196 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa21c06be30 0x7fa21c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:57.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.676+0000 7fa22cff9640 1 -- 172.21.15.67:0/2956327196 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa2280ac850 con 0x7fa23015e5f0 2024-04-25T02:28:57.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.677+0000 7fa22ffff640 1 --2- 172.21.15.67:0/2956327196 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa21c06be30 0x7fa21c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:57.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.677+0000 7fa22ffff640 1 --2- 172.21.15.67:0/2956327196 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa21c06be30 0x7fa21c06e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa220008850 tx=0x7fa220008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:57.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.681+0000 7fa22cff9640 1 -- 172.21.15.67:0/2956327196 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa228043360 con 0x7fa23015e5f0 2024-04-25T02:28:57.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.867+0000 7fa2369b0640 1 -- 172.21.15.67:0/2956327196 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa23006be80 con 0x7fa23015e5f0 2024-04-25T02:28:57.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.868+0000 7fa22cff9640 1 -- 172.21.15.67:0/2956327196 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7fa22807b3e0 con 0x7fa23015e5f0 2024-04-25T02:28:57.871 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:57.872 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:27.819641+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:57.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.870+0000 7fa2369b0640 1 -- 172.21.15.67:0/2956327196 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa21c06be30 msgr2=0x7fa21c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:57.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.870+0000 7fa2369b0640 1 --2- 172.21.15.67:0/2956327196 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa21c06be30 0x7fa21c06e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa220008850 tx=0x7fa220008040 comp rx=0 tx=0).stop 2024-04-25T02:28:57.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.870+0000 7fa2369b0640 1 -- 172.21.15.67:0/2956327196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa23015e5f0 msgr2=0x7fa2300cfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:57.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.870+0000 7fa2369b0640 1 --2- 172.21.15.67:0/2956327196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa23015e5f0 0x7fa2300cfcf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa22802ac70 tx=0x7fa228004a40 comp rx=0 tx=0).stop 2024-04-25T02:28:57.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.870+0000 7fa2369b0640 1 -- 172.21.15.67:0/2956327196 shutdown_connections 2024-04-25T02:28:57.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.870+0000 7fa2369b0640 1 --2- 172.21.15.67:0/2956327196 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa21c06be30 0x7fa21c06e2f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.870+0000 7fa2369b0640 1 --2- 172.21.15.67:0/2956327196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa23015e5f0 0x7fa2300cfcf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.870+0000 7fa2369b0640 1 --2- 172.21.15.67:0/2956327196 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa23015e210 0x7fa2300cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.870+0000 7fa2369b0640 1 --2- 172.21.15.67:0/2956327196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2300cf3d0 0x7fa23015a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.870+0000 7fa2369b0640 1 -- 172.21.15.67:0/2956327196 >> 172.21.15.67:0/2956327196 conn(0x7fa23008dbb0 msgr2=0x7fa23015fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:57.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.870+0000 7fa2369b0640 1 -- 172.21.15.67:0/2956327196 shutdown_connections 2024-04-25T02:28:57.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.870+0000 7fa2369b0640 1 -- 172.21.15.67:0/2956327196 wait complete. 2024-04-25T02:28:57.884 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:28:24.445606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:28:25.161619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:28:57.885 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:28:57.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.985+0000 7f81f8053640 1 Processor -- start 2024-04-25T02:28:57.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.986+0000 7f81f8053640 1 -- start start 2024-04-25T02:28:57.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.986+0000 7f81f8053640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81f015e760 0x7f81f00cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:57.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.986+0000 7f81f8053640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f81f00d0900 0x7f81f00d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:57.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.986+0000 7f81f8053640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81f00d1730 con 0x7f81f00d12a0 2024-04-25T02:28:57.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.986+0000 7f81f8053640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f81f00d28a0 con 0x7f81f00d0900 2024-04-25T02:28:57.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.986+0000 7f81f8053640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f81f00cff80 con 0x7f81f015e760 2024-04-25T02:28:57.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.987+0000 7f81f5def640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81f015e760 0x7f81f00cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:57.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.987+0000 7f81f55ee640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f81f00d0900 0x7f81f00d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:57.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.987+0000 7f81f55ee640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f81f00d0900 0x7f81f00d0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:53984/0 (socket says 172.21.15.67:53984) 2024-04-25T02:28:57.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.987+0000 7f81f5def640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81f015e760 0x7f81f00cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:38394/0 (socket says 172.21.15.67:38394) 2024-04-25T02:28:57.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.987+0000 7f81f55ee640 1 -- 172.21.15.67:0/163602243 learned_addr learned my addr 172.21.15.67:0/163602243 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:57.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.987+0000 7f81f65f0640 1 --1- 172.21.15.67:0/163602243 >> v1:172.21.15.176:6789/0 conn(0x7f81f00d12a0 0x7f81f00d2d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:44060/0 (socket says 172.21.15.67:44060) 2024-04-25T02:28:57.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.987+0000 7f81f5def640 1 -- 172.21.15.67:0/163602243 >> v2:172.21.15.176:3300/0 conn(0x7f81f00d0900 msgr2=0x7f81f00d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:57.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.987+0000 7f81f5def640 1 --2- 172.21.15.67:0/163602243 >> v2:172.21.15.176:3300/0 conn(0x7f81f00d0900 0x7f81f00d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.987+0000 7f81f5def640 1 -- 172.21.15.67:0/163602243 >> v1:172.21.15.176:6789/0 conn(0x7f81f00d12a0 legacy=0x7f81f00d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:57.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.987+0000 7f81f5def640 1 -- 172.21.15.67:0/163602243 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f00d2250 con 0x7f81f015e760 2024-04-25T02:28:57.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.987+0000 7f81f55ee640 1 --2- 172.21.15.67:0/163602243 >> v2:172.21.15.176:3300/0 conn(0x7f81f00d0900 0x7f81f00d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:57.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.988+0000 7f81f5def640 1 --2- 172.21.15.67:0/163602243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81f015e760 0x7f81f00cf8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0097a0 tx=0x7f81ec02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a508405aed53e1c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:57.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.988+0000 7f81f4ded640 1 -- 172.21.15.67:0/163602243 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec037070 con 0x7f81f015e760 2024-04-25T02:28:57.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.988+0000 7f81f4ded640 1 -- 172.21.15.67:0/163602243 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ec032440 con 0x7f81f015e760 2024-04-25T02:28:57.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.988+0000 7f81f4ded640 1 -- 172.21.15.67:0/163602243 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec032810 con 0x7f81f015e760 2024-04-25T02:28:57.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.989+0000 7f81f8053640 1 -- 172.21.15.67:0/163602243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81f015e760 msgr2=0x7f81f00cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:57.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.989+0000 7f81f8053640 1 --2- 172.21.15.67:0/163602243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81f015e760 0x7f81f00cf8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0097a0 tx=0x7f81ec02a180 comp rx=0 tx=0).stop 2024-04-25T02:28:57.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.989+0000 7f81f8053640 1 -- 172.21.15.67:0/163602243 shutdown_connections 2024-04-25T02:28:57.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.989+0000 7f81f8053640 1 --2- 172.21.15.67:0/163602243 >> v2:172.21.15.176:3300/0 conn(0x7f81f00d0900 0x7f81f00d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.989+0000 7f81f8053640 1 --2- 172.21.15.67:0/163602243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81f015e760 0x7f81f00cf8f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.989+0000 7f81f8053640 1 -- 172.21.15.67:0/163602243 >> 172.21.15.67:0/163602243 conn(0x7f81f00d41b0 msgr2=0x7f81f00d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:57.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.989+0000 7f81f8053640 1 -- 172.21.15.67:0/163602243 shutdown_connections 2024-04-25T02:28:57.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.989+0000 7f81f8053640 1 -- 172.21.15.67:0/163602243 wait complete. 2024-04-25T02:28:57.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.990+0000 7f81f8053640 1 Processor -- start 2024-04-25T02:28:57.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.990+0000 7f81f8053640 1 -- start start 2024-04-25T02:28:57.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.991+0000 7f81f8053640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81f00d0900 0x7f81f00c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:57.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.991+0000 7f81f8053640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81f00d12a0 0x7f81f00ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:57.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.991+0000 7f81f8053640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81f015e760 0x7f81f00cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:57.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.991+0000 7f81f8053640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f81f006cfc0 con 0x7f81f00d12a0 2024-04-25T02:28:57.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.991+0000 7f81f8053640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f81f00b0e40 con 0x7f81f015e760 2024-04-25T02:28:57.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.991+0000 7f81f8053640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f81f015eb40 con 0x7f81f00d0900 2024-04-25T02:28:57.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.991+0000 7f81f55ee640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81f00d12a0 0x7f81f00ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:57.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.991+0000 7f81f55ee640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81f00d12a0 0x7f81f00ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46954/0 (socket says 172.21.15.67:46954) 2024-04-25T02:28:57.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.991+0000 7f81f55ee640 1 -- 172.21.15.67:0/1242970147 learned_addr learned my addr 172.21.15.67:0/1242970147 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:57.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.991+0000 7f81f5def640 1 --2- 172.21.15.67:0/1242970147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81f00d0900 0x7f81f00c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:57.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.991+0000 7f81f65f0640 1 --2- 172.21.15.67:0/1242970147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81f015e760 0x7f81f00cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:57.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.991+0000 7f81f55ee640 1 -- 172.21.15.67:0/1242970147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81f00d0900 msgr2=0x7f81f00c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:57.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.991+0000 7f81f55ee640 1 --2- 172.21.15.67:0/1242970147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81f00d0900 0x7f81f00c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.991+0000 7f81f55ee640 1 -- 172.21.15.67:0/1242970147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81f015e760 msgr2=0x7f81f00cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:57.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.991+0000 7f81f55ee640 1 --2- 172.21.15.67:0/1242970147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81f015e760 0x7f81f00cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:57.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.991+0000 7f81f55ee640 1 -- 172.21.15.67:0/1242970147 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f00c7db0 con 0x7f81f00d12a0 2024-04-25T02:28:57.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.991+0000 7f81f55ee640 1 --2- 172.21.15.67:0/1242970147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81f00d12a0 0x7f81f00ca510 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f81e000e9d0 tx=0x7f81e000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:57.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.992+0000 7f81e67fc640 1 -- 172.21.15.67:0/1242970147 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0017070 con 0x7f81f00d12a0 2024-04-25T02:28:57.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.992+0000 7f81e67fc640 1 -- 172.21.15.67:0/1242970147 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e000ca60 con 0x7f81f00d12a0 2024-04-25T02:28:57.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.992+0000 7f81e67fc640 1 -- 172.21.15.67:0/1242970147 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e000ce10 con 0x7f81f00d12a0 2024-04-25T02:28:57.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.992+0000 7f81f8053640 1 -- 172.21.15.67:0/1242970147 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f00c8090 con 0x7f81f00d12a0 2024-04-25T02:28:57.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.992+0000 7f81f8053640 1 -- 172.21.15.67:0/1242970147 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f00c8650 con 0x7f81f00d12a0 2024-04-25T02:28:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.993+0000 7f81f8053640 1 -- 172.21.15.67:0/1242970147 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f0069110 con 0x7f81f00d12a0 2024-04-25T02:28:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.993+0000 7f81e67fc640 1 -- 172.21.15.67:0/1242970147 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81e001a070 con 0x7f81f00d12a0 2024-04-25T02:28:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.994+0000 7f81e67fc640 1 --2- 172.21.15.67:0/1242970147 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f81d406be30 0x7f81d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.994+0000 7f81e67fc640 1 -- 172.21.15.67:0/1242970147 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f81e008b110 con 0x7f81f00d12a0 2024-04-25T02:28:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.994+0000 7f81f5def640 1 --2- 172.21.15.67:0/1242970147 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f81d406be30 0x7f81d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.994+0000 7f81f5def640 1 --2- 172.21.15.67:0/1242970147 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f81d406be30 0x7f81d406e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f81ec034000 tx=0x7f81ec02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:58.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:57.998+0000 7f81e67fc640 1 -- 172.21.15.67:0/1242970147 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f81e0059b50 con 0x7f81f00d12a0 2024-04-25T02:28:58.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.179+0000 7f81f8053640 1 -- 172.21.15.67:0/1242970147 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f81f00b1720 con 0x7f81f00d12a0 2024-04-25T02:28:58.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.180+0000 7f81e67fc640 1 -- 172.21.15.67:0/1242970147 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f81e0059450 con 0x7f81f00d12a0 2024-04-25T02:28:58.183 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:28:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.181+0000 7f81f8053640 1 -- 172.21.15.67:0/1242970147 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f81d406be30 msgr2=0x7f81d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.181+0000 7f81f8053640 1 --2- 172.21.15.67:0/1242970147 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f81d406be30 0x7f81d406e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f81ec034000 tx=0x7f81ec02e000 comp rx=0 tx=0).stop 2024-04-25T02:28:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.181+0000 7f81f8053640 1 -- 172.21.15.67:0/1242970147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81f00d12a0 msgr2=0x7f81f00ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.181+0000 7f81f8053640 1 --2- 172.21.15.67:0/1242970147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81f00d12a0 0x7f81f00ca510 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f81e000e9d0 tx=0x7f81e000ee90 comp rx=0 tx=0).stop 2024-04-25T02:28:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.181+0000 7f81f8053640 1 -- 172.21.15.67:0/1242970147 shutdown_connections 2024-04-25T02:28:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.181+0000 7f81f8053640 1 --2- 172.21.15.67:0/1242970147 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f81d406be30 0x7f81d406e2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.181+0000 7f81f8053640 1 --2- 172.21.15.67:0/1242970147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81f015e760 0x7f81f00cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.181+0000 7f81f8053640 1 --2- 172.21.15.67:0/1242970147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81f00d12a0 0x7f81f00ca510 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.181+0000 7f81f8053640 1 --2- 172.21.15.67:0/1242970147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81f00d0900 0x7f81f00c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.181+0000 7f81f8053640 1 -- 172.21.15.67:0/1242970147 >> 172.21.15.67:0/1242970147 conn(0x7f81f00d41b0 msgr2=0x7f81f00d2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.181+0000 7f81f8053640 1 -- 172.21.15.67:0/1242970147 shutdown_connections 2024-04-25T02:28:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.181+0000 7f81f8053640 1 -- 172.21.15.67:0/1242970147 wait complete. 2024-04-25T02:28:58.195 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:28:58.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.296+0000 7f073eab3640 1 Processor -- start 2024-04-25T02:28:58.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.296+0000 7f073eab3640 1 -- start start 2024-04-25T02:28:58.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.296+0000 7f073eab3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07380cf060 0x7f07380d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:58.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.297+0000 7f073eab3640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f07380b2da0 0x7f073806c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:58.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.297+0000 7f073eab3640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07380b3570 con 0x7f073806cd80 2024-04-25T02:28:58.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.297+0000 7f073eab3640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f07380d05d0 con 0x7f07380b2da0 2024-04-25T02:28:58.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.297+0000 7f073eab3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f07380cff80 con 0x7f07380cf060 2024-04-25T02:28:58.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.297+0000 7f0737fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f07380b2da0 0x7f073806c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:58.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.297+0000 7f0737fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f07380b2da0 0x7f073806c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46964/0 (socket says 172.21.15.67:46964) 2024-04-25T02:28:58.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.297+0000 7f0737fff640 1 -- 172.21.15.67:0/834464902 learned_addr learned my addr 172.21.15.67:0/834464902 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:58.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.297+0000 7f073c84f640 1 --2- 172.21.15.67:0/834464902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07380cf060 0x7f07380d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:58.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.297+0000 7f0737fff640 1 -- 172.21.15.67:0/834464902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07380cf060 msgr2=0x7f07380d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:58.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.297+0000 7f0737fff640 1 --2- 172.21.15.67:0/834464902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07380cf060 0x7f07380d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.297+0000 7f0737fff640 1 -- 172.21.15.67:0/834464902 >> v1:172.21.15.176:6789/0 conn(0x7f073806cd80 legacy=0x7f07380aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:58.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.297+0000 7f0737fff640 1 -- 172.21.15.67:0/834464902 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07380d0260 con 0x7f07380b2da0 2024-04-25T02:28:58.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.298+0000 7f0737fff640 1 --2- 172.21.15.67:0/834464902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07380b2da0 0x7f073806c840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f072c009870 tx=0x7f072c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188dd2faabf5c865 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:58.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.298+0000 7f07377fe640 1 -- 172.21.15.67:0/834464902 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c037070 con 0x7f07380b2da0 2024-04-25T02:28:58.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.298+0000 7f07377fe640 1 -- 172.21.15.67:0/834464902 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f072c032440 con 0x7f07380b2da0 2024-04-25T02:28:58.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.298+0000 7f07377fe640 1 -- 172.21.15.67:0/834464902 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c032810 con 0x7f07380b2da0 2024-04-25T02:28:58.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.298+0000 7f073eab3640 1 -- 172.21.15.67:0/834464902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07380b2da0 msgr2=0x7f073806c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:58.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.298+0000 7f073eab3640 1 --2- 172.21.15.67:0/834464902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07380b2da0 0x7f073806c840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f072c009870 tx=0x7f072c02a270 comp rx=0 tx=0).stop 2024-04-25T02:28:58.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.298+0000 7f073eab3640 1 -- 172.21.15.67:0/834464902 shutdown_connections 2024-04-25T02:28:58.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.299+0000 7f073eab3640 1 --2- 172.21.15.67:0/834464902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07380b2da0 0x7f073806c840 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.299+0000 7f073eab3640 1 --2- 172.21.15.67:0/834464902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07380cf060 0x7f07380d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.299+0000 7f073eab3640 1 -- 172.21.15.67:0/834464902 >> 172.21.15.67:0/834464902 conn(0x7f07380b3a70 msgr2=0x7f07380b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:58.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.299+0000 7f073eab3640 1 -- 172.21.15.67:0/834464902 shutdown_connections 2024-04-25T02:28:58.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.299+0000 7f073eab3640 1 -- 172.21.15.67:0/834464902 wait complete. 2024-04-25T02:28:58.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.300+0000 7f073eab3640 1 Processor -- start 2024-04-25T02:28:58.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.300+0000 7f073eab3640 1 -- start start 2024-04-25T02:28:58.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073eab3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f073806cd80 0x7f073809cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:58.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073eab3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07380b2da0 0x7f0738160760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:58.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073eab3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07380cf060 0x7f07381f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:58.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073eab3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f07380b3260 con 0x7f07380cf060 2024-04-25T02:28:58.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073eab3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f073806d210 con 0x7f07380b2da0 2024-04-25T02:28:58.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073eab3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f07380b2670 con 0x7f073806cd80 2024-04-25T02:28:58.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073d050640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07380cf060 0x7f07381f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:58.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073d050640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07380cf060 0x7f07381f3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46966/0 (socket says 172.21.15.67:46966) 2024-04-25T02:28:58.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073d050640 1 -- 172.21.15.67:0/1197613660 learned_addr learned my addr 172.21.15.67:0/1197613660 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:58.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f0737fff640 1 --2- 172.21.15.67:0/1197613660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07380b2da0 0x7f0738160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:58.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073c84f640 1 --2- 172.21.15.67:0/1197613660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f073806cd80 0x7f073809cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:58.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073d050640 1 -- 172.21.15.67:0/1197613660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f073806cd80 msgr2=0x7f073809cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:58.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073d050640 1 --2- 172.21.15.67:0/1197613660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f073806cd80 0x7f073809cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073d050640 1 -- 172.21.15.67:0/1197613660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07380b2da0 msgr2=0x7f0738160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:58.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073d050640 1 --2- 172.21.15.67:0/1197613660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07380b2da0 0x7f0738160760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073d050640 1 -- 172.21.15.67:0/1197613660 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073809d5c0 con 0x7f07380cf060 2024-04-25T02:28:58.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f0737fff640 1 --2- 172.21.15.67:0/1197613660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07380b2da0 0x7f0738160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:58.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073c84f640 1 --2- 172.21.15.67:0/1197613660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f073806cd80 0x7f073809cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:58.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073d050640 1 --2- 172.21.15.67:0/1197613660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07380cf060 0x7f07381f3d70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f073000c7a0 tx=0x7f073000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:58.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f07357fa640 1 -- 172.21.15.67:0/1197613660 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730003b70 con 0x7f07380cf060 2024-04-25T02:28:58.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f07357fa640 1 -- 172.21.15.67:0/1197613660 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0730003d30 con 0x7f07380cf060 2024-04-25T02:28:58.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073eab3640 1 -- 172.21.15.67:0/1197613660 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f073809d8a0 con 0x7f07380cf060 2024-04-25T02:28:58.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f07357fa640 1 -- 172.21.15.67:0/1197613660 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073000aa90 con 0x7f07380cf060 2024-04-25T02:28:58.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.301+0000 7f073eab3640 1 -- 172.21.15.67:0/1197613660 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f073809de60 con 0x7f07380cf060 2024-04-25T02:28:58.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.302+0000 7f073eab3640 1 -- 172.21.15.67:0/1197613660 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0738069110 con 0x7f07380cf060 2024-04-25T02:28:58.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.303+0000 7f07357fa640 1 -- 172.21.15.67:0/1197613660 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f073000ac30 con 0x7f07380cf060 2024-04-25T02:28:58.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.303+0000 7f07357fa640 1 --2- 172.21.15.67:0/1197613660 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f072406be30 0x7f072406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:58.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.303+0000 7f07357fa640 1 -- 172.21.15.67:0/1197613660 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f073008ad20 con 0x7f07380cf060 2024-04-25T02:28:58.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.303+0000 7f073c84f640 1 --2- 172.21.15.67:0/1197613660 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f072406be30 0x7f072406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:58.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.304+0000 7f073c84f640 1 --2- 172.21.15.67:0/1197613660 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f072406be30 0x7f072406e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0728006fd0 tx=0x7f0728008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:58.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.308+0000 7f07357fa640 1 -- 172.21.15.67:0/1197613660 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0730059760 con 0x7f07380cf060 2024-04-25T02:28:58.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.491+0000 7f073eab3640 1 -- 172.21.15.67:0/1197613660 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f073809d2b0 con 0x7f07380cf060 2024-04-25T02:28:58.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.492+0000 7f07357fa640 1 -- 172.21.15.67:0/1197613660 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f0730059060 con 0x7f07380cf060 2024-04-25T02:28:58.495 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-25T02:28:58.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.494+0000 7f073eab3640 1 -- 172.21.15.67:0/1197613660 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f072406be30 msgr2=0x7f072406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:58.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.494+0000 7f073eab3640 1 --2- 172.21.15.67:0/1197613660 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f072406be30 0x7f072406e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0728006fd0 tx=0x7f0728008040 comp rx=0 tx=0).stop 2024-04-25T02:28:58.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.494+0000 7f073eab3640 1 -- 172.21.15.67:0/1197613660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07380cf060 msgr2=0x7f07381f3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:58.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.494+0000 7f073eab3640 1 --2- 172.21.15.67:0/1197613660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07380cf060 0x7f07381f3d70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f073000c7a0 tx=0x7f073000cc60 comp rx=0 tx=0).stop 2024-04-25T02:28:58.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.494+0000 7f073eab3640 1 -- 172.21.15.67:0/1197613660 shutdown_connections 2024-04-25T02:28:58.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.494+0000 7f073eab3640 1 --2- 172.21.15.67:0/1197613660 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f072406be30 0x7f072406e2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.494+0000 7f073eab3640 1 --2- 172.21.15.67:0/1197613660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07380cf060 0x7f07381f3d70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.494+0000 7f073eab3640 1 --2- 172.21.15.67:0/1197613660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07380b2da0 0x7f0738160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.494+0000 7f073eab3640 1 --2- 172.21.15.67:0/1197613660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f073806cd80 0x7f073809cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.494+0000 7f073eab3640 1 -- 172.21.15.67:0/1197613660 >> 172.21.15.67:0/1197613660 conn(0x7f07380b3a70 msgr2=0x7f07380c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:58.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.494+0000 7f073eab3640 1 -- 172.21.15.67:0/1197613660 shutdown_connections 2024-04-25T02:28:58.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.494+0000 7f073eab3640 1 -- 172.21.15.67:0/1197613660 wait complete. 2024-04-25T02:28:58.508 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:28:58.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.608+0000 7ff3594f5640 1 Processor -- start 2024-04-25T02:28:58.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.608+0000 7ff3594f5640 1 -- start start 2024-04-25T02:28:58.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.609+0000 7ff3594f5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff3540d0ee0 0x7ff3540d4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:58.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.609+0000 7ff3594f5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3540d2a30 con 0x7ff35415e670 2024-04-25T02:28:58.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.609+0000 7ff3594f5640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3540d2d10 con 0x7ff3540b5180 2024-04-25T02:28:58.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.609+0000 7ff3594f5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff3540cee50 con 0x7ff3540d0ee0 2024-04-25T02:28:58.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.609+0000 7ff352ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff35415e670 0x7ff3540c7bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55882/0 (socket says 172.21.15.67:55882) 2024-04-25T02:28:58.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.609+0000 7ff352ffd640 1 -- 172.21.15.67:0/908928101 learned_addr learned my addr 172.21.15.67:0/908928101 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:58.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.609+0000 7ff3537fe640 1 --2- 172.21.15.67:0/908928101 >> v2:172.21.15.67:3300/0 conn(0x7ff3540d0ee0 0x7ff3540d4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:58.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.610+0000 7ff3537fe640 1 -- 172.21.15.67:0/908928101 >> v1:172.21.15.176:6789/0 conn(0x7ff3540b5180 legacy=0x7ff3540d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:58.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.610+0000 7ff3537fe640 1 -- 172.21.15.67:0/908928101 >> v1:172.21.15.67:6789/0 conn(0x7ff35415e670 legacy=0x7ff3540c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:58.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.610+0000 7ff351ffb640 1 -- 172.21.15.67:0/908928101 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3381057263 0 0) 0x7ff3540d2a30 con 0x7ff35415e670 2024-04-25T02:28:58.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.610+0000 7ff3537fe640 1 -- 172.21.15.67:0/908928101 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3540cf130 con 0x7ff3540d0ee0 2024-04-25T02:28:58.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.610+0000 7ff3537fe640 1 --2- 172.21.15.67:0/908928101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3540d0ee0 0x7ff3540d4b90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff344009d90 tx=0x7ff34402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66b7a069a855146 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:58.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.611+0000 7ff351ffb640 1 -- 172.21.15.67:0/908928101 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff344007740 con 0x7ff3540d0ee0 2024-04-25T02:28:58.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.611+0000 7ff351ffb640 1 -- 172.21.15.67:0/908928101 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3440078e0 con 0x7ff3540d0ee0 2024-04-25T02:28:58.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.611+0000 7ff351ffb640 1 -- 172.21.15.67:0/908928101 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff344007cb0 con 0x7ff3540d0ee0 2024-04-25T02:28:58.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.611+0000 7ff3594f5640 1 -- 172.21.15.67:0/908928101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3540d0ee0 msgr2=0x7ff3540d4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:58.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.611+0000 7ff3594f5640 1 --2- 172.21.15.67:0/908928101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3540d0ee0 0x7ff3540d4b90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff344009d90 tx=0x7ff34402a6a0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.611+0000 7ff3594f5640 1 -- 172.21.15.67:0/908928101 shutdown_connections 2024-04-25T02:28:58.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.611+0000 7ff3594f5640 1 --2- 172.21.15.67:0/908928101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3540d0ee0 0x7ff3540d4b90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.611+0000 7ff3594f5640 1 -- 172.21.15.67:0/908928101 >> 172.21.15.67:0/908928101 conn(0x7ff3540d40a0 msgr2=0x7ff3540d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:58.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.611+0000 7ff3594f5640 1 -- 172.21.15.67:0/908928101 shutdown_connections 2024-04-25T02:28:58.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.611+0000 7ff3594f5640 1 -- 172.21.15.67:0/908928101 wait complete. 2024-04-25T02:28:58.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.613+0000 7ff3594f5640 1 Processor -- start 2024-04-25T02:28:58.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.613+0000 7ff3594f5640 1 -- start start 2024-04-25T02:28:58.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.613+0000 7ff3594f5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3540b5180 0x7ff3540ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:58.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.613+0000 7ff3594f5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3540d0ee0 0x7ff3540b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:58.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.613+0000 7ff3594f5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff35415e670 0x7ff3540b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:58.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.613+0000 7ff3594f5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff3540d3170 con 0x7ff3540b5180 2024-04-25T02:28:58.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.613+0000 7ff3594f5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff3540d2ff0 con 0x7ff3540d0ee0 2024-04-25T02:28:58.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.613+0000 7ff3594f5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff3540cf650 con 0x7ff35415e670 2024-04-25T02:28:58.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.613+0000 7ff352ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3540b5180 0x7ff3540ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:58.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.613+0000 7ff352ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3540b5180 0x7ff3540ce0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46978/0 (socket says 172.21.15.67:46978) 2024-04-25T02:28:58.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.613+0000 7ff352ffd640 1 -- 172.21.15.67:0/2784354634 learned_addr learned my addr 172.21.15.67:0/2784354634 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:58.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.614+0000 7ff352ffd640 1 -- 172.21.15.67:0/2784354634 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff35415e670 msgr2=0x7ff3540b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:58.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.614+0000 7ff352ffd640 1 --2- 172.21.15.67:0/2784354634 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff35415e670 0x7ff3540b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.614+0000 7ff352ffd640 1 -- 172.21.15.67:0/2784354634 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3540d0ee0 msgr2=0x7ff3540b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:58.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.614+0000 7ff352ffd640 1 --2- 172.21.15.67:0/2784354634 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3540d0ee0 0x7ff3540b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.614+0000 7ff352ffd640 1 -- 172.21.15.67:0/2784354634 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3540ce5e0 con 0x7ff3540b5180 2024-04-25T02:28:58.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.614+0000 7ff352ffd640 1 --2- 172.21.15.67:0/2784354634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3540b5180 0x7ff3540ce0a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00c430 tx=0x7ff34c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:58.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.614+0000 7ff34b7fe640 1 -- 172.21.15.67:0/2784354634 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c0074e0 con 0x7ff3540b5180 2024-04-25T02:28:58.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.614+0000 7ff34b7fe640 1 -- 172.21.15.67:0/2784354634 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff34c0047e0 con 0x7ff3540b5180 2024-04-25T02:28:58.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.614+0000 7ff34b7fe640 1 -- 172.21.15.67:0/2784354634 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c004bd0 con 0x7ff3540b5180 2024-04-25T02:28:58.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.614+0000 7ff3594f5640 1 -- 172.21.15.67:0/2784354634 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3540b44c0 con 0x7ff3540b5180 2024-04-25T02:28:58.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.614+0000 7ff3594f5640 1 -- 172.21.15.67:0/2784354634 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3540cbc50 con 0x7ff3540b5180 2024-04-25T02:28:58.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.615+0000 7ff3594f5640 1 -- 172.21.15.67:0/2784354634 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3540681f0 con 0x7ff3540b5180 2024-04-25T02:28:58.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.615+0000 7ff34b7fe640 1 -- 172.21.15.67:0/2784354634 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff34c011070 con 0x7ff3540b5180 2024-04-25T02:28:58.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.616+0000 7ff34b7fe640 1 --2- 172.21.15.67:0/2784354634 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff33406be30 0x7ff33406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:58.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.616+0000 7ff34b7fe640 1 -- 172.21.15.67:0/2784354634 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff34c08aad0 con 0x7ff3540b5180 2024-04-25T02:28:58.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.616+0000 7ff3527fc640 1 --2- 172.21.15.67:0/2784354634 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff33406be30 0x7ff33406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:58.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.617+0000 7ff3527fc640 1 --2- 172.21.15.67:0/2784354634 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff33406be30 0x7ff33406e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff3540b28b0 tx=0x7ff33c0079b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:58.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.621+0000 7ff34b7fe640 1 -- 172.21.15.67:0/2784354634 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff34c00e280 con 0x7ff3540b5180 2024-04-25T02:28:58.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.806+0000 7ff3594f5640 1 -- 172.21.15.67:0/2784354634 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff3540d3b80 con 0x7ff3540b5180 2024-04-25T02:28:58.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.806+0000 7ff34b7fe640 1 -- 172.21.15.67:0/2784354634 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7ff34c059480 con 0x7ff3540b5180 2024-04-25T02:28:58.810 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-25T02:28:58.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.809+0000 7ff3594f5640 1 -- 172.21.15.67:0/2784354634 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff33406be30 msgr2=0x7ff33406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:58.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.809+0000 7ff3594f5640 1 --2- 172.21.15.67:0/2784354634 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff33406be30 0x7ff33406e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff3540b28b0 tx=0x7ff33c0079b0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.809+0000 7ff3594f5640 1 -- 172.21.15.67:0/2784354634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3540b5180 msgr2=0x7ff3540ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:58.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.809+0000 7ff3594f5640 1 --2- 172.21.15.67:0/2784354634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3540b5180 0x7ff3540ce0a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00c430 tx=0x7ff34c00c8f0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.809+0000 7ff3594f5640 1 -- 172.21.15.67:0/2784354634 shutdown_connections 2024-04-25T02:28:58.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.809+0000 7ff3594f5640 1 --2- 172.21.15.67:0/2784354634 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff33406be30 0x7ff33406e2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.809+0000 7ff3594f5640 1 --2- 172.21.15.67:0/2784354634 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff35415e670 0x7ff3540b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.809+0000 7ff3594f5640 1 --2- 172.21.15.67:0/2784354634 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3540d0ee0 0x7ff3540b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.809+0000 7ff3594f5640 1 --2- 172.21.15.67:0/2784354634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3540b5180 0x7ff3540ce0a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.809+0000 7ff3594f5640 1 -- 172.21.15.67:0/2784354634 >> 172.21.15.67:0/2784354634 conn(0x7ff3540d40a0 msgr2=0x7ff3540d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:58.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.809+0000 7ff3594f5640 1 -- 172.21.15.67:0/2784354634 shutdown_connections 2024-04-25T02:28:58.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.809+0000 7ff3594f5640 1 -- 172.21.15.67:0/2784354634 wait complete. 2024-04-25T02:28:58.823 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:28:58.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.922+0000 7f54c0929640 1 Processor -- start 2024-04-25T02:28:58.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.922+0000 7f54c0929640 1 -- start start 2024-04-25T02:28:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.923+0000 7f54c0929640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f54bc15e210 0x7f54bc06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.923+0000 7f54c0929640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54bc15e5f0 0x7f54bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.923+0000 7f54c0929640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f54bc0cecc0 0x7f54bc0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.923+0000 7f54c0929640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f54bc06c6f0 con 0x7f54bc0cecc0 2024-04-25T02:28:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.923+0000 7f54c0929640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f54bc0d2cc0 con 0x7f54bc15e210 2024-04-25T02:28:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.923+0000 7f54c0929640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f54bc0d2fa0 con 0x7f54bc15e5f0 2024-04-25T02:28:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.923+0000 7f54bad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f54bc0cecc0 0x7f54bc0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.923+0000 7f54bad9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f54bc0cecc0 0x7f54bc0cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46984/0 (socket says 172.21.15.67:46984) 2024-04-25T02:28:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.923+0000 7f54bad9d640 1 -- 172.21.15.67:0/1512289112 learned_addr learned my addr 172.21.15.67:0/1512289112 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.924+0000 7f54ba59c640 1 --2- 172.21.15.67:0/1512289112 >> v2:172.21.15.176:3300/0 conn(0x7f54bc15e210 0x7f54bc06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:58.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.924+0000 7f54bad9d640 1 -- 172.21.15.67:0/1512289112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54bc15e5f0 msgr2=0x7f54bc06d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:58.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.924+0000 7f54bad9d640 1 --2- 172.21.15.67:0/1512289112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54bc15e5f0 0x7f54bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.924+0000 7f54bad9d640 1 -- 172.21.15.67:0/1512289112 >> v2:172.21.15.176:3300/0 conn(0x7f54bc15e210 msgr2=0x7f54bc06cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:58.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.924+0000 7f54bad9d640 1 --2- 172.21.15.67:0/1512289112 >> v2:172.21.15.176:3300/0 conn(0x7f54bc15e210 0x7f54bc06cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.924+0000 7f54bad9d640 1 -- 172.21.15.67:0/1512289112 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54bc06c0a0 con 0x7f54bc0cecc0 2024-04-25T02:28:58.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.924+0000 7f54bad9d640 1 --2- 172.21.15.67:0/1512289112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54bc0cecc0 0x7f54bc0cf150 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0d1c90 tx=0x7f54ac02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a96cb54b9dc801 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:58.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.925+0000 7f54b959a640 1 -- 172.21.15.67:0/1512289112 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac036070 con 0x7f54bc0cecc0 2024-04-25T02:28:58.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.925+0000 7f54b959a640 1 -- 172.21.15.67:0/1512289112 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ac031600 con 0x7f54bc0cecc0 2024-04-25T02:28:58.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.925+0000 7f54b959a640 1 -- 172.21.15.67:0/1512289112 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac0319d0 con 0x7f54bc0cecc0 2024-04-25T02:28:58.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.925+0000 7f54c0929640 1 -- 172.21.15.67:0/1512289112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54bc0cecc0 msgr2=0x7f54bc0cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:58.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.925+0000 7f54c0929640 1 --2- 172.21.15.67:0/1512289112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54bc0cecc0 0x7f54bc0cf150 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0d1c90 tx=0x7f54ac02a6a0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.925+0000 7f54c0929640 1 -- 172.21.15.67:0/1512289112 shutdown_connections 2024-04-25T02:28:58.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.925+0000 7f54c0929640 1 --2- 172.21.15.67:0/1512289112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54bc0cecc0 0x7f54bc0cf150 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.925+0000 7f54c0929640 1 --2- 172.21.15.67:0/1512289112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54bc15e5f0 0x7f54bc06d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.925+0000 7f54c0929640 1 --2- 172.21.15.67:0/1512289112 >> v2:172.21.15.176:3300/0 conn(0x7f54bc15e210 0x7f54bc06cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.925+0000 7f54c0929640 1 -- 172.21.15.67:0/1512289112 >> 172.21.15.67:0/1512289112 conn(0x7f54bc08dbb0 msgr2=0x7f54bc09d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:58.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.925+0000 7f54c0929640 1 -- 172.21.15.67:0/1512289112 shutdown_connections 2024-04-25T02:28:58.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.925+0000 7f54c0929640 1 -- 172.21.15.67:0/1512289112 wait complete. 2024-04-25T02:28:58.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.927+0000 7f54c0929640 1 Processor -- start 2024-04-25T02:28:58.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.927+0000 7f54c0929640 1 -- start start 2024-04-25T02:28:58.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.927+0000 7f54c0929640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54bc0cecc0 0x7f54bc0b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:58.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.927+0000 7f54c0929640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54bc15e210 0x7f54bc153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:58.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.927+0000 7f54c0929640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54bc15e5f0 0x7f54bc0b8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:58.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.927+0000 7f54c0929640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc0d3fe0 con 0x7f54bc15e5f0 2024-04-25T02:28:58.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.927+0000 7f54c0929640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc0d3e60 con 0x7f54bc0cecc0 2024-04-25T02:28:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.927+0000 7f54c0929640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f54bc0d4160 con 0x7f54bc15e210 2024-04-25T02:28:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.928+0000 7f54bad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54bc15e5f0 0x7f54bc0b8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.928+0000 7f54bad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54bc15e5f0 0x7f54bc0b8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47000/0 (socket says 172.21.15.67:47000) 2024-04-25T02:28:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.928+0000 7f54bad9d640 1 -- 172.21.15.67:0/3732868130 learned_addr learned my addr 172.21.15.67:0/3732868130 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.928+0000 7f54b9d9b640 1 --2- 172.21.15.67:0/3732868130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54bc15e210 0x7f54bc153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.928+0000 7f54ba59c640 1 --2- 172.21.15.67:0/3732868130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54bc0cecc0 0x7f54bc0b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.928+0000 7f54bad9d640 1 -- 172.21.15.67:0/3732868130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54bc15e210 msgr2=0x7f54bc153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.928+0000 7f54bad9d640 1 --2- 172.21.15.67:0/3732868130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54bc15e210 0x7f54bc153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.928+0000 7f54bad9d640 1 -- 172.21.15.67:0/3732868130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54bc0cecc0 msgr2=0x7f54bc0b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.928+0000 7f54bad9d640 1 --2- 172.21.15.67:0/3732868130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54bc0cecc0 0x7f54bc0b6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.928+0000 7f54bad9d640 1 -- 172.21.15.67:0/3732868130 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54bc0b75d0 con 0x7f54bc15e5f0 2024-04-25T02:28:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.928+0000 7f54b9d9b640 1 --2- 172.21.15.67:0/3732868130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54bc15e210 0x7f54bc153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.928+0000 7f54ba59c640 1 --2- 172.21.15.67:0/3732868130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54bc0cecc0 0x7f54bc0b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:28:58.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.928+0000 7f54bad9d640 1 --2- 172.21.15.67:0/3732868130 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54bc15e5f0 0x7f54bc0b8670 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009f40 tx=0x7f54ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.928+0000 7f54aaffd640 1 -- 172.21.15.67:0/3732868130 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac036050 con 0x7f54bc15e5f0 2024-04-25T02:28:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.928+0000 7f54aaffd640 1 -- 172.21.15.67:0/3732868130 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ac042070 con 0x7f54bc15e5f0 2024-04-25T02:28:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.928+0000 7f54c0929640 1 -- 172.21.15.67:0/3732868130 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54bc0b78b0 con 0x7f54bc15e5f0 2024-04-25T02:28:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.928+0000 7f54aaffd640 1 -- 172.21.15.67:0/3732868130 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac009510 con 0x7f54bc15e5f0 2024-04-25T02:28:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.928+0000 7f54c0929640 1 -- 172.21.15.67:0/3732868130 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54bc0b8150 con 0x7f54bc15e5f0 2024-04-25T02:28:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.929+0000 7f54c0929640 1 -- 172.21.15.67:0/3732868130 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54bc069110 con 0x7f54bc15e5f0 2024-04-25T02:28:58.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.930+0000 7f54aaffd640 1 -- 172.21.15.67:0/3732868130 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f54ac007bd0 con 0x7f54bc15e5f0 2024-04-25T02:28:58.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.930+0000 7f54aaffd640 1 --2- 172.21.15.67:0/3732868130 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f549c06be60 0x7f549c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:58.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.930+0000 7f54aaffd640 1 -- 172.21.15.67:0/3732868130 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f54ac0abd30 con 0x7f54bc15e5f0 2024-04-25T02:28:58.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.930+0000 7f54ba59c640 1 --2- 172.21.15.67:0/3732868130 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f549c06be60 0x7f549c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:58.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.931+0000 7f54ba59c640 1 --2- 172.21.15.67:0/3732868130 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f549c06be60 0x7f549c06e320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f54b400a9d0 tx=0x7f54b4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:58.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:58.934+0000 7f54aaffd640 1 -- 172.21.15.67:0/3732868130 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f54ac07a770 con 0x7f54bc15e5f0 2024-04-25T02:28:59.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.131+0000 7f54c0929640 1 -- 172.21.15.67:0/3732868130 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f54bc06be80 con 0x7f54bc15e5f0 2024-04-25T02:28:59.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.131+0000 7f54aaffd640 1 -- 172.21.15.67:0/3732868130 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f54ac07a070 con 0x7f54bc15e5f0 2024-04-25T02:28:59.134 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-04-25T02:28:59.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.133+0000 7f54c0929640 1 -- 172.21.15.67:0/3732868130 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f549c06be60 msgr2=0x7f549c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:59.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.133+0000 7f54c0929640 1 --2- 172.21.15.67:0/3732868130 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f549c06be60 0x7f549c06e320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f54b400a9d0 tx=0x7f54b4008040 comp rx=0 tx=0).stop 2024-04-25T02:28:59.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.133+0000 7f54c0929640 1 -- 172.21.15.67:0/3732868130 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54bc15e5f0 msgr2=0x7f54bc0b8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:59.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.133+0000 7f54c0929640 1 --2- 172.21.15.67:0/3732868130 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54bc15e5f0 0x7f54bc0b8670 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009f40 tx=0x7f54ac004a40 comp rx=0 tx=0).stop 2024-04-25T02:28:59.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.133+0000 7f54c0929640 1 -- 172.21.15.67:0/3732868130 shutdown_connections 2024-04-25T02:28:59.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.133+0000 7f54c0929640 1 --2- 172.21.15.67:0/3732868130 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f549c06be60 0x7f549c06e320 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.133+0000 7f54c0929640 1 --2- 172.21.15.67:0/3732868130 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54bc15e5f0 0x7f54bc0b8670 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.133+0000 7f54c0929640 1 --2- 172.21.15.67:0/3732868130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54bc15e210 0x7f54bc153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.133+0000 7f54c0929640 1 --2- 172.21.15.67:0/3732868130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54bc0cecc0 0x7f54bc0b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.133+0000 7f54c0929640 1 -- 172.21.15.67:0/3732868130 >> 172.21.15.67:0/3732868130 conn(0x7f54bc08dbb0 msgr2=0x7f54bc15f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:59.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.133+0000 7f54c0929640 1 -- 172.21.15.67:0/3732868130 shutdown_connections 2024-04-25T02:28:59.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.133+0000 7f54c0929640 1 -- 172.21.15.67:0/3732868130 wait complete. 2024-04-25T02:28:59.147 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:28:59.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:59.147 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-25T02:28:59.173 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-04-25T02:28:59.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:59.173 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:28:59.235 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:28:59.235 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:28:59.253 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:28:59.253 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:28:59.312 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:28:59.312 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:28:59.371 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:59.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.468+0000 7f87d649e640 1 Processor -- start 2024-04-25T02:28:59.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.468+0000 7f87d649e640 1 -- start start 2024-04-25T02:28:59.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.469+0000 7f87d649e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f87d00b3cd0 0x7f87d0165fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:59.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.469+0000 7f87d649e640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87d015fa90 con 0x7f87d0070df0 2024-04-25T02:28:59.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.469+0000 7f87d649e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87d00713d0 con 0x7f87d015b220 2024-04-25T02:28:59.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.469+0000 7f87d649e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f87d00aee00 con 0x7f87d00b3cd0 2024-04-25T02:28:59.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.469+0000 7f87cf7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f87d0070df0 0x7f87d015f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55894/0 (socket says 172.21.15.67:55894) 2024-04-25T02:28:59.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.469+0000 7f87cf7fe640 1 -- 172.21.15.67:0/221598820 learned_addr learned my addr 172.21.15.67:0/221598820 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:28:59.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.469+0000 7f87d4a3b640 1 --2- 172.21.15.67:0/221598820 >> v2:172.21.15.176:3300/0 conn(0x7f87d00b3cd0 0x7f87d0165fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:59.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.469+0000 7f87ceffd640 1 -- 172.21.15.67:0/221598820 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1099215818 0 0) 0x7f87d015fa90 con 0x7f87d0070df0 2024-04-25T02:28:59.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.469+0000 7f87ceffd640 1 -- 172.21.15.67:0/221598820 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87bc003520 con 0x7f87d0070df0 2024-04-25T02:28:59.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87ceffd640 1 -- 172.21.15.67:0/221598820 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 570522786 0 0) 0x7f87bc003520 con 0x7f87d0070df0 2024-04-25T02:28:59.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87ceffd640 1 -- 172.21.15.67:0/221598820 >> v2:172.21.15.176:3300/0 conn(0x7f87d00b3cd0 msgr2=0x7f87d0165fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:59.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87ceffd640 1 --2- 172.21.15.67:0/221598820 >> v2:172.21.15.176:3300/0 conn(0x7f87d00b3cd0 0x7f87d0165fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87ceffd640 1 -- 172.21.15.67:0/221598820 >> v1:172.21.15.176:6789/0 conn(0x7f87d015b220 legacy=0x7f87d015ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:59.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87ceffd640 1 -- 172.21.15.67:0/221598820 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d00ae4d0 con 0x7f87d0070df0 2024-04-25T02:28:59.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87ceffd640 1 -- 172.21.15.67:0/221598820 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f87c0001670 con 0x7f87d0070df0 2024-04-25T02:28:59.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87ceffd640 1 -- 172.21.15.67:0/221598820 >> v1:172.21.15.67:6789/0 conn(0x7f87d0070df0 legacy=0x7f87d015f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:59.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87ceffd640 1 --2- 172.21.15.67:0/221598820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87bc0039b0 0x7f87bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:59.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87ceffd640 1 --2- 172.21.15.67:0/221598820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87bc004800 0x7f87bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:59.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87ceffd640 1 --2- 172.21.15.67:0/221598820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87bc0051c0 0x7f87bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:59.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87ceffd640 1 -- 172.21.15.67:0/221598820 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f87d00aee00 con 0x7f87bc0051c0 2024-04-25T02:28:59.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87ceffd640 1 -- 172.21.15.67:0/221598820 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f87bc00c060 con 0x7f87bc0039b0 2024-04-25T02:28:59.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87ceffd640 1 -- 172.21.15.67:0/221598820 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f87bc00c260 con 0x7f87bc004800 2024-04-25T02:28:59.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87cffff640 1 --2- 172.21.15.67:0/221598820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87bc0039b0 0x7f87bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:59.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87d4a3b640 1 --2- 172.21.15.67:0/221598820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87bc0051c0 0x7f87bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:59.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87cf7fe640 1 --2- 172.21.15.67:0/221598820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87bc004800 0x7f87bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:59.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87d4a3b640 1 -- 172.21.15.67:0/221598820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87bc004800 msgr2=0x7f87bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:59.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87d4a3b640 1 --2- 172.21.15.67:0/221598820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87bc004800 0x7f87bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87d4a3b640 1 -- 172.21.15.67:0/221598820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87bc0039b0 msgr2=0x7f87bc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:59.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87d4a3b640 1 --2- 172.21.15.67:0/221598820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87bc0039b0 0x7f87bc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87d4a3b640 1 -- 172.21.15.67:0/221598820 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87bc003520 con 0x7f87bc0051c0 2024-04-25T02:28:59.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.470+0000 7f87cffff640 1 --2- 172.21.15.67:0/221598820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87bc0039b0 0x7f87bc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:59.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.471+0000 7f87d4a3b640 1 -- 172.21.15.67:0/221598820 reap_dead start 2024-04-25T02:28:59.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.471+0000 7f87d4a3b640 1 --2- 172.21.15.67:0/221598820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87bc0051c0 0x7f87bc00b9c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f87c8009bd0 tx=0x7f87bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54de67dd5771bc2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:59.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.471+0000 7f87ceffd640 1 -- 172.21.15.67:0/221598820 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b8001370 con 0x7f87bc0051c0 2024-04-25T02:28:59.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.471+0000 7f87ceffd640 1 -- 172.21.15.67:0/221598820 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87c8003b90 con 0x7f87bc0051c0 2024-04-25T02:28:59.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.471+0000 7f87ceffd640 1 -- 172.21.15.67:0/221598820 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c8009c10 con 0x7f87bc0051c0 2024-04-25T02:28:59.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.472+0000 7f87d649e640 1 -- 172.21.15.67:0/221598820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87bc0051c0 msgr2=0x7f87bc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:59.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.472+0000 7f87d649e640 1 --2- 172.21.15.67:0/221598820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87bc0051c0 0x7f87bc00b9c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f87c8009bd0 tx=0x7f87bc005830 comp rx=0 tx=0).stop 2024-04-25T02:28:59.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.472+0000 7f87d649e640 1 -- 172.21.15.67:0/221598820 shutdown_connections 2024-04-25T02:28:59.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.472+0000 7f87d649e640 1 --2- 172.21.15.67:0/221598820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87bc0051c0 0x7f87bc00b9c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.472+0000 7f87d649e640 1 -- 172.21.15.67:0/221598820 >> 172.21.15.67:0/221598820 conn(0x7f87d00b19c0 msgr2=0x7f87d00b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:59.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.472+0000 7f87d649e640 1 -- 172.21.15.67:0/221598820 shutdown_connections 2024-04-25T02:28:59.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.472+0000 7f87d649e640 1 -- 172.21.15.67:0/221598820 wait complete. 2024-04-25T02:28:59.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.473+0000 7f87d649e640 1 Processor -- start 2024-04-25T02:28:59.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.473+0000 7f87d649e640 1 -- start start 2024-04-25T02:28:59.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87d649e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87bc0051c0 0x7f87d00b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:59.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87d649e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87d01f0500 0x7f87d01f0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:59.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87d649e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87d014e5f0 0x7f87d014ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:59.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87d649e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f87d006eb90 con 0x7f87d014e5f0 2024-04-25T02:28:59.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87d649e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f87d00aea90 con 0x7f87bc0051c0 2024-04-25T02:28:59.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87d649e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f87d006ed10 con 0x7f87d01f0500 2024-04-25T02:28:59.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87d4a3b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87d014e5f0 0x7f87d014ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:59.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87d4a3b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87d014e5f0 0x7f87d014ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47012/0 (socket says 172.21.15.67:47012) 2024-04-25T02:28:59.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87d4a3b640 1 -- 172.21.15.67:0/13126628 learned_addr learned my addr 172.21.15.67:0/13126628 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:59.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87cffff640 1 --2- 172.21.15.67:0/13126628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87bc0051c0 0x7f87d00b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:59.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87cf7fe640 1 --2- 172.21.15.67:0/13126628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87d01f0500 0x7f87d01f0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:59.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87d4a3b640 1 -- 172.21.15.67:0/13126628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87d01f0500 msgr2=0x7f87d01f0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:59.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87d4a3b640 1 --2- 172.21.15.67:0/13126628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87d01f0500 0x7f87d01f0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87d4a3b640 1 -- 172.21.15.67:0/13126628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87bc0051c0 msgr2=0x7f87d00b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:59.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87d4a3b640 1 --2- 172.21.15.67:0/13126628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87bc0051c0 0x7f87d00b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87d4a3b640 1 -- 172.21.15.67:0/13126628 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d014efb0 con 0x7f87d014e5f0 2024-04-25T02:28:59.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87cffff640 1 --2- 172.21.15.67:0/13126628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87bc0051c0 0x7f87d00b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:59.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87cf7fe640 1 --2- 172.21.15.67:0/13126628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87d01f0500 0x7f87d01f0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:59.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.474+0000 7f87d4a3b640 1 --2- 172.21.15.67:0/13126628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87d014e5f0 0x7f87d014ea70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f87c802d0f0 tx=0x7f87c8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:59.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.475+0000 7f87ccff9640 1 -- 172.21.15.67:0/13126628 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c8048070 con 0x7f87d014e5f0 2024-04-25T02:28:59.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.475+0000 7f87ccff9640 1 -- 172.21.15.67:0/13126628 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87c8003990 con 0x7f87d014e5f0 2024-04-25T02:28:59.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.475+0000 7f87d649e640 1 -- 172.21.15.67:0/13126628 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87d01f1040 con 0x7f87d014e5f0 2024-04-25T02:28:59.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.475+0000 7f87ccff9640 1 -- 172.21.15.67:0/13126628 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c8009c10 con 0x7f87d014e5f0 2024-04-25T02:28:59.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.475+0000 7f87d649e640 1 -- 172.21.15.67:0/13126628 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87d009ac80 con 0x7f87d014e5f0 2024-04-25T02:28:59.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.476+0000 7f87d649e640 1 -- 172.21.15.67:0/13126628 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87d00689f0 con 0x7f87d014e5f0 2024-04-25T02:28:59.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.476+0000 7f87ccff9640 1 -- 172.21.15.67:0/13126628 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f87c804b070 con 0x7f87d014e5f0 2024-04-25T02:28:59.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.476+0000 7f87ccff9640 1 --2- 172.21.15.67:0/13126628 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f87b006be30 0x7f87b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:59.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.477+0000 7f87ccff9640 1 -- 172.21.15.67:0/13126628 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f87c80ad1f0 con 0x7f87d014e5f0 2024-04-25T02:28:59.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.477+0000 7f87cffff640 1 --2- 172.21.15.67:0/13126628 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f87b006be30 0x7f87b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:59.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.477+0000 7f87cffff640 1 --2- 172.21.15.67:0/13126628 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f87b006be30 0x7f87b006e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f87b8005580 tx=0x7f87b8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:59.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.481+0000 7f87ccff9640 1 -- 172.21.15.67:0/13126628 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f87d00689f0 con 0x7f87d014e5f0 2024-04-25T02:28:59.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.666+0000 7f87d649e640 1 -- 172.21.15.67:0/13126628 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87d0069110 con 0x7f87d014e5f0 2024-04-25T02:28:59.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.667+0000 7f87ccff9640 1 -- 172.21.15.67:0/13126628 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f87c8034030 con 0x7f87d014e5f0 2024-04-25T02:28:59.671 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:28:59.671 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:27.819641+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:59.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.670+0000 7f87d649e640 1 -- 172.21.15.67:0/13126628 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f87b006be30 msgr2=0x7f87b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:59.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.670+0000 7f87d649e640 1 --2- 172.21.15.67:0/13126628 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f87b006be30 0x7f87b006e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f87b8005580 tx=0x7f87b8009040 comp rx=0 tx=0).stop 2024-04-25T02:28:59.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.670+0000 7f87d649e640 1 -- 172.21.15.67:0/13126628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87d014e5f0 msgr2=0x7f87d014ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:59.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.670+0000 7f87d649e640 1 --2- 172.21.15.67:0/13126628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87d014e5f0 0x7f87d014ea70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f87c802d0f0 tx=0x7f87c8009750 comp rx=0 tx=0).stop 2024-04-25T02:28:59.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.670+0000 7f87d649e640 1 -- 172.21.15.67:0/13126628 shutdown_connections 2024-04-25T02:28:59.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.670+0000 7f87d649e640 1 --2- 172.21.15.67:0/13126628 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f87b006be30 0x7f87b006e2f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.670+0000 7f87d649e640 1 --2- 172.21.15.67:0/13126628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87d014e5f0 0x7f87d014ea70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.670+0000 7f87d649e640 1 --2- 172.21.15.67:0/13126628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87d01f0500 0x7f87d01f0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.670+0000 7f87d649e640 1 --2- 172.21.15.67:0/13126628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87bc0051c0 0x7f87d00b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.670+0000 7f87d649e640 1 -- 172.21.15.67:0/13126628 >> 172.21.15.67:0/13126628 conn(0x7f87d00b19c0 msgr2=0x7f87d00cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:59.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.670+0000 7f87d649e640 1 -- 172.21.15.67:0/13126628 shutdown_connections 2024-04-25T02:28:59.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.670+0000 7f87d649e640 1 -- 172.21.15.67:0/13126628 wait complete. 2024-04-25T02:28:59.684 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:28:24.445606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:28:25.161619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:28:59.684 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:28:59.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.784+0000 7f6d0326b640 1 Processor -- start 2024-04-25T02:28:59.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.785+0000 7f6d0326b640 1 -- start start 2024-04-25T02:28:59.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.785+0000 7f6d0326b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6cfc0d0a00 0x7f6cfc06b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:59.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.785+0000 7f6d0326b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cfc06b7a0 con 0x7f6cfc071e70 2024-04-25T02:28:59.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.785+0000 7f6d0326b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cfc06ba80 con 0x7f6cfc0cd1d0 2024-04-25T02:28:59.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.785+0000 7f6d0326b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6cfc06c040 con 0x7f6cfc0d0a00 2024-04-25T02:28:59.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.786+0000 7f6d01007640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6cfc0d0a00 0x7f6cfc06b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:59.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.786+0000 7f6d01007640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6cfc0d0a00 0x7f6cfc06b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47026/0 (socket says 172.21.15.67:47026) 2024-04-25T02:28:59.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.786+0000 7f6d01007640 1 -- 172.21.15.67:0/1657313470 learned_addr learned my addr 172.21.15.67:0/1657313470 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:59.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.786+0000 7f6d01808640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6cfc071e70 0x7f6cfc06f2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55906/0 (socket says 172.21.15.67:55906) 2024-04-25T02:28:59.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.786+0000 7f6d01007640 1 -- 172.21.15.67:0/1657313470 >> v1:172.21.15.176:6789/0 conn(0x7f6cfc0cd1d0 legacy=0x7f6cfc0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:59.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.786+0000 7f6d01007640 1 -- 172.21.15.67:0/1657313470 >> v1:172.21.15.67:6789/0 conn(0x7f6cfc071e70 legacy=0x7f6cfc06f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:59.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.786+0000 7f6d01007640 1 -- 172.21.15.67:0/1657313470 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc06bd60 con 0x7f6cfc0d0a00 2024-04-25T02:28:59.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.787+0000 7f6d01007640 1 --2- 172.21.15.67:0/1657313470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cfc0d0a00 0x7f6cfc06b0c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8009870 tx=0x7f6cf802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb191a3b8db16884 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:59.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.787+0000 7f6cf3fff640 1 -- 172.21.15.67:0/1657313470 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8037070 con 0x7f6cfc0d0a00 2024-04-25T02:28:59.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.787+0000 7f6cf3fff640 1 -- 172.21.15.67:0/1657313470 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf8032440 con 0x7f6cfc0d0a00 2024-04-25T02:28:59.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.787+0000 7f6cf3fff640 1 -- 172.21.15.67:0/1657313470 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8032810 con 0x7f6cfc0d0a00 2024-04-25T02:28:59.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.787+0000 7f6d0326b640 1 -- 172.21.15.67:0/1657313470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cfc0d0a00 msgr2=0x7f6cfc06b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:59.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.787+0000 7f6d0326b640 1 --2- 172.21.15.67:0/1657313470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cfc0d0a00 0x7f6cfc06b0c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8009870 tx=0x7f6cf802a2a0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.787+0000 7f6d0326b640 1 -- 172.21.15.67:0/1657313470 shutdown_connections 2024-04-25T02:28:59.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.787+0000 7f6d0326b640 1 --2- 172.21.15.67:0/1657313470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cfc0d0a00 0x7f6cfc06b0c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.787+0000 7f6d0326b640 1 -- 172.21.15.67:0/1657313470 >> 172.21.15.67:0/1657313470 conn(0x7f6cfc0d0e20 msgr2=0x7f6cfc0d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:59.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.787+0000 7f6d0326b640 1 -- 172.21.15.67:0/1657313470 shutdown_connections 2024-04-25T02:28:59.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.787+0000 7f6d0326b640 1 -- 172.21.15.67:0/1657313470 wait complete. 2024-04-25T02:28:59.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.788+0000 7f6d0326b640 1 Processor -- start 2024-04-25T02:28:59.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.788+0000 7f6d0326b640 1 -- start start 2024-04-25T02:28:59.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.789+0000 7f6d0326b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cfc071e70 0x7f6cfc1e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:59.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.789+0000 7f6d0326b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cfc0cd1d0 0x7f6cfc1e95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:59.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.789+0000 7f6d0326b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6cfc0d0a00 0x7f6cfc0af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:59.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.789+0000 7f6d0326b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc0cd660 con 0x7f6cfc071e70 2024-04-25T02:28:59.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.789+0000 7f6d0326b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc0cef50 con 0x7f6cfc0cd1d0 2024-04-25T02:28:59.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.789+0000 7f6d0326b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6cfc06fa00 con 0x7f6cfc0d0a00 2024-04-25T02:28:59.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.789+0000 7f6d01007640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cfc071e70 0x7f6cfc1e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:59.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.789+0000 7f6d01007640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cfc071e70 0x7f6cfc1e6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47036/0 (socket says 172.21.15.67:47036) 2024-04-25T02:28:59.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.789+0000 7f6d01007640 1 -- 172.21.15.67:0/4222614051 learned_addr learned my addr 172.21.15.67:0/4222614051 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:28:59.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.789+0000 7f6d01808640 1 --2- 172.21.15.67:0/4222614051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6cfc0d0a00 0x7f6cfc0af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:59.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.790+0000 7f6d00806640 1 --2- 172.21.15.67:0/4222614051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cfc0cd1d0 0x7f6cfc1e95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:59.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.790+0000 7f6d01007640 1 -- 172.21.15.67:0/4222614051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6cfc0d0a00 msgr2=0x7f6cfc0af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:59.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.790+0000 7f6d01007640 1 --2- 172.21.15.67:0/4222614051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6cfc0d0a00 0x7f6cfc0af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.790+0000 7f6d01007640 1 -- 172.21.15.67:0/4222614051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cfc0cd1d0 msgr2=0x7f6cfc1e95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:59.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.790+0000 7f6d01007640 1 --2- 172.21.15.67:0/4222614051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cfc0cd1d0 0x7f6cfc1e95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.790+0000 7f6d01007640 1 -- 172.21.15.67:0/4222614051 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc149790 con 0x7f6cfc071e70 2024-04-25T02:28:59.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.790+0000 7f6d00806640 1 --2- 172.21.15.67:0/4222614051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cfc0cd1d0 0x7f6cfc1e95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:28:59.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.790+0000 7f6d01007640 1 --2- 172.21.15.67:0/4222614051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cfc071e70 0x7f6cfc1e6c90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6cf802a2e0 tx=0x7f6cf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:59.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.790+0000 7f6cf1ffb640 1 -- 172.21.15.67:0/4222614051 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8037040 con 0x7f6cfc071e70 2024-04-25T02:28:59.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.790+0000 7f6cf1ffb640 1 -- 172.21.15.67:0/4222614051 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf8042070 con 0x7f6cfc071e70 2024-04-25T02:28:59.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.790+0000 7f6d0326b640 1 -- 172.21.15.67:0/4222614051 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cfc149a70 con 0x7f6cfc071e70 2024-04-25T02:28:59.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.790+0000 7f6cf1ffb640 1 -- 172.21.15.67:0/4222614051 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8030bd0 con 0x7f6cfc071e70 2024-04-25T02:28:59.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.790+0000 7f6d0326b640 1 -- 172.21.15.67:0/4222614051 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cfc14a030 con 0x7f6cfc071e70 2024-04-25T02:28:59.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.791+0000 7f6d0326b640 1 -- 172.21.15.67:0/4222614051 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cfc067e40 con 0x7f6cfc071e70 2024-04-25T02:28:59.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.791+0000 7f6cf1ffb640 1 -- 172.21.15.67:0/4222614051 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6cf8047460 con 0x7f6cfc071e70 2024-04-25T02:28:59.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.792+0000 7f6cf1ffb640 1 --2- 172.21.15.67:0/4222614051 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6ce006be60 0x7f6ce006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:59.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.792+0000 7f6cf1ffb640 1 -- 172.21.15.67:0/4222614051 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6cf80aba50 con 0x7f6cfc071e70 2024-04-25T02:28:59.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.792+0000 7f6d00806640 1 --2- 172.21.15.67:0/4222614051 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6ce006be60 0x7f6ce006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:59.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.793+0000 7f6d00806640 1 --2- 172.21.15.67:0/4222614051 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6ce006be60 0x7f6ce006e320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0af580 tx=0x7f6cec009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:59.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.796+0000 7f6cf1ffb640 1 -- 172.21.15.67:0/4222614051 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6cf8045360 con 0x7f6cfc071e70 2024-04-25T02:28:59.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.980+0000 7f6d0326b640 1 -- 172.21.15.67:0/4222614051 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6cfc069110 con 0x7f6cfc071e70 2024-04-25T02:28:59.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.980+0000 7f6cf1ffb640 1 -- 172.21.15.67:0/4222614051 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f6cf807a400 con 0x7f6cfc071e70 2024-04-25T02:28:59.983 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:28:59.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.982+0000 7f6d0326b640 1 -- 172.21.15.67:0/4222614051 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6ce006be60 msgr2=0x7f6ce006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:59.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.982+0000 7f6d0326b640 1 --2- 172.21.15.67:0/4222614051 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6ce006be60 0x7f6ce006e320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0af580 tx=0x7f6cec009040 comp rx=0 tx=0).stop 2024-04-25T02:28:59.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.982+0000 7f6d0326b640 1 -- 172.21.15.67:0/4222614051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cfc071e70 msgr2=0x7f6cfc1e6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:59.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.982+0000 7f6d0326b640 1 --2- 172.21.15.67:0/4222614051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cfc071e70 0x7f6cfc1e6c90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6cf802a2e0 tx=0x7f6cf80046c0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.982+0000 7f6d0326b640 1 -- 172.21.15.67:0/4222614051 shutdown_connections 2024-04-25T02:28:59.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.982+0000 7f6d0326b640 1 --2- 172.21.15.67:0/4222614051 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6ce006be60 0x7f6ce006e320 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.982+0000 7f6d0326b640 1 --2- 172.21.15.67:0/4222614051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6cfc0d0a00 0x7f6cfc0af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.982+0000 7f6d0326b640 1 --2- 172.21.15.67:0/4222614051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cfc0cd1d0 0x7f6cfc1e95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.982+0000 7f6d0326b640 1 --2- 172.21.15.67:0/4222614051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cfc071e70 0x7f6cfc1e6c90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:59.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.982+0000 7f6d0326b640 1 -- 172.21.15.67:0/4222614051 >> 172.21.15.67:0/4222614051 conn(0x7f6cfc0d0e20 msgr2=0x7f6cfc06de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:59.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.982+0000 7f6d0326b640 1 -- 172.21.15.67:0/4222614051 shutdown_connections 2024-04-25T02:28:59.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:28:59.982+0000 7f6d0326b640 1 -- 172.21.15.67:0/4222614051 wait complete. 2024-04-25T02:28:59.996 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:29:00.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.096+0000 7fafec102640 1 Processor -- start 2024-04-25T02:29:00.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.096+0000 7fafec102640 1 -- start start 2024-04-25T02:29:00.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.097+0000 7fafec102640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fafe415b090 0x7fafe409db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.097+0000 7fafec102640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fafe40b2cc0 0x7fafe406e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.097+0000 7fafec102640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafe40ad820 con 0x7fafe406ea70 2024-04-25T02:29:00.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.097+0000 7fafec102640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fafe406eea0 con 0x7fafe415b090 2024-04-25T02:29:00.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.097+0000 7fafec102640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fafe40b3260 con 0x7fafe40b2cc0 2024-04-25T02:29:00.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.097+0000 7fafe9e9e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fafe415b090 0x7fafe409db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.097+0000 7fafe9e9e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fafe415b090 0x7fafe409db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47038/0 (socket says 172.21.15.67:47038) 2024-04-25T02:29:00.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.097+0000 7fafe9e9e640 1 -- 172.21.15.67:0/2833765591 learned_addr learned my addr 172.21.15.67:0/2833765591 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:00.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.097+0000 7fafe9e9e640 1 -- 172.21.15.67:0/2833765591 >> v2:172.21.15.176:3300/0 conn(0x7fafe40b2cc0 msgr2=0x7fafe406e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:00.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.097+0000 7fafe9e9e640 1 --2- 172.21.15.67:0/2833765591 >> v2:172.21.15.176:3300/0 conn(0x7fafe40b2cc0 0x7fafe406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.097+0000 7fafe9e9e640 1 -- 172.21.15.67:0/2833765591 >> v1:172.21.15.176:6789/0 conn(0x7fafe406ea70 legacy=0x7fafe415ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:00.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.097+0000 7fafe9e9e640 1 -- 172.21.15.67:0/2833765591 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe40b3540 con 0x7fafe415b090 2024-04-25T02:29:00.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.098+0000 7fafe9e9e640 1 --2- 172.21.15.67:0/2833765591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafe415b090 0x7fafe409db30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fafe4070980 tx=0x7fafe002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b48eef0d586295 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:00.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.098+0000 7fafe8e9c640 1 -- 172.21.15.67:0/2833765591 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe0037070 con 0x7fafe415b090 2024-04-25T02:29:00.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.098+0000 7fafe8e9c640 1 -- 172.21.15.67:0/2833765591 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe0032440 con 0x7fafe415b090 2024-04-25T02:29:00.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.098+0000 7fafe8e9c640 1 -- 172.21.15.67:0/2833765591 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe0032810 con 0x7fafe415b090 2024-04-25T02:29:00.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.099+0000 7fafec102640 1 -- 172.21.15.67:0/2833765591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafe415b090 msgr2=0x7fafe409db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.099+0000 7fafec102640 1 --2- 172.21.15.67:0/2833765591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafe415b090 0x7fafe409db30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fafe4070980 tx=0x7fafe002a230 comp rx=0 tx=0).stop 2024-04-25T02:29:00.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.099+0000 7fafec102640 1 -- 172.21.15.67:0/2833765591 shutdown_connections 2024-04-25T02:29:00.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.099+0000 7fafec102640 1 --2- 172.21.15.67:0/2833765591 >> v2:172.21.15.176:3300/0 conn(0x7fafe40b2cc0 0x7fafe406e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.099+0000 7fafec102640 1 --2- 172.21.15.67:0/2833765591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafe415b090 0x7fafe409db30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.099+0000 7fafec102640 1 -- 172.21.15.67:0/2833765591 >> 172.21.15.67:0/2833765591 conn(0x7fafe40b19c0 msgr2=0x7fafe40b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:00.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.099+0000 7fafec102640 1 -- 172.21.15.67:0/2833765591 shutdown_connections 2024-04-25T02:29:00.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.099+0000 7fafec102640 1 -- 172.21.15.67:0/2833765591 wait complete. 2024-04-25T02:29:00.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.100+0000 7fafec102640 1 Processor -- start 2024-04-25T02:29:00.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.100+0000 7fafec102640 1 -- start start 2024-04-25T02:29:00.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafec102640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafe406ea70 0x7fafe4148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafec102640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe40b2cc0 0x7fafe415c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafec102640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafe415b090 0x7fafe409d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafec102640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fafe40b4f70 con 0x7fafe415b090 2024-04-25T02:29:00.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafec102640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fafe40b3b00 con 0x7fafe40b2cc0 2024-04-25T02:29:00.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafec102640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fafe415b470 con 0x7fafe406ea70 2024-04-25T02:29:00.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafea69f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafe415b090 0x7fafe409d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafea69f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafe415b090 0x7fafe409d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47046/0 (socket says 172.21.15.67:47046) 2024-04-25T02:29:00.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafea69f640 1 -- 172.21.15.67:0/2412733310 learned_addr learned my addr 172.21.15.67:0/2412733310 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:00.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafe9e9e640 1 --2- 172.21.15.67:0/2412733310 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafe406ea70 0x7fafe4148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafe969d640 1 --2- 172.21.15.67:0/2412733310 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe40b2cc0 0x7fafe415c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafea69f640 1 -- 172.21.15.67:0/2412733310 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafe406ea70 msgr2=0x7fafe4148800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafea69f640 1 --2- 172.21.15.67:0/2412733310 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafe406ea70 0x7fafe4148800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafea69f640 1 -- 172.21.15.67:0/2412733310 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe40b2cc0 msgr2=0x7fafe415c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafea69f640 1 --2- 172.21.15.67:0/2412733310 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe40b2cc0 0x7fafe415c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafea69f640 1 -- 172.21.15.67:0/2412733310 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe415ce70 con 0x7fafe415b090 2024-04-25T02:29:00.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafe9e9e640 1 --2- 172.21.15.67:0/2412733310 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafe406ea70 0x7fafe4148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:00.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafe969d640 1 --2- 172.21.15.67:0/2412733310 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe40b2cc0 0x7fafe415c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:00.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.101+0000 7fafea69f640 1 --2- 172.21.15.67:0/2412733310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafe415b090 0x7fafe409d2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00c780 tx=0x7fafdc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:00.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.102+0000 7fafda7fc640 1 -- 172.21.15.67:0/2412733310 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc017070 con 0x7fafe415b090 2024-04-25T02:29:00.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.102+0000 7fafda7fc640 1 -- 172.21.15.67:0/2412733310 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafdc003da0 con 0x7fafe415b090 2024-04-25T02:29:00.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.102+0000 7fafec102640 1 -- 172.21.15.67:0/2412733310 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafe415d150 con 0x7fafe415b090 2024-04-25T02:29:00.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.102+0000 7fafda7fc640 1 -- 172.21.15.67:0/2412733310 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0052b0 con 0x7fafe415b090 2024-04-25T02:29:00.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.102+0000 7fafec102640 1 -- 172.21.15.67:0/2412733310 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafe415d430 con 0x7fafe415b090 2024-04-25T02:29:00.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.103+0000 7fafec102640 1 -- 172.21.15.67:0/2412733310 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafe4069110 con 0x7fafe415b090 2024-04-25T02:29:00.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.103+0000 7fafda7fc640 1 -- 172.21.15.67:0/2412733310 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fafdc005450 con 0x7fafe415b090 2024-04-25T02:29:00.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.103+0000 7fafda7fc640 1 --2- 172.21.15.67:0/2412733310 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fafc806be30 0x7fafc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.104+0000 7fafda7fc640 1 -- 172.21.15.67:0/2412733310 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fafdc08a4c0 con 0x7fafe415b090 2024-04-25T02:29:00.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.104+0000 7fafe9e9e640 1 --2- 172.21.15.67:0/2412733310 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fafc806be30 0x7fafc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.104+0000 7fafe9e9e640 1 --2- 172.21.15.67:0/2412733310 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fafc806be30 0x7fafc806e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fafe0034000 tx=0x7fafe002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:00.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.108+0000 7fafda7fc640 1 -- 172.21.15.67:0/2412733310 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fafdc058df0 con 0x7fafe415b090 2024-04-25T02:29:00.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.289+0000 7fafec102640 1 -- 172.21.15.67:0/2412733310 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fafe40d0530 con 0x7fafe415b090 2024-04-25T02:29:00.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.290+0000 7fafda7fc640 1 -- 172.21.15.67:0/2412733310 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fafdc0586f0 con 0x7fafe415b090 2024-04-25T02:29:00.293 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-25T02:29:00.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.292+0000 7fafec102640 1 -- 172.21.15.67:0/2412733310 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fafc806be30 msgr2=0x7fafc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.292+0000 7fafec102640 1 --2- 172.21.15.67:0/2412733310 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fafc806be30 0x7fafc806e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fafe0034000 tx=0x7fafe002e000 comp rx=0 tx=0).stop 2024-04-25T02:29:00.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.292+0000 7fafec102640 1 -- 172.21.15.67:0/2412733310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafe415b090 msgr2=0x7fafe409d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.292+0000 7fafec102640 1 --2- 172.21.15.67:0/2412733310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafe415b090 0x7fafe409d2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00c780 tx=0x7fafdc00cc40 comp rx=0 tx=0).stop 2024-04-25T02:29:00.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.292+0000 7fafec102640 1 -- 172.21.15.67:0/2412733310 shutdown_connections 2024-04-25T02:29:00.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.292+0000 7fafec102640 1 --2- 172.21.15.67:0/2412733310 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fafc806be30 0x7fafc806e2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.292+0000 7fafec102640 1 --2- 172.21.15.67:0/2412733310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafe415b090 0x7fafe409d2f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.292+0000 7fafec102640 1 --2- 172.21.15.67:0/2412733310 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe40b2cc0 0x7fafe415c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.292+0000 7fafec102640 1 --2- 172.21.15.67:0/2412733310 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafe406ea70 0x7fafe4148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.292+0000 7fafec102640 1 -- 172.21.15.67:0/2412733310 >> 172.21.15.67:0/2412733310 conn(0x7fafe40b19c0 msgr2=0x7fafe40715e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:00.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.292+0000 7fafec102640 1 -- 172.21.15.67:0/2412733310 shutdown_connections 2024-04-25T02:29:00.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.292+0000 7fafec102640 1 -- 172.21.15.67:0/2412733310 wait complete. 2024-04-25T02:29:00.306 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:29:00.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.407+0000 7fa5980a5640 1 Processor -- start 2024-04-25T02:29:00.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.407+0000 7fa5980a5640 1 -- start start 2024-04-25T02:29:00.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.408+0000 7fa5980a5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa5900aeff0 0x7fa59015cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.408+0000 7fa5980a5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa59006d100 con 0x7fa59006edf0 2024-04-25T02:29:00.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.408+0000 7fa5980a5640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5900acda0 con 0x7fa590156620 2024-04-25T02:29:00.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.408+0000 7fa5980a5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa5900ad060 con 0x7fa5900aeff0 2024-04-25T02:29:00.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.408+0000 7fa596642640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa5900aeff0 0x7fa59015cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.408+0000 7fa595640640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa59006edf0 0x7fa5900ae8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55916/0 (socket says 172.21.15.67:55916) 2024-04-25T02:29:00.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.408+0000 7fa595640640 1 -- 172.21.15.67:0/1051743623 learned_addr learned my addr 172.21.15.67:0/1051743623 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:00.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.408+0000 7fa596642640 1 -- 172.21.15.67:0/1051743623 >> v1:172.21.15.176:6789/0 conn(0x7fa590156620 legacy=0x7fa59006dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:00.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.408+0000 7fa596642640 1 -- 172.21.15.67:0/1051743623 >> v1:172.21.15.67:6789/0 conn(0x7fa59006edf0 legacy=0x7fa5900ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.408+0000 7fa596642640 1 -- 172.21.15.67:0/1051743623 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59006d3a0 con 0x7fa5900aeff0 2024-04-25T02:29:00.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.408+0000 7fa594e3f640 1 -- 172.21.15.67:0/1051743623 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3073350365 0 0) 0x7fa59006d100 con 0x7fa59006edf0 2024-04-25T02:29:00.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.409+0000 7fa596642640 1 --2- 172.21.15.67:0/1051743623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5900aeff0 0x7fa59015cf70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa588009d90 tx=0x7fa58802a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d364f9fe4720e865 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:00.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.409+0000 7fa594e3f640 1 -- 172.21.15.67:0/1051743623 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa588007740 con 0x7fa5900aeff0 2024-04-25T02:29:00.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.409+0000 7fa594e3f640 1 -- 172.21.15.67:0/1051743623 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5880078e0 con 0x7fa5900aeff0 2024-04-25T02:29:00.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.409+0000 7fa594e3f640 1 -- 172.21.15.67:0/1051743623 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa588007cb0 con 0x7fa5900aeff0 2024-04-25T02:29:00.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.410+0000 7fa5980a5640 1 -- 172.21.15.67:0/1051743623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5900aeff0 msgr2=0x7fa59015cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.410+0000 7fa5980a5640 1 --2- 172.21.15.67:0/1051743623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5900aeff0 0x7fa59015cf70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa588009d90 tx=0x7fa58802a580 comp rx=0 tx=0).stop 2024-04-25T02:29:00.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.410+0000 7fa5980a5640 1 -- 172.21.15.67:0/1051743623 shutdown_connections 2024-04-25T02:29:00.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.410+0000 7fa5980a5640 1 --2- 172.21.15.67:0/1051743623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5900aeff0 0x7fa59015cf70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.410+0000 7fa5980a5640 1 -- 172.21.15.67:0/1051743623 >> 172.21.15.67:0/1051743623 conn(0x7fa5900b19c0 msgr2=0x7fa5900b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:00.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.410+0000 7fa5980a5640 1 -- 172.21.15.67:0/1051743623 shutdown_connections 2024-04-25T02:29:00.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.410+0000 7fa5980a5640 1 -- 172.21.15.67:0/1051743623 wait complete. 2024-04-25T02:29:00.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.411+0000 7fa5980a5640 1 Processor -- start 2024-04-25T02:29:00.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.411+0000 7fa5980a5640 1 -- start start 2024-04-25T02:29:00.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.412+0000 7fa5980a5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa59006edf0 0x7fa590157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.412+0000 7fa5980a5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5900aeff0 0x7fa59009d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.412+0000 7fa5980a5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa590156620 0x7fa5901594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.412+0000 7fa5980a5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa5900ad4c0 con 0x7fa5900aeff0 2024-04-25T02:29:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.412+0000 7fa5980a5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa5900ad340 con 0x7fa59006edf0 2024-04-25T02:29:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.412+0000 7fa5980a5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa590070e10 con 0x7fa590156620 2024-04-25T02:29:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.412+0000 7fa595640640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5900aeff0 0x7fa59009d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.412+0000 7fa595640640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5900aeff0 0x7fa59009d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47062/0 (socket says 172.21.15.67:47062) 2024-04-25T02:29:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.412+0000 7fa595640640 1 -- 172.21.15.67:0/3095476475 learned_addr learned my addr 172.21.15.67:0/3095476475 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.412+0000 7fa596642640 1 --2- 172.21.15.67:0/3095476475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa590156620 0x7fa5901594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.412+0000 7fa595e41640 1 --2- 172.21.15.67:0/3095476475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa59006edf0 0x7fa590157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.412+0000 7fa595640640 1 -- 172.21.15.67:0/3095476475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa590156620 msgr2=0x7fa5901594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.412+0000 7fa595640640 1 --2- 172.21.15.67:0/3095476475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa590156620 0x7fa5901594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.412+0000 7fa595640640 1 -- 172.21.15.67:0/3095476475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa59006edf0 msgr2=0x7fa590157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.412+0000 7fa595640640 1 --2- 172.21.15.67:0/3095476475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa59006edf0 0x7fa590157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.412+0000 7fa595640640 1 -- 172.21.15.67:0/3095476475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59009de00 con 0x7fa5900aeff0 2024-04-25T02:29:00.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.412+0000 7fa595640640 1 --2- 172.21.15.67:0/3095476475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5900aeff0 0x7fa59009d8c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa58000c4d0 tx=0x7fa58000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:00.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.413+0000 7fa5867fc640 1 -- 172.21.15.67:0/3095476475 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa580018070 con 0x7fa5900aeff0 2024-04-25T02:29:00.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.413+0000 7fa5867fc640 1 -- 172.21.15.67:0/3095476475 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5800074e0 con 0x7fa5900aeff0 2024-04-25T02:29:00.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.413+0000 7fa5980a5640 1 -- 172.21.15.67:0/3095476475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa590159a10 con 0x7fa5900aeff0 2024-04-25T02:29:00.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.413+0000 7fa5867fc640 1 -- 172.21.15.67:0/3095476475 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa580004a20 con 0x7fa5900aeff0 2024-04-25T02:29:00.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.413+0000 7fa5980a5640 1 -- 172.21.15.67:0/3095476475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa590158710 con 0x7fa5900aeff0 2024-04-25T02:29:00.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.414+0000 7fa5980a5640 1 -- 172.21.15.67:0/3095476475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa590069110 con 0x7fa5900aeff0 2024-04-25T02:29:00.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.414+0000 7fa5867fc640 1 -- 172.21.15.67:0/3095476475 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa58001b070 con 0x7fa5900aeff0 2024-04-25T02:29:00.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.415+0000 7fa5867fc640 1 --2- 172.21.15.67:0/3095476475 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa57406be30 0x7fa57406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.415+0000 7fa5867fc640 1 -- 172.21.15.67:0/3095476475 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa58008a200 con 0x7fa5900aeff0 2024-04-25T02:29:00.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.415+0000 7fa595e41640 1 --2- 172.21.15.67:0/3095476475 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa57406be30 0x7fa57406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.415+0000 7fa595e41640 1 --2- 172.21.15.67:0/3095476475 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa57406be30 0x7fa57406e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa58c006fd0 tx=0x7fa58c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:00.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.419+0000 7fa5867fc640 1 -- 172.21.15.67:0/3095476475 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa580058bb0 con 0x7fa5900aeff0 2024-04-25T02:29:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.601+0000 7fa5980a5640 1 -- 172.21.15.67:0/3095476475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa59015bc80 con 0x7fa5900aeff0 2024-04-25T02:29:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.601+0000 7fa5867fc640 1 -- 172.21.15.67:0/3095476475 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fa5800584b0 con 0x7fa5900aeff0 2024-04-25T02:29:00.604 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-25T02:29:00.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.603+0000 7fa5980a5640 1 -- 172.21.15.67:0/3095476475 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa57406be30 msgr2=0x7fa57406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.603+0000 7fa5980a5640 1 --2- 172.21.15.67:0/3095476475 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa57406be30 0x7fa57406e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa58c006fd0 tx=0x7fa58c008040 comp rx=0 tx=0).stop 2024-04-25T02:29:00.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.603+0000 7fa5980a5640 1 -- 172.21.15.67:0/3095476475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5900aeff0 msgr2=0x7fa59009d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.603+0000 7fa5980a5640 1 --2- 172.21.15.67:0/3095476475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5900aeff0 0x7fa59009d8c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa58000c4d0 tx=0x7fa58000c990 comp rx=0 tx=0).stop 2024-04-25T02:29:00.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.603+0000 7fa5980a5640 1 -- 172.21.15.67:0/3095476475 shutdown_connections 2024-04-25T02:29:00.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.603+0000 7fa5980a5640 1 --2- 172.21.15.67:0/3095476475 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa57406be30 0x7fa57406e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.603+0000 7fa5980a5640 1 --2- 172.21.15.67:0/3095476475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa590156620 0x7fa5901594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.603+0000 7fa5980a5640 1 --2- 172.21.15.67:0/3095476475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5900aeff0 0x7fa59009d8c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.603+0000 7fa5980a5640 1 --2- 172.21.15.67:0/3095476475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa59006edf0 0x7fa590157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.603+0000 7fa5980a5640 1 -- 172.21.15.67:0/3095476475 >> 172.21.15.67:0/3095476475 conn(0x7fa5900b19c0 msgr2=0x7fa5900b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:00.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.603+0000 7fa5980a5640 1 -- 172.21.15.67:0/3095476475 shutdown_connections 2024-04-25T02:29:00.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.603+0000 7fa5980a5640 1 -- 172.21.15.67:0/3095476475 wait complete. 2024-04-25T02:29:00.617 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:29:00.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.716+0000 7fe0eed70640 1 Processor -- start 2024-04-25T02:29:00.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.716+0000 7fe0eed70640 1 -- start start 2024-04-25T02:29:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.717+0000 7fe0eed70640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0e8070df0 0x7fe0e815f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.717+0000 7fe0eed70640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe0e80b2cc0 0x7fe0e80b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.717+0000 7fe0eed70640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e80713d0 con 0x7fe0e815b220 2024-04-25T02:29:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.717+0000 7fe0eed70640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e80aee00 con 0x7fe0e80b2cc0 2024-04-25T02:29:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.717+0000 7fe0eed70640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e80ae4d0 con 0x7fe0e8070df0 2024-04-25T02:29:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.717+0000 7fe0e7fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0e8070df0 0x7fe0e815f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.717+0000 7fe0ed30d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe0e80b2cc0 0x7fe0e80b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.717+0000 7fe0e7fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0e8070df0 0x7fe0e815f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:38508/0 (socket says 172.21.15.67:38508) 2024-04-25T02:29:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.717+0000 7fe0e7fff640 1 -- 172.21.15.67:0/2205028163 learned_addr learned my addr 172.21.15.67:0/2205028163 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:00.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.717+0000 7fe0e7fff640 1 -- 172.21.15.67:0/2205028163 >> v2:172.21.15.176:3300/0 conn(0x7fe0e80b2cc0 msgr2=0x7fe0e80b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:00.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.717+0000 7fe0e7fff640 1 --2- 172.21.15.67:0/2205028163 >> v2:172.21.15.176:3300/0 conn(0x7fe0e80b2cc0 0x7fe0e80b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.717+0000 7fe0e7fff640 1 -- 172.21.15.67:0/2205028163 >> v1:172.21.15.176:6789/0 conn(0x7fe0e815b220 legacy=0x7fe0e815ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.717+0000 7fe0e7fff640 1 -- 172.21.15.67:0/2205028163 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e80ae7b0 con 0x7fe0e8070df0 2024-04-25T02:29:00.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.717+0000 7fe0ed30d640 1 --2- 172.21.15.67:0/2205028163 >> v2:172.21.15.176:3300/0 conn(0x7fe0e80b2cc0 0x7fe0e80b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:00.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.718+0000 7fe0e7fff640 1 --2- 172.21.15.67:0/2205028163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0e8070df0 0x7fe0e815f380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400bb10 tx=0x7fe0d402c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9505cfbb0cfd2175 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:00.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.718+0000 7fe0e77fe640 1 -- 172.21.15.67:0/2205028163 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4036020 con 0x7fe0e8070df0 2024-04-25T02:29:00.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.718+0000 7fe0e77fe640 1 -- 172.21.15.67:0/2205028163 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d4032820 con 0x7fe0e8070df0 2024-04-25T02:29:00.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.718+0000 7fe0e77fe640 1 -- 172.21.15.67:0/2205028163 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4032bf0 con 0x7fe0e8070df0 2024-04-25T02:29:00.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.719+0000 7fe0eed70640 1 -- 172.21.15.67:0/2205028163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0e8070df0 msgr2=0x7fe0e815f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.719+0000 7fe0eed70640 1 --2- 172.21.15.67:0/2205028163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0e8070df0 0x7fe0e815f380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400bb10 tx=0x7fe0d402c920 comp rx=0 tx=0).stop 2024-04-25T02:29:00.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.719+0000 7fe0eed70640 1 -- 172.21.15.67:0/2205028163 shutdown_connections 2024-04-25T02:29:00.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.719+0000 7fe0eed70640 1 --2- 172.21.15.67:0/2205028163 >> v2:172.21.15.176:3300/0 conn(0x7fe0e80b2cc0 0x7fe0e80b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.719+0000 7fe0eed70640 1 --2- 172.21.15.67:0/2205028163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0e8070df0 0x7fe0e815f380 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.719+0000 7fe0eed70640 1 -- 172.21.15.67:0/2205028163 >> 172.21.15.67:0/2205028163 conn(0x7fe0e80b19c0 msgr2=0x7fe0e80b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:00.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.719+0000 7fe0eed70640 1 -- 172.21.15.67:0/2205028163 shutdown_connections 2024-04-25T02:29:00.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.719+0000 7fe0eed70640 1 -- 172.21.15.67:0/2205028163 wait complete. 2024-04-25T02:29:00.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.720+0000 7fe0eed70640 1 Processor -- start 2024-04-25T02:29:00.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.720+0000 7fe0eed70640 1 -- start start 2024-04-25T02:29:00.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.721+0000 7fe0eed70640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0e8070df0 0x7fe0e81555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.721+0000 7fe0eed70640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0e80b2cc0 0x7fe0e81588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.721+0000 7fe0eed70640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e815b220 0x7fe0e8158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.721+0000 7fe0eed70640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e806ed10 con 0x7fe0e815b220 2024-04-25T02:29:00.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.721+0000 7fe0eed70640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e806eb90 con 0x7fe0e80b2cc0 2024-04-25T02:29:00.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.721+0000 7fe0eed70640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e815f8c0 con 0x7fe0e8070df0 2024-04-25T02:29:00.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.721+0000 7fe0ed30d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e815b220 0x7fe0e8158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.721+0000 7fe0ed30d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e815b220 0x7fe0e8158e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47068/0 (socket says 172.21.15.67:47068) 2024-04-25T02:29:00.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.721+0000 7fe0ed30d640 1 -- 172.21.15.67:0/2188511994 learned_addr learned my addr 172.21.15.67:0/2188511994 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:00.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.721+0000 7fe0e7fff640 1 --2- 172.21.15.67:0/2188511994 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0e80b2cc0 0x7fe0e81588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.721+0000 7fe0ecb0c640 1 --2- 172.21.15.67:0/2188511994 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0e8070df0 0x7fe0e81555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.721+0000 7fe0ed30d640 1 -- 172.21.15.67:0/2188511994 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0e8070df0 msgr2=0x7fe0e81555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.721+0000 7fe0ed30d640 1 --2- 172.21.15.67:0/2188511994 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0e8070df0 0x7fe0e81555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.721+0000 7fe0ed30d640 1 -- 172.21.15.67:0/2188511994 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0e80b2cc0 msgr2=0x7fe0e81588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.722+0000 7fe0ed30d640 1 --2- 172.21.15.67:0/2188511994 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0e80b2cc0 0x7fe0e81588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.722+0000 7fe0ed30d640 1 -- 172.21.15.67:0/2188511994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e81f7830 con 0x7fe0e815b220 2024-04-25T02:29:00.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.722+0000 7fe0ed30d640 1 --2- 172.21.15.67:0/2188511994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e815b220 0x7fe0e8158e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009e50 tx=0x7fe0e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:00.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.722+0000 7fe0e57fa640 1 -- 172.21.15.67:0/2188511994 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0018030 con 0x7fe0e815b220 2024-04-25T02:29:00.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.722+0000 7fe0e57fa640 1 -- 172.21.15.67:0/2188511994 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e000cd90 con 0x7fe0e815b220 2024-04-25T02:29:00.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.722+0000 7fe0eed70640 1 -- 172.21.15.67:0/2188511994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e81f7b10 con 0x7fe0e815b220 2024-04-25T02:29:00.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.722+0000 7fe0e57fa640 1 -- 172.21.15.67:0/2188511994 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0003bb0 con 0x7fe0e815b220 2024-04-25T02:29:00.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.722+0000 7fe0eed70640 1 -- 172.21.15.67:0/2188511994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e81f80d0 con 0x7fe0e815b220 2024-04-25T02:29:00.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.723+0000 7fe0eed70640 1 -- 172.21.15.67:0/2188511994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e8069110 con 0x7fe0e815b220 2024-04-25T02:29:00.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.723+0000 7fe0e57fa640 1 -- 172.21.15.67:0/2188511994 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe0e001b070 con 0x7fe0e815b220 2024-04-25T02:29:00.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.724+0000 7fe0e57fa640 1 --2- 172.21.15.67:0/2188511994 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe0cc06be30 0x7fe0cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.724+0000 7fe0e57fa640 1 -- 172.21.15.67:0/2188511994 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe0e008b660 con 0x7fe0e815b220 2024-04-25T02:29:00.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.724+0000 7fe0ecb0c640 1 --2- 172.21.15.67:0/2188511994 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe0cc06be30 0x7fe0cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.725+0000 7fe0ecb0c640 1 --2- 172.21.15.67:0/2188511994 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe0cc06be30 0x7fe0cc06e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0016e0 tx=0x7fe0dc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:00.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.728+0000 7fe0e57fa640 1 -- 172.21.15.67:0/2188511994 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe0e0010040 con 0x7fe0e815b220 2024-04-25T02:29:00.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.922+0000 7fe0eed70640 1 -- 172.21.15.67:0/2188511994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe0e806e610 con 0x7fe0e815b220 2024-04-25T02:29:00.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.922+0000 7fe0e57fa640 1 -- 172.21.15.67:0/2188511994 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fe0e0059a50 con 0x7fe0e815b220 2024-04-25T02:29:00.963 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-04-25T02:29:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.924+0000 7fe0eed70640 1 -- 172.21.15.67:0/2188511994 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe0cc06be30 msgr2=0x7fe0cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.924+0000 7fe0eed70640 1 --2- 172.21.15.67:0/2188511994 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe0cc06be30 0x7fe0cc06e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0016e0 tx=0x7fe0dc009040 comp rx=0 tx=0).stop 2024-04-25T02:29:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.924+0000 7fe0eed70640 1 -- 172.21.15.67:0/2188511994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e815b220 msgr2=0x7fe0e8158e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.924+0000 7fe0eed70640 1 --2- 172.21.15.67:0/2188511994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e815b220 0x7fe0e8158e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009e50 tx=0x7fe0e000c490 comp rx=0 tx=0).stop 2024-04-25T02:29:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.924+0000 7fe0eed70640 1 -- 172.21.15.67:0/2188511994 shutdown_connections 2024-04-25T02:29:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.924+0000 7fe0eed70640 1 --2- 172.21.15.67:0/2188511994 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe0cc06be30 0x7fe0cc06e2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.924+0000 7fe0eed70640 1 --2- 172.21.15.67:0/2188511994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e815b220 0x7fe0e8158e10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.924+0000 7fe0eed70640 1 --2- 172.21.15.67:0/2188511994 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0e80b2cc0 0x7fe0e81588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.924+0000 7fe0eed70640 1 --2- 172.21.15.67:0/2188511994 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0e8070df0 0x7fe0e81555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.924+0000 7fe0eed70640 1 -- 172.21.15.67:0/2188511994 >> 172.21.15.67:0/2188511994 conn(0x7fe0e80b19c0 msgr2=0x7fe0e80ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.924+0000 7fe0eed70640 1 -- 172.21.15.67:0/2188511994 shutdown_connections 2024-04-25T02:29:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:00.924+0000 7fe0eed70640 1 -- 172.21.15.67:0/2188511994 wait complete. 2024-04-25T02:29:00.966 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T02:29:00.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:00.967 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-25T02:29:00.999 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-04-25T02:29:00.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:00.999 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T02:29:01.084 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:29:01.085 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:29:01.102 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:29:01.102 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:29:01.123 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:29:01.124 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:29:01.184 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:29:01.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.328+0000 7f767efce640 1 Processor -- start 2024-04-25T02:29:01.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.328+0000 7f767efce640 1 -- start start 2024-04-25T02:29:01.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.328+0000 7f767efce640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f767815c230 0x7f7678071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.328+0000 7f767efce640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f76780af120 0x7f767806cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.328+0000 7f767efce640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7678160b20 con 0x7f76780acda0 2024-04-25T02:29:01.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.328+0000 7f767efce640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f767815c610 con 0x7f76780af120 2024-04-25T02:29:01.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.328+0000 7f767efce640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f76780ad200 con 0x7f767815c230 2024-04-25T02:29:01.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.329+0000 7f7677fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f76780acda0 0x7f76780aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55932/0 (socket says 172.21.15.67:55932) 2024-04-25T02:29:01.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.329+0000 7f767d56b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f76780af120 0x7f767806cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.329+0000 7f7677fff640 1 -- 172.21.15.67:0/4155895549 learned_addr learned my addr 172.21.15.67:0/4155895549 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:01.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.329+0000 7f767d56b640 1 -- 172.21.15.67:0/4155895549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f767815c230 msgr2=0x7f7678071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:01.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.329+0000 7f767d56b640 1 --2- 172.21.15.67:0/4155895549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f767815c230 0x7f7678071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.329+0000 7f767d56b640 1 -- 172.21.15.67:0/4155895549 >> v1:172.21.15.67:6789/0 conn(0x7f76780acda0 legacy=0x7f76780aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:01.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.329+0000 7f76777fe640 1 -- 172.21.15.67:0/4155895549 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4123685949 0 0) 0x7f7678160b20 con 0x7f76780acda0 2024-04-25T02:29:01.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.329+0000 7f767d56b640 1 -- 172.21.15.67:0/4155895549 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767815fd60 con 0x7f76780af120 2024-04-25T02:29:01.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.330+0000 7f767d56b640 1 --2- 172.21.15.67:0/4155895549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76780af120 0x7f767806cb70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7670009d90 tx=0x7f767002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c72a160e1c854 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:01.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.330+0000 7f76777fe640 1 -- 172.21.15.67:0/4155895549 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670007740 con 0x7f76780af120 2024-04-25T02:29:01.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.330+0000 7f76777fe640 1 -- 172.21.15.67:0/4155895549 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76700078e0 con 0x7f76780af120 2024-04-25T02:29:01.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.330+0000 7f76777fe640 1 -- 172.21.15.67:0/4155895549 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670007cb0 con 0x7f76780af120 2024-04-25T02:29:01.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.330+0000 7f767efce640 1 -- 172.21.15.67:0/4155895549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76780af120 msgr2=0x7f767806cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:01.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.330+0000 7f767efce640 1 --2- 172.21.15.67:0/4155895549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76780af120 0x7f767806cb70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7670009d90 tx=0x7f767002a660 comp rx=0 tx=0).stop 2024-04-25T02:29:01.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.330+0000 7f767efce640 1 -- 172.21.15.67:0/4155895549 shutdown_connections 2024-04-25T02:29:01.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.330+0000 7f767efce640 1 --2- 172.21.15.67:0/4155895549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76780af120 0x7f767806cb70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.330+0000 7f767efce640 1 --2- 172.21.15.67:0/4155895549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f767815c230 0x7f7678071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.330+0000 7f767efce640 1 -- 172.21.15.67:0/4155895549 >> 172.21.15.67:0/4155895549 conn(0x7f76780b19c0 msgr2=0x7f76780b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:01.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.330+0000 7f767efce640 1 -- 172.21.15.67:0/4155895549 shutdown_connections 2024-04-25T02:29:01.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.330+0000 7f767efce640 1 -- 172.21.15.67:0/4155895549 wait complete. 2024-04-25T02:29:01.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.332+0000 7f767efce640 1 Processor -- start 2024-04-25T02:29:01.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.332+0000 7f767efce640 1 -- start start 2024-04-25T02:29:01.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.332+0000 7f767efce640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76780acda0 0x7f7678150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.332+0000 7f767efce640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76780af120 0x7f767809d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.332+0000 7f767efce640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f767815c230 0x7f76780cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.332+0000 7f767efce640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7678160600 con 0x7f76780af120 2024-04-25T02:29:01.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.332+0000 7f767efce640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7678160320 con 0x7f76780acda0 2024-04-25T02:29:01.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.332+0000 7f767efce640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f76780ad4d0 con 0x7f767815c230 2024-04-25T02:29:01.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.333+0000 7f7677fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76780af120 0x7f767809d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.333+0000 7f7677fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76780af120 0x7f767809d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47086/0 (socket says 172.21.15.67:47086) 2024-04-25T02:29:01.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.333+0000 7f7677fff640 1 -- 172.21.15.67:0/3484832923 learned_addr learned my addr 172.21.15.67:0/3484832923 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:01.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.333+0000 7f767d56b640 1 --2- 172.21.15.67:0/3484832923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f767815c230 0x7f76780cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.333+0000 7f767cd6a640 1 --2- 172.21.15.67:0/3484832923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76780acda0 0x7f7678150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.333+0000 7f7677fff640 1 -- 172.21.15.67:0/3484832923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f767815c230 msgr2=0x7f76780cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:01.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.333+0000 7f7677fff640 1 --2- 172.21.15.67:0/3484832923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f767815c230 0x7f76780cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.333+0000 7f7677fff640 1 -- 172.21.15.67:0/3484832923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76780acda0 msgr2=0x7f7678150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:01.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.333+0000 7f7677fff640 1 --2- 172.21.15.67:0/3484832923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76780acda0 0x7f7678150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.333+0000 7f7677fff640 1 -- 172.21.15.67:0/3484832923 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767809bac0 con 0x7f76780af120 2024-04-25T02:29:01.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.333+0000 7f767cd6a640 1 --2- 172.21.15.67:0/3484832923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76780acda0 0x7f7678150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:01.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.333+0000 7f7677fff640 1 --2- 172.21.15.67:0/3484832923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76780af120 0x7f767809d0f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f766400c500 tx=0x7f766400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:01.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.333+0000 7f76757fa640 1 -- 172.21.15.67:0/3484832923 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7664018070 con 0x7f76780af120 2024-04-25T02:29:01.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.333+0000 7f76757fa640 1 -- 172.21.15.67:0/3484832923 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7664007580 con 0x7f76780af120 2024-04-25T02:29:01.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.333+0000 7f767efce640 1 -- 172.21.15.67:0/3484832923 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767809bda0 con 0x7f76780af120 2024-04-25T02:29:01.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.333+0000 7f76757fa640 1 -- 172.21.15.67:0/3484832923 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7664004a20 con 0x7f76780af120 2024-04-25T02:29:01.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.333+0000 7f767efce640 1 -- 172.21.15.67:0/3484832923 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f767809c360 con 0x7f76780af120 2024-04-25T02:29:01.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.334+0000 7f767efce640 1 -- 172.21.15.67:0/3484832923 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7678069110 con 0x7f76780af120 2024-04-25T02:29:01.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.335+0000 7f76757fa640 1 -- 172.21.15.67:0/3484832923 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f766401b070 con 0x7f76780af120 2024-04-25T02:29:01.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.335+0000 7f76757fa640 1 --2- 172.21.15.67:0/3484832923 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f765c06be30 0x7f765c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.335+0000 7f76757fa640 1 -- 172.21.15.67:0/3484832923 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f766408a0d0 con 0x7f76780af120 2024-04-25T02:29:01.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.336+0000 7f767cd6a640 1 --2- 172.21.15.67:0/3484832923 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f765c06be30 0x7f765c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.336+0000 7f767cd6a640 1 --2- 172.21.15.67:0/3484832923 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f765c06be30 0x7f765c06e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f766c00a870 tx=0x7f766c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:01.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.340+0000 7f76757fa640 1 -- 172.21.15.67:0/3484832923 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7664058b10 con 0x7f76780af120 2024-04-25T02:29:01.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.522+0000 7f767efce640 1 -- 172.21.15.67:0/3484832923 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7678071250 con 0x7f76780af120 2024-04-25T02:29:01.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.524+0000 7f76757fa640 1 -- 172.21.15.67:0/3484832923 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f7664058410 con 0x7f76780af120 2024-04-25T02:29:01.527 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:01.527 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:27.819641+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:29:01.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.525+0000 7f767efce640 1 -- 172.21.15.67:0/3484832923 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f765c06be30 msgr2=0x7f765c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:01.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.525+0000 7f767efce640 1 --2- 172.21.15.67:0/3484832923 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f765c06be30 0x7f765c06e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f766c00a870 tx=0x7f766c008040 comp rx=0 tx=0).stop 2024-04-25T02:29:01.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.526+0000 7f767efce640 1 -- 172.21.15.67:0/3484832923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76780af120 msgr2=0x7f767809d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:01.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.526+0000 7f767efce640 1 --2- 172.21.15.67:0/3484832923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76780af120 0x7f767809d0f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f766400c500 tx=0x7f766400c9c0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.526+0000 7f767efce640 1 -- 172.21.15.67:0/3484832923 shutdown_connections 2024-04-25T02:29:01.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.526+0000 7f767efce640 1 --2- 172.21.15.67:0/3484832923 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f765c06be30 0x7f765c06e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.526+0000 7f767efce640 1 --2- 172.21.15.67:0/3484832923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f767815c230 0x7f76780cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.526+0000 7f767efce640 1 --2- 172.21.15.67:0/3484832923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76780af120 0x7f767809d0f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.526+0000 7f767efce640 1 --2- 172.21.15.67:0/3484832923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76780acda0 0x7f7678150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.526+0000 7f767efce640 1 -- 172.21.15.67:0/3484832923 >> 172.21.15.67:0/3484832923 conn(0x7f76780b19c0 msgr2=0x7f76780af930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:01.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.526+0000 7f767efce640 1 -- 172.21.15.67:0/3484832923 shutdown_connections 2024-04-25T02:29:01.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.526+0000 7f767efce640 1 -- 172.21.15.67:0/3484832923 wait complete. 2024-04-25T02:29:01.541 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:28:24.445606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:28:25.161619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:29:01.541 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:29:01.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.643+0000 7f2ab16c4640 1 Processor -- start 2024-04-25T02:29:01.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.643+0000 7f2ab16c4640 1 -- start start 2024-04-25T02:29:01.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.644+0000 7f2ab16c4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2aac06d420 0x7f2aac0aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.644+0000 7f2ab16c4640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2aac0b2cc0 0x7f2aac071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.644+0000 7f2ab16c4640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2aac071d80 0x7f2aac06d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.644+0000 7f2ab16c4640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f2aac0ad3f0 con 0x7f2aac071d80 2024-04-25T02:29:01.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.644+0000 7f2ab16c4640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2aac0b3150 con 0x7f2aac0b2cc0 2024-04-25T02:29:01.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.644+0000 7f2ab16c4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2aac0b3430 con 0x7f2aac06d420 2024-04-25T02:29:01.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.644+0000 7f2aab7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2aac071d80 0x7f2aac06d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.644+0000 7f2aab7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2aac071d80 0x7f2aac06d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49420/0 (socket says 172.21.15.67:49420) 2024-04-25T02:29:01.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.644+0000 7f2aab7fe640 1 -- 172.21.15.67:0/644474446 learned_addr learned my addr 172.21.15.67:0/644474446 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:01.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.644+0000 7f2aaaffd640 1 --2- 172.21.15.67:0/644474446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2aac06d420 0x7f2aac0aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.644+0000 7f2aa3fff640 1 --2- 172.21.15.67:0/644474446 >> v2:172.21.15.176:3300/0 conn(0x7f2aac0b2cc0 0x7f2aac071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.644+0000 7f2aab7fe640 1 -- 172.21.15.67:0/644474446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2aac06d420 msgr2=0x7f2aac0aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:01.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.644+0000 7f2aab7fe640 1 --2- 172.21.15.67:0/644474446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2aac06d420 0x7f2aac0aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.644+0000 7f2aab7fe640 1 -- 172.21.15.67:0/644474446 >> v2:172.21.15.176:3300/0 conn(0x7f2aac0b2cc0 msgr2=0x7f2aac071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:01.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.644+0000 7f2aab7fe640 1 --2- 172.21.15.67:0/644474446 >> v2:172.21.15.176:3300/0 conn(0x7f2aac0b2cc0 0x7f2aac071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.644+0000 7f2aab7fe640 1 -- 172.21.15.67:0/644474446 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac0b3710 con 0x7f2aac071d80 2024-04-25T02:29:01.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.644+0000 7f2aa3fff640 1 --2- 172.21.15.67:0/644474446 >> v2:172.21.15.176:3300/0 conn(0x7f2aac0b2cc0 0x7f2aac071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.645+0000 7f2aab7fe640 1 --2- 172.21.15.67:0/644474446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2aac071d80 0x7f2aac06d800 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0b3640 tx=0x7f2aa402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e73ea295e56b673 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.645+0000 7f2aaa7fc640 1 -- 172.21.15.67:0/644474446 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4036070 con 0x7f2aac071d80 2024-04-25T02:29:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.645+0000 7f2aaa7fc640 1 -- 172.21.15.67:0/644474446 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa4031600 con 0x7f2aac071d80 2024-04-25T02:29:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.645+0000 7f2aaa7fc640 1 -- 172.21.15.67:0/644474446 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40319d0 con 0x7f2aac071d80 2024-04-25T02:29:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.646+0000 7f2ab16c4640 1 -- 172.21.15.67:0/644474446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2aac071d80 msgr2=0x7f2aac06d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.646+0000 7f2ab16c4640 1 --2- 172.21.15.67:0/644474446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2aac071d80 0x7f2aac06d800 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0b3640 tx=0x7f2aa402a710 comp rx=0 tx=0).stop 2024-04-25T02:29:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.646+0000 7f2ab16c4640 1 -- 172.21.15.67:0/644474446 shutdown_connections 2024-04-25T02:29:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.646+0000 7f2ab16c4640 1 --2- 172.21.15.67:0/644474446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2aac071d80 0x7f2aac06d800 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.646+0000 7f2ab16c4640 1 --2- 172.21.15.67:0/644474446 >> v2:172.21.15.176:3300/0 conn(0x7f2aac0b2cc0 0x7f2aac071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.646+0000 7f2ab16c4640 1 --2- 172.21.15.67:0/644474446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2aac06d420 0x7f2aac0aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.646+0000 7f2ab16c4640 1 -- 172.21.15.67:0/644474446 >> 172.21.15.67:0/644474446 conn(0x7f2aac0b19c0 msgr2=0x7f2aac0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.646+0000 7f2ab16c4640 1 -- 172.21.15.67:0/644474446 shutdown_connections 2024-04-25T02:29:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.646+0000 7f2ab16c4640 1 -- 172.21.15.67:0/644474446 wait complete. 2024-04-25T02:29:01.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.647+0000 7f2ab16c4640 1 Processor -- start 2024-04-25T02:29:01.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.647+0000 7f2ab16c4640 1 -- start start 2024-04-25T02:29:01.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.648+0000 7f2ab16c4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2aac06d420 0x7f2aac150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.648+0000 7f2ab16c4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2aac071d80 0x7f2aac159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.648+0000 7f2ab16c4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2aac0c9a50 0x7f2aac1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.648+0000 7f2ab16c4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac15aa20 con 0x7f2aac071d80 2024-04-25T02:29:01.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.648+0000 7f2ab16c4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac0b3cd0 con 0x7f2aac0c9a50 2024-04-25T02:29:01.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.648+0000 7f2ab16c4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2aac06dd40 con 0x7f2aac06d420 2024-04-25T02:29:01.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.648+0000 7f2aa3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2aac071d80 0x7f2aac159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.648+0000 7f2aa3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2aac071d80 0x7f2aac159060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49422/0 (socket says 172.21.15.67:49422) 2024-04-25T02:29:01.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.648+0000 7f2aa3fff640 1 -- 172.21.15.67:0/1322522757 learned_addr learned my addr 172.21.15.67:0/1322522757 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:01.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.648+0000 7f2aaaffd640 1 --2- 172.21.15.67:0/1322522757 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2aac06d420 0x7f2aac150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.648+0000 7f2aab7fe640 1 --2- 172.21.15.67:0/1322522757 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2aac0c9a50 0x7f2aac1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.648+0000 7f2aa3fff640 1 -- 172.21.15.67:0/1322522757 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2aac06d420 msgr2=0x7f2aac150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.648+0000 7f2aa3fff640 1 --2- 172.21.15.67:0/1322522757 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2aac06d420 0x7f2aac150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.648+0000 7f2aa3fff640 1 -- 172.21.15.67:0/1322522757 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2aac0c9a50 msgr2=0x7f2aac1595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.648+0000 7f2aa3fff640 1 --2- 172.21.15.67:0/1322522757 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2aac0c9a50 0x7f2aac1595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.648+0000 7f2aa3fff640 1 -- 172.21.15.67:0/1322522757 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac0c9fc0 con 0x7f2aac071d80 2024-04-25T02:29:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.648+0000 7f2aab7fe640 1 --2- 172.21.15.67:0/1322522757 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2aac0c9a50 0x7f2aac1595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.648+0000 7f2aa3fff640 1 --2- 172.21.15.67:0/1322522757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2aac071d80 0x7f2aac159060 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400c7f0 tx=0x7f2a9400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.649+0000 7f2aa37fe640 1 -- 172.21.15.67:0/1322522757 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a94015070 con 0x7f2aac071d80 2024-04-25T02:29:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.649+0000 7f2aa37fe640 1 -- 172.21.15.67:0/1322522757 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a94007820 con 0x7f2aac071d80 2024-04-25T02:29:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.649+0000 7f2ab16c4640 1 -- 172.21.15.67:0/1322522757 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aac0ca2a0 con 0x7f2aac071d80 2024-04-25T02:29:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.649+0000 7f2aa37fe640 1 -- 172.21.15.67:0/1322522757 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a94007bf0 con 0x7f2aac071d80 2024-04-25T02:29:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.649+0000 7f2ab16c4640 1 -- 172.21.15.67:0/1322522757 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aac0ca860 con 0x7f2aac071d80 2024-04-25T02:29:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.650+0000 7f2ab16c4640 1 -- 172.21.15.67:0/1322522757 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aac069110 con 0x7f2aac071d80 2024-04-25T02:29:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.650+0000 7f2aa37fe640 1 -- 172.21.15.67:0/1322522757 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a94018070 con 0x7f2aac071d80 2024-04-25T02:29:01.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.651+0000 7f2aa37fe640 1 --2- 172.21.15.67:0/1322522757 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2a8c06be30 0x7f2a8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.651+0000 7f2aa37fe640 1 -- 172.21.15.67:0/1322522757 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2a9408ae50 con 0x7f2aac071d80 2024-04-25T02:29:01.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.651+0000 7f2aaaffd640 1 --2- 172.21.15.67:0/1322522757 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2a8c06be30 0x7f2a8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.651+0000 7f2aaaffd640 1 --2- 172.21.15.67:0/1322522757 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2a8c06be30 0x7f2a8c06e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c006fd0 tx=0x7f2a9c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:01.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.655+0000 7f2aa37fe640 1 -- 172.21.15.67:0/1322522757 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2a94059890 con 0x7f2aac071d80 2024-04-25T02:29:01.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.839+0000 7f2ab16c4640 1 -- 172.21.15.67:0/1322522757 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2aac150da0 con 0x7f2aac071d80 2024-04-25T02:29:01.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.839+0000 7f2aa37fe640 1 -- 172.21.15.67:0/1322522757 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f2a94059190 con 0x7f2aac071d80 2024-04-25T02:29:01.843 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:29:01.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.841+0000 7f2ab16c4640 1 -- 172.21.15.67:0/1322522757 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2a8c06be30 msgr2=0x7f2a8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:01.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.842+0000 7f2ab16c4640 1 --2- 172.21.15.67:0/1322522757 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2a8c06be30 0x7f2a8c06e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c006fd0 tx=0x7f2a9c008040 comp rx=0 tx=0).stop 2024-04-25T02:29:01.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.842+0000 7f2ab16c4640 1 -- 172.21.15.67:0/1322522757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2aac071d80 msgr2=0x7f2aac159060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:01.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.842+0000 7f2ab16c4640 1 --2- 172.21.15.67:0/1322522757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2aac071d80 0x7f2aac159060 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400c7f0 tx=0x7f2a9400ccb0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.842+0000 7f2ab16c4640 1 -- 172.21.15.67:0/1322522757 shutdown_connections 2024-04-25T02:29:01.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.842+0000 7f2ab16c4640 1 --2- 172.21.15.67:0/1322522757 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2a8c06be30 0x7f2a8c06e2f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.842+0000 7f2ab16c4640 1 --2- 172.21.15.67:0/1322522757 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2aac0c9a50 0x7f2aac1595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.842+0000 7f2ab16c4640 1 --2- 172.21.15.67:0/1322522757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2aac071d80 0x7f2aac159060 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.842+0000 7f2ab16c4640 1 --2- 172.21.15.67:0/1322522757 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2aac06d420 0x7f2aac150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.842+0000 7f2ab16c4640 1 -- 172.21.15.67:0/1322522757 >> 172.21.15.67:0/1322522757 conn(0x7f2aac0b19c0 msgr2=0x7f2aac0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:01.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.842+0000 7f2ab16c4640 1 -- 172.21.15.67:0/1322522757 shutdown_connections 2024-04-25T02:29:01.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.842+0000 7f2ab16c4640 1 -- 172.21.15.67:0/1322522757 wait complete. 2024-04-25T02:29:01.856 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:29:01.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.959+0000 7f9169a72640 1 Processor -- start 2024-04-25T02:29:01.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.959+0000 7f9169a72640 1 -- start start 2024-04-25T02:29:01.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.960+0000 7f9169a72640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916406cf50 0x7f91640b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.960+0000 7f9169a72640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91640b3570 con 0x7f91640cf060 2024-04-25T02:29:01.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.960+0000 7f9169a72640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91640cff80 con 0x7f91640b2da0 2024-04-25T02:29:01.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.960+0000 7f9169a72640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f91640d05d0 con 0x7f916406cf50 2024-04-25T02:29:01.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.960+0000 7f91637fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f91640cf060 0x7f91640d0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42752/0 (socket says 172.21.15.67:42752) 2024-04-25T02:29:01.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.960+0000 7f91637fe640 1 -- 172.21.15.67:0/496990770 learned_addr learned my addr 172.21.15.67:0/496990770 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:01.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.960+0000 7f9163fff640 1 --2- 172.21.15.67:0/496990770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916406cf50 0x7f91640b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.960+0000 7f91627fc640 1 -- 172.21.15.67:0/496990770 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3844465809 0 0) 0x7f91640b3570 con 0x7f91640cf060 2024-04-25T02:29:01.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.960+0000 7f91627fc640 1 -- 172.21.15.67:0/496990770 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f914c003520 con 0x7f91640cf060 2024-04-25T02:29:01.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.960+0000 7f91627fc640 1 -- 172.21.15.67:0/496990770 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2725398412 0 0) 0x7f914c003520 con 0x7f91640cf060 2024-04-25T02:29:01.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.960+0000 7f91627fc640 1 -- 172.21.15.67:0/496990770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916406cf50 msgr2=0x7f91640b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:01.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.960+0000 7f91627fc640 1 --2- 172.21.15.67:0/496990770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916406cf50 0x7f91640b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.960+0000 7f91627fc640 1 -- 172.21.15.67:0/496990770 >> v1:172.21.15.176:6789/0 conn(0x7f91640b2da0 legacy=0x7f916406c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:01.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.961+0000 7f91627fc640 1 -- 172.21.15.67:0/496990770 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91640d0260 con 0x7f91640cf060 2024-04-25T02:29:01.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.961+0000 7f91627fc640 1 -- 172.21.15.67:0/496990770 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f9154001670 con 0x7f91640cf060 2024-04-25T02:29:01.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.961+0000 7f91627fc640 1 -- 172.21.15.67:0/496990770 >> v1:172.21.15.67:6789/0 conn(0x7f91640cf060 legacy=0x7f91640d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:01.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.961+0000 7f91627fc640 1 --2- 172.21.15.67:0/496990770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916406cf50 0x7f914c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.961+0000 7f91627fc640 1 --2- 172.21.15.67:0/496990770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f914c003f60 0x7f914c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.961+0000 7f91627fc640 1 --2- 172.21.15.67:0/496990770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f914c004d40 0x7f914c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.961+0000 7f91627fc640 1 -- 172.21.15.67:0/496990770 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f91640d05d0 con 0x7f914c003f60 2024-04-25T02:29:01.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.961+0000 7f91627fc640 1 -- 172.21.15.67:0/496990770 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f914c00bb50 con 0x7f914c004d40 2024-04-25T02:29:01.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.961+0000 7f91627fc640 1 -- 172.21.15.67:0/496990770 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f914c00bd50 con 0x7f916406cf50 2024-04-25T02:29:01.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.961+0000 7f9162ffd640 1 --2- 172.21.15.67:0/496990770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f914c003f60 0x7f914c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.961+0000 7f91637fe640 1 --2- 172.21.15.67:0/496990770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916406cf50 0x7f914c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.961+0000 7f9163fff640 1 --2- 172.21.15.67:0/496990770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f914c004d40 0x7f914c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.961+0000 7f9162ffd640 1 -- 172.21.15.67:0/496990770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916406cf50 msgr2=0x7f914c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:01.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.961+0000 7f9162ffd640 1 --2- 172.21.15.67:0/496990770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916406cf50 0x7f914c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.961+0000 7f9162ffd640 1 -- 172.21.15.67:0/496990770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f914c004d40 msgr2=0x7f914c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:01.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.961+0000 7f9162ffd640 1 --2- 172.21.15.67:0/496990770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f914c004d40 0x7f914c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.961+0000 7f9162ffd640 1 -- 172.21.15.67:0/496990770 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914c003520 con 0x7f914c003f60 2024-04-25T02:29:01.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.961+0000 7f91637fe640 1 --2- 172.21.15.67:0/496990770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916406cf50 0x7f914c0039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:01.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.962+0000 7f9162ffd640 1 --2- 172.21.15.67:0/496990770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f914c003f60 0x7f914c004800 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9158001750 tx=0x7f914c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb5b28b84e5e12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:01.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.962+0000 7f91627fc640 1 -- 172.21.15.67:0/496990770 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158001370 con 0x7f914c003f60 2024-04-25T02:29:01.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.962+0000 7f91627fc640 1 -- 172.21.15.67:0/496990770 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91580052d0 con 0x7f914c003f60 2024-04-25T02:29:01.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.962+0000 7f91627fc640 1 -- 172.21.15.67:0/496990770 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915802abe0 con 0x7f914c003f60 2024-04-25T02:29:01.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.962+0000 7f9169a72640 1 -- 172.21.15.67:0/496990770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f914c003f60 msgr2=0x7f914c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:01.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.962+0000 7f9169a72640 1 --2- 172.21.15.67:0/496990770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f914c003f60 0x7f914c004800 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9158001750 tx=0x7f914c005830 comp rx=0 tx=0).stop 2024-04-25T02:29:01.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.962+0000 7f9163fff640 1 -- 172.21.15.67:0/496990770 reap_dead start 2024-04-25T02:29:01.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.962+0000 7f9169a72640 1 -- 172.21.15.67:0/496990770 shutdown_connections 2024-04-25T02:29:01.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.962+0000 7f9169a72640 1 -- 172.21.15.67:0/496990770 >> 172.21.15.67:0/496990770 conn(0x7f91640b3a70 msgr2=0x7f91640b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:01.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.962+0000 7f9169a72640 1 -- 172.21.15.67:0/496990770 shutdown_connections 2024-04-25T02:29:01.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.962+0000 7f9169a72640 1 -- 172.21.15.67:0/496990770 wait complete. 2024-04-25T02:29:01.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.964+0000 7f9169a72640 1 Processor -- start 2024-04-25T02:29:01.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.964+0000 7f9169a72640 1 -- start start 2024-04-25T02:29:01.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.964+0000 7f9169a72640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f914c003f60 0x7f916414b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.964+0000 7f9169a72640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f916415b740 0x7f916415bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f9169a72640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916415a1d0 0x7f916415a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f9169a72640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f91640b27f0 con 0x7f916415b740 2024-04-25T02:29:01.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f9169a72640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f91640b2670 con 0x7f914c003f60 2024-04-25T02:29:01.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f9169a72640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f91640b2970 con 0x7f916415a1d0 2024-04-25T02:29:01.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f9162ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f916415b740 0x7f916415bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f9162ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f916415b740 0x7f916415bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49438/0 (socket says 172.21.15.67:49438) 2024-04-25T02:29:01.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f9162ffd640 1 -- 172.21.15.67:0/296787261 learned_addr learned my addr 172.21.15.67:0/296787261 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:01.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f9163fff640 1 --2- 172.21.15.67:0/296787261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916415a1d0 0x7f916415a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f91637fe640 1 --2- 172.21.15.67:0/296787261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f914c003f60 0x7f916414b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f9162ffd640 1 -- 172.21.15.67:0/296787261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916415a1d0 msgr2=0x7f916415a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:01.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f9162ffd640 1 --2- 172.21.15.67:0/296787261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916415a1d0 0x7f916415a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f9162ffd640 1 -- 172.21.15.67:0/296787261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f914c003f60 msgr2=0x7f916414b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:01.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f9162ffd640 1 --2- 172.21.15.67:0/296787261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f914c003f60 0x7f916414b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:01.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f9162ffd640 1 -- 172.21.15.67:0/296787261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916415adb0 con 0x7f916415b740 2024-04-25T02:29:01.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f9163fff640 1 --2- 172.21.15.67:0/296787261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916415a1d0 0x7f916415a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:01.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f91637fe640 1 --2- 172.21.15.67:0/296787261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f914c003f60 0x7f916414b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:01.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f9162ffd640 1 --2- 172.21.15.67:0/296787261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f916415b740 0x7f916415bba0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9158001870 tx=0x7f9158001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:01.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f914bfff640 1 -- 172.21.15.67:0/296787261 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158040020 con 0x7f916415b740 2024-04-25T02:29:01.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f914bfff640 1 -- 172.21.15.67:0/296787261 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9158007680 con 0x7f916415b740 2024-04-25T02:29:01.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f9169a72640 1 -- 172.21.15.67:0/296787261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f916415b090 con 0x7f916415b740 2024-04-25T02:29:01.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f914bfff640 1 -- 172.21.15.67:0/296787261 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158007a30 con 0x7f916415b740 2024-04-25T02:29:01.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.965+0000 7f9169a72640 1 -- 172.21.15.67:0/296787261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91640afe20 con 0x7f916415b740 2024-04-25T02:29:01.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.966+0000 7f9169a72640 1 -- 172.21.15.67:0/296787261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9164069110 con 0x7f916415b740 2024-04-25T02:29:01.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.967+0000 7f914bfff640 1 -- 172.21.15.67:0/296787261 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9158043020 con 0x7f916415b740 2024-04-25T02:29:01.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.967+0000 7f914bfff640 1 --2- 172.21.15.67:0/296787261 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f915006be60 0x7f915006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:01.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.967+0000 7f914bfff640 1 -- 172.21.15.67:0/296787261 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f91580aae50 con 0x7f916415b740 2024-04-25T02:29:01.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.967+0000 7f91637fe640 1 --2- 172.21.15.67:0/296787261 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f915006be60 0x7f915006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:01.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.968+0000 7f91637fe640 1 --2- 172.21.15.67:0/296787261 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f915006be60 0x7f915006e320 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9154001eb0 tx=0x7f9154000ed0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:01.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:01.971+0000 7f914bfff640 1 -- 172.21.15.67:0/296787261 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f915804a030 con 0x7f916415b740 2024-04-25T02:29:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.153+0000 7f9169a72640 1 -- 172.21.15.67:0/296787261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f916406f360 con 0x7f916415b740 2024-04-25T02:29:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.153+0000 7f914bfff640 1 -- 172.21.15.67:0/296787261 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f9158079800 con 0x7f916415b740 2024-04-25T02:29:02.157 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-25T02:29:02.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.155+0000 7f9169a72640 1 -- 172.21.15.67:0/296787261 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f915006be60 msgr2=0x7f915006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:02.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.155+0000 7f9169a72640 1 --2- 172.21.15.67:0/296787261 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f915006be60 0x7f915006e320 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9154001eb0 tx=0x7f9154000ed0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.155+0000 7f9169a72640 1 -- 172.21.15.67:0/296787261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f916415b740 msgr2=0x7f916415bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:02.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.155+0000 7f9169a72640 1 --2- 172.21.15.67:0/296787261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f916415b740 0x7f916415bba0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9158001870 tx=0x7f9158001120 comp rx=0 tx=0).stop 2024-04-25T02:29:02.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.155+0000 7f9169a72640 1 -- 172.21.15.67:0/296787261 shutdown_connections 2024-04-25T02:29:02.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.155+0000 7f9169a72640 1 --2- 172.21.15.67:0/296787261 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f915006be60 0x7f915006e320 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.155+0000 7f9169a72640 1 --2- 172.21.15.67:0/296787261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916415a1d0 0x7f916415a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.155+0000 7f9169a72640 1 --2- 172.21.15.67:0/296787261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f916415b740 0x7f916415bba0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.155+0000 7f9169a72640 1 --2- 172.21.15.67:0/296787261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f914c003f60 0x7f916414b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.155+0000 7f9169a72640 1 -- 172.21.15.67:0/296787261 >> 172.21.15.67:0/296787261 conn(0x7f91640b3a70 msgr2=0x7f91640d2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:02.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.155+0000 7f9169a72640 1 -- 172.21.15.67:0/296787261 shutdown_connections 2024-04-25T02:29:02.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.155+0000 7f9169a72640 1 -- 172.21.15.67:0/296787261 wait complete. 2024-04-25T02:29:02.169 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:29:02.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.272+0000 7fa1e207d640 1 Processor -- start 2024-04-25T02:29:02.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.272+0000 7fa1e207d640 1 -- start start 2024-04-25T02:29:02.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.273+0000 7fa1e207d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa1dc15e760 0x7fa1dc0cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:02.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.273+0000 7fa1e207d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa1dc0d1470 0x7fa1dc06bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:02.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.273+0000 7fa1e207d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1dc0cff80 con 0x7fa1dc0d0900 2024-04-25T02:29:02.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.273+0000 7fa1e207d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa1dc0d28a0 con 0x7fa1dc15e760 2024-04-25T02:29:02.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.273+0000 7fa1e207d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa1dc0d2250 con 0x7fa1dc0d1470 2024-04-25T02:29:02.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.273+0000 7fa1db7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa1dc15e760 0x7fa1dc0cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:02.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.273+0000 7fa1db7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa1dc15e760 0x7fa1dc0cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49444/0 (socket says 172.21.15.67:49444) 2024-04-25T02:29:02.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.273+0000 7fa1db7fe640 1 -- 172.21.15.67:0/3135758005 learned_addr learned my addr 172.21.15.67:0/3135758005 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:02.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.273+0000 7fa1dbfff640 1 --2- 172.21.15.67:0/3135758005 >> v2:172.21.15.176:3300/0 conn(0x7fa1dc0d1470 0x7fa1dc06bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:02.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.273+0000 7fa1db7fe640 1 -- 172.21.15.67:0/3135758005 >> v2:172.21.15.176:3300/0 conn(0x7fa1dc0d1470 msgr2=0x7fa1dc06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:02.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.273+0000 7fa1db7fe640 1 --2- 172.21.15.67:0/3135758005 >> v2:172.21.15.176:3300/0 conn(0x7fa1dc0d1470 0x7fa1dc06bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.273+0000 7fa1db7fe640 1 -- 172.21.15.67:0/3135758005 >> v1:172.21.15.176:6789/0 conn(0x7fa1dc0d0900 legacy=0x7fa1dc0d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:02.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.273+0000 7fa1db7fe640 1 -- 172.21.15.67:0/3135758005 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1dc0d2530 con 0x7fa1dc15e760 2024-04-25T02:29:02.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.273+0000 7fa1dbfff640 1 --2- 172.21.15.67:0/3135758005 >> v2:172.21.15.176:3300/0 conn(0x7fa1dc0d1470 0x7fa1dc06bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:02.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.274+0000 7fa1db7fe640 1 --2- 172.21.15.67:0/3135758005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1dc15e760 0x7fa1dc0cf8f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc0d2a20 tx=0x7fa1cc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84426c8438eebb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:02.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.274+0000 7fa1da7fc640 1 -- 172.21.15.67:0/3135758005 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc037070 con 0x7fa1dc15e760 2024-04-25T02:29:02.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.274+0000 7fa1da7fc640 1 -- 172.21.15.67:0/3135758005 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1cc032440 con 0x7fa1dc15e760 2024-04-25T02:29:02.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.274+0000 7fa1da7fc640 1 -- 172.21.15.67:0/3135758005 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc032810 con 0x7fa1dc15e760 2024-04-25T02:29:02.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.275+0000 7fa1e207d640 1 -- 172.21.15.67:0/3135758005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1dc15e760 msgr2=0x7fa1dc0cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:02.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.275+0000 7fa1e207d640 1 --2- 172.21.15.67:0/3135758005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1dc15e760 0x7fa1dc0cf8f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc0d2a20 tx=0x7fa1cc02a210 comp rx=0 tx=0).stop 2024-04-25T02:29:02.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.275+0000 7fa1e207d640 1 -- 172.21.15.67:0/3135758005 shutdown_connections 2024-04-25T02:29:02.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.275+0000 7fa1e207d640 1 --2- 172.21.15.67:0/3135758005 >> v2:172.21.15.176:3300/0 conn(0x7fa1dc0d1470 0x7fa1dc06bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.275+0000 7fa1e207d640 1 --2- 172.21.15.67:0/3135758005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1dc15e760 0x7fa1dc0cf8f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.275+0000 7fa1e207d640 1 -- 172.21.15.67:0/3135758005 >> 172.21.15.67:0/3135758005 conn(0x7fa1dc0d41b0 msgr2=0x7fa1dc0d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:02.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.275+0000 7fa1e207d640 1 -- 172.21.15.67:0/3135758005 shutdown_connections 2024-04-25T02:29:02.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.275+0000 7fa1e207d640 1 -- 172.21.15.67:0/3135758005 wait complete. 2024-04-25T02:29:02.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.276+0000 7fa1e207d640 1 Processor -- start 2024-04-25T02:29:02.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.276+0000 7fa1e207d640 1 -- start start 2024-04-25T02:29:02.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.277+0000 7fa1e207d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1dc0d0900 0x7fa1dc0cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:02.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.277+0000 7fa1e207d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1dc0d1470 0x7fa1dc0b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:02.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.277+0000 7fa1e207d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1dc15e760 0x7fa1dc0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:02.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.277+0000 7fa1e207d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc15eb40 con 0x7fa1dc0d0900 2024-04-25T02:29:02.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.277+0000 7fa1e207d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc0d3d40 con 0x7fa1dc0d1470 2024-04-25T02:29:02.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.277+0000 7fa1e207d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa1dc15ecc0 con 0x7fa1dc15e760 2024-04-25T02:29:02.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.277+0000 7fa1db7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1dc0d0900 0x7fa1dc0cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:02.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.277+0000 7fa1db7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1dc0d0900 0x7fa1dc0cba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49450/0 (socket says 172.21.15.67:49450) 2024-04-25T02:29:02.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.277+0000 7fa1db7fe640 1 -- 172.21.15.67:0/2919718297 learned_addr learned my addr 172.21.15.67:0/2919718297 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:02.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.277+0000 7fa1daffd640 1 --2- 172.21.15.67:0/2919718297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1dc0d1470 0x7fa1dc0b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:02.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.277+0000 7fa1dbfff640 1 --2- 172.21.15.67:0/2919718297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1dc15e760 0x7fa1dc0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:02.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.277+0000 7fa1db7fe640 1 -- 172.21.15.67:0/2919718297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1dc15e760 msgr2=0x7fa1dc0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:02.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.277+0000 7fa1db7fe640 1 --2- 172.21.15.67:0/2919718297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1dc15e760 0x7fa1dc0cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.277+0000 7fa1db7fe640 1 -- 172.21.15.67:0/2919718297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1dc0d1470 msgr2=0x7fa1dc0b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:02.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.277+0000 7fa1db7fe640 1 --2- 172.21.15.67:0/2919718297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1dc0d1470 0x7fa1dc0b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.277+0000 7fa1db7fe640 1 -- 172.21.15.67:0/2919718297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1dc0cbfd0 con 0x7fa1dc0d0900 2024-04-25T02:29:02.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.277+0000 7fa1db7fe640 1 --2- 172.21.15.67:0/2919718297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1dc0d0900 0x7fa1dc0cba90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc000c00 tx=0x7fa1cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:02.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.278+0000 7fa1c3fff640 1 -- 172.21.15.67:0/2919718297 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc041020 con 0x7fa1dc0d0900 2024-04-25T02:29:02.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.278+0000 7fa1c3fff640 1 -- 172.21.15.67:0/2919718297 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1cc030970 con 0x7fa1dc0d0900 2024-04-25T02:29:02.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.278+0000 7fa1c3fff640 1 -- 172.21.15.67:0/2919718297 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc037040 con 0x7fa1dc0d0900 2024-04-25T02:29:02.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.278+0000 7fa1e207d640 1 -- 172.21.15.67:0/2919718297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1dc0b5a40 con 0x7fa1dc0d0900 2024-04-25T02:29:02.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.278+0000 7fa1e207d640 1 -- 172.21.15.67:0/2919718297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1dc0b6000 con 0x7fa1dc0d0900 2024-04-25T02:29:02.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.279+0000 7fa1e207d640 1 -- 172.21.15.67:0/2919718297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1dc069110 con 0x7fa1dc0d0900 2024-04-25T02:29:02.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.279+0000 7fa1c3fff640 1 -- 172.21.15.67:0/2919718297 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1cc044020 con 0x7fa1dc0d0900 2024-04-25T02:29:02.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.279+0000 7fa1c3fff640 1 --2- 172.21.15.67:0/2919718297 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa1c806be30 0x7fa1c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:02.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.280+0000 7fa1c3fff640 1 -- 172.21.15.67:0/2919718297 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa1cc0ab810 con 0x7fa1dc0d0900 2024-04-25T02:29:02.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.280+0000 7fa1daffd640 1 --2- 172.21.15.67:0/2919718297 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa1c806be30 0x7fa1c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:02.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.280+0000 7fa1daffd640 1 --2- 172.21.15.67:0/2919718297 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa1c806be30 0x7fa1c806e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc15aea0 tx=0x7fa1d0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:02.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.284+0000 7fa1c3fff640 1 -- 172.21.15.67:0/2919718297 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa1cc04b030 con 0x7fa1dc0d0900 2024-04-25T02:29:02.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.466+0000 7fa1e207d640 1 -- 172.21.15.67:0/2919718297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa1dc0b4ed0 con 0x7fa1dc0d0900 2024-04-25T02:29:02.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.466+0000 7fa1c3fff640 1 -- 172.21.15.67:0/2919718297 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fa1dc0cbfd0 con 0x7fa1dc0d0900 2024-04-25T02:29:02.469 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-25T02:29:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.468+0000 7fa1e207d640 1 -- 172.21.15.67:0/2919718297 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa1c806be30 msgr2=0x7fa1c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.468+0000 7fa1e207d640 1 --2- 172.21.15.67:0/2919718297 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa1c806be30 0x7fa1c806e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc15aea0 tx=0x7fa1d0009040 comp rx=0 tx=0).stop 2024-04-25T02:29:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.468+0000 7fa1e207d640 1 -- 172.21.15.67:0/2919718297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1dc0d0900 msgr2=0x7fa1dc0cba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.468+0000 7fa1e207d640 1 --2- 172.21.15.67:0/2919718297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1dc0d0900 0x7fa1dc0cba90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc000c00 tx=0x7fa1cc0046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.468+0000 7fa1e207d640 1 -- 172.21.15.67:0/2919718297 shutdown_connections 2024-04-25T02:29:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.468+0000 7fa1e207d640 1 --2- 172.21.15.67:0/2919718297 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa1c806be30 0x7fa1c806e2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.468+0000 7fa1e207d640 1 --2- 172.21.15.67:0/2919718297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1dc15e760 0x7fa1dc0cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.468+0000 7fa1e207d640 1 --2- 172.21.15.67:0/2919718297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1dc0d1470 0x7fa1dc0b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.468+0000 7fa1e207d640 1 --2- 172.21.15.67:0/2919718297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1dc0d0900 0x7fa1dc0cba90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.468+0000 7fa1e207d640 1 -- 172.21.15.67:0/2919718297 >> 172.21.15.67:0/2919718297 conn(0x7fa1dc0d41b0 msgr2=0x7fa1dc160950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:02.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.468+0000 7fa1e207d640 1 -- 172.21.15.67:0/2919718297 shutdown_connections 2024-04-25T02:29:02.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.468+0000 7fa1e207d640 1 -- 172.21.15.67:0/2919718297 wait complete. 2024-04-25T02:29:02.482 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:29:02.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.581+0000 7f10aa89a640 1 Processor -- start 2024-04-25T02:29:02.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.581+0000 7f10aa89a640 1 -- start start 2024-04-25T02:29:02.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.581+0000 7f10aa89a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f10a415e210 0x7f10a406cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:02.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.581+0000 7f10aa89a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10a40d2cc0 con 0x7f10a415e5f0 2024-04-25T02:29:02.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.581+0000 7f10aa89a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10a40d2fa0 con 0x7f10a40cf3d0 2024-04-25T02:29:02.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.581+0000 7f10aa89a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f10a406c6f0 con 0x7f10a415e210 2024-04-25T02:29:02.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.582+0000 7f10a3fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f10a415e210 0x7f10a406cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:02.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.582+0000 7f10a37fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f10a415e5f0 0x7f10a40cecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42766/0 (socket says 172.21.15.67:42766) 2024-04-25T02:29:02.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.582+0000 7f10a3fff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f10a415e210 0x7f10a406cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49460/0 (socket says 172.21.15.67:49460) 2024-04-25T02:29:02.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.582+0000 7f10a37fe640 1 -- 172.21.15.67:0/3493427114 learned_addr learned my addr 172.21.15.67:0/3493427114 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:02.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.582+0000 7f10a3fff640 1 -- 172.21.15.67:0/3493427114 >> v1:172.21.15.176:6789/0 conn(0x7f10a40cf3d0 legacy=0x7f10a40d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:02.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.582+0000 7f10a3fff640 1 -- 172.21.15.67:0/3493427114 >> v1:172.21.15.67:6789/0 conn(0x7f10a415e5f0 legacy=0x7f10a40cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:02.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.582+0000 7f10a3fff640 1 -- 172.21.15.67:0/3493427114 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a406c0a0 con 0x7f10a415e210 2024-04-25T02:29:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.583+0000 7f10a3fff640 1 --2- 172.21.15.67:0/3493427114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10a415e210 0x7f10a406cb80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f10940097a0 tx=0x7f109402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2403c90f58fb7393 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.583+0000 7f10a2ffd640 1 -- 172.21.15.67:0/3493427114 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094037070 con 0x7f10a415e210 2024-04-25T02:29:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.583+0000 7f10a2ffd640 1 -- 172.21.15.67:0/3493427114 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109402ae50 con 0x7f10a415e210 2024-04-25T02:29:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.583+0000 7f10a2ffd640 1 -- 172.21.15.67:0/3493427114 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094032660 con 0x7f10a415e210 2024-04-25T02:29:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.583+0000 7f10aa89a640 1 -- 172.21.15.67:0/3493427114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10a415e210 msgr2=0x7f10a406cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.583+0000 7f10aa89a640 1 --2- 172.21.15.67:0/3493427114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10a415e210 0x7f10a406cb80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f10940097a0 tx=0x7f109402a140 comp rx=0 tx=0).stop 2024-04-25T02:29:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.584+0000 7f10aa89a640 1 -- 172.21.15.67:0/3493427114 shutdown_connections 2024-04-25T02:29:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.584+0000 7f10aa89a640 1 --2- 172.21.15.67:0/3493427114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10a415e210 0x7f10a406cb80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.584+0000 7f10aa89a640 1 -- 172.21.15.67:0/3493427114 >> 172.21.15.67:0/3493427114 conn(0x7f10a408dbb0 msgr2=0x7f10a409d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.584+0000 7f10aa89a640 1 -- 172.21.15.67:0/3493427114 shutdown_connections 2024-04-25T02:29:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.584+0000 7f10aa89a640 1 -- 172.21.15.67:0/3493427114 wait complete. 2024-04-25T02:29:02.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.585+0000 7f10aa89a640 1 Processor -- start 2024-04-25T02:29:02.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.585+0000 7f10aa89a640 1 -- start start 2024-04-25T02:29:02.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10aa89a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10a40cf3d0 0x7f10a40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:02.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10aa89a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10a415e210 0x7f10a4159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:02.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10aa89a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10a415e5f0 0x7f10a40d1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:02.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10aa89a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f10a40d4730 con 0x7f10a415e210 2024-04-25T02:29:02.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10aa89a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f10a40d45b0 con 0x7f10a40cf3d0 2024-04-25T02:29:02.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10aa89a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f10a40d48b0 con 0x7f10a415e5f0 2024-04-25T02:29:02.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10a37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10a415e210 0x7f10a4159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:02.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10a37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10a415e210 0x7f10a4159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49470/0 (socket says 172.21.15.67:49470) 2024-04-25T02:29:02.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10a37fe640 1 -- 172.21.15.67:0/3232399133 learned_addr learned my addr 172.21.15.67:0/3232399133 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:02.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10a8e37640 1 --2- 172.21.15.67:0/3232399133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10a415e5f0 0x7f10a40d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:02.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10a3fff640 1 --2- 172.21.15.67:0/3232399133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10a40cf3d0 0x7f10a40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:02.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10a37fe640 1 -- 172.21.15.67:0/3232399133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10a415e5f0 msgr2=0x7f10a40d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:02.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10a37fe640 1 --2- 172.21.15.67:0/3232399133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10a415e5f0 0x7f10a40d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10a37fe640 1 -- 172.21.15.67:0/3232399133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10a40cf3d0 msgr2=0x7f10a40b8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:02.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10a37fe640 1 --2- 172.21.15.67:0/3232399133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10a40cf3d0 0x7f10a40b8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10a37fe640 1 -- 172.21.15.67:0/3232399133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a40cdc10 con 0x7f10a415e210 2024-04-25T02:29:02.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10a37fe640 1 --2- 172.21.15.67:0/3232399133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10a415e210 0x7f10a4159930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f109800c3c0 tx=0x7f109800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:02.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10a0ff9640 1 -- 172.21.15.67:0/3232399133 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098017070 con 0x7f10a415e210 2024-04-25T02:29:02.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10a0ff9640 1 -- 172.21.15.67:0/3232399133 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1098005ce0 con 0x7f10a415e210 2024-04-25T02:29:02.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10aa89a640 1 -- 172.21.15.67:0/3232399133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a40b7b30 con 0x7f10a415e210 2024-04-25T02:29:02.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.586+0000 7f10a0ff9640 1 -- 172.21.15.67:0/3232399133 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10980072f0 con 0x7f10a415e210 2024-04-25T02:29:02.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.587+0000 7f10aa89a640 1 -- 172.21.15.67:0/3232399133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a40b80b0 con 0x7f10a415e210 2024-04-25T02:29:02.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.588+0000 7f10aa89a640 1 -- 172.21.15.67:0/3232399133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a4069110 con 0x7f10a415e210 2024-04-25T02:29:02.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.588+0000 7f10a0ff9640 1 -- 172.21.15.67:0/3232399133 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f109801a070 con 0x7f10a415e210 2024-04-25T02:29:02.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.588+0000 7f10a0ff9640 1 --2- 172.21.15.67:0/3232399133 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f109006be60 0x7f109006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:02.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.588+0000 7f10a0ff9640 1 -- 172.21.15.67:0/3232399133 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f109808a180 con 0x7f10a415e210 2024-04-25T02:29:02.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.588+0000 7f10a3fff640 1 --2- 172.21.15.67:0/3232399133 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f109006be60 0x7f109006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:02.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.589+0000 7f10a3fff640 1 --2- 172.21.15.67:0/3232399133 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f109006be60 0x7f109006e320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1094034000 tx=0x7f109402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:02.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.592+0000 7f10a0ff9640 1 -- 172.21.15.67:0/3232399133 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1098058b30 con 0x7f10a415e210 2024-04-25T02:29:02.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.787+0000 7f10aa89a640 1 -- 172.21.15.67:0/3232399133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f10a406be80 con 0x7f10a415e210 2024-04-25T02:29:02.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.787+0000 7f10a0ff9640 1 -- 172.21.15.67:0/3232399133 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f1098058430 con 0x7f10a415e210 2024-04-25T02:29:02.790 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-04-25T02:29:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.789+0000 7f10aa89a640 1 -- 172.21.15.67:0/3232399133 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f109006be60 msgr2=0x7f109006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.789+0000 7f10aa89a640 1 --2- 172.21.15.67:0/3232399133 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f109006be60 0x7f109006e320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1094034000 tx=0x7f109402e000 comp rx=0 tx=0).stop 2024-04-25T02:29:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.789+0000 7f10aa89a640 1 -- 172.21.15.67:0/3232399133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10a415e210 msgr2=0x7f10a4159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.789+0000 7f10aa89a640 1 --2- 172.21.15.67:0/3232399133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10a415e210 0x7f10a4159930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f109800c3c0 tx=0x7f109800c880 comp rx=0 tx=0).stop 2024-04-25T02:29:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.789+0000 7f10aa89a640 1 -- 172.21.15.67:0/3232399133 shutdown_connections 2024-04-25T02:29:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.789+0000 7f10aa89a640 1 --2- 172.21.15.67:0/3232399133 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f109006be60 0x7f109006e320 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.789+0000 7f10aa89a640 1 --2- 172.21.15.67:0/3232399133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10a415e5f0 0x7f10a40d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.789+0000 7f10aa89a640 1 --2- 172.21.15.67:0/3232399133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10a415e210 0x7f10a4159930 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.789+0000 7f10aa89a640 1 --2- 172.21.15.67:0/3232399133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10a40cf3d0 0x7f10a40b8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.789+0000 7f10aa89a640 1 -- 172.21.15.67:0/3232399133 >> 172.21.15.67:0/3232399133 conn(0x7f10a408dbb0 msgr2=0x7f10a415fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.789+0000 7f10aa89a640 1 -- 172.21.15.67:0/3232399133 shutdown_connections 2024-04-25T02:29:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:02.789+0000 7f10aa89a640 1 -- 172.21.15.67:0/3232399133 wait complete. 2024-04-25T02:29:02.803 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-25T02:29:02.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:02.803 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-25T02:29:02.829 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-04-25T02:29:02.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:02.829 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-25T02:29:02.884 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:29:02.885 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:29:02.904 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:29:02.904 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:29:02.962 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:29:02.962 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:29:03.020 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:29:03.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.117+0000 7f3eed8f5640 1 Processor -- start 2024-04-25T02:29:03.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.117+0000 7f3eed8f5640 1 -- start start 2024-04-25T02:29:03.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.118+0000 7f3eed8f5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3ee815e5f0 0x7f3ee80cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.118+0000 7f3eed8f5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ee80cf200 0x7f3ee80d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.118+0000 7f3eed8f5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ee80d2cc0 con 0x7f3ee815e210 2024-04-25T02:29:03.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.118+0000 7f3eed8f5640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3ee806c6f0 con 0x7f3ee815e5f0 2024-04-25T02:29:03.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.118+0000 7f3eed8f5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3ee80d2fa0 con 0x7f3ee80cf200 2024-04-25T02:29:03.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.118+0000 7f3ee6ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3ee815e210 0x7f3ee806cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42770/0 (socket says 172.21.15.67:42770) 2024-04-25T02:29:03.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.118+0000 7f3ee6ffd640 1 -- 172.21.15.67:0/859782459 learned_addr learned my addr 172.21.15.67:0/859782459 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:03.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee77fe640 1 --2- 172.21.15.67:0/859782459 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ee80cf200 0x7f3ee80d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee67fc640 1 --2- 172.21.15.67:0/859782459 >> v2:172.21.15.176:3300/0 conn(0x7f3ee815e5f0 0x7f3ee80cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee5ffb640 1 -- 172.21.15.67:0/859782459 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 353167616 0 0) 0x7f3ee80d2cc0 con 0x7f3ee815e210 2024-04-25T02:29:03.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee5ffb640 1 -- 172.21.15.67:0/859782459 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ed0003520 con 0x7f3ee815e210 2024-04-25T02:29:03.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee5ffb640 1 -- 172.21.15.67:0/859782459 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1400556653 0 0) 0x7f3ed0003520 con 0x7f3ee815e210 2024-04-25T02:29:03.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee5ffb640 1 -- 172.21.15.67:0/859782459 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ee80cf200 msgr2=0x7f3ee80d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:03.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee5ffb640 1 --2- 172.21.15.67:0/859782459 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ee80cf200 0x7f3ee80d3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee5ffb640 1 -- 172.21.15.67:0/859782459 >> v2:172.21.15.176:3300/0 conn(0x7f3ee815e5f0 msgr2=0x7f3ee80cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:03.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee5ffb640 1 --2- 172.21.15.67:0/859782459 >> v2:172.21.15.176:3300/0 conn(0x7f3ee815e5f0 0x7f3ee80cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee5ffb640 1 -- 172.21.15.67:0/859782459 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee806c0a0 con 0x7f3ee815e210 2024-04-25T02:29:03.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee5ffb640 1 -- 172.21.15.67:0/859782459 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f3ee0001670 con 0x7f3ee815e210 2024-04-25T02:29:03.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee5ffb640 1 -- 172.21.15.67:0/859782459 >> v1:172.21.15.67:6789/0 conn(0x7f3ee815e210 legacy=0x7f3ee806cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:03.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee5ffb640 1 --2- 172.21.15.67:0/859782459 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ee80cf200 0x7f3ed00039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee5ffb640 1 --2- 172.21.15.67:0/859782459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ed0003f50 0x7f3ed0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee5ffb640 1 --2- 172.21.15.67:0/859782459 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ed0004d40 0x7f3ed00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee5ffb640 1 -- 172.21.15.67:0/859782459 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee806c6f0 con 0x7f3ed0003f50 2024-04-25T02:29:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee5ffb640 1 -- 172.21.15.67:0/859782459 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee80d2fa0 con 0x7f3ed0004d40 2024-04-25T02:29:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee5ffb640 1 -- 172.21.15.67:0/859782459 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3ed000b9c0 con 0x7f3ee80cf200 2024-04-25T02:29:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee67fc640 1 --2- 172.21.15.67:0/859782459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ed0003f50 0x7f3ed0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee6ffd640 1 --2- 172.21.15.67:0/859782459 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ee80cf200 0x7f3ed00039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.119+0000 7f3ee77fe640 1 --2- 172.21.15.67:0/859782459 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ed0004d40 0x7f3ed00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.120+0000 7f3ee67fc640 1 -- 172.21.15.67:0/859782459 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ee80cf200 msgr2=0x7f3ed00039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.120+0000 7f3ee67fc640 1 --2- 172.21.15.67:0/859782459 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ee80cf200 0x7f3ed00039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.120+0000 7f3ee67fc640 1 -- 172.21.15.67:0/859782459 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ed0004d40 msgr2=0x7f3ed00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.120+0000 7f3ee67fc640 1 --2- 172.21.15.67:0/859782459 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ed0004d40 0x7f3ed00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.120+0000 7f3ee67fc640 1 -- 172.21.15.67:0/859782459 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed0003520 con 0x7f3ed0003f50 2024-04-25T02:29:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.120+0000 7f3ee67fc640 1 --2- 172.21.15.67:0/859782459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ed0003f50 0x7f3ed0004800 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009af0 tx=0x7f3ed0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eaf8b96332cbe22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.120+0000 7f3ee5ffb640 1 -- 172.21.15.67:0/859782459 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3edc036070 con 0x7f3ed0003f50 2024-04-25T02:29:03.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.120+0000 7f3ee5ffb640 1 -- 172.21.15.67:0/859782459 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3edc031400 con 0x7f3ed0003f50 2024-04-25T02:29:03.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.120+0000 7f3ee5ffb640 1 -- 172.21.15.67:0/859782459 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3edc009690 con 0x7f3ed0003f50 2024-04-25T02:29:03.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.121+0000 7f3eed8f5640 1 -- 172.21.15.67:0/859782459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ed0003f50 msgr2=0x7f3ed0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:03.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.121+0000 7f3eed8f5640 1 --2- 172.21.15.67:0/859782459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ed0003f50 0x7f3ed0004800 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009af0 tx=0x7f3ed0005830 comp rx=0 tx=0).stop 2024-04-25T02:29:03.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.121+0000 7f3ee77fe640 1 -- 172.21.15.67:0/859782459 reap_dead start 2024-04-25T02:29:03.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.121+0000 7f3eed8f5640 1 -- 172.21.15.67:0/859782459 shutdown_connections 2024-04-25T02:29:03.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.121+0000 7f3eed8f5640 1 -- 172.21.15.67:0/859782459 >> 172.21.15.67:0/859782459 conn(0x7f3ee808dbb0 msgr2=0x7f3ee809d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:03.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.121+0000 7f3eed8f5640 1 -- 172.21.15.67:0/859782459 shutdown_connections 2024-04-25T02:29:03.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.121+0000 7f3eed8f5640 1 -- 172.21.15.67:0/859782459 wait complete. 2024-04-25T02:29:03.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.122+0000 7f3eed8f5640 1 Processor -- start 2024-04-25T02:29:03.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.122+0000 7f3eed8f5640 1 -- start start 2024-04-25T02:29:03.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.123+0000 7f3eed8f5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ed0003f50 0x7f3ee81504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.123+0000 7f3eed8f5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ee815a110 0x7f3ee80cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.123+0000 7f3eed8f5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ee80cbd20 0x7f3ee80cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.123+0000 7f3eed8f5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee806d410 con 0x7f3ed0003f50 2024-04-25T02:29:03.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.123+0000 7f3eed8f5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee806d290 con 0x7f3ee80cbd20 2024-04-25T02:29:03.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.123+0000 7f3eed8f5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3ee80d3e60 con 0x7f3ee815a110 2024-04-25T02:29:03.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.123+0000 7f3ee6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ed0003f50 0x7f3ee81504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.123+0000 7f3ee6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ed0003f50 0x7f3ee81504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49496/0 (socket says 172.21.15.67:49496) 2024-04-25T02:29:03.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.123+0000 7f3ee6ffd640 1 -- 172.21.15.67:0/798559917 learned_addr learned my addr 172.21.15.67:0/798559917 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:03.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.123+0000 7f3ee77fe640 1 --2- 172.21.15.67:0/798559917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ee80cbd20 0x7f3ee80cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.123+0000 7f3ee6ffd640 1 -- 172.21.15.67:0/798559917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ee815a110 msgr2=0x7f3ee80cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:03.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.123+0000 7f3ee67fc640 1 --2- 172.21.15.67:0/798559917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ee815a110 0x7f3ee80cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.124+0000 7f3ee6ffd640 1 --2- 172.21.15.67:0/798559917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ee815a110 0x7f3ee80cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.124+0000 7f3ee6ffd640 1 -- 172.21.15.67:0/798559917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ee80cbd20 msgr2=0x7f3ee80cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:03.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.124+0000 7f3ee6ffd640 1 --2- 172.21.15.67:0/798559917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ee80cbd20 0x7f3ee80cc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.124+0000 7f3ee6ffd640 1 -- 172.21.15.67:0/798559917 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee815c9f0 con 0x7f3ed0003f50 2024-04-25T02:29:03.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.124+0000 7f3ee6ffd640 1 --2- 172.21.15.67:0/798559917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ed0003f50 0x7f3ee81504e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0004f70 tx=0x7f3ee00074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:03.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.124+0000 7f3ecffff640 1 -- 172.21.15.67:0/798559917 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee001a070 con 0x7f3ed0003f50 2024-04-25T02:29:03.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.124+0000 7f3ecffff640 1 -- 172.21.15.67:0/798559917 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ee0007740 con 0x7f3ed0003f50 2024-04-25T02:29:03.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.124+0000 7f3eed8f5640 1 -- 172.21.15.67:0/798559917 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee815ccd0 con 0x7f3ed0003f50 2024-04-25T02:29:03.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.124+0000 7f3ecffff640 1 -- 172.21.15.67:0/798559917 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee000fb80 con 0x7f3ed0003f50 2024-04-25T02:29:03.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.124+0000 7f3eed8f5640 1 -- 172.21.15.67:0/798559917 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee815d290 con 0x7f3ed0003f50 2024-04-25T02:29:03.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.125+0000 7f3eed8f5640 1 -- 172.21.15.67:0/798559917 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee8069110 con 0x7f3ed0003f50 2024-04-25T02:29:03.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.125+0000 7f3ecffff640 1 -- 172.21.15.67:0/798559917 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ee001d070 con 0x7f3ed0003f50 2024-04-25T02:29:03.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.126+0000 7f3ecffff640 1 --2- 172.21.15.67:0/798559917 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3ed406be30 0x7f3ed406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.126+0000 7f3ecffff640 1 -- 172.21.15.67:0/798559917 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3ee008a690 con 0x7f3ed0003f50 2024-04-25T02:29:03.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.126+0000 7f3ee67fc640 1 --2- 172.21.15.67:0/798559917 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3ed406be30 0x7f3ed406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.127+0000 7f3ee67fc640 1 --2- 172.21.15.67:0/798559917 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3ed406be30 0x7f3ed406e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3edc033000 tx=0x7f3edc008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:03.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.130+0000 7f3ecffff640 1 -- 172.21.15.67:0/798559917 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3ee00590d0 con 0x7f3ed0003f50 2024-04-25T02:29:03.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.315+0000 7f3eed8f5640 1 -- 172.21.15.67:0/798559917 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ee806be80 con 0x7f3ed0003f50 2024-04-25T02:29:03.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.316+0000 7f3ecffff640 1 -- 172.21.15.67:0/798559917 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f3ee00589d0 con 0x7f3ed0003f50 2024-04-25T02:29:03.319 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:03.319 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:27.819641+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:29:03.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.318+0000 7f3eed8f5640 1 -- 172.21.15.67:0/798559917 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3ed406be30 msgr2=0x7f3ed406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:03.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.318+0000 7f3eed8f5640 1 --2- 172.21.15.67:0/798559917 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3ed406be30 0x7f3ed406e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3edc033000 tx=0x7f3edc008030 comp rx=0 tx=0).stop 2024-04-25T02:29:03.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.318+0000 7f3eed8f5640 1 -- 172.21.15.67:0/798559917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ed0003f50 msgr2=0x7f3ee81504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:03.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.318+0000 7f3eed8f5640 1 --2- 172.21.15.67:0/798559917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ed0003f50 0x7f3ee81504e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0004f70 tx=0x7f3ee00074f0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.318+0000 7f3eed8f5640 1 -- 172.21.15.67:0/798559917 shutdown_connections 2024-04-25T02:29:03.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.318+0000 7f3eed8f5640 1 --2- 172.21.15.67:0/798559917 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3ed406be30 0x7f3ed406e2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.318+0000 7f3eed8f5640 1 --2- 172.21.15.67:0/798559917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ee80cbd20 0x7f3ee80cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.318+0000 7f3eed8f5640 1 --2- 172.21.15.67:0/798559917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ee815a110 0x7f3ee80cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.318+0000 7f3eed8f5640 1 --2- 172.21.15.67:0/798559917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ed0003f50 0x7f3ee81504e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.318+0000 7f3eed8f5640 1 -- 172.21.15.67:0/798559917 >> 172.21.15.67:0/798559917 conn(0x7f3ee808dbb0 msgr2=0x7f3ee815ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:03.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.318+0000 7f3eed8f5640 1 -- 172.21.15.67:0/798559917 shutdown_connections 2024-04-25T02:29:03.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.318+0000 7f3eed8f5640 1 -- 172.21.15.67:0/798559917 wait complete. 2024-04-25T02:29:03.332 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:28:24.445606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:28:25.161619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:29:03.332 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:29:03.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.433+0000 7fbf1257e640 1 Processor -- start 2024-04-25T02:29:03.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.433+0000 7fbf1257e640 1 -- start start 2024-04-25T02:29:03.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.434+0000 7fbf1257e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbf0c15b090 0x7fbf0c09db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.434+0000 7fbf1257e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf0c0b2cc0 0x7fbf0c06e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.434+0000 7fbf1257e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf0c0ad820 con 0x7fbf0c06ea70 2024-04-25T02:29:03.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.434+0000 7fbf1257e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fbf0c0b3260 con 0x7fbf0c15b090 2024-04-25T02:29:03.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.434+0000 7fbf1257e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbf0c0b3540 con 0x7fbf0c0b2cc0 2024-04-25T02:29:03.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.434+0000 7fbf0bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbf0c15b090 0x7fbf0c09db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.434+0000 7fbf0bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbf0c15b090 0x7fbf0c09db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49510/0 (socket says 172.21.15.67:49510) 2024-04-25T02:29:03.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.434+0000 7fbf0bfff640 1 -- 172.21.15.67:0/1374936908 learned_addr learned my addr 172.21.15.67:0/1374936908 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:03.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.434+0000 7fbf0b7fe640 1 --2- 172.21.15.67:0/1374936908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf0c0b2cc0 0x7fbf0c06e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.434+0000 7fbf0bfff640 1 -- 172.21.15.67:0/1374936908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf0c0b2cc0 msgr2=0x7fbf0c06e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:03.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.434+0000 7fbf0bfff640 1 --2- 172.21.15.67:0/1374936908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf0c0b2cc0 0x7fbf0c06e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.434+0000 7fbf0bfff640 1 -- 172.21.15.67:0/1374936908 >> v1:172.21.15.176:6789/0 conn(0x7fbf0c06ea70 legacy=0x7fbf0c15ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:03.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.434+0000 7fbf0bfff640 1 -- 172.21.15.67:0/1374936908 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0c0b3820 con 0x7fbf0c15b090 2024-04-25T02:29:03.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.435+0000 7fbf0bfff640 1 --2- 172.21.15.67:0/1374936908 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf0c15b090 0x7fbf0c09db30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009870 tx=0x7fbefc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39cb9081dff59bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:03.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.435+0000 7fbf0affd640 1 -- 172.21.15.67:0/1374936908 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc037070 con 0x7fbf0c15b090 2024-04-25T02:29:03.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.435+0000 7fbf0affd640 1 -- 172.21.15.67:0/1374936908 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbefc032440 con 0x7fbf0c15b090 2024-04-25T02:29:03.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.435+0000 7fbf0affd640 1 -- 172.21.15.67:0/1374936908 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc032810 con 0x7fbf0c15b090 2024-04-25T02:29:03.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.436+0000 7fbf1257e640 1 -- 172.21.15.67:0/1374936908 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf0c15b090 msgr2=0x7fbf0c09db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:03.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.436+0000 7fbf1257e640 1 --2- 172.21.15.67:0/1374936908 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf0c15b090 0x7fbf0c09db30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009870 tx=0x7fbefc02a210 comp rx=0 tx=0).stop 2024-04-25T02:29:03.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.436+0000 7fbf1257e640 1 -- 172.21.15.67:0/1374936908 shutdown_connections 2024-04-25T02:29:03.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.436+0000 7fbf1257e640 1 --2- 172.21.15.67:0/1374936908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf0c0b2cc0 0x7fbf0c06e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.436+0000 7fbf1257e640 1 --2- 172.21.15.67:0/1374936908 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf0c15b090 0x7fbf0c09db30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.436+0000 7fbf1257e640 1 -- 172.21.15.67:0/1374936908 >> 172.21.15.67:0/1374936908 conn(0x7fbf0c0b19c0 msgr2=0x7fbf0c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:03.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.436+0000 7fbf1257e640 1 -- 172.21.15.67:0/1374936908 shutdown_connections 2024-04-25T02:29:03.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.436+0000 7fbf1257e640 1 -- 172.21.15.67:0/1374936908 wait complete. 2024-04-25T02:29:03.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.437+0000 7fbf1257e640 1 Processor -- start 2024-04-25T02:29:03.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.437+0000 7fbf1257e640 1 -- start start 2024-04-25T02:29:03.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.438+0000 7fbf1257e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf0c06ea70 0x7fbf0c1e59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.438+0000 7fbf1257e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf0c0b2cc0 0x7fbf0c1496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.438+0000 7fbf1257e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf0c15b090 0x7fbf0c159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.438+0000 7fbf1257e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c15b470 con 0x7fbf0c06ea70 2024-04-25T02:29:03.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.438+0000 7fbf1257e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c0b4f70 con 0x7fbf0c15b090 2024-04-25T02:29:03.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.438+0000 7fbf1257e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbf0c070e10 con 0x7fbf0c0b2cc0 2024-04-25T02:29:03.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.438+0000 7fbf0bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf0c06ea70 0x7fbf0c1e59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.438+0000 7fbf0bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf0c06ea70 0x7fbf0c1e59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49514/0 (socket says 172.21.15.67:49514) 2024-04-25T02:29:03.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.438+0000 7fbf0bfff640 1 -- 172.21.15.67:0/1790036780 learned_addr learned my addr 172.21.15.67:0/1790036780 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:03.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.438+0000 7fbf0bfff640 1 -- 172.21.15.67:0/1790036780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf0c0b2cc0 msgr2=0x7fbf0c1496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:03.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.438+0000 7fbf0bfff640 1 --2- 172.21.15.67:0/1790036780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf0c0b2cc0 0x7fbf0c1496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.438+0000 7fbf0bfff640 1 -- 172.21.15.67:0/1790036780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf0c15b090 msgr2=0x7fbf0c159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:03.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.438+0000 7fbf0bfff640 1 --2- 172.21.15.67:0/1790036780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf0c15b090 0x7fbf0c159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.438+0000 7fbf0bfff640 1 -- 172.21.15.67:0/1790036780 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0c1e4c30 con 0x7fbf0c06ea70 2024-04-25T02:29:03.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.438+0000 7fbf0bfff640 1 --2- 172.21.15.67:0/1790036780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf0c06ea70 0x7fbf0c1e59f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbefc02a250 tx=0x7fbefc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:03.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.439+0000 7fbf08ff9640 1 -- 172.21.15.67:0/1790036780 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc041020 con 0x7fbf0c06ea70 2024-04-25T02:29:03.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.439+0000 7fbf08ff9640 1 -- 172.21.15.67:0/1790036780 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbefc0306c0 con 0x7fbf0c06ea70 2024-04-25T02:29:03.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.439+0000 7fbf1257e640 1 -- 172.21.15.67:0/1790036780 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf0c1e4f10 con 0x7fbf0c06ea70 2024-04-25T02:29:03.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.439+0000 7fbf08ff9640 1 -- 172.21.15.67:0/1790036780 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc037040 con 0x7fbf0c06ea70 2024-04-25T02:29:03.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.439+0000 7fbf1257e640 1 -- 172.21.15.67:0/1790036780 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf0c1e54d0 con 0x7fbf0c06ea70 2024-04-25T02:29:03.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.440+0000 7fbf1257e640 1 -- 172.21.15.67:0/1790036780 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf0c069110 con 0x7fbf0c06ea70 2024-04-25T02:29:03.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.440+0000 7fbf08ff9640 1 -- 172.21.15.67:0/1790036780 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbefc044020 con 0x7fbf0c06ea70 2024-04-25T02:29:03.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.440+0000 7fbf08ff9640 1 --2- 172.21.15.67:0/1790036780 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbef806be30 0x7fbef806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.441+0000 7fbf08ff9640 1 -- 172.21.15.67:0/1790036780 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbefc0ab320 con 0x7fbf0c06ea70 2024-04-25T02:29:03.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.441+0000 7fbf0b7fe640 1 --2- 172.21.15.67:0/1790036780 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbef806be30 0x7fbef806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.441+0000 7fbf0b7fe640 1 --2- 172.21.15.67:0/1790036780 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbef806be30 0x7fbef806e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c159d70 tx=0x7fbf00008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:03.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.445+0000 7fbf08ff9640 1 -- 172.21.15.67:0/1790036780 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbefc04b070 con 0x7fbf0c06ea70 2024-04-25T02:29:03.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.626+0000 7fbf1257e640 1 -- 172.21.15.67:0/1790036780 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbf0c06cdd0 con 0x7fbf0c06ea70 2024-04-25T02:29:03.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.626+0000 7fbf08ff9640 1 -- 172.21.15.67:0/1790036780 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fbefc079cd0 con 0x7fbf0c06ea70 2024-04-25T02:29:03.629 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:29:03.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.628+0000 7fbf1257e640 1 -- 172.21.15.67:0/1790036780 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbef806be30 msgr2=0x7fbef806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:03.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.628+0000 7fbf1257e640 1 --2- 172.21.15.67:0/1790036780 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbef806be30 0x7fbef806e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c159d70 tx=0x7fbf00008040 comp rx=0 tx=0).stop 2024-04-25T02:29:03.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.628+0000 7fbf1257e640 1 -- 172.21.15.67:0/1790036780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf0c06ea70 msgr2=0x7fbf0c1e59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:03.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.628+0000 7fbf1257e640 1 --2- 172.21.15.67:0/1790036780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf0c06ea70 0x7fbf0c1e59f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbefc02a250 tx=0x7fbefc0046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.628+0000 7fbf1257e640 1 -- 172.21.15.67:0/1790036780 shutdown_connections 2024-04-25T02:29:03.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.628+0000 7fbf1257e640 1 --2- 172.21.15.67:0/1790036780 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbef806be30 0x7fbef806e2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.628+0000 7fbf1257e640 1 --2- 172.21.15.67:0/1790036780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf0c15b090 0x7fbf0c159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.628+0000 7fbf1257e640 1 --2- 172.21.15.67:0/1790036780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf0c0b2cc0 0x7fbf0c1496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.628+0000 7fbf1257e640 1 --2- 172.21.15.67:0/1790036780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf0c06ea70 0x7fbf0c1e59f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.628+0000 7fbf1257e640 1 -- 172.21.15.67:0/1790036780 >> 172.21.15.67:0/1790036780 conn(0x7fbf0c0b19c0 msgr2=0x7fbf0c0b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:03.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.628+0000 7fbf1257e640 1 -- 172.21.15.67:0/1790036780 shutdown_connections 2024-04-25T02:29:03.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.628+0000 7fbf1257e640 1 -- 172.21.15.67:0/1790036780 wait complete. 2024-04-25T02:29:03.642 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:29:03.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.743+0000 7f794dada640 1 Processor -- start 2024-04-25T02:29:03.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.743+0000 7f794dada640 1 -- start start 2024-04-25T02:29:03.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.744+0000 7f794dada640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794815b090 0x7f794809db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.744+0000 7f794dada640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f79480b2cc0 0x7f794806e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.744+0000 7f794dada640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79480ad820 con 0x7f794806ea70 2024-04-25T02:29:03.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.744+0000 7f794dada640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f79480b3260 con 0x7f79480b2cc0 2024-04-25T02:29:03.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.744+0000 7f794dada640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f79480b3540 con 0x7f794815b090 2024-04-25T02:29:03.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.744+0000 7f7947fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f794806ea70 0x7f794815ec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42780/0 (socket says 172.21.15.67:42780) 2024-04-25T02:29:03.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.744+0000 7f7947fff640 1 -- 172.21.15.67:0/4041726218 learned_addr learned my addr 172.21.15.67:0/4041726218 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:03.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.744+0000 7f79477fe640 1 --2- 172.21.15.67:0/4041726218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794815b090 0x7f794809db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.744+0000 7f7946ffd640 1 --2- 172.21.15.67:0/4041726218 >> v2:172.21.15.176:3300/0 conn(0x7f79480b2cc0 0x7f794806e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.744+0000 7f79467fc640 1 -- 172.21.15.67:0/4041726218 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3025466436 0 0) 0x7f79480ad820 con 0x7f794806ea70 2024-04-25T02:29:03.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.744+0000 7f79467fc640 1 -- 172.21.15.67:0/4041726218 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7930003520 con 0x7f794806ea70 2024-04-25T02:29:03.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.744+0000 7f79467fc640 1 -- 172.21.15.67:0/4041726218 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3257665166 0 0) 0x7f7930003520 con 0x7f794806ea70 2024-04-25T02:29:03.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.744+0000 7f79467fc640 1 -- 172.21.15.67:0/4041726218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794815b090 msgr2=0x7f794809db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:03.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.744+0000 7f79467fc640 1 --2- 172.21.15.67:0/4041726218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794815b090 0x7f794809db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.744+0000 7f79467fc640 1 -- 172.21.15.67:0/4041726218 >> v2:172.21.15.176:3300/0 conn(0x7f79480b2cc0 msgr2=0x7f794806e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.744+0000 7f79467fc640 1 --2- 172.21.15.67:0/4041726218 >> v2:172.21.15.176:3300/0 conn(0x7f79480b2cc0 0x7f794806e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.744+0000 7f79467fc640 1 -- 172.21.15.67:0/4041726218 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79480b3820 con 0x7f794806ea70 2024-04-25T02:29:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.745+0000 7f79467fc640 1 -- 172.21.15.67:0/4041726218 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f79400019f0 con 0x7f794806ea70 2024-04-25T02:29:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.745+0000 7f79477fe640 1 --2- 172.21.15.67:0/4041726218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794815b090 0x7f794809db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.745+0000 7f79467fc640 1 -- 172.21.15.67:0/4041726218 >> v1:172.21.15.67:6789/0 conn(0x7f794806ea70 legacy=0x7f794815ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.745+0000 7f79467fc640 1 --2- 172.21.15.67:0/4041726218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79300039b0 0x7f7930003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.745+0000 7f79467fc640 1 --2- 172.21.15.67:0/4041726218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7930004800 0x7f7930004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.745+0000 7f79467fc640 1 --2- 172.21.15.67:0/4041726218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794815b090 0x7f79300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.745+0000 7f79467fc640 1 -- 172.21.15.67:0/4041726218 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f79480b3260 con 0x7f7930004800 2024-04-25T02:29:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.745+0000 7f79467fc640 1 -- 172.21.15.67:0/4041726218 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f79480b3540 con 0x7f79300039b0 2024-04-25T02:29:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.745+0000 7f79467fc640 1 -- 172.21.15.67:0/4041726218 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f793000b9c0 con 0x7f794815b090 2024-04-25T02:29:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.745+0000 7f7946ffd640 1 --2- 172.21.15.67:0/4041726218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7930004800 0x7f7930004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.745+0000 7f79477fe640 1 --2- 172.21.15.67:0/4041726218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79300039b0 0x7f7930003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.745+0000 7f7947fff640 1 --2- 172.21.15.67:0/4041726218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794815b090 0x7f79300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.745+0000 7f7946ffd640 1 -- 172.21.15.67:0/4041726218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794815b090 msgr2=0x7f79300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:03.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.745+0000 7f7946ffd640 1 --2- 172.21.15.67:0/4041726218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794815b090 0x7f79300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.745+0000 7f7946ffd640 1 -- 172.21.15.67:0/4041726218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79300039b0 msgr2=0x7f7930003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:03.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.745+0000 7f7946ffd640 1 --2- 172.21.15.67:0/4041726218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79300039b0 0x7f7930003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.745+0000 7f7946ffd640 1 -- 172.21.15.67:0/4041726218 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7930003520 con 0x7f7930004800 2024-04-25T02:29:03.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.746+0000 7f7946ffd640 1 --2- 172.21.15.67:0/4041726218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7930004800 0x7f7930004c80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f793c009ac0 tx=0x7f7930005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6644497001533b85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:03.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.746+0000 7f79467fc640 1 -- 172.21.15.67:0/4041726218 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c036070 con 0x7f7930004800 2024-04-25T02:29:03.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.746+0000 7f79467fc640 1 -- 172.21.15.67:0/4041726218 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f793c031400 con 0x7f7930004800 2024-04-25T02:29:03.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.746+0000 7f79467fc640 1 -- 172.21.15.67:0/4041726218 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c009690 con 0x7f7930004800 2024-04-25T02:29:03.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.746+0000 7f794dada640 1 -- 172.21.15.67:0/4041726218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7930004800 msgr2=0x7f7930004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:03.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.746+0000 7f794dada640 1 --2- 172.21.15.67:0/4041726218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7930004800 0x7f7930004c80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f793c009ac0 tx=0x7f7930005830 comp rx=0 tx=0).stop 2024-04-25T02:29:03.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.746+0000 7f7947fff640 1 -- 172.21.15.67:0/4041726218 reap_dead start 2024-04-25T02:29:03.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.746+0000 7f794dada640 1 -- 172.21.15.67:0/4041726218 shutdown_connections 2024-04-25T02:29:03.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.746+0000 7f794dada640 1 -- 172.21.15.67:0/4041726218 >> 172.21.15.67:0/4041726218 conn(0x7f79480b19c0 msgr2=0x7f79480b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:03.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.746+0000 7f794dada640 1 -- 172.21.15.67:0/4041726218 shutdown_connections 2024-04-25T02:29:03.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.746+0000 7f794dada640 1 -- 172.21.15.67:0/4041726218 wait complete. 2024-04-25T02:29:03.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.748+0000 7f794dada640 1 Processor -- start 2024-04-25T02:29:03.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.748+0000 7f794dada640 1 -- start start 2024-04-25T02:29:03.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.748+0000 7f794dada640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7930004800 0x7f7948155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.748+0000 7f794dada640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794814a820 0x7f7948156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f794dada640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7948157320 0x7f79480cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f794dada640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f794815b470 con 0x7f7930004800 2024-04-25T02:29:03.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f794dada640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f79480b4f70 con 0x7f7948157320 2024-04-25T02:29:03.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f794dada640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7948070e10 con 0x7f794814a820 2024-04-25T02:29:03.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f79477fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7930004800 0x7f7948155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f79477fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7930004800 0x7f7948155ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49542/0 (socket says 172.21.15.67:49542) 2024-04-25T02:29:03.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f79477fe640 1 -- 172.21.15.67:0/2380999388 learned_addr learned my addr 172.21.15.67:0/2380999388 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:03.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f7946ffd640 1 --2- 172.21.15.67:0/2380999388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794814a820 0x7f7948156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f7947fff640 1 --2- 172.21.15.67:0/2380999388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7948157320 0x7f79480cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f79477fe640 1 -- 172.21.15.67:0/2380999388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794814a820 msgr2=0x7f7948156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:03.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f79477fe640 1 --2- 172.21.15.67:0/2380999388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794814a820 0x7f7948156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f79477fe640 1 -- 172.21.15.67:0/2380999388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7948157320 msgr2=0x7f79480cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:03.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f79477fe640 1 --2- 172.21.15.67:0/2380999388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7948157320 0x7f79480cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f79477fe640 1 -- 172.21.15.67:0/2380999388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f794814aca0 con 0x7f7930004800 2024-04-25T02:29:03.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f79477fe640 1 --2- 172.21.15.67:0/2380999388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7930004800 0x7f7948155ea0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f79380119d0 tx=0x7f7938011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:03.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f792ffff640 1 -- 172.21.15.67:0/2380999388 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793800faf0 con 0x7f7930004800 2024-04-25T02:29:03.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f792ffff640 1 -- 172.21.15.67:0/2380999388 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f793800fc90 con 0x7f7930004800 2024-04-25T02:29:03.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f794dada640 1 -- 172.21.15.67:0/2380999388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7948154e00 con 0x7f7930004800 2024-04-25T02:29:03.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f792ffff640 1 -- 172.21.15.67:0/2380999388 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7938004030 con 0x7f7930004800 2024-04-25T02:29:03.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.749+0000 7f794dada640 1 -- 172.21.15.67:0/2380999388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79481553c0 con 0x7f7930004800 2024-04-25T02:29:03.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.750+0000 7f794dada640 1 -- 172.21.15.67:0/2380999388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7948069110 con 0x7f7930004800 2024-04-25T02:29:03.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.751+0000 7f792ffff640 1 -- 172.21.15.67:0/2380999388 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7938012040 con 0x7f7930004800 2024-04-25T02:29:03.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.751+0000 7f792ffff640 1 --2- 172.21.15.67:0/2380999388 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f793406be60 0x7f793406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:03.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.751+0000 7f792ffff640 1 -- 172.21.15.67:0/2380999388 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f793808b0d0 con 0x7f7930004800 2024-04-25T02:29:03.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.752+0000 7f7946ffd640 1 --2- 172.21.15.67:0/2380999388 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f793406be60 0x7f793406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:03.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.752+0000 7f7946ffd640 1 --2- 172.21.15.67:0/2380999388 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f793406be60 0x7f793406e320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f793c033000 tx=0x7f793c008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:03.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.756+0000 7f792ffff640 1 -- 172.21.15.67:0/2380999388 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7938019070 con 0x7f7930004800 2024-04-25T02:29:03.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.937+0000 7f794dada640 1 -- 172.21.15.67:0/2380999388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f794806cdd0 con 0x7f7930004800 2024-04-25T02:29:03.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.937+0000 7f792ffff640 1 -- 172.21.15.67:0/2380999388 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f7938059b10 con 0x7f7930004800 2024-04-25T02:29:03.940 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-25T02:29:03.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.939+0000 7f794dada640 1 -- 172.21.15.67:0/2380999388 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f793406be60 msgr2=0x7f793406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:03.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.939+0000 7f794dada640 1 --2- 172.21.15.67:0/2380999388 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f793406be60 0x7f793406e320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f793c033000 tx=0x7f793c008030 comp rx=0 tx=0).stop 2024-04-25T02:29:03.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.939+0000 7f794dada640 1 -- 172.21.15.67:0/2380999388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7930004800 msgr2=0x7f7948155ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:03.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.939+0000 7f794dada640 1 --2- 172.21.15.67:0/2380999388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7930004800 0x7f7948155ea0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f79380119d0 tx=0x7f7938011e90 comp rx=0 tx=0).stop 2024-04-25T02:29:03.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.939+0000 7f794dada640 1 -- 172.21.15.67:0/2380999388 shutdown_connections 2024-04-25T02:29:03.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.939+0000 7f794dada640 1 --2- 172.21.15.67:0/2380999388 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f793406be60 0x7f793406e320 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.939+0000 7f794dada640 1 --2- 172.21.15.67:0/2380999388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7948157320 0x7f79480cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.939+0000 7f794dada640 1 --2- 172.21.15.67:0/2380999388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794814a820 0x7f7948156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.939+0000 7f794dada640 1 --2- 172.21.15.67:0/2380999388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7930004800 0x7f7948155ea0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:03.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.939+0000 7f794dada640 1 -- 172.21.15.67:0/2380999388 >> 172.21.15.67:0/2380999388 conn(0x7f79480b19c0 msgr2=0x7f794815dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:03.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.939+0000 7f794dada640 1 -- 172.21.15.67:0/2380999388 shutdown_connections 2024-04-25T02:29:03.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:03.939+0000 7f794dada640 1 -- 172.21.15.67:0/2380999388 wait complete. 2024-04-25T02:29:03.953 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:29:04.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.055+0000 7f38c1563640 1 Processor -- start 2024-04-25T02:29:04.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.055+0000 7f38c1563640 1 -- start start 2024-04-25T02:29:04.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.056+0000 7f38c1563640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f38bc156620 0x7f38bc15cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:04.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.056+0000 7f38c1563640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f38bc0ae8e0 0x7f38bc0aed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:04.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.056+0000 7f38c1563640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38bc06d100 con 0x7f38bc06edf0 2024-04-25T02:29:04.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.056+0000 7f38c1563640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f38bc0acda0 con 0x7f38bc156620 2024-04-25T02:29:04.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.056+0000 7f38c1563640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f38bc0ad060 con 0x7f38bc0ae8e0 2024-04-25T02:29:04.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.056+0000 7f38baffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f38bc156620 0x7f38bc15cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:04.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.056+0000 7f38baffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f38bc156620 0x7f38bc15cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49554/0 (socket says 172.21.15.67:49554) 2024-04-25T02:29:04.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.056+0000 7f38baffd640 1 -- 172.21.15.67:0/2073636230 learned_addr learned my addr 172.21.15.67:0/2073636230 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:04.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.056+0000 7f38baffd640 1 -- 172.21.15.67:0/2073636230 >> v2:172.21.15.176:3300/0 conn(0x7f38bc0ae8e0 msgr2=0x7f38bc0aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:04.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.056+0000 7f38baffd640 1 --2- 172.21.15.67:0/2073636230 >> v2:172.21.15.176:3300/0 conn(0x7f38bc0ae8e0 0x7f38bc0aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.056+0000 7f38baffd640 1 -- 172.21.15.67:0/2073636230 >> v1:172.21.15.176:6789/0 conn(0x7f38bc06edf0 legacy=0x7f38bc06dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:04.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.056+0000 7f38baffd640 1 -- 172.21.15.67:0/2073636230 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38bc06d3a0 con 0x7f38bc156620 2024-04-25T02:29:04.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.057+0000 7f38baffd640 1 --2- 172.21.15.67:0/2073636230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38bc156620 0x7f38bc15cf70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0b1950 tx=0x7f38ac02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c18004d07182dc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:04.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.057+0000 7f38ba7fc640 1 -- 172.21.15.67:0/2073636230 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac037070 con 0x7f38bc156620 2024-04-25T02:29:04.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.057+0000 7f38ba7fc640 1 -- 172.21.15.67:0/2073636230 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38ac032440 con 0x7f38bc156620 2024-04-25T02:29:04.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.057+0000 7f38ba7fc640 1 -- 172.21.15.67:0/2073636230 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac032810 con 0x7f38bc156620 2024-04-25T02:29:04.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.058+0000 7f38c1563640 1 -- 172.21.15.67:0/2073636230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38bc156620 msgr2=0x7f38bc15cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:04.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.058+0000 7f38c1563640 1 --2- 172.21.15.67:0/2073636230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38bc156620 0x7f38bc15cf70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0b1950 tx=0x7f38ac02a1a0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.058+0000 7f38c1563640 1 -- 172.21.15.67:0/2073636230 shutdown_connections 2024-04-25T02:29:04.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.058+0000 7f38c1563640 1 --2- 172.21.15.67:0/2073636230 >> v2:172.21.15.176:3300/0 conn(0x7f38bc0ae8e0 0x7f38bc0aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.058+0000 7f38c1563640 1 --2- 172.21.15.67:0/2073636230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38bc156620 0x7f38bc15cf70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.058+0000 7f38c1563640 1 -- 172.21.15.67:0/2073636230 >> 172.21.15.67:0/2073636230 conn(0x7f38bc0b19c0 msgr2=0x7f38bc0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:04.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.058+0000 7f38c1563640 1 -- 172.21.15.67:0/2073636230 shutdown_connections 2024-04-25T02:29:04.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.058+0000 7f38c1563640 1 -- 172.21.15.67:0/2073636230 wait complete. 2024-04-25T02:29:04.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.059+0000 7f38c1563640 1 Processor -- start 2024-04-25T02:29:04.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.059+0000 7f38c1563640 1 -- start start 2024-04-25T02:29:04.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38c1563640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38bc06edf0 0x7f38bc0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:04.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38c1563640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38bc0ae8e0 0x7f38bc14f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:04.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38c1563640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc156620 0x7f38bc1e7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:04.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38c1563640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f38bc0ad340 con 0x7f38bc0ae8e0 2024-04-25T02:29:04.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38c1563640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f38bc0af290 con 0x7f38bc156620 2024-04-25T02:29:04.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38c1563640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f38bc0ad4c0 con 0x7f38bc06edf0 2024-04-25T02:29:04.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38b3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38bc0ae8e0 0x7f38bc14f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:04.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38b3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38bc0ae8e0 0x7f38bc14f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49560/0 (socket says 172.21.15.67:49560) 2024-04-25T02:29:04.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38b3fff640 1 -- 172.21.15.67:0/2268996496 learned_addr learned my addr 172.21.15.67:0/2268996496 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:04.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38baffd640 1 --2- 172.21.15.67:0/2268996496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38bc06edf0 0x7f38bc0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:04.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38bb7fe640 1 --2- 172.21.15.67:0/2268996496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc156620 0x7f38bc1e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:04.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38b3fff640 1 -- 172.21.15.67:0/2268996496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38bc06edf0 msgr2=0x7f38bc0b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:04.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38b3fff640 1 --2- 172.21.15.67:0/2268996496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38bc06edf0 0x7f38bc0b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38b3fff640 1 -- 172.21.15.67:0/2268996496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc156620 msgr2=0x7f38bc1e7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:04.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38b3fff640 1 --2- 172.21.15.67:0/2268996496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc156620 0x7f38bc1e7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38b3fff640 1 -- 172.21.15.67:0/2268996496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38bc0b3d50 con 0x7f38bc0ae8e0 2024-04-25T02:29:04.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38baffd640 1 --2- 172.21.15.67:0/2268996496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38bc06edf0 0x7f38bc0b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:04.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38b3fff640 1 --2- 172.21.15.67:0/2268996496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38bc0ae8e0 0x7f38bc14f970 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f38a400b3e0 tx=0x7f38a400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:04.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38b37fe640 1 -- 172.21.15.67:0/2268996496 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4015020 con 0x7f38bc0ae8e0 2024-04-25T02:29:04.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.060+0000 7f38b37fe640 1 -- 172.21.15.67:0/2268996496 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a4011850 con 0x7f38bc0ae8e0 2024-04-25T02:29:04.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.061+0000 7f38b37fe640 1 -- 172.21.15.67:0/2268996496 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4011c40 con 0x7f38bc0ae8e0 2024-04-25T02:29:04.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.061+0000 7f38c1563640 1 -- 172.21.15.67:0/2268996496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38bc1e7b20 con 0x7f38bc0ae8e0 2024-04-25T02:29:04.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.061+0000 7f38c1563640 1 -- 172.21.15.67:0/2268996496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38bc0b3010 con 0x7f38bc0ae8e0 2024-04-25T02:29:04.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.061+0000 7f38c1563640 1 -- 172.21.15.67:0/2268996496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38bc069110 con 0x7f38bc0ae8e0 2024-04-25T02:29:04.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.062+0000 7f38b37fe640 1 -- 172.21.15.67:0/2268996496 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38a4018020 con 0x7f38bc0ae8e0 2024-04-25T02:29:04.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.062+0000 7f38b37fe640 1 --2- 172.21.15.67:0/2268996496 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f389c06be60 0x7f389c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:04.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.063+0000 7f38b37fe640 1 -- 172.21.15.67:0/2268996496 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f38a408ada0 con 0x7f38bc0ae8e0 2024-04-25T02:29:04.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.063+0000 7f38baffd640 1 --2- 172.21.15.67:0/2268996496 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f389c06be60 0x7f389c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:04.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.063+0000 7f38baffd640 1 --2- 172.21.15.67:0/2268996496 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f389c06be60 0x7f389c06e320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f38ac034000 tx=0x7f38ac02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:04.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.067+0000 7f38b37fe640 1 -- 172.21.15.67:0/2268996496 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f38a401f020 con 0x7f38bc0ae8e0 2024-04-25T02:29:04.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.247+0000 7f38c1563640 1 -- 172.21.15.67:0/2268996496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f38bc160720 con 0x7f38bc0ae8e0 2024-04-25T02:29:04.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.248+0000 7f38b37fe640 1 -- 172.21.15.67:0/2268996496 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f38a40172c0 con 0x7f38bc0ae8e0 2024-04-25T02:29:04.251 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-25T02:29:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.249+0000 7f38c1563640 1 -- 172.21.15.67:0/2268996496 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f389c06be60 msgr2=0x7f389c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.250+0000 7f38c1563640 1 --2- 172.21.15.67:0/2268996496 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f389c06be60 0x7f389c06e320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f38ac034000 tx=0x7f38ac02e000 comp rx=0 tx=0).stop 2024-04-25T02:29:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.250+0000 7f38c1563640 1 -- 172.21.15.67:0/2268996496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38bc0ae8e0 msgr2=0x7f38bc14f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.250+0000 7f38c1563640 1 --2- 172.21.15.67:0/2268996496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38bc0ae8e0 0x7f38bc14f970 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f38a400b3e0 tx=0x7f38a400b8a0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.250+0000 7f38c1563640 1 -- 172.21.15.67:0/2268996496 shutdown_connections 2024-04-25T02:29:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.250+0000 7f38c1563640 1 --2- 172.21.15.67:0/2268996496 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f389c06be60 0x7f389c06e320 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.250+0000 7f38c1563640 1 --2- 172.21.15.67:0/2268996496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc156620 0x7f38bc1e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.250+0000 7f38c1563640 1 --2- 172.21.15.67:0/2268996496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38bc0ae8e0 0x7f38bc14f970 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.250+0000 7f38c1563640 1 --2- 172.21.15.67:0/2268996496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38bc06edf0 0x7f38bc0b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.250+0000 7f38c1563640 1 -- 172.21.15.67:0/2268996496 >> 172.21.15.67:0/2268996496 conn(0x7f38bc0b19c0 msgr2=0x7f38bc06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:04.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.250+0000 7f38c1563640 1 -- 172.21.15.67:0/2268996496 shutdown_connections 2024-04-25T02:29:04.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.250+0000 7f38c1563640 1 -- 172.21.15.67:0/2268996496 wait complete. 2024-04-25T02:29:04.264 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:29:04.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.362+0000 7f081d509640 1 Processor -- start 2024-04-25T02:29:04.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.363+0000 7f081d509640 1 -- start start 2024-04-25T02:29:04.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.363+0000 7f081d509640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f08180d29f0 0x7f08180cd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:04.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.363+0000 7f081d509640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08180ce7a0 0x7f08180cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:04.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.363+0000 7f081d509640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08180cf820 con 0x7f081815c2e0 2024-04-25T02:29:04.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.363+0000 7f081d509640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f08180cde90 con 0x7f08180d29f0 2024-04-25T02:29:04.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.363+0000 7f081d509640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08180d0220 con 0x7f08180ce7a0 2024-04-25T02:29:04.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.364+0000 7f08177fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08180ce7a0 0x7f08180cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:04.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.364+0000 7f08167fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f08180d29f0 0x7f08180cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:04.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.364+0000 7f08177fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08180ce7a0 0x7f08180cec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:53178/0 (socket says 172.21.15.67:53178) 2024-04-25T02:29:04.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.364+0000 7f0816ffd640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f081815c2e0 0x7f08180d06b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:54466/0 (socket says 172.21.15.67:54466) 2024-04-25T02:29:04.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.364+0000 7f08177fe640 1 -- 172.21.15.67:0/3432275953 learned_addr learned my addr 172.21.15.67:0/3432275953 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:04.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.364+0000 7f08167fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f08180d29f0 0x7f08180cd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:37292/0 (socket says 172.21.15.67:37292) 2024-04-25T02:29:04.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.364+0000 7f08177fe640 1 -- 172.21.15.67:0/3432275953 >> v2:172.21.15.176:3300/0 conn(0x7f08180d29f0 msgr2=0x7f08180cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:04.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.364+0000 7f08177fe640 1 --2- 172.21.15.67:0/3432275953 >> v2:172.21.15.176:3300/0 conn(0x7f08180d29f0 0x7f08180cd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.364+0000 7f08177fe640 1 -- 172.21.15.67:0/3432275953 >> v1:172.21.15.176:6789/0 conn(0x7f081815c2e0 legacy=0x7f08180d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:04.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.364+0000 7f08177fe640 1 -- 172.21.15.67:0/3432275953 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f081815c6c0 con 0x7f08180ce7a0 2024-04-25T02:29:04.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.364+0000 7f08167fc640 1 --2- 172.21.15.67:0/3432275953 >> v2:172.21.15.176:3300/0 conn(0x7f08180d29f0 0x7f08180cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:04.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.365+0000 7f08177fe640 1 --2- 172.21.15.67:0/3432275953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08180ce7a0 0x7f08180cec30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0810009e50 tx=0x7f081002a610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b3485823d82c9f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:04.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.365+0000 7f0815ffb640 1 -- 172.21.15.67:0/3432275953 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0810036070 con 0x7f08180ce7a0 2024-04-25T02:29:04.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.365+0000 7f0815ffb640 1 -- 172.21.15.67:0/3432275953 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0810031600 con 0x7f08180ce7a0 2024-04-25T02:29:04.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.365+0000 7f0815ffb640 1 -- 172.21.15.67:0/3432275953 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08100319d0 con 0x7f08180ce7a0 2024-04-25T02:29:04.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.366+0000 7f081d509640 1 -- 172.21.15.67:0/3432275953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08180ce7a0 msgr2=0x7f08180cec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:04.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.366+0000 7f081d509640 1 --2- 172.21.15.67:0/3432275953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08180ce7a0 0x7f08180cec30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0810009e50 tx=0x7f081002a610 comp rx=0 tx=0).stop 2024-04-25T02:29:04.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.366+0000 7f081d509640 1 -- 172.21.15.67:0/3432275953 shutdown_connections 2024-04-25T02:29:04.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.366+0000 7f081d509640 1 --2- 172.21.15.67:0/3432275953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08180ce7a0 0x7f08180cec30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.366+0000 7f081d509640 1 --2- 172.21.15.67:0/3432275953 >> v2:172.21.15.176:3300/0 conn(0x7f08180d29f0 0x7f08180cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.366+0000 7f081d509640 1 -- 172.21.15.67:0/3432275953 >> 172.21.15.67:0/3432275953 conn(0x7f08180d1ed0 msgr2=0x7f08180d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:04.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.366+0000 7f081d509640 1 -- 172.21.15.67:0/3432275953 shutdown_connections 2024-04-25T02:29:04.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.366+0000 7f081d509640 1 -- 172.21.15.67:0/3432275953 wait complete. 2024-04-25T02:29:04.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.367+0000 7f081d509640 1 Processor -- start 2024-04-25T02:29:04.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.367+0000 7f081d509640 1 -- start start 2024-04-25T02:29:04.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.368+0000 7f081d509640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08180ce7a0 0x7f081815a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:04.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.368+0000 7f081d509640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08180d29f0 0x7f08181e15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:04.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.368+0000 7f081d509640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f081815c2e0 0x7f081809bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.368+0000 7f081d509640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f08180cfbd0 con 0x7f08180d29f0 2024-04-25T02:29:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.368+0000 7f081d509640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f08180cdbb0 con 0x7f081815c2e0 2024-04-25T02:29:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.368+0000 7f081d509640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08180cfeb0 con 0x7f08180ce7a0 2024-04-25T02:29:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.368+0000 7f08167fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08180d29f0 0x7f08181e15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.368+0000 7f08167fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08180d29f0 0x7f08181e15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49574/0 (socket says 172.21.15.67:49574) 2024-04-25T02:29:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.368+0000 7f08167fc640 1 -- 172.21.15.67:0/85024180 learned_addr learned my addr 172.21.15.67:0/85024180 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.368+0000 7f08177fe640 1 --2- 172.21.15.67:0/85024180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f081815c2e0 0x7f081809bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.368+0000 7f0816ffd640 1 --2- 172.21.15.67:0/85024180 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08180ce7a0 0x7f081815a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.368+0000 7f08167fc640 1 -- 172.21.15.67:0/85024180 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08180ce7a0 msgr2=0x7f081815a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.368+0000 7f08167fc640 1 --2- 172.21.15.67:0/85024180 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08180ce7a0 0x7f081815a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.368+0000 7f08167fc640 1 -- 172.21.15.67:0/85024180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f081815c2e0 msgr2=0x7f081809bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.368+0000 7f08167fc640 1 --2- 172.21.15.67:0/85024180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f081815c2e0 0x7f081809bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.368+0000 7f08167fc640 1 -- 172.21.15.67:0/85024180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08181e2020 con 0x7f08180d29f0 2024-04-25T02:29:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.368+0000 7f08167fc640 1 --2- 172.21.15.67:0/85024180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08180d29f0 0x7f08181e15a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f080c00e960 tx=0x7f080c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.369+0000 7f07ff7fe640 1 -- 172.21.15.67:0/85024180 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c017070 con 0x7f08180d29f0 2024-04-25T02:29:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.369+0000 7f07ff7fe640 1 -- 172.21.15.67:0/85024180 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f080c00ca00 con 0x7f08180d29f0 2024-04-25T02:29:04.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.369+0000 7f081d509640 1 -- 172.21.15.67:0/85024180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08181e2300 con 0x7f08180d29f0 2024-04-25T02:29:04.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.369+0000 7f07ff7fe640 1 -- 172.21.15.67:0/85024180 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c00cdd0 con 0x7f08180d29f0 2024-04-25T02:29:04.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.369+0000 7f081d509640 1 -- 172.21.15.67:0/85024180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08181e28c0 con 0x7f08180d29f0 2024-04-25T02:29:04.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.370+0000 7f081d509640 1 -- 172.21.15.67:0/85024180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0818069110 con 0x7f08180d29f0 2024-04-25T02:29:04.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.371+0000 7f07ff7fe640 1 -- 172.21.15.67:0/85024180 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f080c01a070 con 0x7f08180d29f0 2024-04-25T02:29:04.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.372+0000 7f07ff7fe640 1 --2- 172.21.15.67:0/85024180 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f080406be30 0x7f080406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:04.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.372+0000 7f07ff7fe640 1 -- 172.21.15.67:0/85024180 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f080c08b300 con 0x7f08180d29f0 2024-04-25T02:29:04.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.372+0000 7f0816ffd640 1 --2- 172.21.15.67:0/85024180 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f080406be30 0x7f080406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:04.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.372+0000 7f0816ffd640 1 --2- 172.21.15.67:0/85024180 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f080406be30 0x7f080406e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0808007fd0 tx=0x7f0808007e80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:04.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.375+0000 7f07ff7fe640 1 -- 172.21.15.67:0/85024180 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f080c0597d0 con 0x7f08180d29f0 2024-04-25T02:29:04.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.569+0000 7f081d509640 1 -- 172.21.15.67:0/85024180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f08180ccb50 con 0x7f08180d29f0 2024-04-25T02:29:04.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.570+0000 7f07ff7fe640 1 -- 172.21.15.67:0/85024180 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f080c05dad0 con 0x7f08180d29f0 2024-04-25T02:29:04.573 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-04-25T02:29:04.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.572+0000 7f081d509640 1 -- 172.21.15.67:0/85024180 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f080406be30 msgr2=0x7f080406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:04.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.572+0000 7f081d509640 1 --2- 172.21.15.67:0/85024180 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f080406be30 0x7f080406e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0808007fd0 tx=0x7f0808007e80 comp rx=0 tx=0).stop 2024-04-25T02:29:04.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.572+0000 7f081d509640 1 -- 172.21.15.67:0/85024180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08180d29f0 msgr2=0x7f08181e15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:04.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.572+0000 7f081d509640 1 --2- 172.21.15.67:0/85024180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08180d29f0 0x7f08181e15a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f080c00e960 tx=0x7f080c00ee20 comp rx=0 tx=0).stop 2024-04-25T02:29:04.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.572+0000 7f081d509640 1 -- 172.21.15.67:0/85024180 shutdown_connections 2024-04-25T02:29:04.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.572+0000 7f081d509640 1 --2- 172.21.15.67:0/85024180 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f080406be30 0x7f080406e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.572+0000 7f081d509640 1 --2- 172.21.15.67:0/85024180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f081815c2e0 0x7f081809bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.572+0000 7f081d509640 1 --2- 172.21.15.67:0/85024180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08180d29f0 0x7f08181e15a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.572+0000 7f081d509640 1 --2- 172.21.15.67:0/85024180 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08180ce7a0 0x7f081815a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.572+0000 7f081d509640 1 -- 172.21.15.67:0/85024180 >> 172.21.15.67:0/85024180 conn(0x7f08180d1ed0 msgr2=0x7f08180c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:04.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.572+0000 7f081d509640 1 -- 172.21.15.67:0/85024180 shutdown_connections 2024-04-25T02:29:04.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.572+0000 7f081d509640 1 -- 172.21.15.67:0/85024180 wait complete. 2024-04-25T02:29:04.586 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-25T02:29:04.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:04.586 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-25T02:29:04.617 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-04-25T02:29:04.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:04.618 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-25T02:29:04.675 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T02:29:04.676 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:29:04.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.774+0000 7f9fe9438640 1 Processor -- start 2024-04-25T02:29:04.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.774+0000 7f9fe9438640 1 -- start start 2024-04-25T02:29:04.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.774+0000 7f9fe9438640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9fe40cee60 0x7f9fe406c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:04.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.774+0000 7f9fe9438640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9fe40d0210 0x7f9fe406c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:04.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.774+0000 7f9fe9438640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fe415c3a0 con 0x7f9fe415bfc0 2024-04-25T02:29:04.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.774+0000 7f9fe9438640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe40d0760 con 0x7f9fe40d0210 2024-04-25T02:29:04.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.774+0000 7f9fe9438640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe40d0a40 con 0x7f9fe40cee60 2024-04-25T02:29:04.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.775+0000 7f9fe37fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9fe40d0210 0x7f9fe406c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:04.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.775+0000 7f9fe37fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9fe40d0210 0x7f9fe406c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49584/0 (socket says 172.21.15.67:49584) 2024-04-25T02:29:04.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.775+0000 7f9fe37fe640 1 -- 172.21.15.67:0/2033029603 learned_addr learned my addr 172.21.15.67:0/2033029603 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:04.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.775+0000 7f9fe27fc640 1 --2- 172.21.15.67:0/2033029603 >> v2:172.21.15.176:3300/0 conn(0x7f9fe40cee60 0x7f9fe406c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.775+0000 7f9fe37fe640 1 -- 172.21.15.67:0/2033029603 >> v2:172.21.15.176:3300/0 conn(0x7f9fe40cee60 msgr2=0x7f9fe406c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.775+0000 7f9fe37fe640 1 --2- 172.21.15.67:0/2033029603 >> v2:172.21.15.176:3300/0 conn(0x7f9fe40cee60 0x7f9fe406c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.775+0000 7f9fe37fe640 1 -- 172.21.15.67:0/2033029603 >> v1:172.21.15.176:6789/0 conn(0x7f9fe415bfc0 legacy=0x7f9fe40ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.775+0000 7f9fe37fe640 1 -- 172.21.15.67:0/2033029603 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe40d0d20 con 0x7f9fe40d0210 2024-04-25T02:29:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.775+0000 7f9fe37fe640 1 --2- 172.21.15.67:0/2033029603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe40d0210 0x7f9fe406c7a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009e50 tx=0x7f9fdc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d73150ae70b233a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.776+0000 7f9fe1ffb640 1 -- 172.21.15.67:0/2033029603 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc036070 con 0x7f9fe40d0210 2024-04-25T02:29:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.776+0000 7f9fe1ffb640 1 -- 172.21.15.67:0/2033029603 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fdc031600 con 0x7f9fe40d0210 2024-04-25T02:29:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.776+0000 7f9fe1ffb640 1 -- 172.21.15.67:0/2033029603 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc0319d0 con 0x7f9fe40d0210 2024-04-25T02:29:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.776+0000 7f9fe9438640 1 -- 172.21.15.67:0/2033029603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe40d0210 msgr2=0x7f9fe406c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.776+0000 7f9fe9438640 1 --2- 172.21.15.67:0/2033029603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe40d0210 0x7f9fe406c7a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009e50 tx=0x7f9fdc02a710 comp rx=0 tx=0).stop 2024-04-25T02:29:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.776+0000 7f9fe9438640 1 -- 172.21.15.67:0/2033029603 shutdown_connections 2024-04-25T02:29:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.776+0000 7f9fe9438640 1 --2- 172.21.15.67:0/2033029603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe40d0210 0x7f9fe406c7a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.776+0000 7f9fe9438640 1 --2- 172.21.15.67:0/2033029603 >> v2:172.21.15.176:3300/0 conn(0x7f9fe40cee60 0x7f9fe406c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.776+0000 7f9fe9438640 1 -- 172.21.15.67:0/2033029603 >> 172.21.15.67:0/2033029603 conn(0x7f9fe40d1ed0 msgr2=0x7f9fe40d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:04.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.776+0000 7f9fe9438640 1 -- 172.21.15.67:0/2033029603 shutdown_connections 2024-04-25T02:29:04.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.776+0000 7f9fe9438640 1 -- 172.21.15.67:0/2033029603 wait complete. 2024-04-25T02:29:04.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.778+0000 7f9fe9438640 1 Processor -- start 2024-04-25T02:29:04.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.778+0000 7f9fe9438640 1 -- start start 2024-04-25T02:29:04.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.778+0000 7f9fe9438640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe40cee60 0x7f9fe409f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:04.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.778+0000 7f9fe9438640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fe40d0210 0x7f9fe40c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:04.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.778+0000 7f9fe9438640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fe415bfc0 0x7f9fe40aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:04.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.778+0000 7f9fe9438640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe40cf690 con 0x7f9fe40cee60 2024-04-25T02:29:04.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.778+0000 7f9fe9438640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe40d12e0 con 0x7f9fe415bfc0 2024-04-25T02:29:04.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.778+0000 7f9fe9438640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9fe40cf810 con 0x7f9fe40d0210 2024-04-25T02:29:04.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.778+0000 7f9fe2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe40cee60 0x7f9fe409f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:04.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.778+0000 7f9fe2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe40cee60 0x7f9fe409f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49600/0 (socket says 172.21.15.67:49600) 2024-04-25T02:29:04.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.778+0000 7f9fe2ffd640 1 -- 172.21.15.67:0/4118053816 learned_addr learned my addr 172.21.15.67:0/4118053816 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:04.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.779+0000 7f9fe2ffd640 1 -- 172.21.15.67:0/4118053816 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fe40d0210 msgr2=0x7f9fe40c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:04.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.779+0000 7f9fe2ffd640 1 --2- 172.21.15.67:0/4118053816 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fe40d0210 0x7f9fe40c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.779+0000 7f9fe2ffd640 1 -- 172.21.15.67:0/4118053816 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fe415bfc0 msgr2=0x7f9fe40aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:04.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.779+0000 7f9fe2ffd640 1 --2- 172.21.15.67:0/4118053816 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fe415bfc0 0x7f9fe40aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:04.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.779+0000 7f9fe2ffd640 1 -- 172.21.15.67:0/4118053816 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe40c74e0 con 0x7f9fe40cee60 2024-04-25T02:29:04.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.779+0000 7f9fe2ffd640 1 --2- 172.21.15.67:0/4118053816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe40cee60 0x7f9fe409f970 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00b420 tx=0x7f9fcc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:04.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.779+0000 7f9fdb7fe640 1 -- 172.21.15.67:0/4118053816 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc011830 con 0x7f9fe40cee60 2024-04-25T02:29:04.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.779+0000 7f9fdb7fe640 1 -- 172.21.15.67:0/4118053816 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fcc016070 con 0x7f9fe40cee60 2024-04-25T02:29:04.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.779+0000 7f9fe9438640 1 -- 172.21.15.67:0/4118053816 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe40c5c60 con 0x7f9fe40cee60 2024-04-25T02:29:04.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.779+0000 7f9fdb7fe640 1 -- 172.21.15.67:0/4118053816 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc011c10 con 0x7f9fe40cee60 2024-04-25T02:29:04.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.779+0000 7f9fe9438640 1 -- 172.21.15.67:0/4118053816 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe40c6220 con 0x7f9fe40cee60 2024-04-25T02:29:04.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.780+0000 7f9fe9438640 1 -- 172.21.15.67:0/4118053816 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe4069110 con 0x7f9fe40cee60 2024-04-25T02:29:04.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.781+0000 7f9fdb7fe640 1 -- 172.21.15.67:0/4118053816 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9fcc01b460 con 0x7f9fe40cee60 2024-04-25T02:29:04.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.781+0000 7f9fdb7fe640 1 --2- 172.21.15.67:0/4118053816 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9fc406be30 0x7f9fc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:04.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.781+0000 7f9fdb7fe640 1 -- 172.21.15.67:0/4118053816 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9fcc08a920 con 0x7f9fe40cee60 2024-04-25T02:29:04.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.781+0000 7f9fe27fc640 1 --2- 172.21.15.67:0/4118053816 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9fc406be30 0x7f9fc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:04.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.782+0000 7f9fe27fc640 1 --2- 172.21.15.67:0/4118053816 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9fc406be30 0x7f9fc406e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40d2820 tx=0x7f9fd4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:04.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:04.785+0000 7f9fdb7fe640 1 -- 172.21.15.67:0/4118053816 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9fcc020020 con 0x7f9fe40cee60 2024-04-25T02:29:05.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.006+0000 7f9fe9438640 1 -- 172.21.15.67:0/4118053816 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fe40b7e50 con 0x7f9fe40cee60 2024-04-25T02:29:05.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.007+0000 7f9fdb7fe640 1 -- 172.21.15.67:0/4118053816 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5172 (secure 0 0 0) 0x7f9fcc0592d0 con 0x7f9fe40cee60 2024-04-25T02:29:05.010 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:05.010 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1246739775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1246739775},{"type":"v1","addr":"172.21.15.67:6835","nonce":1246739775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/267757090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":267757090},{"type":"v1","addr":"172.21.15.67:6833","nonce":267757090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/90768677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":90768677},{"type":"v1","addr":"172.21.15.176:6837","nonce":90768677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:28:26.184170+0000","modified":"2024-04-25T02:28:29.181464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/1058053785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1058053785},{"type":"v1","addr":"172.21.15.176:6836","nonce":1058053785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-25T02:29:05.010 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 7 2024-04-25T02:29:05.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.009+0000 7f9fe9438640 1 -- 172.21.15.67:0/4118053816 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9fc406be30 msgr2=0x7f9fc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.009+0000 7f9fe9438640 1 --2- 172.21.15.67:0/4118053816 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9fc406be30 0x7f9fc406e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40d2820 tx=0x7f9fd4008040 comp rx=0 tx=0).stop 2024-04-25T02:29:05.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.009+0000 7f9fe9438640 1 -- 172.21.15.67:0/4118053816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe40cee60 msgr2=0x7f9fe409f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.009+0000 7f9fe9438640 1 --2- 172.21.15.67:0/4118053816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe40cee60 0x7f9fe409f970 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00b420 tx=0x7f9fcc00b8e0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.009+0000 7f9fe9438640 1 -- 172.21.15.67:0/4118053816 shutdown_connections 2024-04-25T02:29:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.009+0000 7f9fe9438640 1 --2- 172.21.15.67:0/4118053816 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9fc406be30 0x7f9fc406e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.009+0000 7f9fe9438640 1 --2- 172.21.15.67:0/4118053816 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fe415bfc0 0x7f9fe40aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.009+0000 7f9fe9438640 1 --2- 172.21.15.67:0/4118053816 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fe40d0210 0x7f9fe40c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.009+0000 7f9fe9438640 1 --2- 172.21.15.67:0/4118053816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe40cee60 0x7f9fe409f970 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.009+0000 7f9fe9438640 1 -- 172.21.15.67:0/4118053816 >> 172.21.15.67:0/4118053816 conn(0x7f9fe40d1ed0 msgr2=0x7f9fe415df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.009+0000 7f9fe9438640 1 -- 172.21.15.67:0/4118053816 shutdown_connections 2024-04-25T02:29:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.009+0000 7f9fe9438640 1 -- 172.21.15.67:0/4118053816 wait complete. 2024-04-25T02:29:05.023 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:29:05.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.121+0000 7f9a99279640 1 Processor -- start 2024-04-25T02:29:05.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.121+0000 7f9a99279640 1 -- start start 2024-04-25T02:29:05.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.121+0000 7f9a99279640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9a94071cf0 0x7f9a940af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.121+0000 7f9a99279640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a9406f4c0 con 0x7f9a9415c440 2024-04-25T02:29:05.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.121+0000 7f9a99279640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a940723c0 con 0x7f9a9406c620 2024-04-25T02:29:05.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.121+0000 7f9a99279640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f9a940afe10 con 0x7f9a94071cf0 2024-04-25T02:29:05.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.122+0000 7f9a92ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9a9415c440 0x7f9a940715e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42784/0 (socket says 172.21.15.67:42784) 2024-04-25T02:29:05.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.122+0000 7f9a92ffd640 1 -- 172.21.15.67:0/1375022842 learned_addr learned my addr 172.21.15.67:0/1375022842 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:05.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.122+0000 7f9a927fc640 1 --2- 172.21.15.67:0/1375022842 >> v2:172.21.15.67:3300/0 conn(0x7f9a94071cf0 0x7f9a940af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:05.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.122+0000 7f9a927fc640 1 -- 172.21.15.67:0/1375022842 >> v1:172.21.15.176:6789/0 conn(0x7f9a9406c620 legacy=0x7f9a940ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:05.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.122+0000 7f9a927fc640 1 -- 172.21.15.67:0/1375022842 >> v1:172.21.15.67:6789/0 conn(0x7f9a9415c440 legacy=0x7f9a940715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.122+0000 7f9a91ffb640 1 -- 172.21.15.67:0/1375022842 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 375652210 0 0) 0x7f9a8c001110 con 0x7f9a9415c440 2024-04-25T02:29:05.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.122+0000 7f9a927fc640 1 -- 172.21.15.67:0/1375022842 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a940726a0 con 0x7f9a94071cf0 2024-04-25T02:29:05.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.123+0000 7f9a927fc640 1 --2- 172.21.15.67:0/1375022842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a94071cf0 0x7f9a940af8d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0097a0 tx=0x7f9a7c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e92b7e7aa90ab7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:05.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.123+0000 7f9a91ffb640 1 -- 172.21.15.67:0/1375022842 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c037070 con 0x7f9a94071cf0 2024-04-25T02:29:05.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.123+0000 7f9a91ffb640 1 -- 172.21.15.67:0/1375022842 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a7c032440 con 0x7f9a94071cf0 2024-04-25T02:29:05.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.123+0000 7f9a91ffb640 1 -- 172.21.15.67:0/1375022842 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c032810 con 0x7f9a94071cf0 2024-04-25T02:29:05.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.123+0000 7f9a99279640 1 -- 172.21.15.67:0/1375022842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a94071cf0 msgr2=0x7f9a940af8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.123+0000 7f9a99279640 1 --2- 172.21.15.67:0/1375022842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a94071cf0 0x7f9a940af8d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0097a0 tx=0x7f9a7c02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.123+0000 7f9a99279640 1 -- 172.21.15.67:0/1375022842 shutdown_connections 2024-04-25T02:29:05.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.123+0000 7f9a99279640 1 --2- 172.21.15.67:0/1375022842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a94071cf0 0x7f9a940af8d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.123+0000 7f9a99279640 1 -- 172.21.15.67:0/1375022842 >> 172.21.15.67:0/1375022842 conn(0x7f9a940d04f0 msgr2=0x7f9a940d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:05.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.123+0000 7f9a99279640 1 -- 172.21.15.67:0/1375022842 shutdown_connections 2024-04-25T02:29:05.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.123+0000 7f9a99279640 1 -- 172.21.15.67:0/1375022842 wait complete. 2024-04-25T02:29:05.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.125+0000 7f9a99279640 1 Processor -- start 2024-04-25T02:29:05.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.125+0000 7f9a99279640 1 -- start start 2024-04-25T02:29:05.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.125+0000 7f9a99279640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a9406c620 0x7f9a941477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.125+0000 7f9a99279640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a94071cf0 0x7f9a94149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.125+0000 7f9a99279640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9415c440 0x7f9a94145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.125+0000 7f9a99279640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9a940ceb00 con 0x7f9a9415c440 2024-04-25T02:29:05.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.125+0000 7f9a99279640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9406efa0 con 0x7f9a94071cf0 2024-04-25T02:29:05.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.125+0000 7f9a99279640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9a940cec80 con 0x7f9a9406c620 2024-04-25T02:29:05.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.126+0000 7f9a937fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9415c440 0x7f9a94145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:05.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.126+0000 7f9a937fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9415c440 0x7f9a94145720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49614/0 (socket says 172.21.15.67:49614) 2024-04-25T02:29:05.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.126+0000 7f9a937fe640 1 -- 172.21.15.67:0/1252621365 learned_addr learned my addr 172.21.15.67:0/1252621365 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:05.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.126+0000 7f9a927fc640 1 --2- 172.21.15.67:0/1252621365 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a94071cf0 0x7f9a94149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:05.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.126+0000 7f9a937fe640 1 -- 172.21.15.67:0/1252621365 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a9406c620 msgr2=0x7f9a941477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.126+0000 7f9a937fe640 1 --2- 172.21.15.67:0/1252621365 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a9406c620 0x7f9a941477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.126+0000 7f9a937fe640 1 -- 172.21.15.67:0/1252621365 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a94071cf0 msgr2=0x7f9a94149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.126+0000 7f9a937fe640 1 --2- 172.21.15.67:0/1252621365 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a94071cf0 0x7f9a94149590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.126+0000 7f9a937fe640 1 -- 172.21.15.67:0/1252621365 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a94151890 con 0x7f9a9415c440 2024-04-25T02:29:05.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.126+0000 7f9a927fc640 1 --2- 172.21.15.67:0/1252621365 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a94071cf0 0x7f9a94149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:05.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.126+0000 7f9a937fe640 1 --2- 172.21.15.67:0/1252621365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9415c440 0x7f9a94145720 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400c780 tx=0x7f9a8400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:05.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.126+0000 7f9a8b7fe640 1 -- 172.21.15.67:0/1252621365 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84004b60 con 0x7f9a9415c440 2024-04-25T02:29:05.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.126+0000 7f9a8b7fe640 1 -- 172.21.15.67:0/1252621365 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a84004d00 con 0x7f9a9415c440 2024-04-25T02:29:05.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.126+0000 7f9a8b7fe640 1 -- 172.21.15.67:0/1252621365 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8400aa90 con 0x7f9a9415c440 2024-04-25T02:29:05.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.126+0000 7f9a99279640 1 -- 172.21.15.67:0/1252621365 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a94151b70 con 0x7f9a9415c440 2024-04-25T02:29:05.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.126+0000 7f9a99279640 1 -- 172.21.15.67:0/1252621365 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a94152130 con 0x7f9a9415c440 2024-04-25T02:29:05.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.127+0000 7f9a99279640 1 -- 172.21.15.67:0/1252621365 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a94069110 con 0x7f9a9415c440 2024-04-25T02:29:05.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.128+0000 7f9a8b7fe640 1 -- 172.21.15.67:0/1252621365 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a8400ac30 con 0x7f9a9415c440 2024-04-25T02:29:05.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.128+0000 7f9a8b7fe640 1 --2- 172.21.15.67:0/1252621365 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9a7406be30 0x7f9a7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.128+0000 7f9a8b7fe640 1 -- 172.21.15.67:0/1252621365 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9a8408b260 con 0x7f9a9415c440 2024-04-25T02:29:05.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.128+0000 7f9a92ffd640 1 --2- 172.21.15.67:0/1252621365 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9a7406be30 0x7f9a7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:05.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.129+0000 7f9a92ffd640 1 --2- 172.21.15.67:0/1252621365 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9a7406be30 0x7f9a7406e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c007fd0 tx=0x7f9a8c007960 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:05.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.133+0000 7f9a8b7fe640 1 -- 172.21.15.67:0/1252621365 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9a84020070 con 0x7f9a9415c440 2024-04-25T02:29:05.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.316+0000 7f9a99279640 1 -- 172.21.15.67:0/1252621365 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a940679e0 con 0x7f9a9415c440 2024-04-25T02:29:05.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.317+0000 7f9a8b7fe640 1 -- 172.21.15.67:0/1252621365 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f9a84059af0 con 0x7f9a9415c440 2024-04-25T02:29:05.320 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:05.321 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:27.819641+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:29:05.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.319+0000 7f9a99279640 1 -- 172.21.15.67:0/1252621365 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9a7406be30 msgr2=0x7f9a7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.319+0000 7f9a99279640 1 --2- 172.21.15.67:0/1252621365 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9a7406be30 0x7f9a7406e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c007fd0 tx=0x7f9a8c007960 comp rx=0 tx=0).stop 2024-04-25T02:29:05.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.319+0000 7f9a99279640 1 -- 172.21.15.67:0/1252621365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9415c440 msgr2=0x7f9a94145720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.319+0000 7f9a99279640 1 --2- 172.21.15.67:0/1252621365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9415c440 0x7f9a94145720 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400c780 tx=0x7f9a8400cc40 comp rx=0 tx=0).stop 2024-04-25T02:29:05.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.319+0000 7f9a99279640 1 -- 172.21.15.67:0/1252621365 shutdown_connections 2024-04-25T02:29:05.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.319+0000 7f9a99279640 1 --2- 172.21.15.67:0/1252621365 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9a7406be30 0x7f9a7406e2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.319+0000 7f9a99279640 1 --2- 172.21.15.67:0/1252621365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9415c440 0x7f9a94145720 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.319+0000 7f9a99279640 1 --2- 172.21.15.67:0/1252621365 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a94071cf0 0x7f9a94149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.319+0000 7f9a99279640 1 --2- 172.21.15.67:0/1252621365 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a9406c620 0x7f9a941477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.319+0000 7f9a99279640 1 -- 172.21.15.67:0/1252621365 >> 172.21.15.67:0/1252621365 conn(0x7f9a940d04f0 msgr2=0x7f9a940cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:05.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.320+0000 7f9a99279640 1 -- 172.21.15.67:0/1252621365 shutdown_connections 2024-04-25T02:29:05.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.320+0000 7f9a99279640 1 -- 172.21.15.67:0/1252621365 wait complete. 2024-04-25T02:29:05.334 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:28:24.445606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:28:25.161619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:29:05.334 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:29:05.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.435+0000 7fa4471ab640 1 Processor -- start 2024-04-25T02:29:05.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.435+0000 7fa4471ab640 1 -- start start 2024-04-25T02:29:05.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa4471ab640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa44015b090 0x7fa44009db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa4471ab640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4400ad820 con 0x7fa44006ec40 2024-04-25T02:29:05.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa4471ab640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4400b3260 con 0x7fa4400b2cc0 2024-04-25T02:29:05.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa4471ab640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa4400b3540 con 0x7fa44015b090 2024-04-25T02:29:05.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa445748640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa44006ec40 0x7fa4400add00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42786/0 (socket says 172.21.15.67:42786) 2024-04-25T02:29:05.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa445748640 1 -- 172.21.15.67:0/998514061 learned_addr learned my addr 172.21.15.67:0/998514061 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:05.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa444f47640 1 --2- 172.21.15.67:0/998514061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa44015b090 0x7fa44009db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:05.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa43f7fe640 1 -- 172.21.15.67:0/998514061 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2573194910 0 0) 0x7fa4400ad820 con 0x7fa44006ec40 2024-04-25T02:29:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa43f7fe640 1 -- 172.21.15.67:0/998514061 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa430003520 con 0x7fa44006ec40 2024-04-25T02:29:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa43f7fe640 1 -- 172.21.15.67:0/998514061 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1625565251 0 0) 0x7fa430003520 con 0x7fa44006ec40 2024-04-25T02:29:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa43f7fe640 1 -- 172.21.15.67:0/998514061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa44015b090 msgr2=0x7fa44009db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa43f7fe640 1 --2- 172.21.15.67:0/998514061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa44015b090 0x7fa44009db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa43f7fe640 1 -- 172.21.15.67:0/998514061 >> v1:172.21.15.176:6789/0 conn(0x7fa4400b2cc0 legacy=0x7fa44006e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa43f7fe640 1 -- 172.21.15.67:0/998514061 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4400b3820 con 0x7fa44006ec40 2024-04-25T02:29:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa43f7fe640 1 -- 172.21.15.67:0/998514061 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7fa4380019f0 con 0x7fa44006ec40 2024-04-25T02:29:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa43f7fe640 1 -- 172.21.15.67:0/998514061 >> v1:172.21.15.67:6789/0 conn(0x7fa44006ec40 legacy=0x7fa4400add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa43f7fe640 1 --2- 172.21.15.67:0/998514061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa44015b090 0x7fa4300039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa43f7fe640 1 --2- 172.21.15.67:0/998514061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa430003f40 0x7fa430004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa43f7fe640 1 --2- 172.21.15.67:0/998514061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa430004d40 0x7fa4300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.436+0000 7fa43f7fe640 1 -- 172.21.15.67:0/998514061 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa4400b3540 con 0x7fa430004d40 2024-04-25T02:29:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.437+0000 7fa43f7fe640 1 -- 172.21.15.67:0/998514061 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa43000baa0 con 0x7fa430003f40 2024-04-25T02:29:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.437+0000 7fa43f7fe640 1 -- 172.21.15.67:0/998514061 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa43000deb0 con 0x7fa44015b090 2024-04-25T02:29:05.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.437+0000 7fa445748640 1 --2- 172.21.15.67:0/998514061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa430004d40 0x7fa4300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:05.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.437+0000 7fa444f47640 1 --2- 172.21.15.67:0/998514061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa44015b090 0x7fa4300039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:05.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.437+0000 7fa43ffff640 1 --2- 172.21.15.67:0/998514061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa430003f40 0x7fa430004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:05.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.437+0000 7fa445748640 1 -- 172.21.15.67:0/998514061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa44015b090 msgr2=0x7fa4300039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:05.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.437+0000 7fa445748640 1 --2- 172.21.15.67:0/998514061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa44015b090 0x7fa4300039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.437+0000 7fa445748640 1 -- 172.21.15.67:0/998514061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa430003f40 msgr2=0x7fa430004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:05.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.437+0000 7fa445748640 1 --2- 172.21.15.67:0/998514061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa430003f40 0x7fa430004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.437+0000 7fa445748640 1 -- 172.21.15.67:0/998514061 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa430003520 con 0x7fa430004d40 2024-04-25T02:29:05.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.438+0000 7fa445748640 1 --2- 172.21.15.67:0/998514061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa430004d40 0x7fa4300051c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa440070aa0 tx=0x7fa430005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ec77b4df9f98ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:05.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.438+0000 7fa43f7fe640 1 -- 172.21.15.67:0/998514061 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43800a480 con 0x7fa430004d40 2024-04-25T02:29:05.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.438+0000 7fa43f7fe640 1 -- 172.21.15.67:0/998514061 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa43802f070 con 0x7fa430004d40 2024-04-25T02:29:05.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.438+0000 7fa43f7fe640 1 -- 172.21.15.67:0/998514061 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43802bc90 con 0x7fa430004d40 2024-04-25T02:29:05.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.438+0000 7fa4471ab640 1 -- 172.21.15.67:0/998514061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa430004d40 msgr2=0x7fa4300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.438+0000 7fa4471ab640 1 --2- 172.21.15.67:0/998514061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa430004d40 0x7fa4300051c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa440070aa0 tx=0x7fa430005830 comp rx=0 tx=0).stop 2024-04-25T02:29:05.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.438+0000 7fa445748640 1 -- 172.21.15.67:0/998514061 reap_dead start 2024-04-25T02:29:05.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.438+0000 7fa4471ab640 1 -- 172.21.15.67:0/998514061 shutdown_connections 2024-04-25T02:29:05.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.438+0000 7fa4471ab640 1 -- 172.21.15.67:0/998514061 >> 172.21.15.67:0/998514061 conn(0x7fa4400b19c0 msgr2=0x7fa4400b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:05.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.438+0000 7fa4471ab640 1 -- 172.21.15.67:0/998514061 shutdown_connections 2024-04-25T02:29:05.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.438+0000 7fa4471ab640 1 -- 172.21.15.67:0/998514061 wait complete. 2024-04-25T02:29:05.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.440+0000 7fa4471ab640 1 Processor -- start 2024-04-25T02:29:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.440+0000 7fa4471ab640 1 -- start start 2024-04-25T02:29:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.440+0000 7fa4471ab640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa430004d40 0x7fa44015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.440+0000 7fa4471ab640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa44009be00 0x7fa44015e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.440+0000 7fa4471ab640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa440149ff0 0x7fa4400aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.440+0000 7fa4471ab640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa44015b470 con 0x7fa440149ff0 2024-04-25T02:29:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.440+0000 7fa4471ab640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa4400b4f70 con 0x7fa430004d40 2024-04-25T02:29:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.440+0000 7fa4471ab640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa440070e10 con 0x7fa44009be00 2024-04-25T02:29:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.441+0000 7fa445748640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa440149ff0 0x7fa4400aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.441+0000 7fa445748640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa440149ff0 0x7fa4400aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49628/0 (socket says 172.21.15.67:49628) 2024-04-25T02:29:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.441+0000 7fa445748640 1 -- 172.21.15.67:0/2051505902 learned_addr learned my addr 172.21.15.67:0/2051505902 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.441+0000 7fa444f47640 1 --2- 172.21.15.67:0/2051505902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa430004d40 0x7fa44015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.441+0000 7fa43ffff640 1 --2- 172.21.15.67:0/2051505902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa44009be00 0x7fa44015e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.441+0000 7fa445748640 1 -- 172.21.15.67:0/2051505902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa44009be00 msgr2=0x7fa44015e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.441+0000 7fa445748640 1 --2- 172.21.15.67:0/2051505902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa44009be00 0x7fa44015e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.441+0000 7fa445748640 1 -- 172.21.15.67:0/2051505902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa430004d40 msgr2=0x7fa44015cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.441+0000 7fa445748640 1 --2- 172.21.15.67:0/2051505902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa430004d40 0x7fa44015cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.441+0000 7fa445748640 1 -- 172.21.15.67:0/2051505902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44015d0b0 con 0x7fa440149ff0 2024-04-25T02:29:05.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.441+0000 7fa444f47640 1 --2- 172.21.15.67:0/2051505902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa430004d40 0x7fa44015cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:05.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.441+0000 7fa445748640 1 --2- 172.21.15.67:0/2051505902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa440149ff0 0x7fa4400aff90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa43802b4a0 tx=0x7fa4400b3430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:05.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.441+0000 7fa43d7fa640 1 -- 172.21.15.67:0/2051505902 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa438044070 con 0x7fa440149ff0 2024-04-25T02:29:05.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.441+0000 7fa43d7fa640 1 -- 172.21.15.67:0/2051505902 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4380019e0 con 0x7fa440149ff0 2024-04-25T02:29:05.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.441+0000 7fa4471ab640 1 -- 172.21.15.67:0/2051505902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa44015d390 con 0x7fa440149ff0 2024-04-25T02:29:05.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.441+0000 7fa43d7fa640 1 -- 172.21.15.67:0/2051505902 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43800a480 con 0x7fa440149ff0 2024-04-25T02:29:05.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.441+0000 7fa4471ab640 1 -- 172.21.15.67:0/2051505902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa44015d950 con 0x7fa440149ff0 2024-04-25T02:29:05.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.442+0000 7fa4471ab640 1 -- 172.21.15.67:0/2051505902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa440069110 con 0x7fa440149ff0 2024-04-25T02:29:05.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.443+0000 7fa43d7fa640 1 -- 172.21.15.67:0/2051505902 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa438047070 con 0x7fa440149ff0 2024-04-25T02:29:05.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.443+0000 7fa43d7fa640 1 --2- 172.21.15.67:0/2051505902 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa42406be60 0x7fa42406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.443+0000 7fa43d7fa640 1 -- 172.21.15.67:0/2051505902 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa4380aad40 con 0x7fa440149ff0 2024-04-25T02:29:05.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.443+0000 7fa444f47640 1 --2- 172.21.15.67:0/2051505902 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa42406be60 0x7fa42406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:05.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.444+0000 7fa444f47640 1 --2- 172.21.15.67:0/2051505902 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa42406be60 0x7fa42406e320 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa434009bc0 tx=0x7fa434008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:05.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.447+0000 7fa43d7fa640 1 -- 172.21.15.67:0/2051505902 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa438079130 con 0x7fa440149ff0 2024-04-25T02:29:05.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.629+0000 7fa4471ab640 1 -- 172.21.15.67:0/2051505902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa44006cdd0 con 0x7fa440149ff0 2024-04-25T02:29:05.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.629+0000 7fa43d7fa640 1 -- 172.21.15.67:0/2051505902 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fa43807d430 con 0x7fa440149ff0 2024-04-25T02:29:05.632 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:29:05.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.631+0000 7fa4471ab640 1 -- 172.21.15.67:0/2051505902 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa42406be60 msgr2=0x7fa42406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.631+0000 7fa4471ab640 1 --2- 172.21.15.67:0/2051505902 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa42406be60 0x7fa42406e320 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa434009bc0 tx=0x7fa434008040 comp rx=0 tx=0).stop 2024-04-25T02:29:05.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.631+0000 7fa4471ab640 1 -- 172.21.15.67:0/2051505902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa440149ff0 msgr2=0x7fa4400aff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.631+0000 7fa4471ab640 1 --2- 172.21.15.67:0/2051505902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa440149ff0 0x7fa4400aff90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa43802b4a0 tx=0x7fa4400b3430 comp rx=0 tx=0).stop 2024-04-25T02:29:05.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.631+0000 7fa4471ab640 1 -- 172.21.15.67:0/2051505902 shutdown_connections 2024-04-25T02:29:05.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.631+0000 7fa4471ab640 1 --2- 172.21.15.67:0/2051505902 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa42406be60 0x7fa42406e320 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.631+0000 7fa4471ab640 1 --2- 172.21.15.67:0/2051505902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa440149ff0 0x7fa4400aff90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.631+0000 7fa4471ab640 1 --2- 172.21.15.67:0/2051505902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa44009be00 0x7fa44015e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.631+0000 7fa4471ab640 1 --2- 172.21.15.67:0/2051505902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa430004d40 0x7fa44015cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.631+0000 7fa4471ab640 1 -- 172.21.15.67:0/2051505902 >> 172.21.15.67:0/2051505902 conn(0x7fa4400b19c0 msgr2=0x7fa44006e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:05.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.631+0000 7fa4471ab640 1 -- 172.21.15.67:0/2051505902 shutdown_connections 2024-04-25T02:29:05.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.631+0000 7fa4471ab640 1 -- 172.21.15.67:0/2051505902 wait complete. 2024-04-25T02:29:05.645 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:29:05.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.746+0000 7f6a803c1640 1 Processor -- start 2024-04-25T02:29:05.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.746+0000 7f6a803c1640 1 -- start start 2024-04-25T02:29:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.747+0000 7f6a803c1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a7806ec40 0x7f6a7809db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.747+0000 7f6a803c1640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6a780b2cc0 0x7f6a780add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.747+0000 7f6a803c1640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a780ad820 con 0x7f6a7815b090 2024-04-25T02:29:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.747+0000 7f6a803c1640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6a780b3260 con 0x7f6a780b2cc0 2024-04-25T02:29:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.747+0000 7f6a803c1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6a780b3540 con 0x7f6a7806ec40 2024-04-25T02:29:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.747+0000 7f6a7e95e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6a780b2cc0 0x7f6a780add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.747+0000 7f6a7d95c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a7806ec40 0x7f6a7809db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.747+0000 7f6a7e95e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6a780b2cc0 0x7f6a780add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:37360/0 (socket says 172.21.15.67:37360) 2024-04-25T02:29:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.747+0000 7f6a7e95e640 1 -- 172.21.15.67:0/3001401340 learned_addr learned my addr 172.21.15.67:0/3001401340 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.747+0000 7f6a7d95c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a7806ec40 0x7f6a7809db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:53242/0 (socket says 172.21.15.67:53242) 2024-04-25T02:29:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.747+0000 7f6a7e15d640 1 --1- 172.21.15.67:0/3001401340 >> v1:172.21.15.176:6789/0 conn(0x7f6a7815b090 0x7f6a7806e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:54504/0 (socket says 172.21.15.67:54504) 2024-04-25T02:29:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.747+0000 7f6a7e95e640 1 -- 172.21.15.67:0/3001401340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a7806ec40 msgr2=0x7f6a7809db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.747+0000 7f6a7e95e640 1 --2- 172.21.15.67:0/3001401340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a7806ec40 0x7f6a7809db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.747+0000 7f6a7e95e640 1 -- 172.21.15.67:0/3001401340 >> v1:172.21.15.176:6789/0 conn(0x7f6a7815b090 legacy=0x7f6a7806e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.747+0000 7f6a7e95e640 1 -- 172.21.15.67:0/3001401340 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a780b3820 con 0x7f6a780b2cc0 2024-04-25T02:29:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.748+0000 7f6a7e95e640 1 --2- 172.21.15.67:0/3001401340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a780b2cc0 0x7f6a780add00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6a70009e50 tx=0x7f6a7002a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d01070fd8e95c7b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.748+0000 7f6a7d15b640 1 -- 172.21.15.67:0/3001401340 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a70036070 con 0x7f6a780b2cc0 2024-04-25T02:29:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.748+0000 7f6a7d15b640 1 -- 172.21.15.67:0/3001401340 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a70031600 con 0x7f6a780b2cc0 2024-04-25T02:29:05.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.748+0000 7f6a7d15b640 1 -- 172.21.15.67:0/3001401340 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a700319d0 con 0x7f6a780b2cc0 2024-04-25T02:29:05.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.749+0000 7f6a803c1640 1 -- 172.21.15.67:0/3001401340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a780b2cc0 msgr2=0x7f6a780add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.749+0000 7f6a803c1640 1 --2- 172.21.15.67:0/3001401340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a780b2cc0 0x7f6a780add00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6a70009e50 tx=0x7f6a7002a730 comp rx=0 tx=0).stop 2024-04-25T02:29:05.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.749+0000 7f6a803c1640 1 -- 172.21.15.67:0/3001401340 shutdown_connections 2024-04-25T02:29:05.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.749+0000 7f6a803c1640 1 --2- 172.21.15.67:0/3001401340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a780b2cc0 0x7f6a780add00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.749+0000 7f6a803c1640 1 --2- 172.21.15.67:0/3001401340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a7806ec40 0x7f6a7809db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.749+0000 7f6a803c1640 1 -- 172.21.15.67:0/3001401340 >> 172.21.15.67:0/3001401340 conn(0x7f6a780b19c0 msgr2=0x7f6a780b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:05.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.749+0000 7f6a803c1640 1 -- 172.21.15.67:0/3001401340 shutdown_connections 2024-04-25T02:29:05.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.749+0000 7f6a803c1640 1 -- 172.21.15.67:0/3001401340 wait complete. 2024-04-25T02:29:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.750+0000 7f6a803c1640 1 Processor -- start 2024-04-25T02:29:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.750+0000 7f6a803c1640 1 -- start start 2024-04-25T02:29:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.751+0000 7f6a803c1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a7806ec40 0x7f6a7814b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.751+0000 7f6a803c1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a780b2cc0 0x7f6a7815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.751+0000 7f6a803c1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a7815b090 0x7f6a7809be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.751+0000 7f6a803c1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7815b470 con 0x7f6a7806ec40 2024-04-25T02:29:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.751+0000 7f6a803c1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6a780b4f70 con 0x7f6a780b2cc0 2024-04-25T02:29:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.751+0000 7f6a803c1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6a78070e10 con 0x7f6a7815b090 2024-04-25T02:29:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.751+0000 7f6a7e15d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a7806ec40 0x7f6a7814b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.751+0000 7f6a7e15d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a7806ec40 0x7f6a7814b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49630/0 (socket says 172.21.15.67:49630) 2024-04-25T02:29:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.751+0000 7f6a7e15d640 1 -- 172.21.15.67:0/3396049952 learned_addr learned my addr 172.21.15.67:0/3396049952 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.751+0000 7f6a7e95e640 1 --2- 172.21.15.67:0/3396049952 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a7815b090 0x7f6a7809be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.751+0000 7f6a7d95c640 1 --2- 172.21.15.67:0/3396049952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a780b2cc0 0x7f6a7815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.751+0000 7f6a7e15d640 1 -- 172.21.15.67:0/3396049952 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a7815b090 msgr2=0x7f6a7809be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.751+0000 7f6a7e15d640 1 --2- 172.21.15.67:0/3396049952 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a7815b090 0x7f6a7809be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.751+0000 7f6a7e15d640 1 -- 172.21.15.67:0/3396049952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a780b2cc0 msgr2=0x7f6a7815c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.751+0000 7f6a7e15d640 1 --2- 172.21.15.67:0/3396049952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a780b2cc0 0x7f6a7815c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.751+0000 7f6a7e15d640 1 -- 172.21.15.67:0/3396049952 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7809c5b0 con 0x7f6a7806ec40 2024-04-25T02:29:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.752+0000 7f6a7e15d640 1 --2- 172.21.15.67:0/3396049952 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a7806ec40 0x7f6a7814b730 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400c3f0 tx=0x7f6a7400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.752+0000 7f6a6effd640 1 -- 172.21.15.67:0/3396049952 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a740074e0 con 0x7f6a7806ec40 2024-04-25T02:29:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.752+0000 7f6a6effd640 1 -- 172.21.15.67:0/3396049952 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a74007680 con 0x7f6a7806ec40 2024-04-25T02:29:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.752+0000 7f6a803c1640 1 -- 172.21.15.67:0/3396049952 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a7809c890 con 0x7f6a7806ec40 2024-04-25T02:29:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.752+0000 7f6a6effd640 1 -- 172.21.15.67:0/3396049952 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a74004a00 con 0x7f6a7806ec40 2024-04-25T02:29:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.752+0000 7f6a803c1640 1 -- 172.21.15.67:0/3396049952 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a7809ce50 con 0x7f6a7806ec40 2024-04-25T02:29:05.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.753+0000 7f6a803c1640 1 -- 172.21.15.67:0/3396049952 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a78069110 con 0x7f6a7806ec40 2024-04-25T02:29:05.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.753+0000 7f6a6effd640 1 -- 172.21.15.67:0/3396049952 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a7401a020 con 0x7f6a7806ec40 2024-04-25T02:29:05.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.754+0000 7f6a6effd640 1 --2- 172.21.15.67:0/3396049952 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6a5c06be30 0x7f6a5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:05.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.754+0000 7f6a6effd640 1 -- 172.21.15.67:0/3396049952 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6a7408a430 con 0x7f6a7806ec40 2024-04-25T02:29:05.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.754+0000 7f6a7d95c640 1 --2- 172.21.15.67:0/3396049952 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6a5c06be30 0x7f6a5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:05.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.755+0000 7f6a7d95c640 1 --2- 172.21.15.67:0/3396049952 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6a5c06be30 0x7f6a5c06e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6a780cff70 tx=0x7f6a68009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:05.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.758+0000 7f6a6effd640 1 -- 172.21.15.67:0/3396049952 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6a74058820 con 0x7f6a7806ec40 2024-04-25T02:29:05.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.942+0000 7f6a803c1640 1 -- 172.21.15.67:0/3396049952 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6a7806cdd0 con 0x7f6a7806ec40 2024-04-25T02:29:05.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.942+0000 7f6a6effd640 1 -- 172.21.15.67:0/3396049952 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f6a7405cb20 con 0x7f6a7806ec40 2024-04-25T02:29:05.945 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-25T02:29:05.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.944+0000 7f6a803c1640 1 -- 172.21.15.67:0/3396049952 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6a5c06be30 msgr2=0x7f6a5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.944+0000 7f6a803c1640 1 --2- 172.21.15.67:0/3396049952 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6a5c06be30 0x7f6a5c06e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6a780cff70 tx=0x7f6a68009190 comp rx=0 tx=0).stop 2024-04-25T02:29:05.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.944+0000 7f6a803c1640 1 -- 172.21.15.67:0/3396049952 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a7806ec40 msgr2=0x7f6a7814b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:05.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.944+0000 7f6a803c1640 1 --2- 172.21.15.67:0/3396049952 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a7806ec40 0x7f6a7814b730 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400c3f0 tx=0x7f6a7400c8b0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.944+0000 7f6a803c1640 1 -- 172.21.15.67:0/3396049952 shutdown_connections 2024-04-25T02:29:05.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.944+0000 7f6a803c1640 1 --2- 172.21.15.67:0/3396049952 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6a5c06be30 0x7f6a5c06e2f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.944+0000 7f6a803c1640 1 --2- 172.21.15.67:0/3396049952 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a7815b090 0x7f6a7809be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.944+0000 7f6a803c1640 1 --2- 172.21.15.67:0/3396049952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a780b2cc0 0x7f6a7815c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.944+0000 7f6a803c1640 1 --2- 172.21.15.67:0/3396049952 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a7806ec40 0x7f6a7814b730 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:05.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.944+0000 7f6a803c1640 1 -- 172.21.15.67:0/3396049952 >> 172.21.15.67:0/3396049952 conn(0x7f6a780b19c0 msgr2=0x7f6a780b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:05.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.944+0000 7f6a803c1640 1 -- 172.21.15.67:0/3396049952 shutdown_connections 2024-04-25T02:29:05.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:05.944+0000 7f6a803c1640 1 -- 172.21.15.67:0/3396049952 wait complete. 2024-04-25T02:29:05.958 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:29:06.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.059+0000 7fea84031640 1 Processor -- start 2024-04-25T02:29:06.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.059+0000 7fea84031640 1 -- start start 2024-04-25T02:29:06.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.060+0000 7fea84031640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fea7c06b0c0 0x7fea7c0cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:06.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.060+0000 7fea84031640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea7c071e70 0x7fea7c072300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:06.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.060+0000 7fea84031640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea7c06b7a0 con 0x7fea7c0d0a00 2024-04-25T02:29:06.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.060+0000 7fea84031640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fea7c06c040 con 0x7fea7c06b0c0 2024-04-25T02:29:06.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.060+0000 7fea84031640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fea7c0cef50 con 0x7fea7c071e70 2024-04-25T02:29:06.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.060+0000 7fea815cc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fea7c06b0c0 0x7fea7c0cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:06.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.060+0000 7fea81dcd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fea7c0d0a00 0x7fea7c0cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42796/0 (socket says 172.21.15.67:42796) 2024-04-25T02:29:06.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.060+0000 7fea815cc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fea7c06b0c0 0x7fea7c0cd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49638/0 (socket says 172.21.15.67:49638) 2024-04-25T02:29:06.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.060+0000 7fea81dcd640 1 -- 172.21.15.67:0/4192267629 learned_addr learned my addr 172.21.15.67:0/4192267629 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:06.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.060+0000 7fea815cc640 1 -- 172.21.15.67:0/4192267629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea7c071e70 msgr2=0x7fea7c072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:06.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.060+0000 7fea825ce640 1 --2- 172.21.15.67:0/4192267629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea7c071e70 0x7fea7c072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:06.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.060+0000 7fea815cc640 1 --2- 172.21.15.67:0/4192267629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea7c071e70 0x7fea7c072300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.060+0000 7fea80dcb640 1 -- 172.21.15.67:0/4192267629 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 756873274 0 0) 0x7fea7c06b7a0 con 0x7fea7c0d0a00 2024-04-25T02:29:06.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.060+0000 7fea815cc640 1 -- 172.21.15.67:0/4192267629 >> v1:172.21.15.67:6789/0 conn(0x7fea7c0d0a00 legacy=0x7fea7c0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:06.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.060+0000 7fea815cc640 1 -- 172.21.15.67:0/4192267629 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7c06ba80 con 0x7fea7c06b0c0 2024-04-25T02:29:06.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.060+0000 7fea825ce640 1 --2- 172.21.15.67:0/4192267629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea7c071e70 0x7fea7c072300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:06.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.061+0000 7fea815cc640 1 --2- 172.21.15.67:0/4192267629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea7c06b0c0 0x7fea7c0cd1d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0097a0 tx=0x7fea6c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30893e6a42c78f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:06.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.061+0000 7fea80dcb640 1 -- 172.21.15.67:0/4192267629 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c037070 con 0x7fea7c06b0c0 2024-04-25T02:29:06.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.061+0000 7fea80dcb640 1 -- 172.21.15.67:0/4192267629 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea6c032440 con 0x7fea7c06b0c0 2024-04-25T02:29:06.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.061+0000 7fea80dcb640 1 -- 172.21.15.67:0/4192267629 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c032810 con 0x7fea7c06b0c0 2024-04-25T02:29:06.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.062+0000 7fea84031640 1 -- 172.21.15.67:0/4192267629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea7c06b0c0 msgr2=0x7fea7c0cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:06.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.062+0000 7fea84031640 1 --2- 172.21.15.67:0/4192267629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea7c06b0c0 0x7fea7c0cd1d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0097a0 tx=0x7fea6c02a180 comp rx=0 tx=0).stop 2024-04-25T02:29:06.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.062+0000 7fea84031640 1 -- 172.21.15.67:0/4192267629 shutdown_connections 2024-04-25T02:29:06.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.062+0000 7fea84031640 1 --2- 172.21.15.67:0/4192267629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea7c071e70 0x7fea7c072300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.062+0000 7fea84031640 1 --2- 172.21.15.67:0/4192267629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea7c06b0c0 0x7fea7c0cd1d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.062+0000 7fea84031640 1 -- 172.21.15.67:0/4192267629 >> 172.21.15.67:0/4192267629 conn(0x7fea7c0d0e20 msgr2=0x7fea7c0d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:06.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.062+0000 7fea84031640 1 -- 172.21.15.67:0/4192267629 shutdown_connections 2024-04-25T02:29:06.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.062+0000 7fea84031640 1 -- 172.21.15.67:0/4192267629 wait complete. 2024-04-25T02:29:06.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.063+0000 7fea84031640 1 Processor -- start 2024-04-25T02:29:06.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.063+0000 7fea84031640 1 -- start start 2024-04-25T02:29:06.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea84031640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea7c06b0c0 0x7fea7c14d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:06.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea84031640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea7c071e70 0x7fea7c1614a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:06.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea84031640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea7c0d0a00 0x7fea7c15b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:06.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea84031640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c0cfaf0 con 0x7fea7c06b0c0 2024-04-25T02:29:06.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea84031640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c06b550 con 0x7fea7c071e70 2024-04-25T02:29:06.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea84031640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fea7c0cfc70 con 0x7fea7c0d0a00 2024-04-25T02:29:06.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea81dcd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea7c06b0c0 0x7fea7c14d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:06.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea81dcd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea7c06b0c0 0x7fea7c14d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49650/0 (socket says 172.21.15.67:49650) 2024-04-25T02:29:06.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea81dcd640 1 -- 172.21.15.67:0/3207289261 learned_addr learned my addr 172.21.15.67:0/3207289261 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:06.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea81dcd640 1 -- 172.21.15.67:0/3207289261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea7c0d0a00 msgr2=0x7fea7c15b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:06.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea81dcd640 1 --2- 172.21.15.67:0/3207289261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea7c0d0a00 0x7fea7c15b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea81dcd640 1 -- 172.21.15.67:0/3207289261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea7c071e70 msgr2=0x7fea7c1614a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:06.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea81dcd640 1 --2- 172.21.15.67:0/3207289261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea7c071e70 0x7fea7c1614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea81dcd640 1 -- 172.21.15.67:0/3207289261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7c156da0 con 0x7fea7c06b0c0 2024-04-25T02:29:06.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea81dcd640 1 --2- 172.21.15.67:0/3207289261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea7c06b0c0 0x7fea7c14d2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fea7800c430 tx=0x7fea7800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:06.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea727fc640 1 -- 172.21.15.67:0/3207289261 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea780074e0 con 0x7fea7c06b0c0 2024-04-25T02:29:06.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea727fc640 1 -- 172.21.15.67:0/3207289261 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea780047e0 con 0x7fea7c06b0c0 2024-04-25T02:29:06.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea84031640 1 -- 172.21.15.67:0/3207289261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea7c15fa30 con 0x7fea7c06b0c0 2024-04-25T02:29:06.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea727fc640 1 -- 172.21.15.67:0/3207289261 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78004bd0 con 0x7fea7c06b0c0 2024-04-25T02:29:06.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.064+0000 7fea84031640 1 -- 172.21.15.67:0/3207289261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea7c15fff0 con 0x7fea7c06b0c0 2024-04-25T02:29:06.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.065+0000 7fea84031640 1 -- 172.21.15.67:0/3207289261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea7c067e40 con 0x7fea7c06b0c0 2024-04-25T02:29:06.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.066+0000 7fea727fc640 1 -- 172.21.15.67:0/3207289261 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea78011070 con 0x7fea7c06b0c0 2024-04-25T02:29:06.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.066+0000 7fea727fc640 1 --2- 172.21.15.67:0/3207289261 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fea6006be30 0x7fea6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:06.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.067+0000 7fea727fc640 1 -- 172.21.15.67:0/3207289261 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fea7808aad0 con 0x7fea7c06b0c0 2024-04-25T02:29:06.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.067+0000 7fea815cc640 1 --2- 172.21.15.67:0/3207289261 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fea6006be30 0x7fea6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:06.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.067+0000 7fea815cc640 1 --2- 172.21.15.67:0/3207289261 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fea6006be30 0x7fea6006e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fea6c034000 tx=0x7fea6c02c000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:06.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.071+0000 7fea727fc640 1 -- 172.21.15.67:0/3207289261 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fea78059480 con 0x7fea7c06b0c0 2024-04-25T02:29:06.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.251+0000 7fea84031640 1 -- 172.21.15.67:0/3207289261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fea7c0b0640 con 0x7fea7c06b0c0 2024-04-25T02:29:06.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.252+0000 7fea727fc640 1 -- 172.21.15.67:0/3207289261 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fea78058d80 con 0x7fea7c06b0c0 2024-04-25T02:29:06.255 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-25T02:29:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.254+0000 7fea84031640 1 -- 172.21.15.67:0/3207289261 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fea6006be30 msgr2=0x7fea6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.254+0000 7fea84031640 1 --2- 172.21.15.67:0/3207289261 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fea6006be30 0x7fea6006e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fea6c034000 tx=0x7fea6c02c000 comp rx=0 tx=0).stop 2024-04-25T02:29:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.254+0000 7fea84031640 1 -- 172.21.15.67:0/3207289261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea7c06b0c0 msgr2=0x7fea7c14d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.254+0000 7fea84031640 1 --2- 172.21.15.67:0/3207289261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea7c06b0c0 0x7fea7c14d2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fea7800c430 tx=0x7fea7800c8f0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.254+0000 7fea84031640 1 -- 172.21.15.67:0/3207289261 shutdown_connections 2024-04-25T02:29:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.254+0000 7fea84031640 1 --2- 172.21.15.67:0/3207289261 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fea6006be30 0x7fea6006e2f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.254+0000 7fea84031640 1 --2- 172.21.15.67:0/3207289261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea7c0d0a00 0x7fea7c15b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.254+0000 7fea84031640 1 --2- 172.21.15.67:0/3207289261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea7c071e70 0x7fea7c1614a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.254+0000 7fea84031640 1 --2- 172.21.15.67:0/3207289261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea7c06b0c0 0x7fea7c14d2f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.254+0000 7fea84031640 1 -- 172.21.15.67:0/3207289261 >> 172.21.15.67:0/3207289261 conn(0x7fea7c0d0e20 msgr2=0x7fea7c0cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:06.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.254+0000 7fea84031640 1 -- 172.21.15.67:0/3207289261 shutdown_connections 2024-04-25T02:29:06.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.254+0000 7fea84031640 1 -- 172.21.15.67:0/3207289261 wait complete. 2024-04-25T02:29:06.267 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:29:06.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.366+0000 7f9147e95640 1 Processor -- start 2024-04-25T02:29:06.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.366+0000 7f9147e95640 1 -- start start 2024-04-25T02:29:06.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.367+0000 7f9147e95640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f91400b4b70 0x7f91400b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:06.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.367+0000 7f9147e95640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f914006e7a0 0x7f91400ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:06.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.367+0000 7f9147e95640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91400b33c0 con 0x7f914015a6f0 2024-04-25T02:29:06.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.367+0000 7f9147e95640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f91400b3fd0 con 0x7f914006e7a0 2024-04-25T02:29:06.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.367+0000 7f9147e95640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f91400b36a0 con 0x7f91400b4b70 2024-04-25T02:29:06.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.367+0000 7f9146432640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f914006e7a0 0x7f91400ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:06.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.367+0000 7f9145c31640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f914015a6f0 0x7f91400b4460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42802/0 (socket says 172.21.15.67:42802) 2024-04-25T02:29:06.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.367+0000 7f9145c31640 1 -- 172.21.15.67:0/3852430626 learned_addr learned my addr 172.21.15.67:0/3852430626 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:06.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.367+0000 7f9145430640 1 --2- 172.21.15.67:0/3852430626 >> v2:172.21.15.176:3300/0 conn(0x7f91400b4b70 0x7f91400b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:06.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.367+0000 7f9144c2f640 1 -- 172.21.15.67:0/3852430626 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3149180480 0 0) 0x7f91400b33c0 con 0x7f914015a6f0 2024-04-25T02:29:06.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.367+0000 7f9144c2f640 1 -- 172.21.15.67:0/3852430626 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f912c003520 con 0x7f914015a6f0 2024-04-25T02:29:06.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.367+0000 7f9146432640 1 -- 172.21.15.67:0/3852430626 >> v2:172.21.15.176:3300/0 conn(0x7f91400b4b70 msgr2=0x7f91400b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:06.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.367+0000 7f9146432640 1 --2- 172.21.15.67:0/3852430626 >> v2:172.21.15.176:3300/0 conn(0x7f91400b4b70 0x7f91400b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.367+0000 7f9146432640 1 -- 172.21.15.67:0/3852430626 >> v1:172.21.15.67:6789/0 conn(0x7f914015a6f0 legacy=0x7f91400b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:06.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.367+0000 7f9146432640 1 -- 172.21.15.67:0/3852430626 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91400b3980 con 0x7f914006e7a0 2024-04-25T02:29:06.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.367+0000 7f9145430640 1 --2- 172.21.15.67:0/3852430626 >> v2:172.21.15.176:3300/0 conn(0x7f91400b4b70 0x7f91400b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:06.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.368+0000 7f9146432640 1 --2- 172.21.15.67:0/3852430626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f914006e7a0 0x7f91400ad080 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f91400b4150 tx=0x7f913802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676e79dc6e4cc194 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:06.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.368+0000 7f9144c2f640 1 -- 172.21.15.67:0/3852430626 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9138007740 con 0x7f914006e7a0 2024-04-25T02:29:06.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.368+0000 7f9144c2f640 1 -- 172.21.15.67:0/3852430626 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91380078e0 con 0x7f914006e7a0 2024-04-25T02:29:06.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.368+0000 7f9144c2f640 1 -- 172.21.15.67:0/3852430626 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9138007cb0 con 0x7f914006e7a0 2024-04-25T02:29:06.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.369+0000 7f9147e95640 1 -- 172.21.15.67:0/3852430626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f914006e7a0 msgr2=0x7f91400ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:06.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.369+0000 7f9147e95640 1 --2- 172.21.15.67:0/3852430626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f914006e7a0 0x7f91400ad080 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f91400b4150 tx=0x7f913802a660 comp rx=0 tx=0).stop 2024-04-25T02:29:06.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.369+0000 7f9147e95640 1 -- 172.21.15.67:0/3852430626 shutdown_connections 2024-04-25T02:29:06.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.369+0000 7f9147e95640 1 --2- 172.21.15.67:0/3852430626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f914006e7a0 0x7f91400ad080 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.369+0000 7f9147e95640 1 --2- 172.21.15.67:0/3852430626 >> v2:172.21.15.176:3300/0 conn(0x7f91400b4b70 0x7f91400b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.369+0000 7f9147e95640 1 -- 172.21.15.67:0/3852430626 >> 172.21.15.67:0/3852430626 conn(0x7f91400b19c0 msgr2=0x7f91400b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:06.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.369+0000 7f9147e95640 1 -- 172.21.15.67:0/3852430626 shutdown_connections 2024-04-25T02:29:06.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.369+0000 7f9147e95640 1 -- 172.21.15.67:0/3852430626 wait complete. 2024-04-25T02:29:06.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.370+0000 7f9147e95640 1 Processor -- start 2024-04-25T02:29:06.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.370+0000 7f9147e95640 1 -- start start 2024-04-25T02:29:06.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f9147e95640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f914006e7a0 0x7f91400cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:06.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f9147e95640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91400b4b70 0x7f914014e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:06.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f9147e95640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f914015a6f0 0x7f91400b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:06.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f9147e95640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f914015aad0 con 0x7f91400b4b70 2024-04-25T02:29:06.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f9147e95640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f914006ec10 con 0x7f914006e7a0 2024-04-25T02:29:06.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f9147e95640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f91400ad5c0 con 0x7f914015a6f0 2024-04-25T02:29:06.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f9145430640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91400b4b70 0x7f914014e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:06.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f9145430640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91400b4b70 0x7f914014e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49658/0 (socket says 172.21.15.67:49658) 2024-04-25T02:29:06.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f9145430640 1 -- 172.21.15.67:0/2894595306 learned_addr learned my addr 172.21.15.67:0/2894595306 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:06.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f9145c31640 1 --2- 172.21.15.67:0/2894595306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f914006e7a0 0x7f91400cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:06.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f9146432640 1 --2- 172.21.15.67:0/2894595306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f914015a6f0 0x7f91400b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:06.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f9145430640 1 -- 172.21.15.67:0/2894595306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f914015a6f0 msgr2=0x7f91400b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:06.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f9145430640 1 --2- 172.21.15.67:0/2894595306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f914015a6f0 0x7f91400b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f9145430640 1 -- 172.21.15.67:0/2894595306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f914006e7a0 msgr2=0x7f91400cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:06.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f9145430640 1 --2- 172.21.15.67:0/2894595306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f914006e7a0 0x7f91400cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f9145430640 1 -- 172.21.15.67:0/2894595306 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91400c9040 con 0x7f91400b4b70 2024-04-25T02:29:06.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f9146432640 1 --2- 172.21.15.67:0/2894595306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f914015a6f0 0x7f91400b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:06.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f9145430640 1 --2- 172.21.15.67:0/2894595306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91400b4b70 0x7f914014e940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f913000d900 tx=0x7f913000ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:06.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.371+0000 7f91367fc640 1 -- 172.21.15.67:0/2894595306 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913000b040 con 0x7f91400b4b70 2024-04-25T02:29:06.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.372+0000 7f91367fc640 1 -- 172.21.15.67:0/2894595306 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913000bbd0 con 0x7f91400b4b70 2024-04-25T02:29:06.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.372+0000 7f91367fc640 1 -- 172.21.15.67:0/2894595306 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130004030 con 0x7f91400b4b70 2024-04-25T02:29:06.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.372+0000 7f9147e95640 1 -- 172.21.15.67:0/2894595306 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91400c9320 con 0x7f91400b4b70 2024-04-25T02:29:06.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.372+0000 7f9147e95640 1 -- 172.21.15.67:0/2894595306 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91400c98e0 con 0x7f91400b4b70 2024-04-25T02:29:06.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.373+0000 7f9147e95640 1 -- 172.21.15.67:0/2894595306 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9140069110 con 0x7f91400b4b70 2024-04-25T02:29:06.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.373+0000 7f91367fc640 1 -- 172.21.15.67:0/2894595306 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91300041d0 con 0x7f91400b4b70 2024-04-25T02:29:06.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.373+0000 7f91367fc640 1 --2- 172.21.15.67:0/2894595306 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f912406be30 0x7f912406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:06.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.374+0000 7f91367fc640 1 -- 172.21.15.67:0/2894595306 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f913008b050 con 0x7f91400b4b70 2024-04-25T02:29:06.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.374+0000 7f9145c31640 1 --2- 172.21.15.67:0/2894595306 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f912406be30 0x7f912406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:06.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.374+0000 7f9145c31640 1 --2- 172.21.15.67:0/2894595306 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f912406be30 0x7f912406e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f913c005880 tx=0x7f913c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:06.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.378+0000 7f91367fc640 1 -- 172.21.15.67:0/2894595306 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9130015070 con 0x7f91400b4b70 2024-04-25T02:29:06.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.596+0000 7f9147e95640 1 -- 172.21.15.67:0/2894595306 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91400d0880 con 0x7f91400b4b70 2024-04-25T02:29:06.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.596+0000 7f91367fc640 1 -- 172.21.15.67:0/2894595306 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5172 (secure 0 0 0) 0x7f9130059a00 con 0x7f91400b4b70 2024-04-25T02:29:06.600 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:06.600 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1246739775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1246739775},{"type":"v1","addr":"172.21.15.67:6835","nonce":1246739775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/267757090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":267757090},{"type":"v1","addr":"172.21.15.67:6833","nonce":267757090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/90768677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":90768677},{"type":"v1","addr":"172.21.15.176:6837","nonce":90768677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:28:26.184170+0000","modified":"2024-04-25T02:28:29.181464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/1058053785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1058053785},{"type":"v1","addr":"172.21.15.176:6836","nonce":1058053785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-25T02:29:06.600 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 7 2024-04-25T02:29:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.598+0000 7f9147e95640 1 -- 172.21.15.67:0/2894595306 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f912406be30 msgr2=0x7f912406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.598+0000 7f9147e95640 1 --2- 172.21.15.67:0/2894595306 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f912406be30 0x7f912406e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f913c005880 tx=0x7f913c009040 comp rx=0 tx=0).stop 2024-04-25T02:29:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.598+0000 7f9147e95640 1 -- 172.21.15.67:0/2894595306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91400b4b70 msgr2=0x7f914014e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.598+0000 7f9147e95640 1 --2- 172.21.15.67:0/2894595306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91400b4b70 0x7f914014e940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f913000d900 tx=0x7f913000ddc0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.598+0000 7f9147e95640 1 -- 172.21.15.67:0/2894595306 shutdown_connections 2024-04-25T02:29:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.598+0000 7f9147e95640 1 --2- 172.21.15.67:0/2894595306 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f912406be30 0x7f912406e2f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.598+0000 7f9147e95640 1 --2- 172.21.15.67:0/2894595306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f914015a6f0 0x7f91400b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.598+0000 7f9147e95640 1 --2- 172.21.15.67:0/2894595306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91400b4b70 0x7f914014e940 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.598+0000 7f9147e95640 1 --2- 172.21.15.67:0/2894595306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f914006e7a0 0x7f91400cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.599+0000 7f9147e95640 1 -- 172.21.15.67:0/2894595306 >> 172.21.15.67:0/2894595306 conn(0x7f91400b19c0 msgr2=0x7f91401595e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.599+0000 7f9147e95640 1 -- 172.21.15.67:0/2894595306 shutdown_connections 2024-04-25T02:29:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.599+0000 7f9147e95640 1 -- 172.21.15.67:0/2894595306 wait complete. 2024-04-25T02:29:06.612 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:29:06.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.710+0000 7fee9f58b640 1 Processor -- start 2024-04-25T02:29:06.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.710+0000 7fee9f58b640 1 -- start start 2024-04-25T02:29:06.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.711+0000 7fee9f58b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fee9815bfc0 0x7fee980ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:06.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.711+0000 7fee9f58b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee9815e9f0 0x7fee9806d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:06.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.711+0000 7fee9f58b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee9815c3a0 con 0x7fee980d0210 2024-04-25T02:29:06.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.711+0000 7fee9f58b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fee980d0760 con 0x7fee9815bfc0 2024-04-25T02:29:06.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.711+0000 7fee9f58b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fee980d0a40 con 0x7fee9815e9f0 2024-04-25T02:29:06.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.711+0000 7fee9d327640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fee9815bfc0 0x7fee980ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:06.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.711+0000 7fee9d327640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fee9815bfc0 0x7fee980ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49674/0 (socket says 172.21.15.67:49674) 2024-04-25T02:29:06.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.711+0000 7fee9d327640 1 -- 172.21.15.67:0/2224206541 learned_addr learned my addr 172.21.15.67:0/2224206541 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:06.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.711+0000 7fee9db28640 1 --2- 172.21.15.67:0/2224206541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee9815e9f0 0x7fee9806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:06.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.712+0000 7fee9d327640 1 -- 172.21.15.67:0/2224206541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee9815e9f0 msgr2=0x7fee9806d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:06.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.712+0000 7fee9d327640 1 --2- 172.21.15.67:0/2224206541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee9815e9f0 0x7fee9806d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.712+0000 7fee9d327640 1 -- 172.21.15.67:0/2224206541 >> v1:172.21.15.176:6789/0 conn(0x7fee980d0210 legacy=0x7fee98161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:06.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.712+0000 7fee9d327640 1 -- 172.21.15.67:0/2224206541 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee980d0d20 con 0x7fee9815bfc0 2024-04-25T02:29:06.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.712+0000 7fee9d327640 1 --2- 172.21.15.67:0/2224206541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee9815bfc0 0x7fee980ce750 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fee88009e50 tx=0x7fee8802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a43b976df7d36a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:06.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.712+0000 7fee97fff640 1 -- 172.21.15.67:0/2224206541 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88036070 con 0x7fee9815bfc0 2024-04-25T02:29:06.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.712+0000 7fee97fff640 1 -- 172.21.15.67:0/2224206541 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee88031600 con 0x7fee9815bfc0 2024-04-25T02:29:06.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.712+0000 7fee97fff640 1 -- 172.21.15.67:0/2224206541 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee880319d0 con 0x7fee9815bfc0 2024-04-25T02:29:06.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.713+0000 7fee9f58b640 1 -- 172.21.15.67:0/2224206541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee9815bfc0 msgr2=0x7fee980ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:06.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.713+0000 7fee9f58b640 1 --2- 172.21.15.67:0/2224206541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee9815bfc0 0x7fee980ce750 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fee88009e50 tx=0x7fee8802a6c0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.713+0000 7fee9f58b640 1 -- 172.21.15.67:0/2224206541 shutdown_connections 2024-04-25T02:29:06.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.713+0000 7fee9f58b640 1 --2- 172.21.15.67:0/2224206541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee9815e9f0 0x7fee9806d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.713+0000 7fee9f58b640 1 --2- 172.21.15.67:0/2224206541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee9815bfc0 0x7fee980ce750 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.713+0000 7fee9f58b640 1 -- 172.21.15.67:0/2224206541 >> 172.21.15.67:0/2224206541 conn(0x7fee980d1ed0 msgr2=0x7fee980d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:06.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.713+0000 7fee9f58b640 1 -- 172.21.15.67:0/2224206541 shutdown_connections 2024-04-25T02:29:06.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.713+0000 7fee9f58b640 1 -- 172.21.15.67:0/2224206541 wait complete. 2024-04-25T02:29:06.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.714+0000 7fee9f58b640 1 Processor -- start 2024-04-25T02:29:06.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.714+0000 7fee9f58b640 1 -- start start 2024-04-25T02:29:06.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.715+0000 7fee9f58b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee980d0210 0x7fee981571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:06.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.715+0000 7fee9f58b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee9815bfc0 0x7fee9815a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:06.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.715+0000 7fee9f58b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee9815e9f0 0x7fee981f7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:06.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.715+0000 7fee9f58b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fee980cf690 con 0x7fee9815e9f0 2024-04-25T02:29:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.715+0000 7fee9f58b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fee980d12e0 con 0x7fee9815bfc0 2024-04-25T02:29:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.715+0000 7fee9f58b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fee980cf810 con 0x7fee980d0210 2024-04-25T02:29:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.715+0000 7fee9db28640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee9815e9f0 0x7fee981f7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.715+0000 7fee9db28640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee9815e9f0 0x7fee981f7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49690/0 (socket says 172.21.15.67:49690) 2024-04-25T02:29:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.715+0000 7fee9db28640 1 -- 172.21.15.67:0/3284350204 learned_addr learned my addr 172.21.15.67:0/3284350204 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.715+0000 7fee9d327640 1 --2- 172.21.15.67:0/3284350204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee980d0210 0x7fee981571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.715+0000 7fee9cb26640 1 --2- 172.21.15.67:0/3284350204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee9815bfc0 0x7fee9815a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.715+0000 7fee9db28640 1 -- 172.21.15.67:0/3284350204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee980d0210 msgr2=0x7fee981571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.715+0000 7fee9db28640 1 --2- 172.21.15.67:0/3284350204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee980d0210 0x7fee981571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.715+0000 7fee9db28640 1 -- 172.21.15.67:0/3284350204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee9815bfc0 msgr2=0x7fee9815a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.715+0000 7fee9db28640 1 --2- 172.21.15.67:0/3284350204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee9815bfc0 0x7fee9815a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.715+0000 7fee9db28640 1 -- 172.21.15.67:0/3284350204 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee980c82f0 con 0x7fee9815e9f0 2024-04-25T02:29:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.715+0000 7fee9cb26640 1 --2- 172.21.15.67:0/3284350204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee9815bfc0 0x7fee9815a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.716+0000 7fee9db28640 1 --2- 172.21.15.67:0/3284350204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee9815e9f0 0x7fee981f7aa0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fee9000c820 tx=0x7fee9000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.716+0000 7fee95ffb640 1 -- 172.21.15.67:0/3284350204 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee90015070 con 0x7fee9815e9f0 2024-04-25T02:29:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.716+0000 7fee95ffb640 1 -- 172.21.15.67:0/3284350204 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee90004020 con 0x7fee9815e9f0 2024-04-25T02:29:06.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.716+0000 7fee95ffb640 1 -- 172.21.15.67:0/3284350204 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee90004410 con 0x7fee9815e9f0 2024-04-25T02:29:06.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.716+0000 7fee9f58b640 1 -- 172.21.15.67:0/3284350204 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee980c7770 con 0x7fee9815e9f0 2024-04-25T02:29:06.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.716+0000 7fee9f58b640 1 -- 172.21.15.67:0/3284350204 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee980c8010 con 0x7fee9815e9f0 2024-04-25T02:29:06.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.717+0000 7fee9f58b640 1 -- 172.21.15.67:0/3284350204 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee98069110 con 0x7fee9815e9f0 2024-04-25T02:29:06.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.717+0000 7fee95ffb640 1 -- 172.21.15.67:0/3284350204 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee90007830 con 0x7fee9815e9f0 2024-04-25T02:29:06.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.718+0000 7fee95ffb640 1 --2- 172.21.15.67:0/3284350204 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fee8406be30 0x7fee8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:06.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.718+0000 7fee95ffb640 1 -- 172.21.15.67:0/3284350204 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fee9008abc0 con 0x7fee9815e9f0 2024-04-25T02:29:06.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.718+0000 7fee9d327640 1 --2- 172.21.15.67:0/3284350204 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fee8406be30 0x7fee8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:06.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.719+0000 7fee9d327640 1 --2- 172.21.15.67:0/3284350204 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fee8406be30 0x7fee8406e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fee88033000 tx=0x7fee88009000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:06.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.722+0000 7fee95ffb640 1 -- 172.21.15.67:0/3284350204 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fee90058f20 con 0x7fee9815e9f0 2024-04-25T02:29:06.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.908+0000 7fee9f58b640 1 -- 172.21.15.67:0/3284350204 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee980b1fd0 con 0x7fee9815e9f0 2024-04-25T02:29:06.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.909+0000 7fee95ffb640 1 -- 172.21.15.67:0/3284350204 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7fee9005d220 con 0x7fee9815e9f0 2024-04-25T02:29:06.913 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:06.913 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:28:27.819641+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:29:06.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.911+0000 7fee9f58b640 1 -- 172.21.15.67:0/3284350204 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fee8406be30 msgr2=0x7fee8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:06.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.911+0000 7fee9f58b640 1 --2- 172.21.15.67:0/3284350204 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fee8406be30 0x7fee8406e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fee88033000 tx=0x7fee88009000 comp rx=0 tx=0).stop 2024-04-25T02:29:06.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.911+0000 7fee9f58b640 1 -- 172.21.15.67:0/3284350204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee9815e9f0 msgr2=0x7fee981f7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:06.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.911+0000 7fee9f58b640 1 --2- 172.21.15.67:0/3284350204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee9815e9f0 0x7fee981f7aa0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fee9000c820 tx=0x7fee9000cce0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.911+0000 7fee9f58b640 1 -- 172.21.15.67:0/3284350204 shutdown_connections 2024-04-25T02:29:06.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.911+0000 7fee9f58b640 1 --2- 172.21.15.67:0/3284350204 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fee8406be30 0x7fee8406e2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.911+0000 7fee9f58b640 1 --2- 172.21.15.67:0/3284350204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee9815e9f0 0x7fee981f7aa0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.911+0000 7fee9f58b640 1 --2- 172.21.15.67:0/3284350204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee9815bfc0 0x7fee9815a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.911+0000 7fee9f58b640 1 --2- 172.21.15.67:0/3284350204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee980d0210 0x7fee981571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:06.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.911+0000 7fee9f58b640 1 -- 172.21.15.67:0/3284350204 >> 172.21.15.67:0/3284350204 conn(0x7fee980d1ed0 msgr2=0x7fee9815c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:06.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.911+0000 7fee9f58b640 1 -- 172.21.15.67:0/3284350204 shutdown_connections 2024-04-25T02:29:06.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:06.911+0000 7fee9f58b640 1 -- 172.21.15.67:0/3284350204 wait complete. 2024-04-25T02:29:06.925 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T02:29:06.926 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:29:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.026+0000 7f1041c6b640 1 Processor -- start 2024-04-25T02:29:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.026+0000 7f1041c6b640 1 -- start start 2024-04-25T02:29:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.027+0000 7f1041c6b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f103c15c230 0x7f103c071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.027+0000 7f1041c6b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f103c0acda0 0x7f103c0aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.027+0000 7f1041c6b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f103c160b20 con 0x7f103c0aef50 2024-04-25T02:29:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.027+0000 7f1041c6b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f103c15c610 con 0x7f103c15c230 2024-04-25T02:29:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.027+0000 7f1041c6b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f103c0ad230 con 0x7f103c0acda0 2024-04-25T02:29:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.027+0000 7f103b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f103c15c230 0x7f103c071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.027+0000 7f103b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f103c15c230 0x7f103c071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49696/0 (socket says 172.21.15.67:49696) 2024-04-25T02:29:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.027+0000 7f103bfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f103c0aef50 0x7f103c0722c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42808/0 (socket says 172.21.15.67:42808) 2024-04-25T02:29:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.027+0000 7f103b7fe640 1 -- 172.21.15.67:0/2257360779 learned_addr learned my addr 172.21.15.67:0/2257360779 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.027+0000 7f103affd640 1 --2- 172.21.15.67:0/2257360779 >> v2:172.21.15.176:3300/0 conn(0x7f103c0acda0 0x7f103c0aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.027+0000 7f103b7fe640 1 -- 172.21.15.67:0/2257360779 >> v2:172.21.15.176:3300/0 conn(0x7f103c0acda0 msgr2=0x7f103c0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.027+0000 7f103b7fe640 1 --2- 172.21.15.67:0/2257360779 >> v2:172.21.15.176:3300/0 conn(0x7f103c0acda0 0x7f103c0aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.027+0000 7f103b7fe640 1 -- 172.21.15.67:0/2257360779 >> v1:172.21.15.67:6789/0 conn(0x7f103c0aef50 legacy=0x7f103c0722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.027+0000 7f103a7fc640 1 -- 172.21.15.67:0/2257360779 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 814263466 0 0) 0x7f103c160b20 con 0x7f103c0aef50 2024-04-25T02:29:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.027+0000 7f103b7fe640 1 -- 172.21.15.67:0/2257360779 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103c15fd60 con 0x7f103c15c230 2024-04-25T02:29:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.028+0000 7f103b7fe640 1 --2- 172.21.15.67:0/2257360779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c15c230 0x7f103c071800 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f103c073640 tx=0x7f102c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e94f2c6cf4ac604 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.028+0000 7f103a7fc640 1 -- 172.21.15.67:0/2257360779 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c037070 con 0x7f103c15c230 2024-04-25T02:29:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.028+0000 7f103a7fc640 1 -- 172.21.15.67:0/2257360779 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102c032440 con 0x7f103c15c230 2024-04-25T02:29:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.028+0000 7f103a7fc640 1 -- 172.21.15.67:0/2257360779 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c032810 con 0x7f103c15c230 2024-04-25T02:29:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.029+0000 7f1041c6b640 1 -- 172.21.15.67:0/2257360779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c15c230 msgr2=0x7f103c071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.029+0000 7f1041c6b640 1 --2- 172.21.15.67:0/2257360779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c15c230 0x7f103c071800 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f103c073640 tx=0x7f102c02a270 comp rx=0 tx=0).stop 2024-04-25T02:29:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.029+0000 7f1041c6b640 1 -- 172.21.15.67:0/2257360779 shutdown_connections 2024-04-25T02:29:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.029+0000 7f1041c6b640 1 --2- 172.21.15.67:0/2257360779 >> v2:172.21.15.176:3300/0 conn(0x7f103c0acda0 0x7f103c0aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.029+0000 7f1041c6b640 1 --2- 172.21.15.67:0/2257360779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c15c230 0x7f103c071800 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.029+0000 7f1041c6b640 1 -- 172.21.15.67:0/2257360779 >> 172.21.15.67:0/2257360779 conn(0x7f103c0b19c0 msgr2=0x7f103c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.029+0000 7f1041c6b640 1 -- 172.21.15.67:0/2257360779 shutdown_connections 2024-04-25T02:29:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.029+0000 7f1041c6b640 1 -- 172.21.15.67:0/2257360779 wait complete. 2024-04-25T02:29:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.030+0000 7f1041c6b640 1 Processor -- start 2024-04-25T02:29:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.030+0000 7f1041c6b640 1 -- start start 2024-04-25T02:29:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.031+0000 7f1041c6b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f103c0acda0 0x7f103c14d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.031+0000 7f1041c6b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f103c0aef50 0x7f103c0b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.031+0000 7f1041c6b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c15c230 0x7f103c09cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.031+0000 7f1041c6b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f103c160600 con 0x7f103c15c230 2024-04-25T02:29:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.031+0000 7f1041c6b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f103c160320 con 0x7f103c0acda0 2024-04-25T02:29:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.031+0000 7f1041c6b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f103c06db80 con 0x7f103c0aef50 2024-04-25T02:29:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.031+0000 7f103bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c15c230 0x7f103c09cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.031+0000 7f103bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c15c230 0x7f103c09cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49702/0 (socket says 172.21.15.67:49702) 2024-04-25T02:29:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.031+0000 7f103bfff640 1 -- 172.21.15.67:0/10474961 learned_addr learned my addr 172.21.15.67:0/10474961 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.031+0000 7f103b7fe640 1 --2- 172.21.15.67:0/10474961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f103c0acda0 0x7f103c14d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.031+0000 7f103affd640 1 --2- 172.21.15.67:0/10474961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f103c0aef50 0x7f103c0b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.031+0000 7f103bfff640 1 -- 172.21.15.67:0/10474961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f103c0aef50 msgr2=0x7f103c0b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.031+0000 7f103bfff640 1 --2- 172.21.15.67:0/10474961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f103c0aef50 0x7f103c0b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.031+0000 7f103bfff640 1 -- 172.21.15.67:0/10474961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f103c0acda0 msgr2=0x7f103c14d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.031+0000 7f103bfff640 1 --2- 172.21.15.67:0/10474961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f103c0acda0 0x7f103c14d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.031+0000 7f103bfff640 1 -- 172.21.15.67:0/10474961 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103c0b3690 con 0x7f103c15c230 2024-04-25T02:29:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.031+0000 7f103b7fe640 1 --2- 172.21.15.67:0/10474961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f103c0acda0 0x7f103c14d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.032+0000 7f103bfff640 1 --2- 172.21.15.67:0/10474961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c15c230 0x7f103c09cc20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f103400c800 tx=0x7f103400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.032+0000 7f1023fff640 1 -- 172.21.15.67:0/10474961 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1034018070 con 0x7f103c15c230 2024-04-25T02:29:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.032+0000 7f1023fff640 1 -- 172.21.15.67:0/10474961 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1034004d80 con 0x7f103c15c230 2024-04-25T02:29:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.032+0000 7f1041c6b640 1 -- 172.21.15.67:0/10474961 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f103c0b3970 con 0x7f103c15c230 2024-04-25T02:29:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.032+0000 7f1023fff640 1 -- 172.21.15.67:0/10474961 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103400a880 con 0x7f103c15c230 2024-04-25T02:29:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.032+0000 7f1041c6b640 1 -- 172.21.15.67:0/10474961 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f103c0b3f30 con 0x7f103c15c230 2024-04-25T02:29:07.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.033+0000 7f1041c6b640 1 -- 172.21.15.67:0/10474961 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f103c069110 con 0x7f103c15c230 2024-04-25T02:29:07.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.033+0000 7f1023fff640 1 -- 172.21.15.67:0/10474961 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f103401b070 con 0x7f103c15c230 2024-04-25T02:29:07.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.034+0000 7f1023fff640 1 --2- 172.21.15.67:0/10474961 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f102806be30 0x7f102806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:07.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.034+0000 7f1023fff640 1 -- 172.21.15.67:0/10474961 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7f103408a400 con 0x7f103c15c230 2024-04-25T02:29:07.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.034+0000 7f103b7fe640 1 --2- 172.21.15.67:0/10474961 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f102806be30 0x7f102806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:07.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.034+0000 7f103b7fe640 1 --2- 172.21.15.67:0/10474961 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f102806be30 0x7f102806e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f102c034000 tx=0x7f102c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:07.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.038+0000 7f1023fff640 1 -- 172.21.15.67:0/10474961 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1034058e80 con 0x7f103c15c230 2024-04-25T02:29:07.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.261+0000 7f1041c6b640 1 -- 172.21.15.67:0/10474961 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f103c0cea30 con 0x7f103c15c230 2024-04-25T02:29:07.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.262+0000 7f1023fff640 1 -- 172.21.15.67:0/10474961 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5172 (secure 0 0 0) 0x7f1034058780 con 0x7f103c15c230 2024-04-25T02:29:07.265 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:07.265 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1246739775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1246739775},{"type":"v1","addr":"172.21.15.67:6835","nonce":1246739775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/267757090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":267757090},{"type":"v1","addr":"172.21.15.67:6833","nonce":267757090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/90768677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":90768677},{"type":"v1","addr":"172.21.15.176:6837","nonce":90768677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:28:26.184170+0000","modified":"2024-04-25T02:28:29.181464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/1058053785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1058053785},{"type":"v1","addr":"172.21.15.176:6836","nonce":1058053785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-25T02:29:07.265 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 7 2024-04-25T02:29:07.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.264+0000 7f1041c6b640 1 -- 172.21.15.67:0/10474961 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f102806be30 msgr2=0x7f102806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:07.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.264+0000 7f1041c6b640 1 --2- 172.21.15.67:0/10474961 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f102806be30 0x7f102806e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f102c034000 tx=0x7f102c02e000 comp rx=0 tx=0).stop 2024-04-25T02:29:07.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.264+0000 7f1041c6b640 1 -- 172.21.15.67:0/10474961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c15c230 msgr2=0x7f103c09cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:07.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.264+0000 7f1041c6b640 1 --2- 172.21.15.67:0/10474961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c15c230 0x7f103c09cc20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f103400c800 tx=0x7f103400ccc0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.264+0000 7f1041c6b640 1 -- 172.21.15.67:0/10474961 shutdown_connections 2024-04-25T02:29:07.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.264+0000 7f1041c6b640 1 --2- 172.21.15.67:0/10474961 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f102806be30 0x7f102806e2f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.264+0000 7f1041c6b640 1 --2- 172.21.15.67:0/10474961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c15c230 0x7f103c09cc20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.264+0000 7f1041c6b640 1 --2- 172.21.15.67:0/10474961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f103c0aef50 0x7f103c0b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.264+0000 7f1041c6b640 1 --2- 172.21.15.67:0/10474961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f103c0acda0 0x7f103c14d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.264+0000 7f1041c6b640 1 -- 172.21.15.67:0/10474961 >> 172.21.15.67:0/10474961 conn(0x7f103c0b19c0 msgr2=0x7f103c0afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:07.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.264+0000 7f1041c6b640 1 -- 172.21.15.67:0/10474961 shutdown_connections 2024-04-25T02:29:07.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.264+0000 7f1041c6b640 1 -- 172.21.15.67:0/10474961 wait complete. 2024-04-25T02:29:07.278 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:29:07.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.375+0000 7fcd5afd5640 1 Processor -- start 2024-04-25T02:29:07.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.375+0000 7fcd5afd5640 1 -- start start 2024-04-25T02:29:07.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.376+0000 7fcd5afd5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcd54067200 0x7fcd540715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:07.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.376+0000 7fcd5afd5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd5406c9b0 con 0x7fcd5415e280 2024-04-25T02:29:07.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.376+0000 7fcd5afd5640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd5406bc70 con 0x7fcd5415e660 2024-04-25T02:29:07.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.376+0000 7fcd5afd5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fcd5406e990 con 0x7fcd54067200 2024-04-25T02:29:07.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.376+0000 7fcd59572640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcd54067200 0x7fcd540715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:07.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.376+0000 7fcd59572640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcd54067200 0x7fcd540715e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49716/0 (socket says 172.21.15.67:49716) 2024-04-25T02:29:07.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.376+0000 7fcd58d71640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fcd5415e280 0x7fcd5406bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42822/0 (socket says 172.21.15.67:42822) 2024-04-25T02:29:07.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.376+0000 7fcd59572640 1 -- 172.21.15.67:0/1744760686 learned_addr learned my addr 172.21.15.67:0/1744760686 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:07.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.376+0000 7fcd59572640 1 -- 172.21.15.67:0/1744760686 >> v1:172.21.15.176:6789/0 conn(0x7fcd5415e660 legacy=0x7fcd5406ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:07.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.376+0000 7fcd59572640 1 -- 172.21.15.67:0/1744760686 >> v1:172.21.15.67:6789/0 conn(0x7fcd5415e280 legacy=0x7fcd5406bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:07.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.376+0000 7fcd59572640 1 -- 172.21.15.67:0/1744760686 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd5406e340 con 0x7fcd54067200 2024-04-25T02:29:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.377+0000 7fcd59572640 1 --2- 172.21.15.67:0/1744760686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd54067200 0x7fcd540715e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcd5406da20 tx=0x7fcd3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69222e48e1927030 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.377+0000 7fcd537fe640 1 -- 172.21.15.67:0/1744760686 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c037070 con 0x7fcd54067200 2024-04-25T02:29:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.377+0000 7fcd537fe640 1 -- 172.21.15.67:0/1744760686 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd3c032440 con 0x7fcd54067200 2024-04-25T02:29:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.377+0000 7fcd537fe640 1 -- 172.21.15.67:0/1744760686 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c032810 con 0x7fcd54067200 2024-04-25T02:29:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.378+0000 7fcd5afd5640 1 -- 172.21.15.67:0/1744760686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd54067200 msgr2=0x7fcd540715e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.378+0000 7fcd5afd5640 1 --2- 172.21.15.67:0/1744760686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd54067200 0x7fcd540715e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcd5406da20 tx=0x7fcd3c02a270 comp rx=0 tx=0).stop 2024-04-25T02:29:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.378+0000 7fcd5afd5640 1 -- 172.21.15.67:0/1744760686 shutdown_connections 2024-04-25T02:29:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.378+0000 7fcd5afd5640 1 --2- 172.21.15.67:0/1744760686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd54067200 0x7fcd540715e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.378+0000 7fcd5afd5640 1 -- 172.21.15.67:0/1744760686 >> 172.21.15.67:0/1744760686 conn(0x7fcd540d04f0 msgr2=0x7fcd540d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.378+0000 7fcd5afd5640 1 -- 172.21.15.67:0/1744760686 shutdown_connections 2024-04-25T02:29:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.378+0000 7fcd5afd5640 1 -- 172.21.15.67:0/1744760686 wait complete. 2024-04-25T02:29:07.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.379+0000 7fcd5afd5640 1 Processor -- start 2024-04-25T02:29:07.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.379+0000 7fcd5afd5640 1 -- start start 2024-04-25T02:29:07.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.380+0000 7fcd5afd5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd54067200 0x7fcd54154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:07.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.380+0000 7fcd5afd5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd5415e280 0x7fcd5415ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:07.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.380+0000 7fcd5afd5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd5415e660 0x7fcd5415b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:07.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.380+0000 7fcd5afd5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcd54071ca0 con 0x7fcd54067200 2024-04-25T02:29:07.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.380+0000 7fcd5afd5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcd54071b20 con 0x7fcd5415e660 2024-04-25T02:29:07.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.380+0000 7fcd5afd5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcd54071e20 con 0x7fcd5415e280 2024-04-25T02:29:07.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.380+0000 7fcd58d71640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd54067200 0x7fcd54154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:07.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.380+0000 7fcd58d71640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd54067200 0x7fcd54154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49732/0 (socket says 172.21.15.67:49732) 2024-04-25T02:29:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.380+0000 7fcd58d71640 1 -- 172.21.15.67:0/67519542 learned_addr learned my addr 172.21.15.67:0/67519542 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.380+0000 7fcd59572640 1 --2- 172.21.15.67:0/67519542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd5415e660 0x7fcd5415b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.380+0000 7fcd53fff640 1 --2- 172.21.15.67:0/67519542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd5415e280 0x7fcd5415ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.380+0000 7fcd58d71640 1 -- 172.21.15.67:0/67519542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd5415e280 msgr2=0x7fcd5415ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.380+0000 7fcd58d71640 1 --2- 172.21.15.67:0/67519542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd5415e280 0x7fcd5415ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.380+0000 7fcd58d71640 1 -- 172.21.15.67:0/67519542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd5415e660 msgr2=0x7fcd5415b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.380+0000 7fcd58d71640 1 --2- 172.21.15.67:0/67519542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd5415e660 0x7fcd5415b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.380+0000 7fcd58d71640 1 -- 172.21.15.67:0/67519542 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd5415f6b0 con 0x7fcd54067200 2024-04-25T02:29:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.380+0000 7fcd53fff640 1 --2- 172.21.15.67:0/67519542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd5415e280 0x7fcd5415ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.380+0000 7fcd59572640 1 --2- 172.21.15.67:0/67519542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd5415e660 0x7fcd5415b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.381+0000 7fcd58d71640 1 --2- 172.21.15.67:0/67519542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd54067200 0x7fcd54154470 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00c790 tx=0x7fcd4c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.381+0000 7fcd517fa640 1 -- 172.21.15.67:0/67519542 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c017070 con 0x7fcd54067200 2024-04-25T02:29:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.381+0000 7fcd517fa640 1 -- 172.21.15.67:0/67519542 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd4c00a640 con 0x7fcd54067200 2024-04-25T02:29:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.381+0000 7fcd5afd5640 1 -- 172.21.15.67:0/67519542 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd5415f990 con 0x7fcd54067200 2024-04-25T02:29:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.381+0000 7fcd517fa640 1 -- 172.21.15.67:0/67519542 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c00a9f0 con 0x7fcd54067200 2024-04-25T02:29:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.381+0000 7fcd5afd5640 1 -- 172.21.15.67:0/67519542 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd5415ff50 con 0x7fcd54067200 2024-04-25T02:29:07.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.382+0000 7fcd5afd5640 1 -- 172.21.15.67:0/67519542 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd54069110 con 0x7fcd54067200 2024-04-25T02:29:07.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.382+0000 7fcd517fa640 1 -- 172.21.15.67:0/67519542 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd4c01a070 con 0x7fcd54067200 2024-04-25T02:29:07.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.383+0000 7fcd517fa640 1 --2- 172.21.15.67:0/67519542 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fcd3406be60 0x7fcd3406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:07.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.383+0000 7fcd517fa640 1 -- 172.21.15.67:0/67519542 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7fcd4c08a3f0 con 0x7fcd54067200 2024-04-25T02:29:07.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.383+0000 7fcd53fff640 1 --2- 172.21.15.67:0/67519542 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fcd3406be60 0x7fcd3406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:07.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.384+0000 7fcd53fff640 1 --2- 172.21.15.67:0/67519542 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fcd3406be60 0x7fcd3406e320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcd44006fd0 tx=0x7fcd44008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:07.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.387+0000 7fcd517fa640 1 -- 172.21.15.67:0/67519542 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcd4c058760 con 0x7fcd54067200 2024-04-25T02:29:07.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.610+0000 7fcd5afd5640 1 -- 172.21.15.67:0/67519542 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd54066fe0 con 0x7fcd54067200 2024-04-25T02:29:07.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.611+0000 7fcd517fa640 1 -- 172.21.15.67:0/67519542 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5172 (secure 0 0 0) 0x7fcd4c05ca60 con 0x7fcd54067200 2024-04-25T02:29:07.614 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:07.614 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1246739775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1246739775},{"type":"v1","addr":"172.21.15.67:6835","nonce":1246739775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/267757090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":267757090},{"type":"v1","addr":"172.21.15.67:6833","nonce":267757090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/90768677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":90768677},{"type":"v1","addr":"172.21.15.176:6837","nonce":90768677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:28:26.184170+0000","modified":"2024-04-25T02:28:29.181464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/1058053785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1058053785},{"type":"v1","addr":"172.21.15.176:6836","nonce":1058053785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-25T02:29:07.614 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 7 2024-04-25T02:29:07.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.613+0000 7fcd5afd5640 1 -- 172.21.15.67:0/67519542 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fcd3406be60 msgr2=0x7fcd3406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:07.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.613+0000 7fcd5afd5640 1 --2- 172.21.15.67:0/67519542 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fcd3406be60 0x7fcd3406e320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcd44006fd0 tx=0x7fcd44008040 comp rx=0 tx=0).stop 2024-04-25T02:29:07.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.613+0000 7fcd5afd5640 1 -- 172.21.15.67:0/67519542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd54067200 msgr2=0x7fcd54154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:07.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.613+0000 7fcd5afd5640 1 --2- 172.21.15.67:0/67519542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd54067200 0x7fcd54154470 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00c790 tx=0x7fcd4c00cc50 comp rx=0 tx=0).stop 2024-04-25T02:29:07.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.613+0000 7fcd5afd5640 1 -- 172.21.15.67:0/67519542 shutdown_connections 2024-04-25T02:29:07.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.613+0000 7fcd5afd5640 1 --2- 172.21.15.67:0/67519542 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fcd3406be60 0x7fcd3406e320 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.613+0000 7fcd5afd5640 1 --2- 172.21.15.67:0/67519542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd5415e660 0x7fcd5415b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.613+0000 7fcd5afd5640 1 --2- 172.21.15.67:0/67519542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd5415e280 0x7fcd5415ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.613+0000 7fcd5afd5640 1 --2- 172.21.15.67:0/67519542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd54067200 0x7fcd54154470 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.613+0000 7fcd5afd5640 1 -- 172.21.15.67:0/67519542 >> 172.21.15.67:0/67519542 conn(0x7fcd540d04f0 msgr2=0x7fcd540b1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:07.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.613+0000 7fcd5afd5640 1 -- 172.21.15.67:0/67519542 shutdown_connections 2024-04-25T02:29:07.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.613+0000 7fcd5afd5640 1 -- 172.21.15.67:0/67519542 wait complete. 2024-04-25T02:29:07.627 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:29:07.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.725+0000 7fad2ed48640 1 Processor -- start 2024-04-25T02:29:07.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.725+0000 7fad2ed48640 1 -- start start 2024-04-25T02:29:07.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.726+0000 7fad2ed48640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad28071cf0 0x7fad280af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:07.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.726+0000 7fad2ed48640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fad2806c620 0x7fad280ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:07.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.726+0000 7fad2ed48640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2806f4c0 con 0x7fad2815c440 2024-04-25T02:29:07.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.726+0000 7fad2ed48640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fad280afe10 con 0x7fad2806c620 2024-04-25T02:29:07.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.726+0000 7fad2ed48640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fad280723c0 con 0x7fad28071cf0 2024-04-25T02:29:07.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.726+0000 7fad2d2e5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fad2806c620 0x7fad280ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:07.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.726+0000 7fad2d2e5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fad2806c620 0x7fad280ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49734/0 (socket says 172.21.15.67:49734) 2024-04-25T02:29:07.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.726+0000 7fad2d2e5640 1 -- 172.21.15.67:0/594729058 learned_addr learned my addr 172.21.15.67:0/594729058 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:07.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.726+0000 7fad27fff640 1 --2- 172.21.15.67:0/594729058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad28071cf0 0x7fad280af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:07.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.726+0000 7fad2d2e5640 1 -- 172.21.15.67:0/594729058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad28071cf0 msgr2=0x7fad280af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:07.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.726+0000 7fad2d2e5640 1 --2- 172.21.15.67:0/594729058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad28071cf0 0x7fad280af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.726+0000 7fad2d2e5640 1 -- 172.21.15.67:0/594729058 >> v1:172.21.15.67:6789/0 conn(0x7fad2815c440 legacy=0x7fad280715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:07.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.726+0000 7fad2d2e5640 1 -- 172.21.15.67:0/594729058 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad280726a0 con 0x7fad2806c620 2024-04-25T02:29:07.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.726+0000 7fad277fe640 1 -- 172.21.15.67:0/594729058 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3368668198 0 0) 0x7fad1c001110 con 0x7fad2815c440 2024-04-25T02:29:07.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.727+0000 7fad2d2e5640 1 --2- 172.21.15.67:0/594729058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad2806c620 0x7fad280ce3f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fad20009e50 tx=0x7fad2002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0e3c11fadbe6ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:07.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.727+0000 7fad277fe640 1 -- 172.21.15.67:0/594729058 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20036070 con 0x7fad2806c620 2024-04-25T02:29:07.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.727+0000 7fad277fe640 1 -- 172.21.15.67:0/594729058 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad20031600 con 0x7fad2806c620 2024-04-25T02:29:07.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.727+0000 7fad277fe640 1 -- 172.21.15.67:0/594729058 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad200319d0 con 0x7fad2806c620 2024-04-25T02:29:07.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.727+0000 7fad2ed48640 1 -- 172.21.15.67:0/594729058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad2806c620 msgr2=0x7fad280ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:07.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.727+0000 7fad2ed48640 1 --2- 172.21.15.67:0/594729058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad2806c620 0x7fad280ce3f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fad20009e50 tx=0x7fad2002a710 comp rx=0 tx=0).stop 2024-04-25T02:29:07.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.728+0000 7fad2ed48640 1 -- 172.21.15.67:0/594729058 shutdown_connections 2024-04-25T02:29:07.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.728+0000 7fad2ed48640 1 --2- 172.21.15.67:0/594729058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad2806c620 0x7fad280ce3f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.728+0000 7fad2ed48640 1 --2- 172.21.15.67:0/594729058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad28071cf0 0x7fad280af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.728+0000 7fad2ed48640 1 -- 172.21.15.67:0/594729058 >> 172.21.15.67:0/594729058 conn(0x7fad280d04f0 msgr2=0x7fad280d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:07.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.728+0000 7fad2ed48640 1 -- 172.21.15.67:0/594729058 shutdown_connections 2024-04-25T02:29:07.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.728+0000 7fad2ed48640 1 -- 172.21.15.67:0/594729058 wait complete. 2024-04-25T02:29:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.729+0000 7fad2ed48640 1 Processor -- start 2024-04-25T02:29:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.729+0000 7fad2ed48640 1 -- start start 2024-04-25T02:29:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad2ed48640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad2806c620 0x7fad281428c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad2ed48640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad28071cf0 0x7fad28145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad2ed48640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad2815c440 0x7fad28142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad2ed48640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fad280ce930 con 0x7fad2806c620 2024-04-25T02:29:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad2ed48640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fad2806efa0 con 0x7fad28071cf0 2024-04-25T02:29:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad2ed48640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fad280ceab0 con 0x7fad2815c440 2024-04-25T02:29:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad2cae4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad2806c620 0x7fad281428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad2cae4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad2806c620 0x7fad281428c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49736/0 (socket says 172.21.15.67:49736) 2024-04-25T02:29:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad2cae4640 1 -- 172.21.15.67:0/4102475652 learned_addr learned my addr 172.21.15.67:0/4102475652 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:07.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad2d2e5640 1 --2- 172.21.15.67:0/4102475652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad2815c440 0x7fad28142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad27fff640 1 --2- 172.21.15.67:0/4102475652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad28071cf0 0x7fad28145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad2cae4640 1 -- 172.21.15.67:0/4102475652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad2815c440 msgr2=0x7fad28142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad2cae4640 1 --2- 172.21.15.67:0/4102475652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad2815c440 0x7fad28142f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad2cae4640 1 -- 172.21.15.67:0/4102475652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad28071cf0 msgr2=0x7fad28145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad2cae4640 1 --2- 172.21.15.67:0/4102475652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad28071cf0 0x7fad28145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad2cae4640 1 -- 172.21.15.67:0/4102475652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad28143670 con 0x7fad2806c620 2024-04-25T02:29:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad2cae4640 1 --2- 172.21.15.67:0/4102475652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad2806c620 0x7fad281428c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00c440 tx=0x7fad1c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad257fa640 1 -- 172.21.15.67:0/4102475652 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1c017070 con 0x7fad2806c620 2024-04-25T02:29:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad257fa640 1 -- 172.21.15.67:0/4102475652 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad1c005480 con 0x7fad2806c620 2024-04-25T02:29:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad2ed48640 1 -- 172.21.15.67:0/4102475652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad28143950 con 0x7fad2806c620 2024-04-25T02:29:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad257fa640 1 -- 172.21.15.67:0/4102475652 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1c003830 con 0x7fad2806c620 2024-04-25T02:29:07.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.730+0000 7fad2ed48640 1 -- 172.21.15.67:0/4102475652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad28143f10 con 0x7fad2806c620 2024-04-25T02:29:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.731+0000 7fad2ed48640 1 -- 172.21.15.67:0/4102475652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad28069110 con 0x7fad2806c620 2024-04-25T02:29:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.732+0000 7fad257fa640 1 -- 172.21.15.67:0/4102475652 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad1c01a070 con 0x7fad2806c620 2024-04-25T02:29:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.732+0000 7fad257fa640 1 --2- 172.21.15.67:0/4102475652 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fad0c06be30 0x7fad0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.732+0000 7fad257fa640 1 -- 172.21.15.67:0/4102475652 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7fad1c08a180 con 0x7fad2806c620 2024-04-25T02:29:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.732+0000 7fad27fff640 1 --2- 172.21.15.67:0/4102475652 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fad0c06be30 0x7fad0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:07.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.733+0000 7fad27fff640 1 --2- 172.21.15.67:0/4102475652 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fad0c06be30 0x7fad0c06e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fad28152fd0 tx=0x7fad14008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:07.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.736+0000 7fad257fa640 1 -- 172.21.15.67:0/4102475652 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fad2806f4c0 con 0x7fad2806c620 2024-04-25T02:29:07.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.920+0000 7fad2ed48640 1 -- 172.21.15.67:0/4102475652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad28153930 con 0x7fad2806c620 2024-04-25T02:29:07.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.921+0000 7fad257fa640 1 -- 172.21.15.67:0/4102475652 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16831 (secure 0 0 0) 0x7fad1c058b40 con 0x7fad2806c620 2024-04-25T02:29:07.924 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:07.924 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:29:06.998327+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:28:24.445606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:28:25.161619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:29:07.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.923+0000 7fad2ed48640 1 -- 172.21.15.67:0/4102475652 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fad0c06be30 msgr2=0x7fad0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:07.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.923+0000 7fad2ed48640 1 --2- 172.21.15.67:0/4102475652 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fad0c06be30 0x7fad0c06e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fad28152fd0 tx=0x7fad14008040 comp rx=0 tx=0).stop 2024-04-25T02:29:07.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.923+0000 7fad2ed48640 1 -- 172.21.15.67:0/4102475652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad2806c620 msgr2=0x7fad281428c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:07.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.923+0000 7fad2ed48640 1 --2- 172.21.15.67:0/4102475652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad2806c620 0x7fad281428c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00c440 tx=0x7fad1c00c900 comp rx=0 tx=0).stop 2024-04-25T02:29:07.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.923+0000 7fad2ed48640 1 -- 172.21.15.67:0/4102475652 shutdown_connections 2024-04-25T02:29:07.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.923+0000 7fad2ed48640 1 --2- 172.21.15.67:0/4102475652 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fad0c06be30 0x7fad0c06e2f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.923+0000 7fad2ed48640 1 --2- 172.21.15.67:0/4102475652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad2815c440 0x7fad28142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.923+0000 7fad2ed48640 1 --2- 172.21.15.67:0/4102475652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad28071cf0 0x7fad28145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.923+0000 7fad2ed48640 1 --2- 172.21.15.67:0/4102475652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad2806c620 0x7fad281428c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:07.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.923+0000 7fad2ed48640 1 -- 172.21.15.67:0/4102475652 >> 172.21.15.67:0/4102475652 conn(0x7fad280d04f0 msgr2=0x7fad280cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:07.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.923+0000 7fad2ed48640 1 -- 172.21.15.67:0/4102475652 shutdown_connections 2024-04-25T02:29:07.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:07.923+0000 7fad2ed48640 1 -- 172.21.15.67:0/4102475652 wait complete. 2024-04-25T02:29:07.937 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:29:08.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.038+0000 7f0b1e389640 1 Processor -- start 2024-04-25T02:29:08.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.038+0000 7f0b1e389640 1 -- start start 2024-04-25T02:29:08.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.038+0000 7f0b1e389640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b180cf3d0 0x7f0b180d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:08.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.038+0000 7f0b1e389640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b180d2cc0 con 0x7f0b1815e5f0 2024-04-25T02:29:08.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.038+0000 7f0b1e389640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b180d2fa0 con 0x7f0b1815e210 2024-04-25T02:29:08.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.038+0000 7f0b1e389640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0b1806c6f0 con 0x7f0b180cf3d0 2024-04-25T02:29:08.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b177fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0b1815e5f0 0x7f0b180cecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42832/0 (socket says 172.21.15.67:42832) 2024-04-25T02:29:08.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b177fe640 1 -- 172.21.15.67:0/2732934254 learned_addr learned my addr 172.21.15.67:0/2732934254 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:08.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b16ffd640 1 -- 172.21.15.67:0/2732934254 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4180918100 0 0) 0x7f0b180d2cc0 con 0x7f0b1815e5f0 2024-04-25T02:29:08.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b1c926640 1 --2- 172.21.15.67:0/2732934254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b180cf3d0 0x7f0b180d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:08.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b16ffd640 1 -- 172.21.15.67:0/2732934254 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b00003520 con 0x7f0b1815e5f0 2024-04-25T02:29:08.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b16ffd640 1 -- 172.21.15.67:0/2732934254 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 372853941 0 0) 0x7f0b00003520 con 0x7f0b1815e5f0 2024-04-25T02:29:08.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b16ffd640 1 -- 172.21.15.67:0/2732934254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b180cf3d0 msgr2=0x7f0b180d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:08.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b16ffd640 1 --2- 172.21.15.67:0/2732934254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b180cf3d0 0x7f0b180d3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:08.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b16ffd640 1 -- 172.21.15.67:0/2732934254 >> v1:172.21.15.176:6789/0 conn(0x7f0b1815e210 legacy=0x7f0b1806cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:08.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b16ffd640 1 -- 172.21.15.67:0/2732934254 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1806c0a0 con 0x7f0b1815e5f0 2024-04-25T02:29:08.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b16ffd640 1 -- 172.21.15.67:0/2732934254 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f0b0c001670 con 0x7f0b1815e5f0 2024-04-25T02:29:08.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b16ffd640 1 -- 172.21.15.67:0/2732934254 >> v1:172.21.15.67:6789/0 conn(0x7f0b1815e5f0 legacy=0x7f0b180cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:08.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b16ffd640 1 --2- 172.21.15.67:0/2732934254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b000039e0 0x7f0b00003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:08.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b16ffd640 1 --2- 172.21.15.67:0/2732934254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b00004800 0x7f0b00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:08.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b16ffd640 1 --2- 172.21.15.67:0/2732934254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b180cf3d0 0x7f0b000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:08.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b16ffd640 1 -- 172.21.15.67:0/2732934254 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1806c6f0 con 0x7f0b00004800 2024-04-25T02:29:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b16ffd640 1 -- 172.21.15.67:0/2732934254 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0000baa0 con 0x7f0b000039e0 2024-04-25T02:29:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b16ffd640 1 -- 172.21.15.67:0/2732934254 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0b0000bca0 con 0x7f0b180cf3d0 2024-04-25T02:29:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b177fe640 1 --2- 172.21.15.67:0/2732934254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b00004800 0x7f0b00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b17fff640 1 --2- 172.21.15.67:0/2732934254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b000039e0 0x7f0b00003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.039+0000 7f0b1c926640 1 --2- 172.21.15.67:0/2732934254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b180cf3d0 0x7f0b000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.040+0000 7f0b177fe640 1 -- 172.21.15.67:0/2732934254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b180cf3d0 msgr2=0x7f0b000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.040+0000 7f0b177fe640 1 --2- 172.21.15.67:0/2732934254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b180cf3d0 0x7f0b000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.040+0000 7f0b177fe640 1 -- 172.21.15.67:0/2732934254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b000039e0 msgr2=0x7f0b00003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.040+0000 7f0b177fe640 1 --2- 172.21.15.67:0/2732934254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b000039e0 0x7f0b00003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.040+0000 7f0b177fe640 1 -- 172.21.15.67:0/2732934254 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b00003520 con 0x7f0b00004800 2024-04-25T02:29:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.040+0000 7f0b17fff640 1 --2- 172.21.15.67:0/2732934254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b000039e0 0x7f0b00003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.040+0000 7f0b177fe640 1 --2- 172.21.15.67:0/2732934254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b00004800 0x7f0b00004c80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00c210 tx=0x7f0b00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c77e08ff2acdbc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.040+0000 7f0b16ffd640 1 -- 172.21.15.67:0/2732934254 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c007cf0 con 0x7f0b00004800 2024-04-25T02:29:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.040+0000 7f0b16ffd640 1 -- 172.21.15.67:0/2732934254 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0c005ad0 con 0x7f0b00004800 2024-04-25T02:29:08.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.040+0000 7f0b16ffd640 1 -- 172.21.15.67:0/2732934254 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c007070 con 0x7f0b00004800 2024-04-25T02:29:08.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.041+0000 7f0b1e389640 1 -- 172.21.15.67:0/2732934254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b00004800 msgr2=0x7f0b00004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:08.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.041+0000 7f0b1e389640 1 --2- 172.21.15.67:0/2732934254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b00004800 0x7f0b00004c80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00c210 tx=0x7f0b00005830 comp rx=0 tx=0).stop 2024-04-25T02:29:08.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.041+0000 7f0b1c926640 1 -- 172.21.15.67:0/2732934254 reap_dead start 2024-04-25T02:29:08.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.041+0000 7f0b1e389640 1 -- 172.21.15.67:0/2732934254 shutdown_connections 2024-04-25T02:29:08.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.041+0000 7f0b1e389640 1 -- 172.21.15.67:0/2732934254 >> 172.21.15.67:0/2732934254 conn(0x7f0b1808dbb0 msgr2=0x7f0b1809d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:08.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.041+0000 7f0b1e389640 1 -- 172.21.15.67:0/2732934254 shutdown_connections 2024-04-25T02:29:08.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.041+0000 7f0b1e389640 1 -- 172.21.15.67:0/2732934254 wait complete. 2024-04-25T02:29:08.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.042+0000 7f0b1e389640 1 Processor -- start 2024-04-25T02:29:08.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.042+0000 7f0b1e389640 1 -- start start 2024-04-25T02:29:08.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.043+0000 7f0b1e389640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b00004800 0x7f0b18150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:08.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.043+0000 7f0b1e389640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b1815a7b0 0x7f0b1815ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:08.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.043+0000 7f0b1e389640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b180ccce0 0x7f0b180cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:08.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.043+0000 7f0b1e389640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1806d450 con 0x7f0b180ccce0 2024-04-25T02:29:08.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.043+0000 7f0b1e389640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1806d2d0 con 0x7f0b00004800 2024-04-25T02:29:08.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.043+0000 7f0b1e389640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0b180d3e60 con 0x7f0b1815a7b0 2024-04-25T02:29:08.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.043+0000 7f0b1c926640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b180ccce0 0x7f0b180cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:08.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.043+0000 7f0b1c926640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b180ccce0 0x7f0b180cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49756/0 (socket says 172.21.15.67:49756) 2024-04-25T02:29:08.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.043+0000 7f0b1c926640 1 -- 172.21.15.67:0/2667766371 learned_addr learned my addr 172.21.15.67:0/2667766371 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:08.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.043+0000 7f0b17fff640 1 --2- 172.21.15.67:0/2667766371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b00004800 0x7f0b18150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:08.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.043+0000 7f0b177fe640 1 --2- 172.21.15.67:0/2667766371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b1815a7b0 0x7f0b1815ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:08.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.043+0000 7f0b1c926640 1 -- 172.21.15.67:0/2667766371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b1815a7b0 msgr2=0x7f0b1815ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:08.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.043+0000 7f0b1c926640 1 --2- 172.21.15.67:0/2667766371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b1815a7b0 0x7f0b1815ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:08.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.043+0000 7f0b1c926640 1 -- 172.21.15.67:0/2667766371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b00004800 msgr2=0x7f0b18150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:08.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.043+0000 7f0b1c926640 1 --2- 172.21.15.67:0/2667766371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b00004800 0x7f0b18150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:08.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.043+0000 7f0b1c926640 1 -- 172.21.15.67:0/2667766371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b180cda50 con 0x7f0b180ccce0 2024-04-25T02:29:08.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.043+0000 7f0b17fff640 1 --2- 172.21.15.67:0/2667766371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b00004800 0x7f0b18150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:08.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.044+0000 7f0b1c926640 1 --2- 172.21.15.67:0/2667766371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b180ccce0 0x7f0b180cd160 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0b180cb230 tx=0x7f0b100115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:08.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.044+0000 7f0b14ff9640 1 -- 172.21.15.67:0/2667766371 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10011e70 con 0x7f0b180ccce0 2024-04-25T02:29:08.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.044+0000 7f0b14ff9640 1 -- 172.21.15.67:0/2667766371 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b1001b070 con 0x7f0b180ccce0 2024-04-25T02:29:08.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.044+0000 7f0b1e389640 1 -- 172.21.15.67:0/2667766371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b180b7b70 con 0x7f0b180ccce0 2024-04-25T02:29:08.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.044+0000 7f0b14ff9640 1 -- 172.21.15.67:0/2667766371 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10003990 con 0x7f0b180ccce0 2024-04-25T02:29:08.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.044+0000 7f0b1e389640 1 -- 172.21.15.67:0/2667766371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b180b8130 con 0x7f0b180ccce0 2024-04-25T02:29:08.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.045+0000 7f0b1e389640 1 -- 172.21.15.67:0/2667766371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b18069110 con 0x7f0b180ccce0 2024-04-25T02:29:08.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.045+0000 7f0b14ff9640 1 -- 172.21.15.67:0/2667766371 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b10005d10 con 0x7f0b180ccce0 2024-04-25T02:29:08.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.046+0000 7f0b14ff9640 1 --2- 172.21.15.67:0/2667766371 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f0b0406be60 0x7f0b0406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:08.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.046+0000 7f0b14ff9640 1 -- 172.21.15.67:0/2667766371 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f0b1008b400 con 0x7f0b180ccce0 2024-04-25T02:29:08.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.046+0000 7f0b17fff640 1 --2- 172.21.15.67:0/2667766371 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f0b0406be60 0x7f0b0406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:08.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.047+0000 7f0b17fff640 1 --2- 172.21.15.67:0/2667766371 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f0b0406be60 0x7f0b0406e320 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0b181f7920 tx=0x7f0b08009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:08.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.050+0000 7f0b14ff9640 1 -- 172.21.15.67:0/2667766371 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0b10025020 con 0x7f0b180ccce0 2024-04-25T02:29:08.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.268+0000 7f0b1e389640 1 -- 172.21.15.67:0/2667766371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0b180b8300 con 0x7f0b180ccce0 2024-04-25T02:29:08.271 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-04-25T02:29:08.268+0000 7f23f648f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:29:08.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.271+0000 7f0b14ff9640 1 -- 172.21.15.67:0/2667766371 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7f0b10059dc0 con 0x7f0b180ccce0 2024-04-25T02:29:08.274 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:29:08.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.273+0000 7f0b1e389640 1 -- 172.21.15.67:0/2667766371 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f0b0406be60 msgr2=0x7f0b0406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:08.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.273+0000 7f0b1e389640 1 --2- 172.21.15.67:0/2667766371 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f0b0406be60 0x7f0b0406e320 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0b181f7920 tx=0x7f0b08009040 comp rx=0 tx=0).stop 2024-04-25T02:29:08.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.273+0000 7f0b1e389640 1 -- 172.21.15.67:0/2667766371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b180ccce0 msgr2=0x7f0b180cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:08.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.273+0000 7f0b1e389640 1 --2- 172.21.15.67:0/2667766371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b180ccce0 0x7f0b180cd160 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0b180cb230 tx=0x7f0b100115a0 comp rx=0 tx=0).stop 2024-04-25T02:29:08.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.273+0000 7f0b1e389640 1 -- 172.21.15.67:0/2667766371 shutdown_connections 2024-04-25T02:29:08.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.274+0000 7f0b1e389640 1 --2- 172.21.15.67:0/2667766371 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f0b0406be60 0x7f0b0406e320 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:08.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.274+0000 7f0b1e389640 1 --2- 172.21.15.67:0/2667766371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b180ccce0 0x7f0b180cd160 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:08.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.274+0000 7f0b1e389640 1 --2- 172.21.15.67:0/2667766371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b1815a7b0 0x7f0b1815ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:08.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.274+0000 7f0b1e389640 1 --2- 172.21.15.67:0/2667766371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b00004800 0x7f0b18150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:08.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.274+0000 7f0b1e389640 1 -- 172.21.15.67:0/2667766371 >> 172.21.15.67:0/2667766371 conn(0x7f0b1808dbb0 msgr2=0x7f0b180c9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:08.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.274+0000 7f0b1e389640 1 -- 172.21.15.67:0/2667766371 shutdown_connections 2024-04-25T02:29:08.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.274+0000 7f0b1e389640 1 -- 172.21.15.67:0/2667766371 wait complete. 2024-04-25T02:29:08.282 INFO:tasks.ceph.mds.d.smithi176.stderr: -7480> 2024-04-25T02:28:30.928+0000 7f2335dd3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:29:08.288 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T02:29:08.316 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-04-25T02:29:08.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.390+0000 7fb27d142640 1 Processor -- start 2024-04-25T02:29:08.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.390+0000 7fb27d142640 1 -- start start 2024-04-25T02:29:08.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.390+0000 7fb27d142640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb27806b0c0 0x7fb2780cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:08.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.390+0000 7fb27d142640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb27806b520 con 0x7fb2780d0a00 2024-04-25T02:29:08.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.390+0000 7fb27d142640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb27806b7a0 con 0x7fb278071e70 2024-04-25T02:29:08.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.390+0000 7fb27d142640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb27806c040 con 0x7fb27806b0c0 2024-04-25T02:29:08.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.391+0000 7fb276d9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb2780d0a00 0x7fb2780cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42846/0 (socket says 172.21.15.67:42846) 2024-04-25T02:29:08.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.391+0000 7fb276d9d640 1 -- 172.21.15.67:0/3829760062 learned_addr learned my addr 172.21.15.67:0/3829760062 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:08.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.391+0000 7fb27659c640 1 --2- 172.21.15.67:0/3829760062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb27806b0c0 0x7fb2780cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:08.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.391+0000 7fb275d9b640 1 -- 172.21.15.67:0/3829760062 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 348094376 0 0) 0x7fb268001110 con 0x7fb2780d0a00 2024-04-25T02:29:08.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.391+0000 7fb275d9b640 1 -- 172.21.15.67:0/3829760062 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb260003520 con 0x7fb2780d0a00 2024-04-25T02:29:08.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.391+0000 7fb275d9b640 1 -- 172.21.15.67:0/3829760062 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1893367655 0 0) 0x7fb27806b7a0 con 0x7fb278071e70 2024-04-25T02:29:08.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.391+0000 7fb275d9b640 1 -- 172.21.15.67:0/3829760062 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb268001110 con 0x7fb278071e70 2024-04-25T02:29:08.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.391+0000 7fb27659c640 1 -- 172.21.15.67:0/3829760062 >> v1:172.21.15.176:6789/0 conn(0x7fb278071e70 legacy=0x7fb27806f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:08.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.391+0000 7fb27659c640 1 -- 172.21.15.67:0/3829760062 >> v1:172.21.15.67:6789/0 conn(0x7fb2780d0a00 legacy=0x7fb2780cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:08.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.391+0000 7fb275d9b640 1 -- 172.21.15.67:0/3829760062 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2500237029 0 0) 0x7fb260003520 con 0x7fb2780d0a00 2024-04-25T02:29:08.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.391+0000 7fb27659c640 1 -- 172.21.15.67:0/3829760062 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27806ba80 con 0x7fb27806b0c0 2024-04-25T02:29:08.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.392+0000 7fb27659c640 1 --2- 172.21.15.67:0/3829760062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb27806b0c0 0x7fb2780cd1d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0097d0 tx=0x7fb26c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5cb1d6f5cc90656 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:08.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.392+0000 7fb275d9b640 1 -- 172.21.15.67:0/3829760062 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c037070 con 0x7fb27806b0c0 2024-04-25T02:29:08.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.392+0000 7fb275d9b640 1 -- 172.21.15.67:0/3829760062 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb26c02ac30 con 0x7fb27806b0c0 2024-04-25T02:29:08.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.392+0000 7fb275d9b640 1 -- 172.21.15.67:0/3829760062 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268001840 con 0x7fb27806b0c0 2024-04-25T02:29:08.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.392+0000 7fb27d142640 1 -- 172.21.15.67:0/3829760062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb27806b0c0 msgr2=0x7fb2780cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:08.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.392+0000 7fb27d142640 1 --2- 172.21.15.67:0/3829760062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb27806b0c0 0x7fb2780cd1d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0097d0 tx=0x7fb26c02a1a0 comp rx=0 tx=0).stop 2024-04-25T02:29:08.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.392+0000 7fb27d142640 1 -- 172.21.15.67:0/3829760062 shutdown_connections 2024-04-25T02:29:08.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.392+0000 7fb27d142640 1 --2- 172.21.15.67:0/3829760062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb27806b0c0 0x7fb2780cd1d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:08.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.392+0000 7fb27d142640 1 -- 172.21.15.67:0/3829760062 >> 172.21.15.67:0/3829760062 conn(0x7fb2780d0e20 msgr2=0x7fb2780d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:08.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.393+0000 7fb27d142640 1 -- 172.21.15.67:0/3829760062 shutdown_connections 2024-04-25T02:29:08.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.393+0000 7fb27d142640 1 -- 172.21.15.67:0/3829760062 wait complete. 2024-04-25T02:29:08.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.394+0000 7fb27d142640 1 Processor -- start 2024-04-25T02:29:08.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.394+0000 7fb27d142640 1 -- start start 2024-04-25T02:29:08.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.395+0000 7fb27d142640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb27806b0c0 0x7fb278158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:08.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.395+0000 7fb27d142640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb278071e70 0x7fb27815a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:08.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.395+0000 7fb27d142640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2780d0a00 0x7fb2781e6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:08.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.395+0000 7fb27d142640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb2780cfaf0 con 0x7fb278071e70 2024-04-25T02:29:08.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.395+0000 7fb27d142640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb2780cef50 con 0x7fb2780d0a00 2024-04-25T02:29:08.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.395+0000 7fb27d142640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb2780cfc70 con 0x7fb27806b0c0 2024-04-25T02:29:08.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.395+0000 7fb27659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb278071e70 0x7fb27815a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:08.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.395+0000 7fb27659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb278071e70 0x7fb27815a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49766/0 (socket says 172.21.15.67:49766) 2024-04-25T02:29:08.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.395+0000 7fb27659c640 1 -- 172.21.15.67:0/3338819830 learned_addr learned my addr 172.21.15.67:0/3338819830 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:08.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.395+0000 7fb276d9d640 1 --2- 172.21.15.67:0/3338819830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb27806b0c0 0x7fb278158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:08.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.395+0000 7fb27759e640 1 --2- 172.21.15.67:0/3338819830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2780d0a00 0x7fb2781e6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:08.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.395+0000 7fb27659c640 1 -- 172.21.15.67:0/3338819830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb27806b0c0 msgr2=0x7fb278158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:08.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.395+0000 7fb27659c640 1 --2- 172.21.15.67:0/3338819830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb27806b0c0 0x7fb278158fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:08.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.395+0000 7fb27659c640 1 -- 172.21.15.67:0/3338819830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2780d0a00 msgr2=0x7fb2781e6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:08.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.395+0000 7fb27659c640 1 --2- 172.21.15.67:0/3338819830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2780d0a00 0x7fb2781e6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:08.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.395+0000 7fb27659c640 1 -- 172.21.15.67:0/3338819830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb278147140 con 0x7fb278071e70 2024-04-25T02:29:08.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.395+0000 7fb27659c640 1 --2- 172.21.15.67:0/3338819830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb278071e70 0x7fb27815a680 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0097d0 tx=0x7fb26c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:08.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.396+0000 7fb25f7fe640 1 -- 172.21.15.67:0/3338819830 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c041020 con 0x7fb278071e70 2024-04-25T02:29:08.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.396+0000 7fb25f7fe640 1 -- 172.21.15.67:0/3338819830 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb26c03d640 con 0x7fb278071e70 2024-04-25T02:29:08.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.396+0000 7fb25f7fe640 1 -- 172.21.15.67:0/3338819830 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c037040 con 0x7fb278071e70 2024-04-25T02:29:08.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.396+0000 7fb27d142640 1 -- 172.21.15.67:0/3338819830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb278147420 con 0x7fb278071e70 2024-04-25T02:29:08.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.396+0000 7fb27d142640 1 -- 172.21.15.67:0/3338819830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2781479e0 con 0x7fb278071e70 2024-04-25T02:29:08.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.397+0000 7fb27d142640 1 -- 172.21.15.67:0/3338819830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb278067e40 con 0x7fb278071e70 2024-04-25T02:29:08.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.397+0000 7fb25f7fe640 1 -- 172.21.15.67:0/3338819830 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb26c044020 con 0x7fb278071e70 2024-04-25T02:29:08.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.397+0000 7fb25f7fe640 1 --2- 172.21.15.67:0/3338819830 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb26406be30 0x7fb26406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:08.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.398+0000 7fb25f7fe640 1 -- 172.21.15.67:0/3338819830 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7fb26c0ab3b0 con 0x7fb278071e70 2024-04-25T02:29:08.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.398+0000 7fb276d9d640 1 --2- 172.21.15.67:0/3338819830 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb26406be30 0x7fb26406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:08.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.398+0000 7fb276d9d640 1 --2- 172.21.15.67:0/3338819830 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb26406be30 0x7fb26406e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb2680013b0 tx=0x7fb268001d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:08.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.402+0000 7fb25f7fe640 1 -- 172.21.15.67:0/3338819830 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb26c04b030 con 0x7fb278071e70 2024-04-25T02:29:08.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:08.624+0000 7fb27d142640 1 -- 172.21.15.67:0/3338819830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb2780b0640 con 0x7fb278071e70 2024-04-25T02:29:09.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.275+0000 7fb25f7fe640 1 -- 172.21.15.67:0/3338819830 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7fb26c098020 con 0x7fb278071e70 2024-04-25T02:29:09.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.278+0000 7fb27d142640 1 -- 172.21.15.67:0/3338819830 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb26406be30 msgr2=0x7fb26406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:09.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.278+0000 7fb27d142640 1 --2- 172.21.15.67:0/3338819830 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb26406be30 0x7fb26406e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb2680013b0 tx=0x7fb268001d50 comp rx=0 tx=0).stop 2024-04-25T02:29:09.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.278+0000 7fb27d142640 1 -- 172.21.15.67:0/3338819830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb278071e70 msgr2=0x7fb27815a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:09.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.278+0000 7fb27d142640 1 --2- 172.21.15.67:0/3338819830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb278071e70 0x7fb27815a680 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0097d0 tx=0x7fb26c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:09.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.278+0000 7fb27d142640 1 -- 172.21.15.67:0/3338819830 shutdown_connections 2024-04-25T02:29:09.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.278+0000 7fb27d142640 1 --2- 172.21.15.67:0/3338819830 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb26406be30 0x7fb26406e2f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:09.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.278+0000 7fb27d142640 1 --2- 172.21.15.67:0/3338819830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2780d0a00 0x7fb2781e6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:09.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.278+0000 7fb27d142640 1 --2- 172.21.15.67:0/3338819830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb278071e70 0x7fb27815a680 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:09.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.278+0000 7fb27d142640 1 --2- 172.21.15.67:0/3338819830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb27806b0c0 0x7fb278158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:09.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.278+0000 7fb27d142640 1 -- 172.21.15.67:0/3338819830 >> 172.21.15.67:0/3338819830 conn(0x7fb2780d0e20 msgr2=0x7fb2780af690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:09.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.278+0000 7fb27d142640 1 -- 172.21.15.67:0/3338819830 shutdown_connections 2024-04-25T02:29:09.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.278+0000 7fb27d142640 1 -- 172.21.15.67:0/3338819830 wait complete. 2024-04-25T02:29:09.293 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T02:29:09.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.400+0000 7f11e847d640 1 Processor -- start 2024-04-25T02:29:09.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.400+0000 7f11e847d640 1 -- start start 2024-04-25T02:29:09.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e847d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e00d1250 0x7f11e00d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:09.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e847d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11e00d2e80 con 0x7f11e00d4b70 2024-04-25T02:29:09.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e847d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11e00cef50 con 0x7f11e015e4b0 2024-04-25T02:29:09.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e847d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f11e00d3160 con 0x7f11e00d1250 2024-04-25T02:29:09.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e5a18640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f11e00d4b70 0x7f11e00d0b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42848/0 (socket says 172.21.15.67:42848) 2024-04-25T02:29:09.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e5a18640 1 -- 172.21.15.67:0/977175956 learned_addr learned my addr 172.21.15.67:0/977175956 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:09.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e6a1a640 1 --2- 172.21.15.67:0/977175956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e00d1250 0x7f11e00d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:09.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e5217640 1 -- 172.21.15.67:0/977175956 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2184149005 0 0) 0x7f11e00d2e80 con 0x7f11e00d4b70 2024-04-25T02:29:09.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e5217640 1 -- 172.21.15.67:0/977175956 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11cc003520 con 0x7f11e00d4b70 2024-04-25T02:29:09.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e5217640 1 -- 172.21.15.67:0/977175956 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2270331089 0 0) 0x7f11cc003520 con 0x7f11e00d4b70 2024-04-25T02:29:09.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e5217640 1 -- 172.21.15.67:0/977175956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e00d1250 msgr2=0x7f11e00d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:09.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e5217640 1 --2- 172.21.15.67:0/977175956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e00d1250 0x7f11e00d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:09.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e5217640 1 -- 172.21.15.67:0/977175956 >> v1:172.21.15.176:6789/0 conn(0x7f11e015e4b0 legacy=0x7f11e00cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:09.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e5217640 1 -- 172.21.15.67:0/977175956 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e00cf230 con 0x7f11e00d4b70 2024-04-25T02:29:09.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e5217640 1 -- 172.21.15.67:0/977175956 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f11d0001670 con 0x7f11e00d4b70 2024-04-25T02:29:09.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e5217640 1 -- 172.21.15.67:0/977175956 >> v1:172.21.15.67:6789/0 conn(0x7f11e00d4b70 legacy=0x7f11e00d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:09.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e5217640 1 --2- 172.21.15.67:0/977175956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e00d1250 0x7f11cc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:09.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e5217640 1 --2- 172.21.15.67:0/977175956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11cc003f20 0x7f11cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:09.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e5217640 1 --2- 172.21.15.67:0/977175956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11cc004d40 0x7f11cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:09.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e5217640 1 -- 172.21.15.67:0/977175956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f11e00d3160 con 0x7f11cc003f20 2024-04-25T02:29:09.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e5217640 1 -- 172.21.15.67:0/977175956 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f11cc00ba20 con 0x7f11cc004d40 2024-04-25T02:29:09.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.401+0000 7f11e5217640 1 -- 172.21.15.67:0/977175956 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f11cc00bc20 con 0x7f11e00d1250 2024-04-25T02:29:09.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.402+0000 7f11e5a18640 1 --2- 172.21.15.67:0/977175956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11cc003f20 0x7f11cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:09.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.402+0000 7f11e6219640 1 --2- 172.21.15.67:0/977175956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e00d1250 0x7f11cc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:09.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.402+0000 7f11e6a1a640 1 --2- 172.21.15.67:0/977175956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11cc004d40 0x7f11cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:09.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.402+0000 7f11e5a18640 1 -- 172.21.15.67:0/977175956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e00d1250 msgr2=0x7f11cc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:09.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.402+0000 7f11e5a18640 1 --2- 172.21.15.67:0/977175956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e00d1250 0x7f11cc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:09.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.402+0000 7f11e5a18640 1 -- 172.21.15.67:0/977175956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11cc004d40 msgr2=0x7f11cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:09.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.402+0000 7f11e5a18640 1 --2- 172.21.15.67:0/977175956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11cc004d40 0x7f11cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:09.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.402+0000 7f11e5a18640 1 -- 172.21.15.67:0/977175956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11cc003520 con 0x7f11cc003f20 2024-04-25T02:29:09.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.403+0000 7f11e5a18640 1 --2- 172.21.15.67:0/977175956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11cc003f20 0x7f11cc004800 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f11d000c240 tx=0x7f11cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844ca317759e7e8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:09.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.403+0000 7f11e5217640 1 -- 172.21.15.67:0/977175956 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d0007d30 con 0x7f11cc003f20 2024-04-25T02:29:09.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.403+0000 7f11e5217640 1 -- 172.21.15.67:0/977175956 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11d0005af0 con 0x7f11cc003f20 2024-04-25T02:29:09.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.403+0000 7f11e5217640 1 -- 172.21.15.67:0/977175956 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d0007070 con 0x7f11cc003f20 2024-04-25T02:29:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.403+0000 7f11e847d640 1 -- 172.21.15.67:0/977175956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11cc003f20 msgr2=0x7f11cc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.403+0000 7f11e847d640 1 --2- 172.21.15.67:0/977175956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11cc003f20 0x7f11cc004800 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f11d000c240 tx=0x7f11cc005830 comp rx=0 tx=0).stop 2024-04-25T02:29:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.403+0000 7f11e6a1a640 1 -- 172.21.15.67:0/977175956 reap_dead start 2024-04-25T02:29:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.403+0000 7f11e847d640 1 -- 172.21.15.67:0/977175956 shutdown_connections 2024-04-25T02:29:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.403+0000 7f11e847d640 1 -- 172.21.15.67:0/977175956 >> 172.21.15.67:0/977175956 conn(0x7f11e009d4a0 msgr2=0x7f11e00d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.403+0000 7f11e847d640 1 -- 172.21.15.67:0/977175956 shutdown_connections 2024-04-25T02:29:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.403+0000 7f11e847d640 1 -- 172.21.15.67:0/977175956 wait complete. 2024-04-25T02:29:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.404+0000 7f11e847d640 1 Processor -- start 2024-04-25T02:29:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.405+0000 7f11e847d640 1 -- start start 2024-04-25T02:29:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.405+0000 7f11e847d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11cc003f20 0x7f11e014fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.405+0000 7f11e847d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11e00b7db0 0x7f11e00b8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.405+0000 7f11e847d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11e015f7c0 0x7f11e015fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.405+0000 7f11e847d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f11e00d5000 con 0x7f11e00b7db0 2024-04-25T02:29:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.405+0000 7f11e847d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f11e00cf5a0 con 0x7f11e015f7c0 2024-04-25T02:29:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.405+0000 7f11e847d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f11e015e890 con 0x7f11cc003f20 2024-04-25T02:29:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.405+0000 7f11e5a18640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11e00b7db0 0x7f11e00b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.405+0000 7f11e5a18640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11e00b7db0 0x7f11e00b8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49780/0 (socket says 172.21.15.67:49780) 2024-04-25T02:29:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.405+0000 7f11e5a18640 1 -- 172.21.15.67:0/2832561632 learned_addr learned my addr 172.21.15.67:0/2832561632 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.405+0000 7f11e6219640 1 --2- 172.21.15.67:0/2832561632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11cc003f20 0x7f11e014fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.405+0000 7f11e6a1a640 1 --2- 172.21.15.67:0/2832561632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11e015f7c0 0x7f11e015fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.406+0000 7f11e5a18640 1 -- 172.21.15.67:0/2832561632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11cc003f20 msgr2=0x7f11e014fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.406+0000 7f11e5a18640 1 --2- 172.21.15.67:0/2832561632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11cc003f20 0x7f11e014fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.406+0000 7f11e5a18640 1 -- 172.21.15.67:0/2832561632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11e015f7c0 msgr2=0x7f11e015fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.406+0000 7f11e5a18640 1 --2- 172.21.15.67:0/2832561632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11e015f7c0 0x7f11e015fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.406+0000 7f11e5a18640 1 -- 172.21.15.67:0/2832561632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e00b6d10 con 0x7f11e00b7db0 2024-04-25T02:29:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.406+0000 7f11e6a1a640 1 --2- 172.21.15.67:0/2832561632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11e015f7c0 0x7f11e015fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.406+0000 7f11e6219640 1 --2- 172.21.15.67:0/2832561632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11cc003f20 0x7f11e014fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.406+0000 7f11e5a18640 1 --2- 172.21.15.67:0/2832561632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11e00b7db0 0x7f11e00b8230 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f11d0000c00 tx=0x7f11e00cf510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.406+0000 7f11d6ffd640 1 -- 172.21.15.67:0/2832561632 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d0041020 con 0x7f11e00b7db0 2024-04-25T02:29:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.406+0000 7f11d6ffd640 1 -- 172.21.15.67:0/2832561632 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11d0001430 con 0x7f11e00b7db0 2024-04-25T02:29:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.406+0000 7f11e847d640 1 -- 172.21.15.67:0/2832561632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11e00b6ff0 con 0x7f11e00b7db0 2024-04-25T02:29:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.406+0000 7f11d6ffd640 1 -- 172.21.15.67:0/2832561632 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d0007070 con 0x7f11e00b7db0 2024-04-25T02:29:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.406+0000 7f11e847d640 1 -- 172.21.15.67:0/2832561632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11e00b75b0 con 0x7f11e00b7db0 2024-04-25T02:29:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.407+0000 7f11e847d640 1 -- 172.21.15.67:0/2832561632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11e0069110 con 0x7f11e00b7db0 2024-04-25T02:29:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.407+0000 7f11d6ffd640 1 -- 172.21.15.67:0/2832561632 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11d0044020 con 0x7f11e00b7db0 2024-04-25T02:29:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.408+0000 7f11d6ffd640 1 --2- 172.21.15.67:0/2832561632 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f11c406be60 0x7f11c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.408+0000 7f11d6ffd640 1 -- 172.21.15.67:0/2832561632 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7f11d00ab2f0 con 0x7f11e00b7db0 2024-04-25T02:29:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.408+0000 7f11e6219640 1 --2- 172.21.15.67:0/2832561632 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f11c406be60 0x7f11c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:09.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.409+0000 7f11e6219640 1 --2- 172.21.15.67:0/2832561632 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f11c406be60 0x7f11c406e320 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f11dc003700 tx=0x7f11dc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:09.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.412+0000 7f11d6ffd640 1 -- 172.21.15.67:0/2832561632 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f11d0005ac0 con 0x7f11e00b7db0 2024-04-25T02:29:09.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:09.594+0000 7f11e847d640 1 -- 172.21.15.67:0/2832561632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f11e006dab0 con 0x7f11e00b7db0 2024-04-25T02:29:10.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.277+0000 7f11d6ffd640 1 -- 172.21.15.67:0/2832561632 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7f11d0079bd0 con 0x7f11e00b7db0 2024-04-25T02:29:10.280 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-04-25T02:29:10.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.280+0000 7f11e847d640 1 -- 172.21.15.67:0/2832561632 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f11c406be60 msgr2=0x7f11c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:10.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.280+0000 7f11e847d640 1 --2- 172.21.15.67:0/2832561632 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f11c406be60 0x7f11c406e320 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f11dc003700 tx=0x7f11dc009040 comp rx=0 tx=0).stop 2024-04-25T02:29:10.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.280+0000 7f11e847d640 1 -- 172.21.15.67:0/2832561632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11e00b7db0 msgr2=0x7f11e00b8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:10.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.280+0000 7f11e847d640 1 --2- 172.21.15.67:0/2832561632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11e00b7db0 0x7f11e00b8230 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f11d0000c00 tx=0x7f11e00cf510 comp rx=0 tx=0).stop 2024-04-25T02:29:10.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.280+0000 7f11e847d640 1 -- 172.21.15.67:0/2832561632 shutdown_connections 2024-04-25T02:29:10.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.280+0000 7f11e847d640 1 --2- 172.21.15.67:0/2832561632 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f11c406be60 0x7f11c406e320 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:10.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.280+0000 7f11e847d640 1 --2- 172.21.15.67:0/2832561632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11e015f7c0 0x7f11e015fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:10.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.280+0000 7f11e847d640 1 --2- 172.21.15.67:0/2832561632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11e00b7db0 0x7f11e00b8230 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:10.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.280+0000 7f11e847d640 1 --2- 172.21.15.67:0/2832561632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11cc003f20 0x7f11e014fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:10.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.280+0000 7f11e847d640 1 -- 172.21.15.67:0/2832561632 >> 172.21.15.67:0/2832561632 conn(0x7f11e009d4a0 msgr2=0x7f11e00c9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:10.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.281+0000 7f11e847d640 1 -- 172.21.15.67:0/2832561632 shutdown_connections 2024-04-25T02:29:10.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.281+0000 7f11e847d640 1 -- 172.21.15.67:0/2832561632 wait complete. 2024-04-25T02:29:10.302 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T02:29:10.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.409+0000 7fc7af15c640 1 Processor -- start 2024-04-25T02:29:10.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.410+0000 7fc7af15c640 1 -- start start 2024-04-25T02:29:10.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.410+0000 7fc7af15c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc7a80727f0 0x7fc7a815ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:10.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.410+0000 7fc7af15c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7a815f220 0x7fc7a80ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.410+0000 7fc7af15c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a8072bd0 con 0x7fc7a80ae9e0 2024-04-25T02:29:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.410+0000 7fc7af15c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc7a815f680 con 0x7fc7a80727f0 2024-04-25T02:29:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.410+0000 7fc7af15c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a80b4a90 con 0x7fc7a815f220 2024-04-25T02:29:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.411+0000 7fc7acef8640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc7a80727f0 0x7fc7a815ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.411+0000 7fc7acef8640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc7a80727f0 0x7fc7a815ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49788/0 (socket says 172.21.15.67:49788) 2024-04-25T02:29:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.411+0000 7fc7acef8640 1 -- 172.21.15.67:0/4137130747 learned_addr learned my addr 172.21.15.67:0/4137130747 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.411+0000 7fc7a7fff640 1 --2- 172.21.15.67:0/4137130747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7a815f220 0x7fc7a80ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.411+0000 7fc7acef8640 1 -- 172.21.15.67:0/4137130747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7a815f220 msgr2=0x7fc7a80ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.411+0000 7fc7acef8640 1 --2- 172.21.15.67:0/4137130747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7a815f220 0x7fc7a80ae4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.411+0000 7fc7acef8640 1 -- 172.21.15.67:0/4137130747 >> v1:172.21.15.176:6789/0 conn(0x7fc7a80ae9e0 legacy=0x7fc7a8154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.411+0000 7fc7acef8640 1 -- 172.21.15.67:0/4137130747 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a80af260 con 0x7fc7a80727f0 2024-04-25T02:29:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.412+0000 7fc7acef8640 1 --2- 172.21.15.67:0/4137130747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7a80727f0 0x7fc7a815ece0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009870 tx=0x7fc79c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45b9addc2bdc87d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.412+0000 7fc7a77fe640 1 -- 172.21.15.67:0/4137130747 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c037070 con 0x7fc7a80727f0 2024-04-25T02:29:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.412+0000 7fc7a77fe640 1 -- 172.21.15.67:0/4137130747 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79c032440 con 0x7fc7a80727f0 2024-04-25T02:29:10.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.412+0000 7fc7a77fe640 1 -- 172.21.15.67:0/4137130747 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c032810 con 0x7fc7a80727f0 2024-04-25T02:29:10.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.412+0000 7fc7af15c640 1 -- 172.21.15.67:0/4137130747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7a80727f0 msgr2=0x7fc7a815ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:10.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.412+0000 7fc7af15c640 1 --2- 172.21.15.67:0/4137130747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7a80727f0 0x7fc7a815ece0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009870 tx=0x7fc79c02a210 comp rx=0 tx=0).stop 2024-04-25T02:29:10.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.412+0000 7fc7af15c640 1 -- 172.21.15.67:0/4137130747 shutdown_connections 2024-04-25T02:29:10.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.412+0000 7fc7af15c640 1 --2- 172.21.15.67:0/4137130747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7a815f220 0x7fc7a80ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:10.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.412+0000 7fc7af15c640 1 --2- 172.21.15.67:0/4137130747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7a80727f0 0x7fc7a815ece0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:10.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.412+0000 7fc7af15c640 1 -- 172.21.15.67:0/4137130747 >> 172.21.15.67:0/4137130747 conn(0x7fc7a80b19c0 msgr2=0x7fc7a80b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:10.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.412+0000 7fc7af15c640 1 -- 172.21.15.67:0/4137130747 shutdown_connections 2024-04-25T02:29:10.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.412+0000 7fc7af15c640 1 -- 172.21.15.67:0/4137130747 wait complete. 2024-04-25T02:29:10.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.413+0000 7fc7af15c640 1 Processor -- start 2024-04-25T02:29:10.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.414+0000 7fc7af15c640 1 -- start start 2024-04-25T02:29:10.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.414+0000 7fc7af15c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7a80727f0 0x7fc7a80cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:10.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.414+0000 7fc7af15c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7a80ae9e0 0x7fc7a8159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:10.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.414+0000 7fc7af15c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7a815f220 0x7fc7a80cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:10.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.414+0000 7fc7af15c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a80b3280 con 0x7fc7a80727f0 2024-04-25T02:29:10.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.414+0000 7fc7af15c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a80b2fa0 con 0x7fc7a815f220 2024-04-25T02:29:10.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.414+0000 7fc7af15c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a80b3560 con 0x7fc7a80ae9e0 2024-04-25T02:29:10.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.415+0000 7fc7acef8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7a80727f0 0x7fc7a80cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:10.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.415+0000 7fc7acef8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7a80727f0 0x7fc7a80cf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49790/0 (socket says 172.21.15.67:49790) 2024-04-25T02:29:10.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.415+0000 7fc7acef8640 1 -- 172.21.15.67:0/2110224015 learned_addr learned my addr 172.21.15.67:0/2110224015 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:10.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.415+0000 7fc7acef8640 1 -- 172.21.15.67:0/2110224015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7a80ae9e0 msgr2=0x7fc7a8159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:10.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.415+0000 7fc7acef8640 1 --2- 172.21.15.67:0/2110224015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7a80ae9e0 0x7fc7a8159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:10.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.415+0000 7fc7acef8640 1 -- 172.21.15.67:0/2110224015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7a815f220 msgr2=0x7fc7a80cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:10.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.415+0000 7fc7acef8640 1 --2- 172.21.15.67:0/2110224015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7a815f220 0x7fc7a80cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:10.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.415+0000 7fc7acef8640 1 -- 172.21.15.67:0/2110224015 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a815a1a0 con 0x7fc7a80727f0 2024-04-25T02:29:10.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.415+0000 7fc7acef8640 1 --2- 172.21.15.67:0/2110224015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7a80727f0 0x7fc7a80cf1c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009870 tx=0x7fc79c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:10.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.415+0000 7fc7a57fa640 1 -- 172.21.15.67:0/2110224015 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c041020 con 0x7fc7a80727f0 2024-04-25T02:29:10.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.415+0000 7fc7a57fa640 1 -- 172.21.15.67:0/2110224015 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79c030970 con 0x7fc7a80727f0 2024-04-25T02:29:10.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.415+0000 7fc7a57fa640 1 -- 172.21.15.67:0/2110224015 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c037040 con 0x7fc7a80727f0 2024-04-25T02:29:10.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.415+0000 7fc7af15c640 1 -- 172.21.15.67:0/2110224015 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a81ee860 con 0x7fc7a80727f0 2024-04-25T02:29:10.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.415+0000 7fc7af15c640 1 -- 172.21.15.67:0/2110224015 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a815a710 con 0x7fc7a80727f0 2024-04-25T02:29:10.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.416+0000 7fc7af15c640 1 -- 172.21.15.67:0/2110224015 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a8069110 con 0x7fc7a80727f0 2024-04-25T02:29:10.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.417+0000 7fc7a57fa640 1 -- 172.21.15.67:0/2110224015 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc79c044020 con 0x7fc7a80727f0 2024-04-25T02:29:10.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.417+0000 7fc7a57fa640 1 --2- 172.21.15.67:0/2110224015 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc78c06be30 0x7fc78c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:10.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.417+0000 7fc7a57fa640 1 -- 172.21.15.67:0/2110224015 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5473+0+0 (secure 0 0 0) 0x7fc79c0ab6b0 con 0x7fc7a80727f0 2024-04-25T02:29:10.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.417+0000 7fc7a7fff640 1 --2- 172.21.15.67:0/2110224015 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc78c06be30 0x7fc78c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:10.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.418+0000 7fc7a7fff640 1 --2- 172.21.15.67:0/2110224015 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc78c06be30 0x7fc78c06e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc794006fd0 tx=0x7fc794008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:10.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.421+0000 7fc7a57fa640 1 -- 172.21.15.67:0/2110224015 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc79c04b030 con 0x7fc7a80727f0 2024-04-25T02:29:10.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:10.604+0000 7fc7af15c640 1 -- 172.21.15.67:0/2110224015 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc7a80683f0 con 0x7fc7a80727f0 2024-04-25T02:29:11.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.282+0000 7fc7a57fa640 1 -- 172.21.15.67:0/2110224015 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7fc79c07a1d0 con 0x7fc7a80727f0 2024-04-25T02:29:11.285 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-04-25T02:29:11.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.286+0000 7fc7af15c640 1 -- 172.21.15.67:0/2110224015 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc78c06be30 msgr2=0x7fc78c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:11.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.286+0000 7fc7af15c640 1 --2- 172.21.15.67:0/2110224015 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc78c06be30 0x7fc78c06e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc794006fd0 tx=0x7fc794008040 comp rx=0 tx=0).stop 2024-04-25T02:29:11.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.286+0000 7fc7af15c640 1 -- 172.21.15.67:0/2110224015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7a80727f0 msgr2=0x7fc7a80cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:11.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.286+0000 7fc7af15c640 1 --2- 172.21.15.67:0/2110224015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7a80727f0 0x7fc7a80cf1c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009870 tx=0x7fc79c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:11.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.287+0000 7fc7af15c640 1 -- 172.21.15.67:0/2110224015 shutdown_connections 2024-04-25T02:29:11.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.287+0000 7fc7af15c640 1 --2- 172.21.15.67:0/2110224015 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc78c06be30 0x7fc78c06e2f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:11.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.287+0000 7fc7af15c640 1 --2- 172.21.15.67:0/2110224015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7a815f220 0x7fc7a80cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:11.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.287+0000 7fc7af15c640 1 --2- 172.21.15.67:0/2110224015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7a80ae9e0 0x7fc7a8159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:11.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.287+0000 7fc7af15c640 1 --2- 172.21.15.67:0/2110224015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7a80727f0 0x7fc7a80cf1c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:11.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.287+0000 7fc7af15c640 1 -- 172.21.15.67:0/2110224015 >> 172.21.15.67:0/2110224015 conn(0x7fc7a80b19c0 msgr2=0x7fc7a80b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:11.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.287+0000 7fc7af15c640 1 -- 172.21.15.67:0/2110224015 shutdown_connections 2024-04-25T02:29:11.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.287+0000 7fc7af15c640 1 -- 172.21.15.67:0/2110224015 wait complete. 2024-04-25T02:29:11.306 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T02:29:11.306 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T02:29:11.306 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T02:29:11.306 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:29:11.306 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T02:29:11.306 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T02:29:11.307 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T02:29:11.307 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:29:11.307 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T02:29:11.307 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T02:29:11.307 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T02:29:11.308 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:29:11.308 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T02:29:11.308 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T02:29:11.308 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T02:29:11.308 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:29:11.317 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T02:29:11.318 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T02:29:11.319 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T02:29:11.319 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T02:29:11.320 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T02:29:11.320 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T02:29:11.321 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T02:29:11.321 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T02:29:11.361 INFO:tasks.ceph.mds.a:Started 2024-04-25T02:29:11.361 DEBUG:teuthology.parallel:result is None 2024-04-25T02:29:11.362 INFO:tasks.ceph.mds.c:Started 2024-04-25T02:29:11.362 DEBUG:teuthology.parallel:result is None 2024-04-25T02:29:11.363 INFO:tasks.ceph.mds.b:Started 2024-04-25T02:29:11.363 DEBUG:teuthology.parallel:result is None 2024-04-25T02:29:11.364 INFO:tasks.ceph.mds.d:Started 2024-04-25T02:29:11.364 DEBUG:teuthology.parallel:result is None 2024-04-25T02:29:11.364 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T02:29:11.445 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-04-25T02:29:11.445 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-04-25T02:29:11.446 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-04-25T02:29:11.446 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-04-25T02:29:11.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.476+0000 7f11711e7640 1 Processor -- start 2024-04-25T02:29:11.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.476+0000 7f11711e7640 1 -- start start 2024-04-25T02:29:11.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.476+0000 7f11711e7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c0cef60 0x7f116c06c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:11.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.476+0000 7f11711e7640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f116c0b1600 0x7f116c0d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:11.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.476+0000 7f11711e7640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f116c0b3770 con 0x7f116c0b3390 2024-04-25T02:29:11.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.476+0000 7f11711e7640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f116c0cc500 con 0x7f116c0b1600 2024-04-25T02:29:11.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.476+0000 7f11711e7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f116c0cd080 con 0x7f116c0cef60 2024-04-25T02:29:11.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.477+0000 7f116a59c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c0cef60 0x7f116c06c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:11.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.477+0000 7f116b59e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f116c0b1600 0x7f116c0d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:11.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.477+0000 7f116a59c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c0cef60 0x7f116c06c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:53464/0 (socket says 172.21.15.67:53464) 2024-04-25T02:29:11.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.477+0000 7f116a59c640 1 -- 172.21.15.67:0/1771795694 learned_addr learned my addr 172.21.15.67:0/1771795694 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:11.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.477+0000 7f116a59c640 1 -- 172.21.15.67:0/1771795694 >> v2:172.21.15.176:3300/0 conn(0x7f116c0b1600 msgr2=0x7f116c0d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:11.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.477+0000 7f116a59c640 1 --2- 172.21.15.67:0/1771795694 >> v2:172.21.15.176:3300/0 conn(0x7f116c0b1600 0x7f116c0d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:11.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.477+0000 7f116a59c640 1 -- 172.21.15.67:0/1771795694 >> v1:172.21.15.176:6789/0 conn(0x7f116c0b3390 legacy=0x7f116c0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:11.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.477+0000 7f116a59c640 1 -- 172.21.15.67:0/1771795694 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116c0cc750 con 0x7f116c0cef60 2024-04-25T02:29:11.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.478+0000 7f116a59c640 1 --2- 172.21.15.67:0/1771795694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c0cef60 0x7f116c06c500 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1160009870 tx=0x7f116002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba462af4c0469615 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:11.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.478+0000 7f1169d9b640 1 -- 172.21.15.67:0/1771795694 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1160037070 con 0x7f116c0cef60 2024-04-25T02:29:11.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.478+0000 7f1169d9b640 1 -- 172.21.15.67:0/1771795694 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1160032440 con 0x7f116c0cef60 2024-04-25T02:29:11.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.478+0000 7f1169d9b640 1 -- 172.21.15.67:0/1771795694 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1160032810 con 0x7f116c0cef60 2024-04-25T02:29:11.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.478+0000 7f11711e7640 1 -- 172.21.15.67:0/1771795694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c0cef60 msgr2=0x7f116c06c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:11.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.478+0000 7f11711e7640 1 --2- 172.21.15.67:0/1771795694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c0cef60 0x7f116c06c500 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1160009870 tx=0x7f116002a270 comp rx=0 tx=0).stop 2024-04-25T02:29:11.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.478+0000 7f11711e7640 1 -- 172.21.15.67:0/1771795694 shutdown_connections 2024-04-25T02:29:11.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.478+0000 7f11711e7640 1 --2- 172.21.15.67:0/1771795694 >> v2:172.21.15.176:3300/0 conn(0x7f116c0b1600 0x7f116c0d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:11.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.478+0000 7f11711e7640 1 --2- 172.21.15.67:0/1771795694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c0cef60 0x7f116c06c500 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:11.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.479+0000 7f11711e7640 1 -- 172.21.15.67:0/1771795694 >> 172.21.15.67:0/1771795694 conn(0x7f116c0d1eb0 msgr2=0x7f116c0d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:11.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.479+0000 7f11711e7640 1 -- 172.21.15.67:0/1771795694 shutdown_connections 2024-04-25T02:29:11.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.479+0000 7f11711e7640 1 -- 172.21.15.67:0/1771795694 wait complete. 2024-04-25T02:29:11.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.480+0000 7f11711e7640 1 Processor -- start 2024-04-25T02:29:11.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.480+0000 7f11711e7640 1 -- start start 2024-04-25T02:29:11.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.481+0000 7f11711e7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f116c0b1600 0x7f116c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:11.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.481+0000 7f11711e7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f116c0b3390 0x7f116c0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:11.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.481+0000 7f11711e7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c0cef60 0x7f116c1601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:11.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.481+0000 7f11711e7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f116c0d14f0 con 0x7f116c0b1600 2024-04-25T02:29:11.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.481+0000 7f11711e7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f116c0ccd10 con 0x7f116c0b3390 2024-04-25T02:29:11.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.481+0000 7f11711e7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f116c0d29d0 con 0x7f116c0cef60 2024-04-25T02:29:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.481+0000 7f116ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f116c0b1600 0x7f116c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.481+0000 7f116ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f116c0b1600 0x7f116c15d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49832/0 (socket says 172.21.15.67:49832) 2024-04-25T02:29:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.481+0000 7f116ad9d640 1 -- 172.21.15.67:0/3053263192 learned_addr learned my addr 172.21.15.67:0/3053263192 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.481+0000 7f116b59e640 1 --2- 172.21.15.67:0/3053263192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c0cef60 0x7f116c1601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.481+0000 7f116ad9d640 1 -- 172.21.15.67:0/3053263192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c0cef60 msgr2=0x7f116c1601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.481+0000 7f116a59c640 1 --2- 172.21.15.67:0/3053263192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f116c0b3390 0x7f116c0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.481+0000 7f116ad9d640 1 --2- 172.21.15.67:0/3053263192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c0cef60 0x7f116c1601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.481+0000 7f116ad9d640 1 -- 172.21.15.67:0/3053263192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f116c0b3390 msgr2=0x7f116c0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.481+0000 7f116ad9d640 1 --2- 172.21.15.67:0/3053263192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f116c0b3390 0x7f116c0cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.481+0000 7f116ad9d640 1 -- 172.21.15.67:0/3053263192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116c1578d0 con 0x7f116c0b1600 2024-04-25T02:29:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.481+0000 7f116b59e640 1 --2- 172.21.15.67:0/3053263192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c0cef60 0x7f116c1601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.481+0000 7f116a59c640 1 --2- 172.21.15.67:0/3053263192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f116c0b3390 0x7f116c0cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.482+0000 7f116ad9d640 1 --2- 172.21.15.67:0/3053263192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f116c0b1600 0x7f116c15d430 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f115c00c430 tx=0x7f115c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:11.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.482+0000 7f11537fe640 1 -- 172.21.15.67:0/3053263192 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c0052d0 con 0x7f116c0b1600 2024-04-25T02:29:11.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.482+0000 7f11537fe640 1 -- 172.21.15.67:0/3053263192 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f115c005490 con 0x7f116c0b1600 2024-04-25T02:29:11.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.482+0000 7f11711e7640 1 -- 172.21.15.67:0/3053263192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116c15dac0 con 0x7f116c0b1600 2024-04-25T02:29:11.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.482+0000 7f11537fe640 1 -- 172.21.15.67:0/3053263192 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c007260 con 0x7f116c0b1600 2024-04-25T02:29:11.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.482+0000 7f11711e7640 1 -- 172.21.15.67:0/3053263192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f116c15e080 con 0x7f116c0b1600 2024-04-25T02:29:11.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.483+0000 7f11711e7640 1 -- 172.21.15.67:0/3053263192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f116c15e2c0 con 0x7f116c0b1600 2024-04-25T02:29:11.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.483+0000 7f11537fe640 1 -- 172.21.15.67:0/3053263192 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f115c007400 con 0x7f116c0b1600 2024-04-25T02:29:11.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.484+0000 7f11537fe640 1 --2- 172.21.15.67:0/3053263192 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f115806be60 0x7f115806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:11.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.484+0000 7f11537fe640 1 -- 172.21.15.67:0/3053263192 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4943+0+0 (secure 0 0 0) 0x7f115c08a010 con 0x7f116c0b1600 2024-04-25T02:29:11.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.485+0000 7f116a59c640 1 --2- 172.21.15.67:0/3053263192 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f115806be60 0x7f115806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:11.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.485+0000 7f116a59c640 1 --2- 172.21.15.67:0/3053263192 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f115806be60 0x7f115806e320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1160034000 tx=0x7f116002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:11.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.488+0000 7f11537fe640 1 -- 172.21.15.67:0/3053263192 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f116c15e2c0 con 0x7f116c0b1600 2024-04-25T02:29:11.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:11.686+0000 7f11711e7640 1 -- 172.21.15.67:0/3053263192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f116c0c9230 con 0x7f116c0b1600 2024-04-25T02:29:12.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.299+0000 7f11537fe640 1 -- 172.21.15.67:0/3053263192 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) ==== 97+0+0 (secure 0 0 0) 0x7f115c058d50 con 0x7f116c0b1600 2024-04-25T02:29:12.303 INFO:teuthology.orchestra.run.smithi067.stderr: removed all blocklist entries 2024-04-25T02:29:12.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.301+0000 7f11711e7640 1 -- 172.21.15.67:0/3053263192 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f115806be60 msgr2=0x7f115806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:12.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.301+0000 7f11711e7640 1 --2- 172.21.15.67:0/3053263192 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f115806be60 0x7f115806e320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1160034000 tx=0x7f116002e000 comp rx=0 tx=0).stop 2024-04-25T02:29:12.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.301+0000 7f11711e7640 1 -- 172.21.15.67:0/3053263192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f116c0b1600 msgr2=0x7f116c15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:12.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.301+0000 7f11711e7640 1 --2- 172.21.15.67:0/3053263192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f116c0b1600 0x7f116c15d430 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f115c00c430 tx=0x7f115c00c8f0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.302+0000 7f11711e7640 1 -- 172.21.15.67:0/3053263192 shutdown_connections 2024-04-25T02:29:12.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.302+0000 7f11711e7640 1 --2- 172.21.15.67:0/3053263192 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f115806be60 0x7f115806e320 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.302+0000 7f11711e7640 1 --2- 172.21.15.67:0/3053263192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f116c0cef60 0x7f116c1601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.302+0000 7f11711e7640 1 --2- 172.21.15.67:0/3053263192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f116c0b3390 0x7f116c0cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.302+0000 7f11711e7640 1 --2- 172.21.15.67:0/3053263192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f116c0b1600 0x7f116c15d430 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.302+0000 7f11711e7640 1 -- 172.21.15.67:0/3053263192 >> 172.21.15.67:0/3053263192 conn(0x7f116c0d1eb0 msgr2=0x7f116c0700c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:12.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.302+0000 7f11711e7640 1 -- 172.21.15.67:0/3053263192 shutdown_connections 2024-04-25T02:29:12.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.302+0000 7f11711e7640 1 -- 172.21.15.67:0/3053263192 wait complete. 2024-04-25T02:29:12.317 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T02:29:12.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.417+0000 7fe4ea2fc640 1 Processor -- start 2024-04-25T02:29:12.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.417+0000 7fe4ea2fc640 1 -- start start 2024-04-25T02:29:12.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.418+0000 7fe4ea2fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4e4070df0 0x7fe4e415f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:12.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.418+0000 7fe4ea2fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe4e40b2cc0 0x7fe4e40b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:12.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.418+0000 7fe4ea2fc640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4e40713d0 con 0x7fe4e415b220 2024-04-25T02:29:12.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.418+0000 7fe4ea2fc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe4e40aee00 con 0x7fe4e40b2cc0 2024-04-25T02:29:12.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.418+0000 7fe4ea2fc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe4e40ae4d0 con 0x7fe4e4070df0 2024-04-25T02:29:12.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.418+0000 7fe4e8899640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe4e40b2cc0 0x7fe4e40b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:12.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.418+0000 7fe4e8899640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe4e40b2cc0 0x7fe4e40b3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37596/0 (socket says 172.21.15.67:37596) 2024-04-25T02:29:12.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.418+0000 7fe4e8899640 1 -- 172.21.15.67:0/3704129783 learned_addr learned my addr 172.21.15.67:0/3704129783 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:12.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.418+0000 7fe4e37fe640 1 --2- 172.21.15.67:0/3704129783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4e4070df0 0x7fe4e415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:12.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.418+0000 7fe4e8899640 1 -- 172.21.15.67:0/3704129783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4e4070df0 msgr2=0x7fe4e415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:12.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.418+0000 7fe4e8899640 1 --2- 172.21.15.67:0/3704129783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4e4070df0 0x7fe4e415f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.418+0000 7fe4e8899640 1 -- 172.21.15.67:0/3704129783 >> v1:172.21.15.176:6789/0 conn(0x7fe4e415b220 legacy=0x7fe4e415ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:12.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.418+0000 7fe4e8899640 1 -- 172.21.15.67:0/3704129783 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e40ae7b0 con 0x7fe4e40b2cc0 2024-04-25T02:29:12.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.419+0000 7fe4e8899640 1 --2- 172.21.15.67:0/3704129783 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4e40b2cc0 0x7fe4e40b3150 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009e50 tx=0x7fe4dc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75dde2e51d408657 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:12.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.419+0000 7fe4e2ffd640 1 -- 172.21.15.67:0/3704129783 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc036070 con 0x7fe4e40b2cc0 2024-04-25T02:29:12.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.419+0000 7fe4e2ffd640 1 -- 172.21.15.67:0/3704129783 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4dc031600 con 0x7fe4e40b2cc0 2024-04-25T02:29:12.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.419+0000 7fe4e2ffd640 1 -- 172.21.15.67:0/3704129783 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc0319d0 con 0x7fe4e40b2cc0 2024-04-25T02:29:12.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.420+0000 7fe4ea2fc640 1 -- 172.21.15.67:0/3704129783 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4e40b2cc0 msgr2=0x7fe4e40b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:12.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.420+0000 7fe4ea2fc640 1 --2- 172.21.15.67:0/3704129783 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4e40b2cc0 0x7fe4e40b3150 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009e50 tx=0x7fe4dc02a710 comp rx=0 tx=0).stop 2024-04-25T02:29:12.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.420+0000 7fe4ea2fc640 1 -- 172.21.15.67:0/3704129783 shutdown_connections 2024-04-25T02:29:12.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.420+0000 7fe4ea2fc640 1 --2- 172.21.15.67:0/3704129783 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4e40b2cc0 0x7fe4e40b3150 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.420+0000 7fe4ea2fc640 1 --2- 172.21.15.67:0/3704129783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4e4070df0 0x7fe4e415f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.420+0000 7fe4ea2fc640 1 -- 172.21.15.67:0/3704129783 >> 172.21.15.67:0/3704129783 conn(0x7fe4e40b19c0 msgr2=0x7fe4e40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:12.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.420+0000 7fe4ea2fc640 1 -- 172.21.15.67:0/3704129783 shutdown_connections 2024-04-25T02:29:12.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.420+0000 7fe4ea2fc640 1 -- 172.21.15.67:0/3704129783 wait complete. 2024-04-25T02:29:12.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.421+0000 7fe4ea2fc640 1 Processor -- start 2024-04-25T02:29:12.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.421+0000 7fe4ea2fc640 1 -- start start 2024-04-25T02:29:12.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.422+0000 7fe4ea2fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4e4070df0 0x7fe4e41f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:12.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.422+0000 7fe4ea2fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4e40b2cc0 0x7fe4e414f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:12.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.422+0000 7fe4ea2fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4e415b220 0x7fe4e406d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:12.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.422+0000 7fe4ea2fc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e406ed10 con 0x7fe4e4070df0 2024-04-25T02:29:12.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.422+0000 7fe4ea2fc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e406eb90 con 0x7fe4e40b2cc0 2024-04-25T02:29:12.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.422+0000 7fe4ea2fc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe4e415f8c0 con 0x7fe4e415b220 2024-04-25T02:29:12.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.422+0000 7fe4e3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4e4070df0 0x7fe4e41f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:12.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.422+0000 7fe4e3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4e4070df0 0x7fe4e41f71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37610/0 (socket says 172.21.15.67:37610) 2024-04-25T02:29:12.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.422+0000 7fe4e3fff640 1 -- 172.21.15.67:0/1341582151 learned_addr learned my addr 172.21.15.67:0/1341582151 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:12.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.422+0000 7fe4e8899640 1 --2- 172.21.15.67:0/1341582151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4e415b220 0x7fe4e406d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:12.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.422+0000 7fe4e37fe640 1 --2- 172.21.15.67:0/1341582151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4e40b2cc0 0x7fe4e414f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:12.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.422+0000 7fe4e3fff640 1 -- 172.21.15.67:0/1341582151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4e415b220 msgr2=0x7fe4e406d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:12.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.422+0000 7fe4e3fff640 1 --2- 172.21.15.67:0/1341582151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4e415b220 0x7fe4e406d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.422+0000 7fe4e3fff640 1 -- 172.21.15.67:0/1341582151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4e40b2cc0 msgr2=0x7fe4e414f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:12.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.422+0000 7fe4e3fff640 1 --2- 172.21.15.67:0/1341582151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4e40b2cc0 0x7fe4e414f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.422+0000 7fe4e3fff640 1 -- 172.21.15.67:0/1341582151 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e414fe20 con 0x7fe4e4070df0 2024-04-25T02:29:12.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.422+0000 7fe4e8899640 1 --2- 172.21.15.67:0/1341582151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4e415b220 0x7fe4e406d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:12.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.422+0000 7fe4e37fe640 1 --2- 172.21.15.67:0/1341582151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4e40b2cc0 0x7fe4e414f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:12.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.423+0000 7fe4e3fff640 1 --2- 172.21.15.67:0/1341582151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4e4070df0 0x7fe4e41f71a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400c400 tx=0x7fe4d400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:12.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.423+0000 7fe4e0ff9640 1 -- 172.21.15.67:0/1341582151 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d40052d0 con 0x7fe4e4070df0 2024-04-25T02:29:12.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.423+0000 7fe4e0ff9640 1 -- 172.21.15.67:0/1341582151 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d4005490 con 0x7fe4e4070df0 2024-04-25T02:29:12.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.423+0000 7fe4ea2fc640 1 -- 172.21.15.67:0/1341582151 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e4150100 con 0x7fe4e4070df0 2024-04-25T02:29:12.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.423+0000 7fe4e0ff9640 1 -- 172.21.15.67:0/1341582151 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4007260 con 0x7fe4e4070df0 2024-04-25T02:29:12.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.423+0000 7fe4ea2fc640 1 -- 172.21.15.67:0/1341582151 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e41f80e0 con 0x7fe4e4070df0 2024-04-25T02:29:12.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.424+0000 7fe4ea2fc640 1 -- 172.21.15.67:0/1341582151 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4e41f82e0 con 0x7fe4e4070df0 2024-04-25T02:29:12.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.424+0000 7fe4e0ff9640 1 -- 172.21.15.67:0/1341582151 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe4d4007400 con 0x7fe4e4070df0 2024-04-25T02:29:12.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.424+0000 7fe4e0ff9640 1 --2- 172.21.15.67:0/1341582151 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe4d006be30 0x7fe4d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:12.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.425+0000 7fe4e0ff9640 1 -- 172.21.15.67:0/1341582151 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fe4d408a050 con 0x7fe4e4070df0 2024-04-25T02:29:12.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.425+0000 7fe4e37fe640 1 --2- 172.21.15.67:0/1341582151 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe4d006be30 0x7fe4d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:12.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.425+0000 7fe4e37fe640 1 --2- 172.21.15.67:0/1341582151 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe4d006be30 0x7fe4d006e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8006fd0 tx=0x7fe4d8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:12.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.429+0000 7fe4e0ff9640 1 -- 172.21.15.67:0/1341582151 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe4d4058d50 con 0x7fe4e4070df0 2024-04-25T02:29:12.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.680+0000 7fe4ea2fc640 1 -- 172.21.15.67:0/1341582151 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe4e4069110 con 0x7fe4e4070df0 2024-04-25T02:29:12.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.681+0000 7fe4e0ff9640 1 -- 172.21.15.67:0/1341582151 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7fe4d4058650 con 0x7fe4e4070df0 2024-04-25T02:29:12.684 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:12.684 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-25T02:29:12.684 INFO:teuthology.orchestra.run.smithi067.stdout: "auth_dump": [ 2024-04-25T02:29:12.684 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.684 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.a", 2024-04-25T02:29:12.684 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCQvylmWcy+JhAANb0D1giuHVHgKuMgpXq12Q==", 2024-04-25T02:29:12.684 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.684 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-04-25T02:29:12.685 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-04-25T02:29:12.685 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-04-25T02:29:12.685 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-25T02:29:12.685 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.685 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.685 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.685 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.b", 2024-04-25T02:29:12.685 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCQvylm2/sxMhAAdlCv6DVRbxlmuI0UhRaBug==", 2024-04-25T02:29:12.685 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.685 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-04-25T02:29:12.685 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-04-25T02:29:12.685 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-04-25T02:29:12.685 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-25T02:29:12.685 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.686 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.686 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.686 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.c", 2024-04-25T02:29:12.686 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCQvylmtN+0LRAAwHOGcpdIM2nj18k/Gp3s5A==", 2024-04-25T02:29:12.686 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.686 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-04-25T02:29:12.686 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-04-25T02:29:12.686 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-04-25T02:29:12.686 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-25T02:29:12.686 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.686 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.686 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.686 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.d", 2024-04-25T02:29:12.686 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCQvylmrOrqOBAAoNdqYG4PWrrCEdC9ay/+rw==", 2024-04-25T02:29:12.687 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.687 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-04-25T02:29:12.687 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-04-25T02:29:12.687 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-04-25T02:29:12.687 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-25T02:29:12.687 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.687 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.687 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.687 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.0", 2024-04-25T02:29:12.687 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCUvylmtLasGRAA614HMQoWCDmPL7S6ZgGsbg==", 2024-04-25T02:29:12.687 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.687 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-04-25T02:29:12.687 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-04-25T02:29:12.687 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-25T02:29:12.688 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.688 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.688 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.688 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.1", 2024-04-25T02:29:12.688 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCXvylmNEN5GBAAbQQUv7UsJl7s0q1NpyBNbA==", 2024-04-25T02:29:12.688 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.688 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-04-25T02:29:12.688 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-04-25T02:29:12.688 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-25T02:29:12.688 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.688 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.688 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.688 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.2", 2024-04-25T02:29:12.688 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCavylm5pI0FxAAY16ieuMghyCk1Tw9fbk37Q==", 2024-04-25T02:29:12.688 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.689 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-04-25T02:29:12.689 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-04-25T02:29:12.689 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-25T02:29:12.689 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.689 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.689 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.689 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.3", 2024-04-25T02:29:12.689 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCdvylm1WACFhAAte7GQuyvfCJMxeh9rEUWhA==", 2024-04-25T02:29:12.689 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.689 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-04-25T02:29:12.689 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-04-25T02:29:12.689 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-25T02:29:12.689 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.689 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.690 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.690 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.4", 2024-04-25T02:29:12.690 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCjvylmgtybHBAAmtJjiAx82EohqvGBWTKXqA==", 2024-04-25T02:29:12.690 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.690 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-04-25T02:29:12.690 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-04-25T02:29:12.690 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-25T02:29:12.690 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.690 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.690 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.690 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.5", 2024-04-25T02:29:12.690 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCmvylmhp7nGhAA3Cdw9khlX/9iikvKPsvWKw==", 2024-04-25T02:29:12.690 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.690 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-04-25T02:29:12.691 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-04-25T02:29:12.691 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-25T02:29:12.691 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.691 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.691 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.691 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.6", 2024-04-25T02:29:12.691 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCpvylm2MFNGBAAAdNcsfOmnT5klPxzZnxs7w==", 2024-04-25T02:29:12.691 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.691 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-04-25T02:29:12.691 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-04-25T02:29:12.691 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-25T02:29:12.691 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.691 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.691 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.691 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.7", 2024-04-25T02:29:12.691 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCsvylmF+1vFhAAu5iJ9zpmTMMnG74d4D36NQ==", 2024-04-25T02:29:12.692 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.692 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-04-25T02:29:12.692 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-04-25T02:29:12.692 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-25T02:29:12.692 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.692 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.692 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.692 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.0", 2024-04-25T02:29:12.692 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCRvylm9w5GARAAYGhC/7jDn/aVYwTEFFwjyg==", 2024-04-25T02:29:12.692 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.692 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-04-25T02:29:12.692 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-04-25T02:29:12.692 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-04-25T02:29:12.692 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-04-25T02:29:12.693 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.693 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.693 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.693 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.1", 2024-04-25T02:29:12.693 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCRvylm4jbjCRAASo9ABKQGqafHuY2p5tuVsA==", 2024-04-25T02:29:12.693 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.693 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-04-25T02:29:12.693 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-04-25T02:29:12.693 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-04-25T02:29:12.693 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-04-25T02:29:12.693 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.693 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.693 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.693 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.2", 2024-04-25T02:29:12.693 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCRvylmyLfXBhAA12x/Rg+FGVCUOZlXmA1MmA==", 2024-04-25T02:29:12.694 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.694 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-04-25T02:29:12.694 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-04-25T02:29:12.694 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-04-25T02:29:12.694 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-04-25T02:29:12.694 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.694 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.694 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.694 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.3", 2024-04-25T02:29:12.694 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCRvylmmh9IDxAAV4Km22GhI1KEH6Wwaxo88A==", 2024-04-25T02:29:12.694 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.694 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-04-25T02:29:12.694 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-04-25T02:29:12.694 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-04-25T02:29:12.694 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-04-25T02:29:12.695 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.695 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.695 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.695 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.admin", 2024-04-25T02:29:12.695 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCQvylmiM+QCRAA9ei/v+DS2Ka6YJnqhBHioA==", 2024-04-25T02:29:12.695 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.695 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-04-25T02:29:12.695 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-04-25T02:29:12.695 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-04-25T02:29:12.695 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-25T02:29:12.695 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.695 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.695 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.695 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-mds", 2024-04-25T02:29:12.696 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCyvylm+K12CRAAi1Jr5ZkJ1KVuNfATOl5LlA==", 2024-04-25T02:29:12.696 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.696 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-mds" 2024-04-25T02:29:12.696 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.696 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.696 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.696 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-mgr", 2024-04-25T02:29:12.696 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCyvylmYbd2CRAAS8StIfl+bm9junlNjmlsXw==", 2024-04-25T02:29:12.696 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.696 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-25T02:29:12.696 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.696 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.696 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.696 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-osd", 2024-04-25T02:29:12.697 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCyvylmFb92CRAA+0eXkdKEyIpLnEdCRsev6Q==", 2024-04-25T02:29:12.697 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.697 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-osd" 2024-04-25T02:29:12.697 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.697 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.697 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.697 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-rbd", 2024-04-25T02:29:12.697 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCyvylmicZ2CRAA6QfWoqbtS7sLOhtDWMp1Hg==", 2024-04-25T02:29:12.697 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.697 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-25T02:29:12.697 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.697 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.697 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.698 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-25T02:29:12.698 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCyvylmps92CRAAeZhVo/jYB5kyeHyZUH9N5g==", 2024-04-25T02:29:12.698 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.698 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-25T02:29:12.698 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.698 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.698 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.698 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-rgw", 2024-04-25T02:29:12.698 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCyvylmc9d2CRAAg7d/YN2sjLWV1bBpX7g8wg==", 2024-04-25T02:29:12.698 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.698 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-25T02:29:12.698 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.698 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.698 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.698 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.x", 2024-04-25T02:29:12.699 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCQvylmxJaeIxAAzjrkU7jdyEC5YZkkq80ZZg==", 2024-04-25T02:29:12.699 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.699 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-04-25T02:29:12.699 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-04-25T02:29:12.699 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-25T02:29:12.699 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.699 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:12.699 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:12.699 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.y", 2024-04-25T02:29:12.699 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQCQvylmEjQmHxAARBqxaZnHoYMatA/pNB8vJA==", 2024-04-25T02:29:12.699 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-25T02:29:12.699 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-04-25T02:29:12.699 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-04-25T02:29:12.699 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-25T02:29:12.699 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.700 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:12.700 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-04-25T02:29:12.700 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-25T02:29:12.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.683+0000 7fe4ea2fc640 1 -- 172.21.15.67:0/1341582151 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe4d006be30 msgr2=0x7fe4d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:12.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.683+0000 7fe4ea2fc640 1 --2- 172.21.15.67:0/1341582151 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe4d006be30 0x7fe4d006e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8006fd0 tx=0x7fe4d8008040 comp rx=0 tx=0).stop 2024-04-25T02:29:12.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.683+0000 7fe4ea2fc640 1 -- 172.21.15.67:0/1341582151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4e4070df0 msgr2=0x7fe4e41f71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:12.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.683+0000 7fe4ea2fc640 1 --2- 172.21.15.67:0/1341582151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4e4070df0 0x7fe4e41f71a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400c400 tx=0x7fe4d400c8c0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.683+0000 7fe4ea2fc640 1 -- 172.21.15.67:0/1341582151 shutdown_connections 2024-04-25T02:29:12.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.683+0000 7fe4ea2fc640 1 --2- 172.21.15.67:0/1341582151 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe4d006be30 0x7fe4d006e2f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.683+0000 7fe4ea2fc640 1 --2- 172.21.15.67:0/1341582151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4e415b220 0x7fe4e406d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.683+0000 7fe4ea2fc640 1 --2- 172.21.15.67:0/1341582151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4e40b2cc0 0x7fe4e414f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.683+0000 7fe4ea2fc640 1 --2- 172.21.15.67:0/1341582151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4e4070df0 0x7fe4e41f71a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.683+0000 7fe4ea2fc640 1 -- 172.21.15.67:0/1341582151 >> 172.21.15.67:0/1341582151 conn(0x7fe4e40b19c0 msgr2=0x7fe4e40b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:12.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.683+0000 7fe4ea2fc640 1 -- 172.21.15.67:0/1341582151 shutdown_connections 2024-04-25T02:29:12.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.683+0000 7fe4ea2fc640 1 -- 172.21.15.67:0/1341582151 wait complete. 2024-04-25T02:29:12.702 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-25T02:29:12.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.801+0000 7f72c619e640 1 Processor -- start 2024-04-25T02:29:12.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.801+0000 7f72c619e640 1 -- start start 2024-04-25T02:29:12.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.802+0000 7f72c619e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c015e280 0x7f72c006bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:12.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.802+0000 7f72c619e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f72c0067200 0x7f72c00715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:12.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.802+0000 7f72c619e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72c006c9b0 con 0x7f72c015e660 2024-04-25T02:29:12.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.802+0000 7f72c619e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f72c006e990 con 0x7f72c0067200 2024-04-25T02:29:12.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.802+0000 7f72c619e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f72c006bc70 con 0x7f72c015e280 2024-04-25T02:29:12.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.802+0000 7f72bffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f72c0067200 0x7f72c00715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:12.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.802+0000 7f72bffff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f72c0067200 0x7f72c00715e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37620/0 (socket says 172.21.15.67:37620) 2024-04-25T02:29:12.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.802+0000 7f72bffff640 1 -- 172.21.15.67:0/1485834006 learned_addr learned my addr 172.21.15.67:0/1485834006 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:12.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.802+0000 7f72bf7fe640 1 --2- 172.21.15.67:0/1485834006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c015e280 0x7f72c006bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:12.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.802+0000 7f72bffff640 1 -- 172.21.15.67:0/1485834006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c015e280 msgr2=0x7f72c006bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:12.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.802+0000 7f72bffff640 1 --2- 172.21.15.67:0/1485834006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c015e280 0x7f72c006bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.802+0000 7f72bffff640 1 -- 172.21.15.67:0/1485834006 >> v1:172.21.15.176:6789/0 conn(0x7f72c015e660 legacy=0x7f72c006ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:12.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.802+0000 7f72bffff640 1 -- 172.21.15.67:0/1485834006 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c006e340 con 0x7f72c0067200 2024-04-25T02:29:12.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.802+0000 7f72bf7fe640 1 --2- 172.21.15.67:0/1485834006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c015e280 0x7f72c006bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:12.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.803+0000 7f72bffff640 1 --2- 172.21.15.67:0/1485834006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72c0067200 0x7f72c00715e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009e50 tx=0x7f72b802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bf6cfbfc1d500 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:12.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.803+0000 7f72be7fc640 1 -- 172.21.15.67:0/1485834006 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8036070 con 0x7f72c0067200 2024-04-25T02:29:12.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.803+0000 7f72be7fc640 1 -- 172.21.15.67:0/1485834006 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b8031600 con 0x7f72c0067200 2024-04-25T02:29:12.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.803+0000 7f72be7fc640 1 -- 172.21.15.67:0/1485834006 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b80319d0 con 0x7f72c0067200 2024-04-25T02:29:12.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.804+0000 7f72c619e640 1 -- 172.21.15.67:0/1485834006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72c0067200 msgr2=0x7f72c00715e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:12.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.804+0000 7f72c619e640 1 --2- 172.21.15.67:0/1485834006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72c0067200 0x7f72c00715e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009e50 tx=0x7f72b802a6c0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.804+0000 7f72c619e640 1 -- 172.21.15.67:0/1485834006 shutdown_connections 2024-04-25T02:29:12.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.804+0000 7f72c619e640 1 --2- 172.21.15.67:0/1485834006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72c0067200 0x7f72c00715e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.804+0000 7f72c619e640 1 --2- 172.21.15.67:0/1485834006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c015e280 0x7f72c006bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.804+0000 7f72c619e640 1 -- 172.21.15.67:0/1485834006 >> 172.21.15.67:0/1485834006 conn(0x7f72c00d04f0 msgr2=0x7f72c00d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:12.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.804+0000 7f72c619e640 1 -- 172.21.15.67:0/1485834006 shutdown_connections 2024-04-25T02:29:12.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.804+0000 7f72c619e640 1 -- 172.21.15.67:0/1485834006 wait complete. 2024-04-25T02:29:12.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.805+0000 7f72c619e640 1 Processor -- start 2024-04-25T02:29:12.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.805+0000 7f72c619e640 1 -- start start 2024-04-25T02:29:12.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.806+0000 7f72c619e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72c0067200 0x7f72c0155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:12.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.806+0000 7f72c619e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c015e280 0x7f72c015a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:12.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.806+0000 7f72c619e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72c015e660 0x7f72c015a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:12.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.806+0000 7f72c619e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f72c0071b20 con 0x7f72c015e660 2024-04-25T02:29:12.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.806+0000 7f72c619e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f72c006c450 con 0x7f72c0067200 2024-04-25T02:29:12.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.806+0000 7f72c619e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f72c0071ca0 con 0x7f72c015e280 2024-04-25T02:29:12.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.806+0000 7f72bffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72c015e660 0x7f72c015a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:12.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.806+0000 7f72bffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72c015e660 0x7f72c015a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37632/0 (socket says 172.21.15.67:37632) 2024-04-25T02:29:12.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.806+0000 7f72bffff640 1 -- 172.21.15.67:0/2311468961 learned_addr learned my addr 172.21.15.67:0/2311468961 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:12.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.806+0000 7f72beffd640 1 --2- 172.21.15.67:0/2311468961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c015e280 0x7f72c015a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:12.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.806+0000 7f72bf7fe640 1 --2- 172.21.15.67:0/2311468961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72c0067200 0x7f72c0155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:12.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.806+0000 7f72bffff640 1 -- 172.21.15.67:0/2311468961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c015e280 msgr2=0x7f72c015a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:12.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.806+0000 7f72bffff640 1 --2- 172.21.15.67:0/2311468961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c015e280 0x7f72c015a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.806+0000 7f72bffff640 1 -- 172.21.15.67:0/2311468961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72c0067200 msgr2=0x7f72c0155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:12.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.806+0000 7f72bffff640 1 --2- 172.21.15.67:0/2311468961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72c0067200 0x7f72c0155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:12.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.806+0000 7f72bffff640 1 -- 172.21.15.67:0/2311468961 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c0153ce0 con 0x7f72c015e660 2024-04-25T02:29:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.806+0000 7f72bffff640 1 --2- 172.21.15.67:0/2311468961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72c015e660 0x7f72c015a8c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009e50 tx=0x7f72b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.807+0000 7f72a7fff640 1 -- 172.21.15.67:0/2311468961 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8036050 con 0x7f72c015e660 2024-04-25T02:29:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.807+0000 7f72a7fff640 1 -- 172.21.15.67:0/2311468961 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b8042070 con 0x7f72c015e660 2024-04-25T02:29:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.807+0000 7f72c619e640 1 -- 172.21.15.67:0/2311468961 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c0153a00 con 0x7f72c015e660 2024-04-25T02:29:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.807+0000 7f72a7fff640 1 -- 172.21.15.67:0/2311468961 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8009510 con 0x7f72c015e660 2024-04-25T02:29:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.807+0000 7f72c619e640 1 -- 172.21.15.67:0/2311468961 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c015b460 con 0x7f72c015e660 2024-04-25T02:29:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.808+0000 7f72c619e640 1 -- 172.21.15.67:0/2311468961 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c0069110 con 0x7f72c015e660 2024-04-25T02:29:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.808+0000 7f72a7fff640 1 -- 172.21.15.67:0/2311468961 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72b8007bd0 con 0x7f72c015e660 2024-04-25T02:29:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.809+0000 7f72a7fff640 1 --2- 172.21.15.67:0/2311468961 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f72ac06be60 0x7f72ac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.809+0000 7f72a7fff640 1 -- 172.21.15.67:0/2311468961 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f72b80ab9b0 con 0x7f72c015e660 2024-04-25T02:29:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.809+0000 7f72bf7fe640 1 --2- 172.21.15.67:0/2311468961 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f72ac06be60 0x7f72ac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:12.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.809+0000 7f72bf7fe640 1 --2- 172.21.15.67:0/2311468961 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f72ac06be60 0x7f72ac06e320 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f72b000a990 tx=0x7f72b0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:12.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:12.813+0000 7f72a7fff640 1 -- 172.21.15.67:0/2311468961 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f72b8045360 con 0x7f72c015e660 2024-04-25T02:29:13.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.072+0000 7f72c619e640 1 -- 172.21.15.67:0/2311468961 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f72c0066fe0 con 0x7f72c015e660 2024-04-25T02:29:13.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.074+0000 7f72a7fff640 1 -- 172.21.15.67:0/2311468961 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f72b807a740 con 0x7f72c015e660 2024-04-25T02:29:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.076+0000 7f72c619e640 1 -- 172.21.15.67:0/2311468961 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f72ac06be60 msgr2=0x7f72ac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.076+0000 7f72c619e640 1 --2- 172.21.15.67:0/2311468961 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f72ac06be60 0x7f72ac06e320 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f72b000a990 tx=0x7f72b0008040 comp rx=0 tx=0).stop 2024-04-25T02:29:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.076+0000 7f72c619e640 1 -- 172.21.15.67:0/2311468961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72c015e660 msgr2=0x7f72c015a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.076+0000 7f72c619e640 1 --2- 172.21.15.67:0/2311468961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72c015e660 0x7f72c015a8c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009e50 tx=0x7f72b8004a40 comp rx=0 tx=0).stop 2024-04-25T02:29:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.076+0000 7f72c619e640 1 -- 172.21.15.67:0/2311468961 shutdown_connections 2024-04-25T02:29:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.076+0000 7f72c619e640 1 --2- 172.21.15.67:0/2311468961 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f72ac06be60 0x7f72ac06e320 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.076+0000 7f72c619e640 1 --2- 172.21.15.67:0/2311468961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72c015e660 0x7f72c015a8c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.076+0000 7f72c619e640 1 --2- 172.21.15.67:0/2311468961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72c015e280 0x7f72c015a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.076+0000 7f72c619e640 1 --2- 172.21.15.67:0/2311468961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72c0067200 0x7f72c0155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.076+0000 7f72c619e640 1 -- 172.21.15.67:0/2311468961 >> 172.21.15.67:0/2311468961 conn(0x7f72c00d04f0 msgr2=0x7f72c006b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:13.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.076+0000 7f72c619e640 1 -- 172.21.15.67:0/2311468961 shutdown_connections 2024-04-25T02:29:13.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.076+0000 7f72c619e640 1 -- 172.21.15.67:0/2311468961 wait complete. 2024-04-25T02:29:13.089 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-25T02:29:13.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.188+0000 7f607f761640 1 Processor -- start 2024-04-25T02:29:13.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.188+0000 7f607f761640 1 -- start start 2024-04-25T02:29:13.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.189+0000 7f607f761640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6078070df0 0x7f607815f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:13.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.189+0000 7f607f761640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60780b2cc0 0x7f60780b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:13.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.189+0000 7f607f761640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60780713d0 con 0x7f607815b220 2024-04-25T02:29:13.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.189+0000 7f607f761640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f60780aee00 con 0x7f6078070df0 2024-04-25T02:29:13.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.189+0000 7f607f761640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f60780ae4d0 con 0x7f60780b2cc0 2024-04-25T02:29:13.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.189+0000 7f607ccfc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6078070df0 0x7f607815f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:13.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.189+0000 7f607ccfc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6078070df0 0x7f607815f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37636/0 (socket says 172.21.15.67:37636) 2024-04-25T02:29:13.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.189+0000 7f607ccfc640 1 -- 172.21.15.67:0/200708602 learned_addr learned my addr 172.21.15.67:0/200708602 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:13.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.189+0000 7f607dcfe640 1 --2- 172.21.15.67:0/200708602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60780b2cc0 0x7f60780b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:13.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.189+0000 7f607ccfc640 1 -- 172.21.15.67:0/200708602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60780b2cc0 msgr2=0x7f60780b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:13.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.189+0000 7f607ccfc640 1 --2- 172.21.15.67:0/200708602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60780b2cc0 0x7f60780b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.189+0000 7f607ccfc640 1 -- 172.21.15.67:0/200708602 >> v1:172.21.15.176:6789/0 conn(0x7f607815b220 legacy=0x7f607815ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:13.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.189+0000 7f607ccfc640 1 -- 172.21.15.67:0/200708602 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60780ae7b0 con 0x7f6078070df0 2024-04-25T02:29:13.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.190+0000 7f607ccfc640 1 --2- 172.21.15.67:0/200708602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6078070df0 0x7f607815f380 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6068009870 tx=0x7f606802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf93e4a20ef932a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:13.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.190+0000 7f606ffff640 1 -- 172.21.15.67:0/200708602 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6068037070 con 0x7f6078070df0 2024-04-25T02:29:13.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.190+0000 7f606ffff640 1 -- 172.21.15.67:0/200708602 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6068032440 con 0x7f6078070df0 2024-04-25T02:29:13.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.190+0000 7f606ffff640 1 -- 172.21.15.67:0/200708602 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6068032810 con 0x7f6078070df0 2024-04-25T02:29:13.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.190+0000 7f607f761640 1 -- 172.21.15.67:0/200708602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6078070df0 msgr2=0x7f607815f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.190+0000 7f607f761640 1 --2- 172.21.15.67:0/200708602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6078070df0 0x7f607815f380 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6068009870 tx=0x7f606802a270 comp rx=0 tx=0).stop 2024-04-25T02:29:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.191+0000 7f607f761640 1 -- 172.21.15.67:0/200708602 shutdown_connections 2024-04-25T02:29:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.191+0000 7f607f761640 1 --2- 172.21.15.67:0/200708602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60780b2cc0 0x7f60780b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.191+0000 7f607f761640 1 --2- 172.21.15.67:0/200708602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6078070df0 0x7f607815f380 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.191+0000 7f607f761640 1 -- 172.21.15.67:0/200708602 >> 172.21.15.67:0/200708602 conn(0x7f60780b19c0 msgr2=0x7f60780b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.191+0000 7f607f761640 1 -- 172.21.15.67:0/200708602 shutdown_connections 2024-04-25T02:29:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.191+0000 7f607f761640 1 -- 172.21.15.67:0/200708602 wait complete. 2024-04-25T02:29:13.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.192+0000 7f607f761640 1 Processor -- start 2024-04-25T02:29:13.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.192+0000 7f607f761640 1 -- start start 2024-04-25T02:29:13.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.192+0000 7f607f761640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6078070df0 0x7f60781f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:13.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.192+0000 7f607f761640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60780b2cc0 0x7f60781f85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:13.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.192+0000 7f607f761640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f607815b220 0x7f60780ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:13.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.193+0000 7f607f761640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f607806ed10 con 0x7f60780b2cc0 2024-04-25T02:29:13.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.193+0000 7f607f761640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f607806eb90 con 0x7f6078070df0 2024-04-25T02:29:13.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.193+0000 7f607f761640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f607815f8c0 con 0x7f607815b220 2024-04-25T02:29:13.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.193+0000 7f607ccfc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60780b2cc0 0x7f60781f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:13.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.193+0000 7f607ccfc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60780b2cc0 0x7f60781f85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37652/0 (socket says 172.21.15.67:37652) 2024-04-25T02:29:13.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.193+0000 7f607ccfc640 1 -- 172.21.15.67:0/2417893446 learned_addr learned my addr 172.21.15.67:0/2417893446 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:13.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.193+0000 7f607d4fd640 1 --2- 172.21.15.67:0/2417893446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6078070df0 0x7f60781f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:13.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.193+0000 7f607dcfe640 1 --2- 172.21.15.67:0/2417893446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f607815b220 0x7f60780ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:13.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.193+0000 7f607ccfc640 1 -- 172.21.15.67:0/2417893446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f607815b220 msgr2=0x7f60780ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:13.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.193+0000 7f607ccfc640 1 --2- 172.21.15.67:0/2417893446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f607815b220 0x7f60780ce530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.193+0000 7f607ccfc640 1 -- 172.21.15.67:0/2417893446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6078070df0 msgr2=0x7f60781f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:13.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.193+0000 7f607ccfc640 1 --2- 172.21.15.67:0/2417893446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6078070df0 0x7f60781f54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.193+0000 7f607ccfc640 1 -- 172.21.15.67:0/2417893446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60781f46a0 con 0x7f60780b2cc0 2024-04-25T02:29:13.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.193+0000 7f607ccfc640 1 --2- 172.21.15.67:0/2417893446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60780b2cc0 0x7f60781f85a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f606802a2b0 tx=0x7f60680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:13.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.193+0000 7f606dffb640 1 -- 172.21.15.67:0/2417893446 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6068041020 con 0x7f60780b2cc0 2024-04-25T02:29:13.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.193+0000 7f606dffb640 1 -- 172.21.15.67:0/2417893446 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60680306c0 con 0x7f60780b2cc0 2024-04-25T02:29:13.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.193+0000 7f606dffb640 1 -- 172.21.15.67:0/2417893446 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6068037040 con 0x7f60780b2cc0 2024-04-25T02:29:13.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.193+0000 7f607f761640 1 -- 172.21.15.67:0/2417893446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60781f4960 con 0x7f60780b2cc0 2024-04-25T02:29:13.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.194+0000 7f607f761640 1 -- 172.21.15.67:0/2417893446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60781f4f20 con 0x7f60780b2cc0 2024-04-25T02:29:13.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.194+0000 7f607f761640 1 -- 172.21.15.67:0/2417893446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60780af290 con 0x7f60780b2cc0 2024-04-25T02:29:13.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.195+0000 7f606dffb640 1 -- 172.21.15.67:0/2417893446 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6068044020 con 0x7f60780b2cc0 2024-04-25T02:29:13.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.195+0000 7f606dffb640 1 --2- 172.21.15.67:0/2417893446 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f605c06be30 0x7f605c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:13.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.195+0000 7f606dffb640 1 -- 172.21.15.67:0/2417893446 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f60680ab2d0 con 0x7f60780b2cc0 2024-04-25T02:29:13.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.196+0000 7f607d4fd640 1 --2- 172.21.15.67:0/2417893446 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f605c06be30 0x7f605c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:13.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.196+0000 7f607d4fd640 1 --2- 172.21.15.67:0/2417893446 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f605c06be30 0x7f605c06e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6074001500 tx=0x7f6074009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:13.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.200+0000 7f606dffb640 1 -- 172.21.15.67:0/2417893446 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f60780af290 con 0x7f60780b2cc0 2024-04-25T02:29:13.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.457+0000 7f607f761640 1 -- 172.21.15.67:0/2417893446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f6078069110 con 0x7f60780b2cc0 2024-04-25T02:29:13.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.459+0000 7f606dffb640 1 -- 172.21.15.67:0/2417893446 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f606804b030 con 0x7f60780b2cc0 2024-04-25T02:29:13.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.461+0000 7f607f761640 1 -- 172.21.15.67:0/2417893446 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f605c06be30 msgr2=0x7f605c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:13.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.461+0000 7f607f761640 1 --2- 172.21.15.67:0/2417893446 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f605c06be30 0x7f605c06e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6074001500 tx=0x7f6074009040 comp rx=0 tx=0).stop 2024-04-25T02:29:13.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.461+0000 7f607f761640 1 -- 172.21.15.67:0/2417893446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60780b2cc0 msgr2=0x7f60781f85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:13.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.461+0000 7f607f761640 1 --2- 172.21.15.67:0/2417893446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60780b2cc0 0x7f60781f85a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f606802a2b0 tx=0x7f60680046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.461+0000 7f607f761640 1 -- 172.21.15.67:0/2417893446 shutdown_connections 2024-04-25T02:29:13.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.461+0000 7f607f761640 1 --2- 172.21.15.67:0/2417893446 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f605c06be30 0x7f605c06e2f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.461+0000 7f607f761640 1 --2- 172.21.15.67:0/2417893446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f607815b220 0x7f60780ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.461+0000 7f607f761640 1 --2- 172.21.15.67:0/2417893446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60780b2cc0 0x7f60781f85a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.461+0000 7f607f761640 1 --2- 172.21.15.67:0/2417893446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6078070df0 0x7f60781f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.461+0000 7f607f761640 1 -- 172.21.15.67:0/2417893446 >> 172.21.15.67:0/2417893446 conn(0x7f60780b19c0 msgr2=0x7f60780b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:13.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.461+0000 7f607f761640 1 -- 172.21.15.67:0/2417893446 shutdown_connections 2024-04-25T02:29:13.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.461+0000 7f607f761640 1 -- 172.21.15.67:0/2417893446 wait complete. 2024-04-25T02:29:13.475 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-25T02:29:13.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.573+0000 7f9cf5f9e640 1 Processor -- start 2024-04-25T02:29:13.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.573+0000 7f9cf5f9e640 1 -- start start 2024-04-25T02:29:13.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.573+0000 7f9cf5f9e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9cf015e210 0x7f9cf006cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:13.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.573+0000 7f9cf5f9e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9cf015e5f0 0x7f9cf006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:13.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.573+0000 7f9cf5f9e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cf00d2cc0 con 0x7f9cf00cecc0 2024-04-25T02:29:13.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.573+0000 7f9cf5f9e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f9cf006c6f0 con 0x7f9cf015e210 2024-04-25T02:29:13.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.573+0000 7f9cf5f9e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9cf00d2fa0 con 0x7f9cf015e5f0 2024-04-25T02:29:13.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.574+0000 7f9cef7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9cf015e210 0x7f9cf006cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:13.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.574+0000 7f9cef7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9cf015e210 0x7f9cf006cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37662/0 (socket says 172.21.15.67:37662) 2024-04-25T02:29:13.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.574+0000 7f9cef7fe640 1 -- 172.21.15.67:0/2177137150 learned_addr learned my addr 172.21.15.67:0/2177137150 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:13.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.574+0000 7f9ceeffd640 1 --2- 172.21.15.67:0/2177137150 >> v2:172.21.15.176:3300/0 conn(0x7f9cf015e5f0 0x7f9cf006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:13.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.574+0000 7f9cef7fe640 1 -- 172.21.15.67:0/2177137150 >> v2:172.21.15.176:3300/0 conn(0x7f9cf015e5f0 msgr2=0x7f9cf006d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:13.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.574+0000 7f9cef7fe640 1 --2- 172.21.15.67:0/2177137150 >> v2:172.21.15.176:3300/0 conn(0x7f9cf015e5f0 0x7f9cf006d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.574+0000 7f9cef7fe640 1 -- 172.21.15.67:0/2177137150 >> v1:172.21.15.176:6789/0 conn(0x7f9cf00cecc0 legacy=0x7f9cf00d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:13.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.574+0000 7f9cef7fe640 1 -- 172.21.15.67:0/2177137150 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf006c0a0 con 0x7f9cf015e210 2024-04-25T02:29:13.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.575+0000 7f9cef7fe640 1 --2- 172.21.15.67:0/2177137150 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cf015e210 0x7f9cf006cb80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009870 tx=0x7f9ce002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2680e621173b6a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:13.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.575+0000 7f9cee7fc640 1 -- 172.21.15.67:0/2177137150 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0037070 con 0x7f9cf015e210 2024-04-25T02:29:13.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.575+0000 7f9cee7fc640 1 -- 172.21.15.67:0/2177137150 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce0032440 con 0x7f9cf015e210 2024-04-25T02:29:13.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.575+0000 7f9cee7fc640 1 -- 172.21.15.67:0/2177137150 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0032810 con 0x7f9cf015e210 2024-04-25T02:29:13.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.575+0000 7f9cf5f9e640 1 -- 172.21.15.67:0/2177137150 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cf015e210 msgr2=0x7f9cf006cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:13.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.575+0000 7f9cf5f9e640 1 --2- 172.21.15.67:0/2177137150 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cf015e210 0x7f9cf006cb80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009870 tx=0x7f9ce002a270 comp rx=0 tx=0).stop 2024-04-25T02:29:13.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.575+0000 7f9cf5f9e640 1 -- 172.21.15.67:0/2177137150 shutdown_connections 2024-04-25T02:29:13.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.575+0000 7f9cf5f9e640 1 --2- 172.21.15.67:0/2177137150 >> v2:172.21.15.176:3300/0 conn(0x7f9cf015e5f0 0x7f9cf006d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.575+0000 7f9cf5f9e640 1 --2- 172.21.15.67:0/2177137150 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cf015e210 0x7f9cf006cb80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.575+0000 7f9cf5f9e640 1 -- 172.21.15.67:0/2177137150 >> 172.21.15.67:0/2177137150 conn(0x7f9cf008dbb0 msgr2=0x7f9cf009d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:13.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.575+0000 7f9cf5f9e640 1 -- 172.21.15.67:0/2177137150 shutdown_connections 2024-04-25T02:29:13.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.575+0000 7f9cf5f9e640 1 -- 172.21.15.67:0/2177137150 wait complete. 2024-04-25T02:29:13.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.576+0000 7f9cf5f9e640 1 Processor -- start 2024-04-25T02:29:13.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.577+0000 7f9cf5f9e640 1 -- start start 2024-04-25T02:29:13.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.577+0000 7f9cf5f9e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9cf00cecc0 0x7f9cf01597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:13.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.577+0000 7f9cf5f9e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9cf015e210 0x7f9cf00b9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:13.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.577+0000 7f9cf5f9e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cf015e5f0 0x7f9cf00cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:13.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.577+0000 7f9cf5f9e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf00d46f0 con 0x7f9cf015e5f0 2024-04-25T02:29:13.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.577+0000 7f9cf5f9e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf00d4570 con 0x7f9cf00cecc0 2024-04-25T02:29:13.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.577+0000 7f9cf5f9e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9cf00d4870 con 0x7f9cf015e210 2024-04-25T02:29:13.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.578+0000 7f9ceffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cf015e5f0 0x7f9cf00cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:13.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.578+0000 7f9ceffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cf015e5f0 0x7f9cf00cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37672/0 (socket says 172.21.15.67:37672) 2024-04-25T02:29:13.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.578+0000 7f9ceffff640 1 -- 172.21.15.67:0/2431967599 learned_addr learned my addr 172.21.15.67:0/2431967599 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:13.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.578+0000 7f9ceeffd640 1 --2- 172.21.15.67:0/2431967599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9cf015e210 0x7f9cf00b9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:13.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.578+0000 7f9cef7fe640 1 --2- 172.21.15.67:0/2431967599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9cf00cecc0 0x7f9cf01597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:13.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.578+0000 7f9ceffff640 1 -- 172.21.15.67:0/2431967599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9cf015e210 msgr2=0x7f9cf00b9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:13.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.578+0000 7f9ceffff640 1 --2- 172.21.15.67:0/2431967599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9cf015e210 0x7f9cf00b9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.578+0000 7f9ceffff640 1 -- 172.21.15.67:0/2431967599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9cf00cecc0 msgr2=0x7f9cf01597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:13.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.578+0000 7f9ceffff640 1 --2- 172.21.15.67:0/2431967599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9cf00cecc0 0x7f9cf01597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.578+0000 7f9ceffff640 1 -- 172.21.15.67:0/2431967599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf015b9d0 con 0x7f9cf015e5f0 2024-04-25T02:29:13.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.578+0000 7f9ceffff640 1 --2- 172.21.15.67:0/2431967599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cf015e5f0 0x7f9cf00cc870 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800b9a0 tx=0x7f9ce800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:13.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.578+0000 7f9cd7fff640 1 -- 172.21.15.67:0/2431967599 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8019070 con 0x7f9cf015e5f0 2024-04-25T02:29:13.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.578+0000 7f9cd7fff640 1 -- 172.21.15.67:0/2431967599 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce800cba0 con 0x7f9cf015e5f0 2024-04-25T02:29:13.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.578+0000 7f9cf5f9e640 1 -- 172.21.15.67:0/2431967599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf015a930 con 0x7f9cf015e5f0 2024-04-25T02:29:13.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.578+0000 7f9cd7fff640 1 -- 172.21.15.67:0/2431967599 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8014440 con 0x7f9cf015e5f0 2024-04-25T02:29:13.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.578+0000 7f9cf5f9e640 1 -- 172.21.15.67:0/2431967599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf015aef0 con 0x7f9cf015e5f0 2024-04-25T02:29:13.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.579+0000 7f9cf5f9e640 1 -- 172.21.15.67:0/2431967599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cf0069110 con 0x7f9cf015e5f0 2024-04-25T02:29:13.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.580+0000 7f9cd7fff640 1 -- 172.21.15.67:0/2431967599 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ce801c070 con 0x7f9cf015e5f0 2024-04-25T02:29:13.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.580+0000 7f9cd7fff640 1 --2- 172.21.15.67:0/2431967599 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9cdc06be30 0x7f9cdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:13.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.580+0000 7f9cd7fff640 1 -- 172.21.15.67:0/2431967599 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f9ce808a5f0 con 0x7f9cf015e5f0 2024-04-25T02:29:13.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.580+0000 7f9cef7fe640 1 --2- 172.21.15.67:0/2431967599 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9cdc06be30 0x7f9cdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:13.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.581+0000 7f9cef7fe640 1 --2- 172.21.15.67:0/2431967599 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9cdc06be30 0x7f9cdc06e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0034000 tx=0x7f9ce002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:13.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.584+0000 7f9cd7fff640 1 -- 172.21.15.67:0/2431967599 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9ce8058d30 con 0x7f9cf015e5f0 2024-04-25T02:29:13.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.840+0000 7f9cf5f9e640 1 -- 172.21.15.67:0/2431967599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f9cf015da30 con 0x7f9cf015e5f0 2024-04-25T02:29:13.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.843+0000 7f9cd7fff640 1 -- 172.21.15.67:0/2431967599 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f9ce805d030 con 0x7f9cf015e5f0 2024-04-25T02:29:13.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.844+0000 7f9cf5f9e640 1 -- 172.21.15.67:0/2431967599 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9cdc06be30 msgr2=0x7f9cdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:13.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.844+0000 7f9cf5f9e640 1 --2- 172.21.15.67:0/2431967599 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9cdc06be30 0x7f9cdc06e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0034000 tx=0x7f9ce002e000 comp rx=0 tx=0).stop 2024-04-25T02:29:13.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.844+0000 7f9cf5f9e640 1 -- 172.21.15.67:0/2431967599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cf015e5f0 msgr2=0x7f9cf00cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:13.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.844+0000 7f9cf5f9e640 1 --2- 172.21.15.67:0/2431967599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cf015e5f0 0x7f9cf00cc870 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800b9a0 tx=0x7f9ce800be60 comp rx=0 tx=0).stop 2024-04-25T02:29:13.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.845+0000 7f9cf5f9e640 1 -- 172.21.15.67:0/2431967599 shutdown_connections 2024-04-25T02:29:13.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.845+0000 7f9cf5f9e640 1 --2- 172.21.15.67:0/2431967599 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9cdc06be30 0x7f9cdc06e2f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.845+0000 7f9cf5f9e640 1 --2- 172.21.15.67:0/2431967599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cf015e5f0 0x7f9cf00cc870 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.845+0000 7f9cf5f9e640 1 --2- 172.21.15.67:0/2431967599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9cf015e210 0x7f9cf00b9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.845+0000 7f9cf5f9e640 1 --2- 172.21.15.67:0/2431967599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9cf00cecc0 0x7f9cf01597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.845+0000 7f9cf5f9e640 1 -- 172.21.15.67:0/2431967599 >> 172.21.15.67:0/2431967599 conn(0x7f9cf008dbb0 msgr2=0x7f9cf015fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:13.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.845+0000 7f9cf5f9e640 1 -- 172.21.15.67:0/2431967599 shutdown_connections 2024-04-25T02:29:13.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.845+0000 7f9cf5f9e640 1 -- 172.21.15.67:0/2431967599 wait complete. 2024-04-25T02:29:13.859 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-25T02:29:13.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.958+0000 7f24daecd640 1 Processor -- start 2024-04-25T02:29:13.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.958+0000 7f24daecd640 1 -- start start 2024-04-25T02:29:13.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.958+0000 7f24daecd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f24d415c230 0x7f24d4071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:13.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.959+0000 7f24daecd640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d4160b20 con 0x7f24d40af120 2024-04-25T02:29:13.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.959+0000 7f24daecd640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d40ad230 con 0x7f24d40acda0 2024-04-25T02:29:13.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.959+0000 7f24daecd640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f24d415c610 con 0x7f24d415c230 2024-04-25T02:29:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.959+0000 7f24d8c69640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f24d415c230 0x7f24d4071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.959+0000 7f24d946a640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f24d40af120 0x7f24d406cb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49362/0 (socket says 172.21.15.67:49362) 2024-04-25T02:29:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.959+0000 7f24d946a640 1 -- 172.21.15.67:0/1564997475 learned_addr learned my addr 172.21.15.67:0/1564997475 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.959+0000 7f24d8c69640 1 -- 172.21.15.67:0/1564997475 >> v1:172.21.15.176:6789/0 conn(0x7f24d40acda0 legacy=0x7f24d40aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.959+0000 7f24d8c69640 1 -- 172.21.15.67:0/1564997475 >> v1:172.21.15.67:6789/0 conn(0x7f24d40af120 legacy=0x7f24d406cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.959+0000 7f24d37fe640 1 -- 172.21.15.67:0/1564997475 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1686630757 0 0) 0x7f24d4160b20 con 0x7f24d40af120 2024-04-25T02:29:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.959+0000 7f24d8c69640 1 -- 172.21.15.67:0/1564997475 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d415fd60 con 0x7f24d415c230 2024-04-25T02:29:13.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.960+0000 7f24d8c69640 1 --2- 172.21.15.67:0/1564997475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d415c230 0x7f24d4071800 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f24c80097a0 tx=0x7f24c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07ff7ce20cf617e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:13.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.960+0000 7f24d37fe640 1 -- 172.21.15.67:0/1564997475 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c8037070 con 0x7f24d415c230 2024-04-25T02:29:13.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.960+0000 7f24d37fe640 1 -- 172.21.15.67:0/1564997475 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c8032440 con 0x7f24d415c230 2024-04-25T02:29:13.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.960+0000 7f24d37fe640 1 -- 172.21.15.67:0/1564997475 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c8032810 con 0x7f24d415c230 2024-04-25T02:29:13.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.960+0000 7f24daecd640 1 -- 172.21.15.67:0/1564997475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d415c230 msgr2=0x7f24d4071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:13.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.960+0000 7f24daecd640 1 --2- 172.21.15.67:0/1564997475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d415c230 0x7f24d4071800 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f24c80097a0 tx=0x7f24c802a1e0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.960+0000 7f24daecd640 1 -- 172.21.15.67:0/1564997475 shutdown_connections 2024-04-25T02:29:13.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.960+0000 7f24daecd640 1 --2- 172.21.15.67:0/1564997475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d415c230 0x7f24d4071800 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.960+0000 7f24daecd640 1 -- 172.21.15.67:0/1564997475 >> 172.21.15.67:0/1564997475 conn(0x7f24d40b19c0 msgr2=0x7f24d40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:13.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.960+0000 7f24daecd640 1 -- 172.21.15.67:0/1564997475 shutdown_connections 2024-04-25T02:29:13.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.960+0000 7f24daecd640 1 -- 172.21.15.67:0/1564997475 wait complete. 2024-04-25T02:29:13.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.962+0000 7f24daecd640 1 Processor -- start 2024-04-25T02:29:13.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.962+0000 7f24daecd640 1 -- start start 2024-04-25T02:29:13.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.962+0000 7f24daecd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24d40acda0 0x7f24d4151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:13.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24daecd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d40af120 0x7f24d415f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:13.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24daecd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24d415c230 0x7f24d415d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:13.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24daecd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f24d4160600 con 0x7f24d40af120 2024-04-25T02:29:13.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24daecd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f24d4160320 con 0x7f24d40acda0 2024-04-25T02:29:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24daecd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f24d40ad4d0 con 0x7f24d415c230 2024-04-25T02:29:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24d3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d40af120 0x7f24d415f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24d3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d40af120 0x7f24d415f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37688/0 (socket says 172.21.15.67:37688) 2024-04-25T02:29:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24d3fff640 1 -- 172.21.15.67:0/3400324971 learned_addr learned my addr 172.21.15.67:0/3400324971 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24d8c69640 1 --2- 172.21.15.67:0/3400324971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24d40acda0 0x7f24d4151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24d946a640 1 --2- 172.21.15.67:0/3400324971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24d415c230 0x7f24d415d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24d3fff640 1 -- 172.21.15.67:0/3400324971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24d415c230 msgr2=0x7f24d415d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24d3fff640 1 --2- 172.21.15.67:0/3400324971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24d415c230 0x7f24d415d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24d3fff640 1 -- 172.21.15.67:0/3400324971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24d40acda0 msgr2=0x7f24d4151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24d3fff640 1 --2- 172.21.15.67:0/3400324971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24d40acda0 0x7f24d4151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24d3fff640 1 -- 172.21.15.67:0/3400324971 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d409c7c0 con 0x7f24d40af120 2024-04-25T02:29:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24d3fff640 1 --2- 172.21.15.67:0/3400324971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d40af120 0x7f24d415f030 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f24c000c430 tx=0x7f24c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24d17fa640 1 -- 172.21.15.67:0/3400324971 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c0011790 con 0x7f24d40af120 2024-04-25T02:29:13.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24d17fa640 1 -- 172.21.15.67:0/3400324971 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c0017070 con 0x7f24d40af120 2024-04-25T02:29:13.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24d17fa640 1 -- 172.21.15.67:0/3400324971 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c0011bb0 con 0x7f24d40af120 2024-04-25T02:29:13.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24daecd640 1 -- 172.21.15.67:0/3400324971 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d409caa0 con 0x7f24d40af120 2024-04-25T02:29:13.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.963+0000 7f24daecd640 1 -- 172.21.15.67:0/3400324971 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d409aba0 con 0x7f24d40af120 2024-04-25T02:29:13.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.964+0000 7f24daecd640 1 -- 172.21.15.67:0/3400324971 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d4069110 con 0x7f24d40af120 2024-04-25T02:29:13.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.965+0000 7f24d17fa640 1 -- 172.21.15.67:0/3400324971 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f24c001c460 con 0x7f24d40af120 2024-04-25T02:29:13.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.965+0000 7f24d17fa640 1 --2- 172.21.15.67:0/3400324971 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f24b806be30 0x7f24b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:13.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.965+0000 7f24d17fa640 1 -- 172.21.15.67:0/3400324971 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f24c008a910 con 0x7f24d40af120 2024-04-25T02:29:13.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.965+0000 7f24d8c69640 1 --2- 172.21.15.67:0/3400324971 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f24b806be30 0x7f24b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:13.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.966+0000 7f24d8c69640 1 --2- 172.21.15.67:0/3400324971 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f24b806be30 0x7f24b806e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f24c8034000 tx=0x7f24c802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:13.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:13.969+0000 7f24d17fa640 1 -- 172.21.15.67:0/3400324971 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f24c00596a0 con 0x7f24d40af120 2024-04-25T02:29:14.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.222+0000 7f24daecd640 1 -- 172.21.15.67:0/3400324971 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f24d415a600 con 0x7f24d40af120 2024-04-25T02:29:14.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.224+0000 7f24d17fa640 1 -- 172.21.15.67:0/3400324971 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f24c0058fa0 con 0x7f24d40af120 2024-04-25T02:29:14.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.226+0000 7f24daecd640 1 -- 172.21.15.67:0/3400324971 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f24b806be30 msgr2=0x7f24b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:14.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.226+0000 7f24daecd640 1 --2- 172.21.15.67:0/3400324971 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f24b806be30 0x7f24b806e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f24c8034000 tx=0x7f24c802e000 comp rx=0 tx=0).stop 2024-04-25T02:29:14.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.226+0000 7f24daecd640 1 -- 172.21.15.67:0/3400324971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d40af120 msgr2=0x7f24d415f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:14.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.226+0000 7f24daecd640 1 --2- 172.21.15.67:0/3400324971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d40af120 0x7f24d415f030 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f24c000c430 tx=0x7f24c000c8f0 comp rx=0 tx=0).stop 2024-04-25T02:29:14.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.226+0000 7f24daecd640 1 -- 172.21.15.67:0/3400324971 shutdown_connections 2024-04-25T02:29:14.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.226+0000 7f24daecd640 1 --2- 172.21.15.67:0/3400324971 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f24b806be30 0x7f24b806e2f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:14.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.226+0000 7f24daecd640 1 --2- 172.21.15.67:0/3400324971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24d415c230 0x7f24d415d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:14.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.226+0000 7f24daecd640 1 --2- 172.21.15.67:0/3400324971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d40af120 0x7f24d415f030 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:14.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.226+0000 7f24daecd640 1 --2- 172.21.15.67:0/3400324971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24d40acda0 0x7f24d4151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:14.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.226+0000 7f24daecd640 1 -- 172.21.15.67:0/3400324971 >> 172.21.15.67:0/3400324971 conn(0x7f24d40b19c0 msgr2=0x7f24d415ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:14.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.226+0000 7f24daecd640 1 -- 172.21.15.67:0/3400324971 shutdown_connections 2024-04-25T02:29:14.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.226+0000 7f24daecd640 1 -- 172.21.15.67:0/3400324971 wait complete. 2024-04-25T02:29:14.241 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-25T02:29:14.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.338+0000 7ff909ded640 1 Processor -- start 2024-04-25T02:29:14.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.338+0000 7ff909ded640 1 -- start start 2024-04-25T02:29:14.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.339+0000 7ff909ded640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff904147040 0x7ff9040b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:14.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.339+0000 7ff909ded640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff904161f90 con 0x7ff9040b42a0 2024-04-25T02:29:14.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.339+0000 7ff909ded640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff904162270 con 0x7ff9040d1720 2024-04-25T02:29:14.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.339+0000 7ff909ded640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff9041628c0 con 0x7ff904147040 2024-04-25T02:29:14.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.339+0000 7ff902ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff9040b42a0 0x7ff9040d1010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49368/0 (socket says 172.21.15.67:49368) 2024-04-25T02:29:14.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.339+0000 7ff902ffd640 1 -- 172.21.15.67:0/3295931253 learned_addr learned my addr 172.21.15.67:0/3295931253 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:14.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.339+0000 7ff9037fe640 1 --2- 172.21.15.67:0/3295931253 >> v2:172.21.15.176:3300/0 conn(0x7ff904147040 0x7ff9040b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:14.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.340+0000 7ff9027fc640 1 -- 172.21.15.67:0/3295931253 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2436767569 0 0) 0x7ff904161f90 con 0x7ff9040b42a0 2024-04-25T02:29:14.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.340+0000 7ff9027fc640 1 -- 172.21.15.67:0/3295931253 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8ec003520 con 0x7ff9040b42a0 2024-04-25T02:29:14.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.340+0000 7ff9037fe640 1 -- 172.21.15.67:0/3295931253 >> v1:172.21.15.176:6789/0 conn(0x7ff9040d1720 legacy=0x7ff90406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:14.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.340+0000 7ff9037fe640 1 -- 172.21.15.67:0/3295931253 >> v1:172.21.15.67:6789/0 conn(0x7ff9040b42a0 legacy=0x7ff9040d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:14.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.340+0000 7ff9037fe640 1 -- 172.21.15.67:0/3295931253 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff904162550 con 0x7ff904147040 2024-04-25T02:29:14.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.341+0000 7ff9037fe640 1 --2- 172.21.15.67:0/3295931253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff904147040 0x7ff9040b3d60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff8f40097a0 tx=0x7ff8f402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd1d0dcd8879fbab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:14.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.341+0000 7ff9027fc640 1 -- 172.21.15.67:0/3295931253 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4037070 con 0x7ff904147040 2024-04-25T02:29:14.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.341+0000 7ff9027fc640 1 -- 172.21.15.67:0/3295931253 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f402ab90 con 0x7ff904147040 2024-04-25T02:29:14.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.341+0000 7ff9027fc640 1 -- 172.21.15.67:0/3295931253 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8001670 con 0x7ff904147040 2024-04-25T02:29:14.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.341+0000 7ff909ded640 1 -- 172.21.15.67:0/3295931253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff904147040 msgr2=0x7ff9040b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:14.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.341+0000 7ff909ded640 1 --2- 172.21.15.67:0/3295931253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff904147040 0x7ff9040b3d60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff8f40097a0 tx=0x7ff8f402a100 comp rx=0 tx=0).stop 2024-04-25T02:29:14.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.341+0000 7ff909ded640 1 -- 172.21.15.67:0/3295931253 shutdown_connections 2024-04-25T02:29:14.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.341+0000 7ff909ded640 1 --2- 172.21.15.67:0/3295931253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff904147040 0x7ff9040b3d60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:14.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.341+0000 7ff909ded640 1 -- 172.21.15.67:0/3295931253 >> 172.21.15.67:0/3295931253 conn(0x7ff90406c3b0 msgr2=0x7ff90406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:14.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.341+0000 7ff909ded640 1 -- 172.21.15.67:0/3295931253 shutdown_connections 2024-04-25T02:29:14.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.341+0000 7ff909ded640 1 -- 172.21.15.67:0/3295931253 wait complete. 2024-04-25T02:29:14.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.342+0000 7ff909ded640 1 Processor -- start 2024-04-25T02:29:14.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.343+0000 7ff909ded640 1 -- start start 2024-04-25T02:29:14.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.343+0000 7ff909ded640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9040b42a0 0x7ff90415af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:14.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.343+0000 7ff909ded640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9040d1720 0x7ff904142290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:14.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.343+0000 7ff909ded640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff904147040 0x7ff90406ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:14.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.343+0000 7ff909ded640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff9040b5eb0 con 0x7ff9040d1720 2024-04-25T02:29:14.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.343+0000 7ff909ded640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff9040b4740 con 0x7ff904147040 2024-04-25T02:29:14.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.343+0000 7ff909ded640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff9040b6030 con 0x7ff9040b42a0 2024-04-25T02:29:14.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.343+0000 7ff902ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9040d1720 0x7ff904142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:14.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.344+0000 7ff902ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9040d1720 0x7ff904142290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37690/0 (socket says 172.21.15.67:37690) 2024-04-25T02:29:14.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.344+0000 7ff902ffd640 1 -- 172.21.15.67:0/1765473468 learned_addr learned my addr 172.21.15.67:0/1765473468 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:14.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.344+0000 7ff9037fe640 1 --2- 172.21.15.67:0/1765473468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9040b42a0 0x7ff90415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:14.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.344+0000 7ff903fff640 1 --2- 172.21.15.67:0/1765473468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff904147040 0x7ff90406ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:14.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.344+0000 7ff902ffd640 1 -- 172.21.15.67:0/1765473468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9040b42a0 msgr2=0x7ff90415af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:14.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.344+0000 7ff902ffd640 1 --2- 172.21.15.67:0/1765473468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9040b42a0 0x7ff90415af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:14.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.344+0000 7ff902ffd640 1 -- 172.21.15.67:0/1765473468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff904147040 msgr2=0x7ff90406ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:14.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.344+0000 7ff902ffd640 1 --2- 172.21.15.67:0/1765473468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff904147040 0x7ff90406ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:14.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.344+0000 7ff902ffd640 1 -- 172.21.15.67:0/1765473468 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9041e7e60 con 0x7ff9040d1720 2024-04-25T02:29:14.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.344+0000 7ff902ffd640 1 --2- 172.21.15.67:0/1765473468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9040d1720 0x7ff904142290 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800c7d0 tx=0x7ff8f800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:14.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.344+0000 7ff8ebfff640 1 -- 172.21.15.67:0/1765473468 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8018070 con 0x7ff9040d1720 2024-04-25T02:29:14.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.344+0000 7ff8ebfff640 1 -- 172.21.15.67:0/1765473468 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f80074e0 con 0x7ff9040d1720 2024-04-25T02:29:14.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.344+0000 7ff909ded640 1 -- 172.21.15.67:0/1765473468 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9041e8140 con 0x7ff9040d1720 2024-04-25T02:29:14.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.344+0000 7ff8ebfff640 1 -- 172.21.15.67:0/1765473468 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8004a20 con 0x7ff9040d1720 2024-04-25T02:29:14.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.344+0000 7ff909ded640 1 -- 172.21.15.67:0/1765473468 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9041e8700 con 0x7ff9040d1720 2024-04-25T02:29:14.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.345+0000 7ff909ded640 1 -- 172.21.15.67:0/1765473468 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff904069110 con 0x7ff9040d1720 2024-04-25T02:29:14.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.346+0000 7ff8ebfff640 1 -- 172.21.15.67:0/1765473468 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff8f801b070 con 0x7ff9040d1720 2024-04-25T02:29:14.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.346+0000 7ff8ebfff640 1 --2- 172.21.15.67:0/1765473468 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff8f006be30 0x7ff8f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:14.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.346+0000 7ff8ebfff640 1 -- 172.21.15.67:0/1765473468 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7ff8f808a020 con 0x7ff9040d1720 2024-04-25T02:29:14.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.346+0000 7ff9037fe640 1 --2- 172.21.15.67:0/1765473468 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff8f006be30 0x7ff8f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:14.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.347+0000 7ff9037fe640 1 --2- 172.21.15.67:0/1765473468 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff8f006be30 0x7ff8f006e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4034000 tx=0x7ff8f402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:14.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.350+0000 7ff8ebfff640 1 -- 172.21.15.67:0/1765473468 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff8f80586d0 con 0x7ff9040d1720 2024-04-25T02:29:14.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.604+0000 7ff909ded640 1 -- 172.21.15.67:0/1765473468 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7ff90406cb10 con 0x7ff9040d1720 2024-04-25T02:29:14.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.608+0000 7ff8ebfff640 1 -- 172.21.15.67:0/1765473468 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7ff8f805c9d0 con 0x7ff9040d1720 2024-04-25T02:29:14.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.610+0000 7ff909ded640 1 -- 172.21.15.67:0/1765473468 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff8f006be30 msgr2=0x7ff8f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:14.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.610+0000 7ff909ded640 1 --2- 172.21.15.67:0/1765473468 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff8f006be30 0x7ff8f006e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4034000 tx=0x7ff8f402e000 comp rx=0 tx=0).stop 2024-04-25T02:29:14.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.610+0000 7ff909ded640 1 -- 172.21.15.67:0/1765473468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9040d1720 msgr2=0x7ff904142290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:14.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.610+0000 7ff909ded640 1 --2- 172.21.15.67:0/1765473468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9040d1720 0x7ff904142290 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800c7d0 tx=0x7ff8f800cc90 comp rx=0 tx=0).stop 2024-04-25T02:29:14.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.610+0000 7ff909ded640 1 -- 172.21.15.67:0/1765473468 shutdown_connections 2024-04-25T02:29:14.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.610+0000 7ff909ded640 1 --2- 172.21.15.67:0/1765473468 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff8f006be30 0x7ff8f006e2f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:14.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.610+0000 7ff909ded640 1 --2- 172.21.15.67:0/1765473468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff904147040 0x7ff90406ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:14.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.610+0000 7ff909ded640 1 --2- 172.21.15.67:0/1765473468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9040d1720 0x7ff904142290 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:14.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.610+0000 7ff909ded640 1 --2- 172.21.15.67:0/1765473468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9040b42a0 0x7ff90415af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:14.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.610+0000 7ff909ded640 1 -- 172.21.15.67:0/1765473468 >> 172.21.15.67:0/1765473468 conn(0x7ff90406c3b0 msgr2=0x7ff9040b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:14.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.610+0000 7ff909ded640 1 -- 172.21.15.67:0/1765473468 shutdown_connections 2024-04-25T02:29:14.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.610+0000 7ff909ded640 1 -- 172.21.15.67:0/1765473468 wait complete. 2024-04-25T02:29:14.625 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-25T02:29:14.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.723+0000 7f7f9349e640 1 Processor -- start 2024-04-25T02:29:14.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.723+0000 7f7f9349e640 1 -- start start 2024-04-25T02:29:14.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.724+0000 7f7f9349e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7f8c15bfc0 0x7f7f8c0ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:14.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.724+0000 7f7f9349e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f8c0d0210 0x7f7f8c0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:14.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.724+0000 7f7f9349e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f8c15c3a0 con 0x7f7f8c15e9f0 2024-04-25T02:29:14.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.724+0000 7f7f9349e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7f8c0d0760 con 0x7f7f8c15bfc0 2024-04-25T02:29:14.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.724+0000 7f7f9349e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7f8c0d0a40 con 0x7f7f8c0d0210 2024-04-25T02:29:14.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.724+0000 7f7f9123a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7f8c15bfc0 0x7f7f8c0ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:14.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.724+0000 7f7f90a39640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f8c0d0210 0x7f7f8c0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:14.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.724+0000 7f7f91a3b640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f7f8c15e9f0 0x7f7f8c161f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:56944/0 (socket says 172.21.15.67:56944) 2024-04-25T02:29:14.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.724+0000 7f7f9123a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7f8c15bfc0 0x7f7f8c0ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:60722/0 (socket says 172.21.15.67:60722) 2024-04-25T02:29:14.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.724+0000 7f7f90a39640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f8c0d0210 0x7f7f8c0cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:34926/0 (socket says 172.21.15.67:34926) 2024-04-25T02:29:14.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.724+0000 7f7f91a3b640 1 -- 172.21.15.67:0/1620153967 learned_addr learned my addr 172.21.15.67:0/1620153967 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:14.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.725+0000 7f7f9123a640 1 -- 172.21.15.67:0/1620153967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f8c0d0210 msgr2=0x7f7f8c0cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:14.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.725+0000 7f7f9123a640 1 --2- 172.21.15.67:0/1620153967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f8c0d0210 0x7f7f8c0cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:14.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.725+0000 7f7f9123a640 1 -- 172.21.15.67:0/1620153967 >> v1:172.21.15.176:6789/0 conn(0x7f7f8c15e9f0 legacy=0x7f7f8c161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:14.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.725+0000 7f7f83fff640 1 -- 172.21.15.67:0/1620153967 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 970050754 0 0) 0x7f7f8c15c3a0 con 0x7f7f8c15e9f0 2024-04-25T02:29:14.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.725+0000 7f7f9123a640 1 -- 172.21.15.67:0/1620153967 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8c0d0d20 con 0x7f7f8c15bfc0 2024-04-25T02:29:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.725+0000 7f7f9123a640 1 --2- 172.21.15.67:0/1620153967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f8c15bfc0 0x7f7f8c0ce750 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7f880097a0 tx=0x7f7f8802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c0f3242631efa58 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.726+0000 7f7f83fff640 1 -- 172.21.15.67:0/1620153967 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f88037070 con 0x7f7f8c15bfc0 2024-04-25T02:29:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.726+0000 7f7f83fff640 1 -- 172.21.15.67:0/1620153967 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f88032440 con 0x7f7f8c15bfc0 2024-04-25T02:29:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.726+0000 7f7f83fff640 1 -- 172.21.15.67:0/1620153967 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f88032810 con 0x7f7f8c15bfc0 2024-04-25T02:29:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.726+0000 7f7f9349e640 1 -- 172.21.15.67:0/1620153967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f8c15bfc0 msgr2=0x7f7f8c0ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.726+0000 7f7f9349e640 1 --2- 172.21.15.67:0/1620153967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f8c15bfc0 0x7f7f8c0ce750 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7f880097a0 tx=0x7f7f8802a180 comp rx=0 tx=0).stop 2024-04-25T02:29:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.726+0000 7f7f9349e640 1 -- 172.21.15.67:0/1620153967 shutdown_connections 2024-04-25T02:29:14.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.726+0000 7f7f9349e640 1 --2- 172.21.15.67:0/1620153967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f8c0d0210 0x7f7f8c0cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:14.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.726+0000 7f7f9349e640 1 --2- 172.21.15.67:0/1620153967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f8c15bfc0 0x7f7f8c0ce750 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:14.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.726+0000 7f7f9349e640 1 -- 172.21.15.67:0/1620153967 >> 172.21.15.67:0/1620153967 conn(0x7f7f8c0d1ed0 msgr2=0x7f7f8c0d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:14.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.726+0000 7f7f9349e640 1 -- 172.21.15.67:0/1620153967 shutdown_connections 2024-04-25T02:29:14.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.726+0000 7f7f9349e640 1 -- 172.21.15.67:0/1620153967 wait complete. 2024-04-25T02:29:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.727+0000 7f7f9349e640 1 Processor -- start 2024-04-25T02:29:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.728+0000 7f7f9349e640 1 -- start start 2024-04-25T02:29:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.728+0000 7f7f9349e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f8c0d0210 0x7f7f8c09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.728+0000 7f7f9349e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f8c15bfc0 0x7f7f8c0b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.728+0000 7f7f9349e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f8c15e9f0 0x7f7f8c1f7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:14.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.728+0000 7f7f9349e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c0cf690 con 0x7f7f8c15e9f0 2024-04-25T02:29:14.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.728+0000 7f7f9349e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c0d12e0 con 0x7f7f8c15bfc0 2024-04-25T02:29:14.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.728+0000 7f7f9349e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7f8c0cf810 con 0x7f7f8c0d0210 2024-04-25T02:29:14.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.728+0000 7f7f91a3b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f8c15e9f0 0x7f7f8c1f7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:14.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.728+0000 7f7f91a3b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f8c15e9f0 0x7f7f8c1f7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37702/0 (socket says 172.21.15.67:37702) 2024-04-25T02:29:14.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.728+0000 7f7f91a3b640 1 -- 172.21.15.67:0/1421895568 learned_addr learned my addr 172.21.15.67:0/1421895568 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:14.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.729+0000 7f7f90a39640 1 --2- 172.21.15.67:0/1421895568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f8c15bfc0 0x7f7f8c0b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:14.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.729+0000 7f7f9123a640 1 --2- 172.21.15.67:0/1421895568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f8c0d0210 0x7f7f8c09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:14.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.729+0000 7f7f91a3b640 1 -- 172.21.15.67:0/1421895568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f8c0d0210 msgr2=0x7f7f8c09ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:14.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.729+0000 7f7f91a3b640 1 --2- 172.21.15.67:0/1421895568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f8c0d0210 0x7f7f8c09ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:14.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.729+0000 7f7f91a3b640 1 -- 172.21.15.67:0/1421895568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f8c15bfc0 msgr2=0x7f7f8c0b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:14.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.729+0000 7f7f91a3b640 1 --2- 172.21.15.67:0/1421895568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f8c15bfc0 0x7f7f8c0b39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:14.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.729+0000 7f7f91a3b640 1 -- 172.21.15.67:0/1421895568 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8c09d1a0 con 0x7f7f8c15e9f0 2024-04-25T02:29:14.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.729+0000 7f7f91a3b640 1 --2- 172.21.15.67:0/1421895568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f8c15e9f0 0x7f7f8c1f7ae0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400c7a0 tx=0x7f7f8400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:14.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.729+0000 7f7f81ffb640 1 -- 172.21.15.67:0/1421895568 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84018070 con 0x7f7f8c15e9f0 2024-04-25T02:29:14.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.729+0000 7f7f81ffb640 1 -- 172.21.15.67:0/1421895568 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f8400a640 con 0x7f7f8c15e9f0 2024-04-25T02:29:14.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.729+0000 7f7f9349e640 1 -- 172.21.15.67:0/1421895568 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f8c09d480 con 0x7f7f8c15e9f0 2024-04-25T02:29:14.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.729+0000 7f7f81ffb640 1 -- 172.21.15.67:0/1421895568 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8400aab0 con 0x7f7f8c15e9f0 2024-04-25T02:29:14.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.729+0000 7f7f9349e640 1 -- 172.21.15.67:0/1421895568 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f8c09e820 con 0x7f7f8c15e9f0 2024-04-25T02:29:14.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.730+0000 7f7f9349e640 1 -- 172.21.15.67:0/1421895568 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f8c0b1570 con 0x7f7f8c15e9f0 2024-04-25T02:29:14.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.731+0000 7f7f81ffb640 1 -- 172.21.15.67:0/1421895568 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f8401b070 con 0x7f7f8c15e9f0 2024-04-25T02:29:14.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.731+0000 7f7f81ffb640 1 --2- 172.21.15.67:0/1421895568 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7f7006be30 0x7f7f7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:14.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.731+0000 7f7f81ffb640 1 -- 172.21.15.67:0/1421895568 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f7f8408a070 con 0x7f7f8c15e9f0 2024-04-25T02:29:14.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.732+0000 7f7f9123a640 1 --2- 172.21.15.67:0/1421895568 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7f7006be30 0x7f7f7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:14.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.732+0000 7f7f9123a640 1 --2- 172.21.15.67:0/1421895568 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7f7006be30 0x7f7f7006e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7f88034000 tx=0x7f7f8802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:14.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.736+0000 7f7f81ffb640 1 -- 172.21.15.67:0/1421895568 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7f8c0b1570 con 0x7f7f8c15e9f0 2024-04-25T02:29:14.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.995+0000 7f7f9349e640 1 -- 172.21.15.67:0/1421895568 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f7f8c069110 con 0x7f7f8c15e9f0 2024-04-25T02:29:15.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:14.999+0000 7f7f81ffb640 1 -- 172.21.15.67:0/1421895568 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f7f84058720 con 0x7f7f8c15e9f0 2024-04-25T02:29:15.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.001+0000 7f7f9349e640 1 -- 172.21.15.67:0/1421895568 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7f7006be30 msgr2=0x7f7f7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.001+0000 7f7f9349e640 1 --2- 172.21.15.67:0/1421895568 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7f7006be30 0x7f7f7006e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7f88034000 tx=0x7f7f8802e000 comp rx=0 tx=0).stop 2024-04-25T02:29:15.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.001+0000 7f7f9349e640 1 -- 172.21.15.67:0/1421895568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f8c15e9f0 msgr2=0x7f7f8c1f7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.001+0000 7f7f9349e640 1 --2- 172.21.15.67:0/1421895568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f8c15e9f0 0x7f7f8c1f7ae0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400c7a0 tx=0x7f7f8400cc60 comp rx=0 tx=0).stop 2024-04-25T02:29:15.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.001+0000 7f7f9349e640 1 -- 172.21.15.67:0/1421895568 shutdown_connections 2024-04-25T02:29:15.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.001+0000 7f7f9349e640 1 --2- 172.21.15.67:0/1421895568 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7f7006be30 0x7f7f7006e2f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.001+0000 7f7f9349e640 1 --2- 172.21.15.67:0/1421895568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f8c15e9f0 0x7f7f8c1f7ae0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.001+0000 7f7f9349e640 1 --2- 172.21.15.67:0/1421895568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f8c15bfc0 0x7f7f8c0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.001+0000 7f7f9349e640 1 --2- 172.21.15.67:0/1421895568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f8c0d0210 0x7f7f8c09ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.001+0000 7f7f9349e640 1 -- 172.21.15.67:0/1421895568 >> 172.21.15.67:0/1421895568 conn(0x7f7f8c0d1ed0 msgr2=0x7f7f8c0b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:15.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.001+0000 7f7f9349e640 1 -- 172.21.15.67:0/1421895568 shutdown_connections 2024-04-25T02:29:15.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.001+0000 7f7f9349e640 1 -- 172.21.15.67:0/1421895568 wait complete. 2024-04-25T02:29:15.016 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:29:15.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.114+0000 7ff1d569a640 1 Processor -- start 2024-04-25T02:29:15.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.114+0000 7ff1d569a640 1 -- start start 2024-04-25T02:29:15.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.115+0000 7ff1d569a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff1d00b3020 0x7ff1d00b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.115+0000 7ff1d569a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d009b180 0x7ff1d00cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.115+0000 7ff1d569a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1d00b49e0 con 0x7ff1d015e630 2024-04-25T02:29:15.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.115+0000 7ff1d569a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff1d006ca00 con 0x7ff1d00b3020 2024-04-25T02:29:15.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.115+0000 7ff1d569a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d00d0a10 con 0x7ff1d009b180 2024-04-25T02:29:15.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.116+0000 7ff1ce7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff1d00b3020 0x7ff1d00b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.116+0000 7ff1ce7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff1d00b3020 0x7ff1d00b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37708/0 (socket says 172.21.15.67:37708) 2024-04-25T02:29:15.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.116+0000 7ff1ce7fc640 1 -- 172.21.15.67:0/134625092 learned_addr learned my addr 172.21.15.67:0/134625092 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:15.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.116+0000 7ff1cf7fe640 1 --2- 172.21.15.67:0/134625092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d009b180 0x7ff1d00cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.116+0000 7ff1ce7fc640 1 -- 172.21.15.67:0/134625092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d009b180 msgr2=0x7ff1d00cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:15.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.116+0000 7ff1ce7fc640 1 --2- 172.21.15.67:0/134625092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d009b180 0x7ff1d00cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.116+0000 7ff1ce7fc640 1 -- 172.21.15.67:0/134625092 >> v1:172.21.15.176:6789/0 conn(0x7ff1d015e630 legacy=0x7ff1d009aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.116+0000 7ff1ce7fc640 1 -- 172.21.15.67:0/134625092 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d00d0cf0 con 0x7ff1d00b3020 2024-04-25T02:29:15.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.116+0000 7ff1cf7fe640 1 --2- 172.21.15.67:0/134625092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d009b180 0x7ff1d00cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:15.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.117+0000 7ff1ce7fc640 1 --2- 172.21.15.67:0/134625092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1d00b3020 0x7ff1d00b3490 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009870 tx=0x7ff1c002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f17b2f77d94a73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:15.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.117+0000 7ff1cdffb640 1 -- 172.21.15.67:0/134625092 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0037070 con 0x7ff1d00b3020 2024-04-25T02:29:15.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.117+0000 7ff1cdffb640 1 -- 172.21.15.67:0/134625092 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c0032440 con 0x7ff1d00b3020 2024-04-25T02:29:15.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.117+0000 7ff1cdffb640 1 -- 172.21.15.67:0/134625092 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0032810 con 0x7ff1d00b3020 2024-04-25T02:29:15.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.117+0000 7ff1d569a640 1 -- 172.21.15.67:0/134625092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1d00b3020 msgr2=0x7ff1d00b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.117+0000 7ff1d569a640 1 --2- 172.21.15.67:0/134625092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1d00b3020 0x7ff1d00b3490 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009870 tx=0x7ff1c002a1c0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.117+0000 7ff1d569a640 1 -- 172.21.15.67:0/134625092 shutdown_connections 2024-04-25T02:29:15.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.117+0000 7ff1d569a640 1 --2- 172.21.15.67:0/134625092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d009b180 0x7ff1d00cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.117+0000 7ff1d569a640 1 --2- 172.21.15.67:0/134625092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1d00b3020 0x7ff1d00b3490 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.117+0000 7ff1d569a640 1 -- 172.21.15.67:0/134625092 >> 172.21.15.67:0/134625092 conn(0x7ff1d00b3ae0 msgr2=0x7ff1d00b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:15.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.117+0000 7ff1d569a640 1 -- 172.21.15.67:0/134625092 shutdown_connections 2024-04-25T02:29:15.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.117+0000 7ff1d569a640 1 -- 172.21.15.67:0/134625092 wait complete. 2024-04-25T02:29:15.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.119+0000 7ff1d569a640 1 Processor -- start 2024-04-25T02:29:15.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.119+0000 7ff1d569a640 1 -- start start 2024-04-25T02:29:15.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.119+0000 7ff1d569a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1d009b180 0x7ff1d01f4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1d569a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d00b3020 0x7ff1d00c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1d569a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d015e630 0x7ff1d00c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1d569a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d00d1150 con 0x7ff1d009b180 2024-04-25T02:29:15.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1d569a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d00d0fd0 con 0x7ff1d00b3020 2024-04-25T02:29:15.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1d569a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d015ea10 con 0x7ff1d015e630 2024-04-25T02:29:15.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1ceffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1d009b180 0x7ff1d01f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1ceffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1d009b180 0x7ff1d01f4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37720/0 (socket says 172.21.15.67:37720) 2024-04-25T02:29:15.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1ceffd640 1 -- 172.21.15.67:0/3183782070 learned_addr learned my addr 172.21.15.67:0/3183782070 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:15.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1cf7fe640 1 --2- 172.21.15.67:0/3183782070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d015e630 0x7ff1d00c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1ce7fc640 1 --2- 172.21.15.67:0/3183782070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d00b3020 0x7ff1d00c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1ceffd640 1 -- 172.21.15.67:0/3183782070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d015e630 msgr2=0x7ff1d00c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1ceffd640 1 --2- 172.21.15.67:0/3183782070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d015e630 0x7ff1d00c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1ceffd640 1 -- 172.21.15.67:0/3183782070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d00b3020 msgr2=0x7ff1d00c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1ceffd640 1 --2- 172.21.15.67:0/3183782070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d00b3020 0x7ff1d00c7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1ceffd640 1 -- 172.21.15.67:0/3183782070 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d0152fe0 con 0x7ff1d009b180 2024-04-25T02:29:15.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1cf7fe640 1 --2- 172.21.15.67:0/3183782070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d015e630 0x7ff1d00c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:15.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1ceffd640 1 --2- 172.21.15.67:0/3183782070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1d009b180 0x7ff1d01f4470 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400c430 tx=0x7ff1c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:15.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1b77fe640 1 -- 172.21.15.67:0/3183782070 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4017070 con 0x7ff1d009b180 2024-04-25T02:29:15.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1b77fe640 1 -- 172.21.15.67:0/3183782070 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c40052d0 con 0x7ff1d009b180 2024-04-25T02:29:15.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1b77fe640 1 -- 172.21.15.67:0/3183782070 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4003830 con 0x7ff1d009b180 2024-04-25T02:29:15.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1d569a640 1 -- 172.21.15.67:0/3183782070 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d00b6200 con 0x7ff1d009b180 2024-04-25T02:29:15.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.120+0000 7ff1d569a640 1 -- 172.21.15.67:0/3183782070 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d00b67c0 con 0x7ff1d009b180 2024-04-25T02:29:15.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.121+0000 7ff1d569a640 1 -- 172.21.15.67:0/3183782070 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d0069110 con 0x7ff1d009b180 2024-04-25T02:29:15.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.122+0000 7ff1b77fe640 1 -- 172.21.15.67:0/3183782070 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1c401a070 con 0x7ff1d009b180 2024-04-25T02:29:15.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.122+0000 7ff1b77fe640 1 --2- 172.21.15.67:0/3183782070 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff1bc06be30 0x7ff1bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.122+0000 7ff1b77fe640 1 -- 172.21.15.67:0/3183782070 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7ff1c4089df0 con 0x7ff1d009b180 2024-04-25T02:29:15.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.122+0000 7ff1ce7fc640 1 --2- 172.21.15.67:0/3183782070 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff1bc06be30 0x7ff1bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.123+0000 7ff1ce7fc640 1 --2- 172.21.15.67:0/3183782070 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff1bc06be30 0x7ff1bc06e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0034000 tx=0x7ff1c002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:15.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.126+0000 7ff1b77fe640 1 -- 172.21.15.67:0/3183782070 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff1d0152fe0 con 0x7ff1d009b180 2024-04-25T02:29:15.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.314+0000 7ff1d569a640 1 -- 172.21.15.67:0/3183782070 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1d006df10 con 0x7ff1d009b180 2024-04-25T02:29:15.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.315+0000 7ff1b77fe640 1 -- 172.21.15.67:0/3183782070 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+12867 (secure 0 0 0) 0x7ff1c4058b80 con 0x7ff1d009b180 2024-04-25T02:29:15.319 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:15.319 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":29,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:29:12.308650+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:29:15.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.317+0000 7ff1d569a640 1 -- 172.21.15.67:0/3183782070 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff1bc06be30 msgr2=0x7ff1bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.317+0000 7ff1d569a640 1 --2- 172.21.15.67:0/3183782070 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff1bc06be30 0x7ff1bc06e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0034000 tx=0x7ff1c002e000 comp rx=0 tx=0).stop 2024-04-25T02:29:15.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.317+0000 7ff1d569a640 1 -- 172.21.15.67:0/3183782070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1d009b180 msgr2=0x7ff1d01f4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.317+0000 7ff1d569a640 1 --2- 172.21.15.67:0/3183782070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1d009b180 0x7ff1d01f4470 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400c430 tx=0x7ff1c400c8f0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.317+0000 7ff1d569a640 1 -- 172.21.15.67:0/3183782070 shutdown_connections 2024-04-25T02:29:15.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.317+0000 7ff1d569a640 1 --2- 172.21.15.67:0/3183782070 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff1bc06be30 0x7ff1bc06e2f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.317+0000 7ff1d569a640 1 --2- 172.21.15.67:0/3183782070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d015e630 0x7ff1d00c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.317+0000 7ff1d569a640 1 --2- 172.21.15.67:0/3183782070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d00b3020 0x7ff1d00c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.317+0000 7ff1d569a640 1 --2- 172.21.15.67:0/3183782070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1d009b180 0x7ff1d01f4470 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.317+0000 7ff1d569a640 1 -- 172.21.15.67:0/3183782070 >> 172.21.15.67:0/3183782070 conn(0x7ff1d00b3ae0 msgr2=0x7ff1d009aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:15.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.317+0000 7ff1d569a640 1 -- 172.21.15.67:0/3183782070 shutdown_connections 2024-04-25T02:29:15.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.317+0000 7ff1d569a640 1 -- 172.21.15.67:0/3183782070 wait complete. 2024-04-25T02:29:15.332 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:29:15.333 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:29:15.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.435+0000 7f6a70807640 1 Processor -- start 2024-04-25T02:29:15.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.435+0000 7f6a70807640 1 -- start start 2024-04-25T02:29:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.436+0000 7f6a70807640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a6c06c7e0 0x7f6a6c0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.436+0000 7f6a70807640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a6c15ec30 con 0x7f6a6c158750 2024-04-25T02:29:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.436+0000 7f6a70807640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a6c15ef10 con 0x7f6a6c15e6c0 2024-04-25T02:29:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.436+0000 7f6a70807640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6c15f1f0 con 0x7f6a6c06c7e0 2024-04-25T02:29:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.436+0000 7f6a6a59c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6a6c158750 0x7f6a6c06c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49374/0 (socket says 172.21.15.67:49374) 2024-04-25T02:29:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.436+0000 7f6a6a59c640 1 -- 172.21.15.67:0/4203253418 learned_addr learned my addr 172.21.15.67:0/4203253418 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.436+0000 7f6a6959a640 1 -- 172.21.15.67:0/4203253418 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3681859163 0 0) 0x7f6a6c15ec30 con 0x7f6a6c158750 2024-04-25T02:29:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.436+0000 7f6a69d9b640 1 --2- 172.21.15.67:0/4203253418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a6c06c7e0 0x7f6a6c0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.436+0000 7f6a6959a640 1 -- 172.21.15.67:0/4203253418 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a54003520 con 0x7f6a6c158750 2024-04-25T02:29:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6959a640 1 -- 172.21.15.67:0/4203253418 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2566820598 0 0) 0x7f6a54003520 con 0x7f6a6c158750 2024-04-25T02:29:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6959a640 1 -- 172.21.15.67:0/4203253418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a6c06c7e0 msgr2=0x7f6a6c0b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6959a640 1 --2- 172.21.15.67:0/4203253418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a6c06c7e0 0x7f6a6c0b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6959a640 1 -- 172.21.15.67:0/4203253418 >> v1:172.21.15.176:6789/0 conn(0x7f6a6c15e6c0 legacy=0x7f6a6c0b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6959a640 1 -- 172.21.15.67:0/4203253418 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c15f4d0 con 0x7f6a6c158750 2024-04-25T02:29:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6959a640 1 -- 172.21.15.67:0/4203253418 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f6a5c001670 con 0x7f6a6c158750 2024-04-25T02:29:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6959a640 1 -- 172.21.15.67:0/4203253418 >> v1:172.21.15.67:6789/0 conn(0x7f6a6c158750 legacy=0x7f6a6c06c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6959a640 1 --2- 172.21.15.67:0/4203253418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a6c06c7e0 0x7f6a540039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6959a640 1 --2- 172.21.15.67:0/4203253418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a54003f20 0x7f6a54004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6959a640 1 --2- 172.21.15.67:0/4203253418 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a54004d40 0x7f6a540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6959a640 1 -- 172.21.15.67:0/4203253418 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c15f1f0 con 0x7f6a54004d40 2024-04-25T02:29:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6959a640 1 -- 172.21.15.67:0/4203253418 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5400ba20 con 0x7f6a54003f20 2024-04-25T02:29:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6959a640 1 -- 172.21.15.67:0/4203253418 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6a5400bc20 con 0x7f6a6c06c7e0 2024-04-25T02:29:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6ad9d640 1 --2- 172.21.15.67:0/4203253418 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a54004d40 0x7f6a540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a69d9b640 1 --2- 172.21.15.67:0/4203253418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a54003f20 0x7f6a54004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6a59c640 1 --2- 172.21.15.67:0/4203253418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a6c06c7e0 0x7f6a540039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6ad9d640 1 -- 172.21.15.67:0/4203253418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a6c06c7e0 msgr2=0x7f6a540039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6ad9d640 1 --2- 172.21.15.67:0/4203253418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a6c06c7e0 0x7f6a540039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6ad9d640 1 -- 172.21.15.67:0/4203253418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a54003f20 msgr2=0x7f6a54004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6ad9d640 1 --2- 172.21.15.67:0/4203253418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a54003f20 0x7f6a54004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6ad9d640 1 -- 172.21.15.67:0/4203253418 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a54003520 con 0x7f6a54004d40 2024-04-25T02:29:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a6a59c640 1 --2- 172.21.15.67:0/4203253418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a6c06c7e0 0x7f6a540039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.437+0000 7f6a69d9b640 1 --2- 172.21.15.67:0/4203253418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a54003f20 0x7f6a54004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:15.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.438+0000 7f6a6ad9d640 1 --2- 172.21.15.67:0/4203253418 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a54004d40 0x7f6a540051c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6a64001f60 tx=0x7f6a54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d15f07f229fc20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:15.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.438+0000 7f6a6959a640 1 -- 172.21.15.67:0/4203253418 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a64001b30 con 0x7f6a54004d40 2024-04-25T02:29:15.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.438+0000 7f6a6959a640 1 -- 172.21.15.67:0/4203253418 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a64031620 con 0x7f6a54004d40 2024-04-25T02:29:15.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.439+0000 7f6a6959a640 1 -- 172.21.15.67:0/4203253418 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a64031a10 con 0x7f6a54004d40 2024-04-25T02:29:15.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.439+0000 7f6a70807640 1 -- 172.21.15.67:0/4203253418 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a54004d40 msgr2=0x7f6a540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.439+0000 7f6a70807640 1 --2- 172.21.15.67:0/4203253418 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a54004d40 0x7f6a540051c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6a64001f60 tx=0x7f6a54005830 comp rx=0 tx=0).stop 2024-04-25T02:29:15.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.439+0000 7f6a6ad9d640 1 -- 172.21.15.67:0/4203253418 reap_dead start 2024-04-25T02:29:15.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.439+0000 7f6a70807640 1 -- 172.21.15.67:0/4203253418 shutdown_connections 2024-04-25T02:29:15.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.439+0000 7f6a70807640 1 -- 172.21.15.67:0/4203253418 >> 172.21.15.67:0/4203253418 conn(0x7f6a6c0715c0 msgr2=0x7f6a6c0719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:15.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.439+0000 7f6a70807640 1 -- 172.21.15.67:0/4203253418 shutdown_connections 2024-04-25T02:29:15.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.439+0000 7f6a70807640 1 -- 172.21.15.67:0/4203253418 wait complete. 2024-04-25T02:29:15.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.441+0000 7f6a70807640 1 Processor -- start 2024-04-25T02:29:15.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.441+0000 7f6a70807640 1 -- start start 2024-04-25T02:29:15.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.441+0000 7f6a70807640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a54004d40 0x7f6a6c15d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.441+0000 7f6a70807640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a6c161c40 0x7f6a6c1620c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.441+0000 7f6a70807640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a6c14ab80 0x7f6a6c14b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.441+0000 7f6a70807640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c0723b0 con 0x7f6a54004d40 2024-04-25T02:29:15.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.441+0000 7f6a70807640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c072230 con 0x7f6a6c14ab80 2024-04-25T02:29:15.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.441+0000 7f6a70807640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6c0ad8e0 con 0x7f6a6c161c40 2024-04-25T02:29:15.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.441+0000 7f6a6a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a54004d40 0x7f6a6c15d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.442+0000 7f6a6a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a54004d40 0x7f6a6c15d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37738/0 (socket says 172.21.15.67:37738) 2024-04-25T02:29:15.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.442+0000 7f6a6a59c640 1 -- 172.21.15.67:0/231929983 learned_addr learned my addr 172.21.15.67:0/231929983 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:15.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.442+0000 7f6a69d9b640 1 --2- 172.21.15.67:0/231929983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a6c161c40 0x7f6a6c1620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.442+0000 7f6a6ad9d640 1 --2- 172.21.15.67:0/231929983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a6c14ab80 0x7f6a6c14b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.442+0000 7f6a6a59c640 1 -- 172.21.15.67:0/231929983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a6c161c40 msgr2=0x7f6a6c1620c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.442+0000 7f6a6a59c640 1 --2- 172.21.15.67:0/231929983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a6c161c40 0x7f6a6c1620c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.442+0000 7f6a6a59c640 1 -- 172.21.15.67:0/231929983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a6c14ab80 msgr2=0x7f6a6c14b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.442+0000 7f6a6a59c640 1 --2- 172.21.15.67:0/231929983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a6c14ab80 0x7f6a6c14b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.442+0000 7f6a6a59c640 1 -- 172.21.15.67:0/231929983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c1459f0 con 0x7f6a54004d40 2024-04-25T02:29:15.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.442+0000 7f6a6a59c640 1 --2- 172.21.15.67:0/231929983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a54004d40 0x7f6a6c15d590 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00e840 tx=0x7f6a5c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:15.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.442+0000 7f6a5affd640 1 -- 172.21.15.67:0/231929983 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c00c8d0 con 0x7f6a54004d40 2024-04-25T02:29:15.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.442+0000 7f6a5affd640 1 -- 172.21.15.67:0/231929983 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c018070 con 0x7f6a54004d40 2024-04-25T02:29:15.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.442+0000 7f6a5affd640 1 -- 172.21.15.67:0/231929983 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c00cc90 con 0x7f6a54004d40 2024-04-25T02:29:15.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.442+0000 7f6a70807640 1 -- 172.21.15.67:0/231929983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6c14b920 con 0x7f6a54004d40 2024-04-25T02:29:15.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.442+0000 7f6a70807640 1 -- 172.21.15.67:0/231929983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6c14bc00 con 0x7f6a54004d40 2024-04-25T02:29:15.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.444+0000 7f6a70807640 1 -- 172.21.15.67:0/231929983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a6c069110 con 0x7f6a54004d40 2024-04-25T02:29:15.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.444+0000 7f6a5affd640 1 -- 172.21.15.67:0/231929983 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a5c01d460 con 0x7f6a54004d40 2024-04-25T02:29:15.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.444+0000 7f6a5affd640 1 --2- 172.21.15.67:0/231929983 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6a4c06be60 0x7f6a4c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.445+0000 7f6a5affd640 1 -- 172.21.15.67:0/231929983 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f6a5c08a880 con 0x7f6a54004d40 2024-04-25T02:29:15.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.445+0000 7f6a69d9b640 1 --2- 172.21.15.67:0/231929983 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6a4c06be60 0x7f6a4c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.445+0000 7f6a69d9b640 1 --2- 172.21.15.67:0/231929983 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6a4c06be60 0x7f6a4c06e320 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c15f830 tx=0x7f6a60008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:15.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.449+0000 7f6a5affd640 1 -- 172.21.15.67:0/231929983 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6a5c058fc0 con 0x7f6a54004d40 2024-04-25T02:29:15.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.634+0000 7f6a70807640 1 -- 172.21.15.67:0/231929983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6a6c0b1e10 con 0x7f6a54004d40 2024-04-25T02:29:15.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.634+0000 7f6a5affd640 1 -- 172.21.15.67:0/231929983 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f6a5c05d2c0 con 0x7f6a54004d40 2024-04-25T02:29:15.638 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:29:15.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.636+0000 7f6a70807640 1 -- 172.21.15.67:0/231929983 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6a4c06be60 msgr2=0x7f6a4c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.636+0000 7f6a70807640 1 --2- 172.21.15.67:0/231929983 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6a4c06be60 0x7f6a4c06e320 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c15f830 tx=0x7f6a60008040 comp rx=0 tx=0).stop 2024-04-25T02:29:15.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.636+0000 7f6a70807640 1 -- 172.21.15.67:0/231929983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a54004d40 msgr2=0x7f6a6c15d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.636+0000 7f6a70807640 1 --2- 172.21.15.67:0/231929983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a54004d40 0x7f6a6c15d590 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00e840 tx=0x7f6a5c00ed00 comp rx=0 tx=0).stop 2024-04-25T02:29:15.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.636+0000 7f6a70807640 1 -- 172.21.15.67:0/231929983 shutdown_connections 2024-04-25T02:29:15.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.636+0000 7f6a70807640 1 --2- 172.21.15.67:0/231929983 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6a4c06be60 0x7f6a4c06e320 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.636+0000 7f6a70807640 1 --2- 172.21.15.67:0/231929983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a6c14ab80 0x7f6a6c14b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.636+0000 7f6a70807640 1 --2- 172.21.15.67:0/231929983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a6c161c40 0x7f6a6c1620c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.636+0000 7f6a70807640 1 --2- 172.21.15.67:0/231929983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a54004d40 0x7f6a6c15d590 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.636+0000 7f6a70807640 1 -- 172.21.15.67:0/231929983 >> 172.21.15.67:0/231929983 conn(0x7f6a6c0715c0 msgr2=0x7f6a6c0aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:15.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.636+0000 7f6a70807640 1 -- 172.21.15.67:0/231929983 shutdown_connections 2024-04-25T02:29:15.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.636+0000 7f6a70807640 1 -- 172.21.15.67:0/231929983 wait complete. 2024-04-25T02:29:15.652 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T02:29:15.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.751+0000 7f97694bd640 1 Processor -- start 2024-04-25T02:29:15.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.751+0000 7f97694bd640 1 -- start start 2024-04-25T02:29:15.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.752+0000 7f97694bd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f97640af120 0x7f9764071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.752+0000 7f97694bd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97640acda0 0x7f976406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.752+0000 7f97694bd640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9764160b20 con 0x7f976415c230 2024-04-25T02:29:15.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.752+0000 7f97694bd640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f976415c610 con 0x7f97640af120 2024-04-25T02:29:15.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.752+0000 7f97694bd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f97640ad230 con 0x7f97640acda0 2024-04-25T02:29:15.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.752+0000 7f97627fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f97640af120 0x7f9764071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.752+0000 7f97637fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97640acda0 0x7f976406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.752+0000 7f97627fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f97640af120 0x7f9764071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:60782/0 (socket says 172.21.15.67:60782) 2024-04-25T02:29:15.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.752+0000 7f97637fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97640acda0 0x7f976406cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:34992/0 (socket says 172.21.15.67:34992) 2024-04-25T02:29:15.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.752+0000 7f97627fc640 1 -- 172.21.15.67:0/3233526168 learned_addr learned my addr 172.21.15.67:0/3233526168 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:15.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.752+0000 7f9762ffd640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f976415c230 0x7f97640aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:56978/0 (socket says 172.21.15.67:56978) 2024-04-25T02:29:15.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.753+0000 7f97637fe640 1 -- 172.21.15.67:0/3233526168 >> v2:172.21.15.176:3300/0 conn(0x7f97640af120 msgr2=0x7f9764071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:15.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.753+0000 7f97637fe640 1 --2- 172.21.15.67:0/3233526168 >> v2:172.21.15.176:3300/0 conn(0x7f97640af120 0x7f9764071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.753+0000 7f97637fe640 1 -- 172.21.15.67:0/3233526168 >> v1:172.21.15.176:6789/0 conn(0x7f976415c230 legacy=0x7f97640aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.753+0000 7f97637fe640 1 -- 172.21.15.67:0/3233526168 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f976415fd60 con 0x7f97640acda0 2024-04-25T02:29:15.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.753+0000 7f97637fe640 1 --2- 172.21.15.67:0/3233526168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97640acda0 0x7f976406cb70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f975c009d90 tx=0x7f975c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c48a8c79b60e98b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:15.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.754+0000 7f9761ffb640 1 -- 172.21.15.67:0/3233526168 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975c007740 con 0x7f97640acda0 2024-04-25T02:29:15.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.754+0000 7f9761ffb640 1 -- 172.21.15.67:0/3233526168 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f975c0078e0 con 0x7f97640acda0 2024-04-25T02:29:15.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.754+0000 7f9761ffb640 1 -- 172.21.15.67:0/3233526168 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975c007cb0 con 0x7f97640acda0 2024-04-25T02:29:15.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.754+0000 7f97694bd640 1 -- 172.21.15.67:0/3233526168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97640acda0 msgr2=0x7f976406cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.754+0000 7f97694bd640 1 --2- 172.21.15.67:0/3233526168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97640acda0 0x7f976406cb70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f975c009d90 tx=0x7f975c02a660 comp rx=0 tx=0).stop 2024-04-25T02:29:15.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.754+0000 7f97694bd640 1 -- 172.21.15.67:0/3233526168 shutdown_connections 2024-04-25T02:29:15.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.754+0000 7f97694bd640 1 --2- 172.21.15.67:0/3233526168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97640acda0 0x7f976406cb70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.754+0000 7f97694bd640 1 --2- 172.21.15.67:0/3233526168 >> v2:172.21.15.176:3300/0 conn(0x7f97640af120 0x7f9764071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.754+0000 7f97694bd640 1 -- 172.21.15.67:0/3233526168 >> 172.21.15.67:0/3233526168 conn(0x7f97640b19c0 msgr2=0x7f97640b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:15.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.754+0000 7f97694bd640 1 -- 172.21.15.67:0/3233526168 shutdown_connections 2024-04-25T02:29:15.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.754+0000 7f97694bd640 1 -- 172.21.15.67:0/3233526168 wait complete. 2024-04-25T02:29:15.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.755+0000 7f97694bd640 1 Processor -- start 2024-04-25T02:29:15.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.755+0000 7f97694bd640 1 -- start start 2024-04-25T02:29:15.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.756+0000 7f97694bd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97640acda0 0x7f97640b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.756+0000 7f97694bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97640af120 0x7f976414e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.756+0000 7f97694bd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f976415c230 0x7f976414ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.756+0000 7f97694bd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9764160600 con 0x7f97640af120 2024-04-25T02:29:15.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.756+0000 7f97694bd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9764160320 con 0x7f976415c230 2024-04-25T02:29:15.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.756+0000 7f97694bd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f97640ad4d0 con 0x7f97640acda0 2024-04-25T02:29:15.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.756+0000 7f97627fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97640af120 0x7f976414e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.756+0000 7f97627fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97640af120 0x7f976414e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37746/0 (socket says 172.21.15.67:37746) 2024-04-25T02:29:15.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.756+0000 7f97627fc640 1 -- 172.21.15.67:0/2046269669 learned_addr learned my addr 172.21.15.67:0/2046269669 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:15.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.756+0000 7f9762ffd640 1 --2- 172.21.15.67:0/2046269669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97640acda0 0x7f97640b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.756+0000 7f97637fe640 1 --2- 172.21.15.67:0/2046269669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f976415c230 0x7f976414ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.757+0000 7f97627fc640 1 -- 172.21.15.67:0/2046269669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97640acda0 msgr2=0x7f97640b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.757+0000 7f97627fc640 1 --2- 172.21.15.67:0/2046269669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97640acda0 0x7f97640b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.757+0000 7f97627fc640 1 -- 172.21.15.67:0/2046269669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f976415c230 msgr2=0x7f976414ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.757+0000 7f97627fc640 1 --2- 172.21.15.67:0/2046269669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f976415c230 0x7f976414ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.757+0000 7f97627fc640 1 -- 172.21.15.67:0/2046269669 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97640b3700 con 0x7f97640af120 2024-04-25T02:29:15.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.757+0000 7f97637fe640 1 --2- 172.21.15.67:0/2046269669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f976415c230 0x7f976414ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:15.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.757+0000 7f97627fc640 1 --2- 172.21.15.67:0/2046269669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97640af120 0x7f976414e6e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f975400e8b0 tx=0x7f975400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:15.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.757+0000 7f975b7fe640 1 -- 172.21.15.67:0/2046269669 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9754017070 con 0x7f97640af120 2024-04-25T02:29:15.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.757+0000 7f975b7fe640 1 -- 172.21.15.67:0/2046269669 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f975400c940 con 0x7f97640af120 2024-04-25T02:29:15.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.757+0000 7f97694bd640 1 -- 172.21.15.67:0/2046269669 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97640b39e0 con 0x7f97640af120 2024-04-25T02:29:15.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.757+0000 7f975b7fe640 1 -- 172.21.15.67:0/2046269669 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975400cd10 con 0x7f97640af120 2024-04-25T02:29:15.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.757+0000 7f97694bd640 1 -- 172.21.15.67:0/2046269669 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97640b0140 con 0x7f97640af120 2024-04-25T02:29:15.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.758+0000 7f97694bd640 1 -- 172.21.15.67:0/2046269669 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9764069110 con 0x7f97640af120 2024-04-25T02:29:15.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.758+0000 7f975b7fe640 1 -- 172.21.15.67:0/2046269669 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f975401a070 con 0x7f97640af120 2024-04-25T02:29:15.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.759+0000 7f975b7fe640 1 --2- 172.21.15.67:0/2046269669 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f974406be30 0x7f974406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:15.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.759+0000 7f975b7fe640 1 -- 172.21.15.67:0/2046269669 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f975408ad80 con 0x7f97640af120 2024-04-25T02:29:15.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.759+0000 7f9762ffd640 1 --2- 172.21.15.67:0/2046269669 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f974406be30 0x7f974406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:15.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.760+0000 7f9762ffd640 1 --2- 172.21.15.67:0/2046269669 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f974406be30 0x7f974406e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f974c007fd0 tx=0x7f974c007e80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:15.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.767+0000 7f975b7fe640 1 -- 172.21.15.67:0/2046269669 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9754059430 con 0x7f97640af120 2024-04-25T02:29:15.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.953+0000 7f97694bd640 1 -- 172.21.15.67:0/2046269669 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f976415b9c0 con 0x7f97640af120 2024-04-25T02:29:15.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.953+0000 7f975b7fe640 1 -- 172.21.15.67:0/2046269669 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) ==== 84+0+65 (secure 0 0 0) 0x7f975405d730 con 0x7f97640af120 2024-04-25T02:29:15.958 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:15.958 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-04-25T02:29:15.958 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:15.958 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-04-25T02:29:15.958 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-04-25T02:29:15.958 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:15.958 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-04-25T02:29:15.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.955+0000 7f97694bd640 1 -- 172.21.15.67:0/2046269669 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f974406be30 msgr2=0x7f974406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.955+0000 7f97694bd640 1 --2- 172.21.15.67:0/2046269669 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f974406be30 0x7f974406e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f974c007fd0 tx=0x7f974c007e80 comp rx=0 tx=0).stop 2024-04-25T02:29:15.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.955+0000 7f97694bd640 1 -- 172.21.15.67:0/2046269669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97640af120 msgr2=0x7f976414e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:15.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.955+0000 7f97694bd640 1 --2- 172.21.15.67:0/2046269669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97640af120 0x7f976414e6e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f975400e8b0 tx=0x7f975400ed70 comp rx=0 tx=0).stop 2024-04-25T02:29:15.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.955+0000 7f97694bd640 1 -- 172.21.15.67:0/2046269669 shutdown_connections 2024-04-25T02:29:15.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.955+0000 7f97694bd640 1 --2- 172.21.15.67:0/2046269669 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f974406be30 0x7f974406e2f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.955+0000 7f97694bd640 1 --2- 172.21.15.67:0/2046269669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f976415c230 0x7f976414ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.955+0000 7f97694bd640 1 --2- 172.21.15.67:0/2046269669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97640af120 0x7f976414e6e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.955+0000 7f97694bd640 1 --2- 172.21.15.67:0/2046269669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97640acda0 0x7f97640b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:15.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.955+0000 7f97694bd640 1 -- 172.21.15.67:0/2046269669 >> 172.21.15.67:0/2046269669 conn(0x7f97640b19c0 msgr2=0x7f97640cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:15.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.956+0000 7f97694bd640 1 -- 172.21.15.67:0/2046269669 shutdown_connections 2024-04-25T02:29:15.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:15.956+0000 7f97694bd640 1 -- 172.21.15.67:0/2046269669 wait complete. 2024-04-25T02:29:15.970 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T02:29:15.970 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T02:29:16.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.071+0000 7f6967212640 1 Processor -- start 2024-04-25T02:29:16.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.071+0000 7f6967212640 1 -- start start 2024-04-25T02:29:16.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f6967212640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f69600d12b0 0x7f69600cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:16.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f6967212640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69600d1f70 con 0x7f696015e5a0 2024-04-25T02:29:16.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f6967212640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69600d2250 con 0x7f69600b4fc0 2024-04-25T02:29:16.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f6967212640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f69600b3b20 con 0x7f69600d12b0 2024-04-25T02:29:16.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f6964fae640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f696015e5a0 0x7f69600d0ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49388/0 (socket says 172.21.15.67:49388) 2024-04-25T02:29:16.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f6964fae640 1 -- 172.21.15.67:0/1449940213 learned_addr learned my addr 172.21.15.67:0/1449940213 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:16.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f695ffff640 1 --2- 172.21.15.67:0/1449940213 >> v2:172.21.15.176:3300/0 conn(0x7f69600d12b0 0x7f69600cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:16.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f695f7fe640 1 -- 172.21.15.67:0/1449940213 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2362180947 0 0) 0x7f69600d1f70 con 0x7f696015e5a0 2024-04-25T02:29:16.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f695f7fe640 1 -- 172.21.15.67:0/1449940213 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6950003520 con 0x7f696015e5a0 2024-04-25T02:29:16.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f695f7fe640 1 -- 172.21.15.67:0/1449940213 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 814285020 0 0) 0x7f6950003520 con 0x7f696015e5a0 2024-04-25T02:29:16.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f695f7fe640 1 -- 172.21.15.67:0/1449940213 >> v2:172.21.15.176:3300/0 conn(0x7f69600d12b0 msgr2=0x7f69600cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:16.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f695f7fe640 1 --2- 172.21.15.67:0/1449940213 >> v2:172.21.15.176:3300/0 conn(0x7f69600d12b0 0x7f69600cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:16.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f695f7fe640 1 -- 172.21.15.67:0/1449940213 >> v1:172.21.15.176:6789/0 conn(0x7f69600b4fc0 legacy=0x7f69600cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:16.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f695f7fe640 1 -- 172.21.15.67:0/1449940213 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69600b37b0 con 0x7f696015e5a0 2024-04-25T02:29:16.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f695f7fe640 1 -- 172.21.15.67:0/1449940213 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f6954001670 con 0x7f696015e5a0 2024-04-25T02:29:16.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f695f7fe640 1 -- 172.21.15.67:0/1449940213 >> v1:172.21.15.67:6789/0 conn(0x7f696015e5a0 legacy=0x7f69600d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:16.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f695f7fe640 1 --2- 172.21.15.67:0/1449940213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69500039b0 0x7f6950003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:16.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f695f7fe640 1 --2- 172.21.15.67:0/1449940213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6950004800 0x7f6950004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:16.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.072+0000 7f695f7fe640 1 --2- 172.21.15.67:0/1449940213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69500052e0 0x7f695000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:16.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.073+0000 7f695f7fe640 1 -- 172.21.15.67:0/1449940213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f69600b3b20 con 0x7f69500052e0 2024-04-25T02:29:16.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.073+0000 7f695f7fe640 1 -- 172.21.15.67:0/1449940213 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f695000c1b0 con 0x7f6950004800 2024-04-25T02:29:16.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.073+0000 7f695f7fe640 1 -- 172.21.15.67:0/1449940213 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f695000c3b0 con 0x7f69500039b0 2024-04-25T02:29:16.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.073+0000 7f69657af640 1 --2- 172.21.15.67:0/1449940213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69500052e0 0x7f695000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:16.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.073+0000 7f6964fae640 1 --2- 172.21.15.67:0/1449940213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69500039b0 0x7f6950003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:16.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.073+0000 7f695ffff640 1 --2- 172.21.15.67:0/1449940213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6950004800 0x7f6950004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:16.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.073+0000 7f69657af640 1 -- 172.21.15.67:0/1449940213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69500039b0 msgr2=0x7f6950003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:16.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.073+0000 7f69657af640 1 --2- 172.21.15.67:0/1449940213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69500039b0 0x7f6950003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:16.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.073+0000 7f69657af640 1 -- 172.21.15.67:0/1449940213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6950004800 msgr2=0x7f6950004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:16.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.073+0000 7f69657af640 1 --2- 172.21.15.67:0/1449940213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6950004800 0x7f6950004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:16.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.073+0000 7f69657af640 1 -- 172.21.15.67:0/1449940213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6950003520 con 0x7f69500052e0 2024-04-25T02:29:16.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.074+0000 7f69657af640 1 -- 172.21.15.67:0/1449940213 reap_dead start 2024-04-25T02:29:16.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.074+0000 7f69657af640 1 --2- 172.21.15.67:0/1449940213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69500052e0 0x7f695000b9c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6958001e20 tx=0x7f6950005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174588a74f07908 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:16.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.074+0000 7f695f7fe640 1 -- 172.21.15.67:0/1449940213 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6958001a70 con 0x7f69500052e0 2024-04-25T02:29:16.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.074+0000 7f695f7fe640 1 -- 172.21.15.67:0/1449940213 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f695802ae40 con 0x7f69500052e0 2024-04-25T02:29:16.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.074+0000 7f695f7fe640 1 -- 172.21.15.67:0/1449940213 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6958003bb0 con 0x7f69500052e0 2024-04-25T02:29:16.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.074+0000 7f6967212640 1 -- 172.21.15.67:0/1449940213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69500052e0 msgr2=0x7f695000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:16.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.074+0000 7f6967212640 1 --2- 172.21.15.67:0/1449940213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69500052e0 0x7f695000b9c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6958001e20 tx=0x7f6950005830 comp rx=0 tx=0).stop 2024-04-25T02:29:16.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.074+0000 7f6967212640 1 -- 172.21.15.67:0/1449940213 shutdown_connections 2024-04-25T02:29:16.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.074+0000 7f6967212640 1 --2- 172.21.15.67:0/1449940213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69500052e0 0x7f695000b9c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:16.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.074+0000 7f6967212640 1 -- 172.21.15.67:0/1449940213 >> 172.21.15.67:0/1449940213 conn(0x7f69600d4190 msgr2=0x7f69600d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:16.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.074+0000 7f6967212640 1 -- 172.21.15.67:0/1449940213 shutdown_connections 2024-04-25T02:29:16.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.074+0000 7f6967212640 1 -- 172.21.15.67:0/1449940213 wait complete. 2024-04-25T02:29:16.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.076+0000 7f6967212640 1 Processor -- start 2024-04-25T02:29:16.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.076+0000 7f6967212640 1 -- start start 2024-04-25T02:29:16.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f6967212640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69500052e0 0x7f6960160b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:16.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f6967212640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f696015f510 0x7f696015f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:16.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f6967212640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69600cc4a0 0x7f69600cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:16.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f6967212640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f696015e980 con 0x7f69600cc4a0 2024-04-25T02:29:16.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f6967212640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f69600d2530 con 0x7f69500052e0 2024-04-25T02:29:16.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f6967212640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f69600d4cb0 con 0x7f696015f510 2024-04-25T02:29:16.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f69657af640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69600cc4a0 0x7f69600cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:16.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f69657af640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69600cc4a0 0x7f69600cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37760/0 (socket says 172.21.15.67:37760) 2024-04-25T02:29:16.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f69657af640 1 -- 172.21.15.67:0/63079107 learned_addr learned my addr 172.21.15.67:0/63079107 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:16.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f6964fae640 1 --2- 172.21.15.67:0/63079107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69500052e0 0x7f6960160b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:16.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f695ffff640 1 --2- 172.21.15.67:0/63079107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f696015f510 0x7f696015f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:16.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f69657af640 1 -- 172.21.15.67:0/63079107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f696015f510 msgr2=0x7f696015f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:16.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f69657af640 1 --2- 172.21.15.67:0/63079107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f696015f510 0x7f696015f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:16.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f69657af640 1 -- 172.21.15.67:0/63079107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69500052e0 msgr2=0x7f6960160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:16.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f69657af640 1 --2- 172.21.15.67:0/63079107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69500052e0 0x7f6960160b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:16.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f69657af640 1 -- 172.21.15.67:0/63079107 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69600cdbd0 con 0x7f69600cc4a0 2024-04-25T02:29:16.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f69657af640 1 --2- 172.21.15.67:0/63079107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69600cc4a0 0x7f69600cc900 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6958001f40 tx=0x7f69580014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:16.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f695d7fa640 1 -- 172.21.15.67:0/63079107 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6958007db0 con 0x7f69600cc4a0 2024-04-25T02:29:16.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f695d7fa640 1 -- 172.21.15.67:0/63079107 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6958041070 con 0x7f69600cc4a0 2024-04-25T02:29:16.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f695d7fa640 1 -- 172.21.15.67:0/63079107 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6958001a70 con 0x7f69600cc4a0 2024-04-25T02:29:16.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.077+0000 7f6967212640 1 -- 172.21.15.67:0/63079107 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69600cb400 con 0x7f69600cc4a0 2024-04-25T02:29:16.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.078+0000 7f6967212640 1 -- 172.21.15.67:0/63079107 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69600cb9c0 con 0x7f69600cc4a0 2024-04-25T02:29:16.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.078+0000 7f6967212640 1 -- 172.21.15.67:0/63079107 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6960069110 con 0x7f69600cc4a0 2024-04-25T02:29:16.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.079+0000 7f695d7fa640 1 -- 172.21.15.67:0/63079107 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6958032680 con 0x7f69600cc4a0 2024-04-25T02:29:16.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.079+0000 7f695d7fa640 1 --2- 172.21.15.67:0/63079107 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f694406be60 0x7f694406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:16.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.079+0000 7f695d7fa640 1 -- 172.21.15.67:0/63079107 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f69580aa9c0 con 0x7f69600cc4a0 2024-04-25T02:29:16.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.080+0000 7f6964fae640 1 --2- 172.21.15.67:0/63079107 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f694406be60 0x7f694406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:16.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.080+0000 7f6964fae640 1 --2- 172.21.15.67:0/63079107 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f694406be60 0x7f694406e320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f69540010e0 tx=0x7f6954009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:16.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.084+0000 7f695d7fa640 1 -- 172.21.15.67:0/63079107 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f69580ace20 con 0x7f69600cc4a0 2024-04-25T02:29:16.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.268+0000 7f6967212640 1 -- 172.21.15.67:0/63079107 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f69600b5a60 con 0x7f69600cc4a0 2024-04-25T02:29:16.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.311+0000 7f695d7fa640 1 -- 172.21.15.67:0/63079107 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) ==== 138+0+0 (secure 0 0 0) 0x7f6958039070 con 0x7f69600cc4a0 2024-04-25T02:29:16.315 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-04-25T02:29:16.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.313+0000 7f6967212640 1 -- 172.21.15.67:0/63079107 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f694406be60 msgr2=0x7f694406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:16.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.313+0000 7f6967212640 1 --2- 172.21.15.67:0/63079107 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f694406be60 0x7f694406e320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f69540010e0 tx=0x7f6954009040 comp rx=0 tx=0).stop 2024-04-25T02:29:16.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.313+0000 7f6967212640 1 -- 172.21.15.67:0/63079107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69600cc4a0 msgr2=0x7f69600cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:16.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.313+0000 7f6967212640 1 --2- 172.21.15.67:0/63079107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69600cc4a0 0x7f69600cc900 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6958001f40 tx=0x7f69580014a0 comp rx=0 tx=0).stop 2024-04-25T02:29:16.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.313+0000 7f6967212640 1 -- 172.21.15.67:0/63079107 shutdown_connections 2024-04-25T02:29:16.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.313+0000 7f6967212640 1 --2- 172.21.15.67:0/63079107 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f694406be60 0x7f694406e320 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.313+0000 7f6967212640 1 --2- 172.21.15.67:0/63079107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69600cc4a0 0x7f69600cc900 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.313+0000 7f6967212640 1 --2- 172.21.15.67:0/63079107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f696015f510 0x7f696015f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.313+0000 7f6967212640 1 --2- 172.21.15.67:0/63079107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69500052e0 0x7f6960160b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.313+0000 7f6967212640 1 -- 172.21.15.67:0/63079107 >> 172.21.15.67:0/63079107 conn(0x7f69600d4190 msgr2=0x7f69600cf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.313+0000 7f6967212640 1 -- 172.21.15.67:0/63079107 shutdown_connections 2024-04-25T02:29:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.313+0000 7f6967212640 1 -- 172.21.15.67:0/63079107 wait complete. 2024-04-25T02:29:16.331 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T02:29:16.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.435+0000 7fd21d56a640 1 Processor -- start 2024-04-25T02:29:16.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.435+0000 7fd21d56a640 1 -- start start 2024-04-25T02:29:16.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.436+0000 7fd21d56a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd21815e5a0 0x7fd2180d0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:16.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.436+0000 7fd21d56a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd2180cfdf0 0x7fd2180d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:16.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.436+0000 7fd21d56a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2180d1f70 con 0x7fd2180d4cb0 2024-04-25T02:29:16.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.436+0000 7fd21d56a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd2180b3b20 con 0x7fd2180cfdf0 2024-04-25T02:29:16.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.436+0000 7fd21d56a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd2180d2530 con 0x7fd21815e5a0 2024-04-25T02:29:16.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.436+0000 7fd2177fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd2180cfdf0 0x7fd2180d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:16.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.436+0000 7fd2167fc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd2180d4cb0 0x7fd2180b3fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49404/0 (socket says 172.21.15.67:49404) 2024-04-25T02:29:16.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.436+0000 7fd2167fc640 1 -- 172.21.15.67:0/987275335 learned_addr learned my addr 172.21.15.67:0/987275335 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:16.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.436+0000 7fd216ffd640 1 --2- 172.21.15.67:0/987275335 >> v2:172.21.15.176:3300/0 conn(0x7fd21815e5a0 0x7fd2180d0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:16.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.437+0000 7fd2177fe640 1 -- 172.21.15.67:0/987275335 >> v2:172.21.15.176:3300/0 conn(0x7fd21815e5a0 msgr2=0x7fd2180d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:16.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.437+0000 7fd2177fe640 1 --2- 172.21.15.67:0/987275335 >> v2:172.21.15.176:3300/0 conn(0x7fd21815e5a0 0x7fd2180d0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:16.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.437+0000 7fd2177fe640 1 -- 172.21.15.67:0/987275335 >> v1:172.21.15.67:6789/0 conn(0x7fd2180d4cb0 legacy=0x7fd2180b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:16.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.437+0000 7fd2177fe640 1 -- 172.21.15.67:0/987275335 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2180d2250 con 0x7fd2180cfdf0 2024-04-25T02:29:16.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.437+0000 7fd216ffd640 1 --2- 172.21.15.67:0/987275335 >> v2:172.21.15.176:3300/0 conn(0x7fd21815e5a0 0x7fd2180d0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.437+0000 7fd2177fe640 1 --2- 172.21.15.67:0/987275335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2180cfdf0 0x7fd2180d10e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd218067ed0 tx=0x7fd20802a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894f489a431422e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.437+0000 7fd215ffb640 1 -- 172.21.15.67:0/987275335 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208007740 con 0x7fd2180cfdf0 2024-04-25T02:29:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.438+0000 7fd215ffb640 1 -- 172.21.15.67:0/987275335 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2080078e0 con 0x7fd2180cfdf0 2024-04-25T02:29:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.438+0000 7fd215ffb640 1 -- 172.21.15.67:0/987275335 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208007cb0 con 0x7fd2180cfdf0 2024-04-25T02:29:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.438+0000 7fd21d56a640 1 -- 172.21.15.67:0/987275335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2180cfdf0 msgr2=0x7fd2180d10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.438+0000 7fd21d56a640 1 --2- 172.21.15.67:0/987275335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2180cfdf0 0x7fd2180d10e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd218067ed0 tx=0x7fd20802a560 comp rx=0 tx=0).stop 2024-04-25T02:29:16.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.438+0000 7fd21d56a640 1 -- 172.21.15.67:0/987275335 shutdown_connections 2024-04-25T02:29:16.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.438+0000 7fd21d56a640 1 --2- 172.21.15.67:0/987275335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2180cfdf0 0x7fd2180d10e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:16.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.438+0000 7fd21d56a640 1 --2- 172.21.15.67:0/987275335 >> v2:172.21.15.176:3300/0 conn(0x7fd21815e5a0 0x7fd2180d0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:16.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.438+0000 7fd21d56a640 1 -- 172.21.15.67:0/987275335 >> 172.21.15.67:0/987275335 conn(0x7fd2180d4190 msgr2=0x7fd2180d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:16.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.438+0000 7fd21d56a640 1 -- 172.21.15.67:0/987275335 shutdown_connections 2024-04-25T02:29:16.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.438+0000 7fd21d56a640 1 -- 172.21.15.67:0/987275335 wait complete. 2024-04-25T02:29:16.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.439+0000 7fd21d56a640 1 Processor -- start 2024-04-25T02:29:16.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.439+0000 7fd21d56a640 1 -- start start 2024-04-25T02:29:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.440+0000 7fd21d56a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2180cfdf0 0x7fd2180c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.440+0000 7fd21d56a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2180d4cb0 0x7fd2181605a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.440+0000 7fd21d56a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd21815e5a0 0x7fd218160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.440+0000 7fd21d56a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd21815e980 con 0x7fd21815e5a0 2024-04-25T02:29:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.440+0000 7fd21d56a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd2180d1a30 con 0x7fd2180cfdf0 2024-04-25T02:29:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.440+0000 7fd21d56a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd2180b46c0 con 0x7fd2180d4cb0 2024-04-25T02:29:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.440+0000 7fd2177fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd21815e5a0 0x7fd218160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.440+0000 7fd2177fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd21815e5a0 0x7fd218160ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37770/0 (socket says 172.21.15.67:37770) 2024-04-25T02:29:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.440+0000 7fd2177fe640 1 -- 172.21.15.67:0/2425126912 learned_addr learned my addr 172.21.15.67:0/2425126912 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.440+0000 7fd216ffd640 1 --2- 172.21.15.67:0/2425126912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2180cfdf0 0x7fd2180c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.440+0000 7fd2167fc640 1 --2- 172.21.15.67:0/2425126912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2180d4cb0 0x7fd2181605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.441+0000 7fd2177fe640 1 -- 172.21.15.67:0/2425126912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2180d4cb0 msgr2=0x7fd2181605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:16.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.441+0000 7fd2177fe640 1 --2- 172.21.15.67:0/2425126912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2180d4cb0 0x7fd2181605a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:16.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.441+0000 7fd2177fe640 1 -- 172.21.15.67:0/2425126912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2180cfdf0 msgr2=0x7fd2180c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:16.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.441+0000 7fd2177fe640 1 --2- 172.21.15.67:0/2425126912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2180cfdf0 0x7fd2180c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:16.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.441+0000 7fd2177fe640 1 -- 172.21.15.67:0/2425126912 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21815edc0 con 0x7fd21815e5a0 2024-04-25T02:29:16.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.441+0000 7fd2177fe640 1 --2- 172.21.15.67:0/2425126912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd21815e5a0 0x7fd218160ae0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd20802ab50 tx=0x7fd208004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:16.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.441+0000 7fd20f7fe640 1 -- 172.21.15.67:0/2425126912 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208040070 con 0x7fd21815e5a0 2024-04-25T02:29:16.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.441+0000 7fd20f7fe640 1 -- 172.21.15.67:0/2425126912 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd208031bc0 con 0x7fd21815e5a0 2024-04-25T02:29:16.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.441+0000 7fd20f7fe640 1 -- 172.21.15.67:0/2425126912 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208045460 con 0x7fd21815e5a0 2024-04-25T02:29:16.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.441+0000 7fd21d56a640 1 -- 172.21.15.67:0/2425126912 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd218161110 con 0x7fd21815e5a0 2024-04-25T02:29:16.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.441+0000 7fd21d56a640 1 -- 172.21.15.67:0/2425126912 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2181616d0 con 0x7fd21815e5a0 2024-04-25T02:29:16.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.442+0000 7fd21d56a640 1 -- 172.21.15.67:0/2425126912 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd218069110 con 0x7fd21815e5a0 2024-04-25T02:29:16.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.443+0000 7fd20f7fe640 1 -- 172.21.15.67:0/2425126912 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd208039040 con 0x7fd21815e5a0 2024-04-25T02:29:16.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.443+0000 7fd20f7fe640 1 --2- 172.21.15.67:0/2425126912 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd1f806be30 0x7fd1f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:16.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.443+0000 7fd20f7fe640 1 -- 172.21.15.67:0/2425126912 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7fd2080ac4b0 con 0x7fd21815e5a0 2024-04-25T02:29:16.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.443+0000 7fd216ffd640 1 --2- 172.21.15.67:0/2425126912 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd1f806be30 0x7fd1f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:16.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.444+0000 7fd216ffd640 1 --2- 172.21.15.67:0/2425126912 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd1f806be30 0x7fd1f806e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd210006fd0 tx=0x7fd210008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:16.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.448+0000 7fd20f7fe640 1 -- 172.21.15.67:0/2425126912 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd20807a9f0 con 0x7fd21815e5a0 2024-04-25T02:29:16.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:16.631+0000 7fd21d56a640 1 -- 172.21.15.67:0/2425126912 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd2180caa30 con 0x7fd21815e5a0 2024-04-25T02:29:17.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.319+0000 7fd20f7fe640 1 -- 172.21.15.67:0/2425126912 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) ==== 170+0+0 (secure 0 0 0) 0x7fd20807ecf0 con 0x7fd21815e5a0 2024-04-25T02:29:17.324 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-04-25T02:29:17.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.322+0000 7fd21d56a640 1 -- 172.21.15.67:0/2425126912 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd1f806be30 msgr2=0x7fd1f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:17.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.322+0000 7fd21d56a640 1 --2- 172.21.15.67:0/2425126912 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd1f806be30 0x7fd1f806e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd210006fd0 tx=0x7fd210008040 comp rx=0 tx=0).stop 2024-04-25T02:29:17.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.322+0000 7fd21d56a640 1 -- 172.21.15.67:0/2425126912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd21815e5a0 msgr2=0x7fd218160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:17.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.322+0000 7fd21d56a640 1 --2- 172.21.15.67:0/2425126912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd21815e5a0 0x7fd218160ae0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd20802ab50 tx=0x7fd208004a40 comp rx=0 tx=0).stop 2024-04-25T02:29:17.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.322+0000 7fd21d56a640 1 -- 172.21.15.67:0/2425126912 shutdown_connections 2024-04-25T02:29:17.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.322+0000 7fd21d56a640 1 --2- 172.21.15.67:0/2425126912 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd1f806be30 0x7fd1f806e2f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:17.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.322+0000 7fd21d56a640 1 --2- 172.21.15.67:0/2425126912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd21815e5a0 0x7fd218160ae0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:17.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.322+0000 7fd21d56a640 1 --2- 172.21.15.67:0/2425126912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2180d4cb0 0x7fd2181605a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:17.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.322+0000 7fd21d56a640 1 --2- 172.21.15.67:0/2425126912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2180cfdf0 0x7fd2180c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:17.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.322+0000 7fd21d56a640 1 -- 172.21.15.67:0/2425126912 >> 172.21.15.67:0/2425126912 conn(0x7fd2180d4190 msgr2=0x7fd2180b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:17.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.322+0000 7fd21d56a640 1 -- 172.21.15.67:0/2425126912 shutdown_connections 2024-04-25T02:29:17.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.322+0000 7fd21d56a640 1 -- 172.21.15.67:0/2425126912 wait complete. 2024-04-25T02:29:17.351 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T02:29:17.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.455+0000 7f83c1942640 1 Processor -- start 2024-04-25T02:29:17.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.455+0000 7f83c1942640 1 -- start start 2024-04-25T02:29:17.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.456+0000 7f83c1942640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f83bc15e760 0x7f83bc0cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:17.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.456+0000 7f83c1942640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f83bc0d1470 0x7f83bc06bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:17.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.456+0000 7f83c1942640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83bc0cff80 con 0x7f83bc0d0900 2024-04-25T02:29:17.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.456+0000 7f83c1942640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f83bc0d28a0 con 0x7f83bc15e760 2024-04-25T02:29:17.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.456+0000 7f83c1942640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f83bc0d2250 con 0x7f83bc0d1470 2024-04-25T02:29:17.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.456+0000 7f83baffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f83bc15e760 0x7f83bc0cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:17.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.456+0000 7f83baffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f83bc15e760 0x7f83bc0cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37778/0 (socket says 172.21.15.67:37778) 2024-04-25T02:29:17.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.456+0000 7f83baffd640 1 -- 172.21.15.67:0/1029473409 learned_addr learned my addr 172.21.15.67:0/1029473409 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:17.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.457+0000 7f83bb7fe640 1 --2- 172.21.15.67:0/1029473409 >> v2:172.21.15.176:3300/0 conn(0x7f83bc0d1470 0x7f83bc06bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:17.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.457+0000 7f83baffd640 1 -- 172.21.15.67:0/1029473409 >> v2:172.21.15.176:3300/0 conn(0x7f83bc0d1470 msgr2=0x7f83bc06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:17.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.457+0000 7f83baffd640 1 --2- 172.21.15.67:0/1029473409 >> v2:172.21.15.176:3300/0 conn(0x7f83bc0d1470 0x7f83bc06bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:17.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.457+0000 7f83baffd640 1 -- 172.21.15.67:0/1029473409 >> v1:172.21.15.176:6789/0 conn(0x7f83bc0d0900 legacy=0x7f83bc0d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:17.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.457+0000 7f83baffd640 1 -- 172.21.15.67:0/1029473409 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83bc0d2530 con 0x7f83bc15e760 2024-04-25T02:29:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.457+0000 7f83baffd640 1 --2- 172.21.15.67:0/1029473409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83bc15e760 0x7f83bc0cf8f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0d2a20 tx=0x7f83b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f89d29f249ee29c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.458+0000 7f83b9ffb640 1 -- 172.21.15.67:0/1029473409 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b4037070 con 0x7f83bc15e760 2024-04-25T02:29:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.458+0000 7f83b9ffb640 1 -- 172.21.15.67:0/1029473409 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b4032440 con 0x7f83bc15e760 2024-04-25T02:29:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.458+0000 7f83b9ffb640 1 -- 172.21.15.67:0/1029473409 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b4032810 con 0x7f83bc15e760 2024-04-25T02:29:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.458+0000 7f83c1942640 1 -- 172.21.15.67:0/1029473409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83bc15e760 msgr2=0x7f83bc0cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.458+0000 7f83c1942640 1 --2- 172.21.15.67:0/1029473409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83bc15e760 0x7f83bc0cf8f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0d2a20 tx=0x7f83b402a270 comp rx=0 tx=0).stop 2024-04-25T02:29:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.458+0000 7f83c1942640 1 -- 172.21.15.67:0/1029473409 shutdown_connections 2024-04-25T02:29:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.458+0000 7f83c1942640 1 --2- 172.21.15.67:0/1029473409 >> v2:172.21.15.176:3300/0 conn(0x7f83bc0d1470 0x7f83bc06bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:17.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.458+0000 7f83c1942640 1 --2- 172.21.15.67:0/1029473409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83bc15e760 0x7f83bc0cf8f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:17.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.458+0000 7f83c1942640 1 -- 172.21.15.67:0/1029473409 >> 172.21.15.67:0/1029473409 conn(0x7f83bc0d41b0 msgr2=0x7f83bc0d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:17.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.458+0000 7f83c1942640 1 -- 172.21.15.67:0/1029473409 shutdown_connections 2024-04-25T02:29:17.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.458+0000 7f83c1942640 1 -- 172.21.15.67:0/1029473409 wait complete. 2024-04-25T02:29:17.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.459+0000 7f83c1942640 1 Processor -- start 2024-04-25T02:29:17.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.460+0000 7f83c1942640 1 -- start start 2024-04-25T02:29:17.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.460+0000 7f83c1942640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83bc0d0900 0x7f83bc154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:17.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.460+0000 7f83c1942640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83bc0d1470 0x7f83bc0b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:17.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.460+0000 7f83c1942640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83bc15e760 0x7f83bc0c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:17.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.460+0000 7f83c1942640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f83bc15eb40 con 0x7f83bc0d1470 2024-04-25T02:29:17.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.460+0000 7f83c1942640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f83bc0d3d40 con 0x7f83bc0d0900 2024-04-25T02:29:17.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.460+0000 7f83c1942640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f83bc15ecc0 con 0x7f83bc15e760 2024-04-25T02:29:17.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.460+0000 7f83ba7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83bc0d1470 0x7f83bc0b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:17.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.461+0000 7f83ba7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83bc0d1470 0x7f83bc0b71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37786/0 (socket says 172.21.15.67:37786) 2024-04-25T02:29:17.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.461+0000 7f83ba7fc640 1 -- 172.21.15.67:0/210917949 learned_addr learned my addr 172.21.15.67:0/210917949 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:17.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.461+0000 7f83baffd640 1 --2- 172.21.15.67:0/210917949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83bc0d0900 0x7f83bc154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:17.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.461+0000 7f83bb7fe640 1 --2- 172.21.15.67:0/210917949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83bc15e760 0x7f83bc0c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:17.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.461+0000 7f83ba7fc640 1 -- 172.21.15.67:0/210917949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83bc15e760 msgr2=0x7f83bc0c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:17.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.461+0000 7f83ba7fc640 1 --2- 172.21.15.67:0/210917949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83bc15e760 0x7f83bc0c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:17.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.461+0000 7f83ba7fc640 1 -- 172.21.15.67:0/210917949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83bc0d0900 msgr2=0x7f83bc154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:17.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.461+0000 7f83ba7fc640 1 --2- 172.21.15.67:0/210917949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83bc0d0900 0x7f83bc154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:17.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.461+0000 7f83ba7fc640 1 -- 172.21.15.67:0/210917949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83bc0c81d0 con 0x7f83bc0d1470 2024-04-25T02:29:17.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.461+0000 7f83ba7fc640 1 --2- 172.21.15.67:0/210917949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83bc0d1470 0x7f83bc0b71f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f83b000c430 tx=0x7f83b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:17.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.461+0000 7f83a3fff640 1 -- 172.21.15.67:0/210917949 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b00052d0 con 0x7f83bc0d1470 2024-04-25T02:29:17.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.461+0000 7f83a3fff640 1 -- 172.21.15.67:0/210917949 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b0005490 con 0x7f83bc0d1470 2024-04-25T02:29:17.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.461+0000 7f83c1942640 1 -- 172.21.15.67:0/210917949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83bc0c84b0 con 0x7f83bc0d1470 2024-04-25T02:29:17.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.461+0000 7f83a3fff640 1 -- 172.21.15.67:0/210917949 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0007260 con 0x7f83bc0d1470 2024-04-25T02:29:17.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.461+0000 7f83c1942640 1 -- 172.21.15.67:0/210917949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83bc0c8a70 con 0x7f83bc0d1470 2024-04-25T02:29:17.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.462+0000 7f83c1942640 1 -- 172.21.15.67:0/210917949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83bc069110 con 0x7f83bc0d1470 2024-04-25T02:29:17.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.463+0000 7f83a3fff640 1 -- 172.21.15.67:0/210917949 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83b0007400 con 0x7f83bc0d1470 2024-04-25T02:29:17.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.463+0000 7f83a3fff640 1 --2- 172.21.15.67:0/210917949 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f83a806be60 0x7f83a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:17.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.463+0000 7f83a3fff640 1 -- 172.21.15.67:0/210917949 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5609+0+0 (secure 0 0 0) 0x7f83b008a290 con 0x7f83bc0d1470 2024-04-25T02:29:17.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.464+0000 7f83baffd640 1 --2- 172.21.15.67:0/210917949 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f83a806be60 0x7f83a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:17.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.464+0000 7f83baffd640 1 --2- 172.21.15.67:0/210917949 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f83a806be60 0x7f83a806e320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f83b4034000 tx=0x7f83b402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:17.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.468+0000 7f83a3fff640 1 -- 172.21.15.67:0/210917949 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f83b0058650 con 0x7f83bc0d1470 2024-04-25T02:29:17.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:17.691+0000 7f83c1942640 1 -- 172.21.15.67:0/210917949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f83bc15de30 con 0x7f83bc0d1470 2024-04-25T02:29:18.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.321+0000 7f83a3fff640 1 -- 172.21.15.67:0/210917949 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7f83b005c950 con 0x7f83bc0d1470 2024-04-25T02:29:18.325 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 4 and data pool 5 2024-04-25T02:29:18.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.328+0000 7f83c1942640 1 -- 172.21.15.67:0/210917949 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f83a806be60 msgr2=0x7f83a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:18.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.328+0000 7f83c1942640 1 --2- 172.21.15.67:0/210917949 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f83a806be60 0x7f83a806e320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f83b4034000 tx=0x7f83b402e000 comp rx=0 tx=0).stop 2024-04-25T02:29:18.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.328+0000 7f83c1942640 1 -- 172.21.15.67:0/210917949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83bc0d1470 msgr2=0x7f83bc0b71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.328+0000 7f83c1942640 1 --2- 172.21.15.67:0/210917949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83bc0d1470 0x7f83bc0b71f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f83b000c430 tx=0x7f83b000c8f0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.331+0000 7f83c1942640 1 -- 172.21.15.67:0/210917949 shutdown_connections 2024-04-25T02:29:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.331+0000 7f83c1942640 1 --2- 172.21.15.67:0/210917949 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f83a806be60 0x7f83a806e320 secure :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f83b4034000 tx=0x7f83b402e000 comp rx=0 tx=0).stop 2024-04-25T02:29:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.331+0000 7f83c1942640 1 --2- 172.21.15.67:0/210917949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83bc15e760 0x7f83bc0c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.331+0000 7f83c1942640 1 --2- 172.21.15.67:0/210917949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83bc0d1470 0x7f83bc0b71f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.331+0000 7f83c1942640 1 --2- 172.21.15.67:0/210917949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83bc0d0900 0x7f83bc154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.331+0000 7f83c1942640 1 -- 172.21.15.67:0/210917949 >> 172.21.15.67:0/210917949 conn(0x7f83bc0d41b0 msgr2=0x7f83bc0b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:18.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.341+0000 7f83c1942640 1 -- 172.21.15.67:0/210917949 shutdown_connections 2024-04-25T02:29:18.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.341+0000 7f83c1942640 1 -- 172.21.15.67:0/210917949 wait complete. 2024-04-25T02:29:18.366 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:29:18.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.466+0000 7fc0937b0640 1 Processor -- start 2024-04-25T02:29:18.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.466+0000 7fc0937b0640 1 -- start start 2024-04-25T02:29:18.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.467+0000 7fc0937b0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc08c15a6f0 0x7fc08c0b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:18.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.467+0000 7fc0937b0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc08c06e7a0 0x7fc08c0b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:18.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.467+0000 7fc0937b0640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc08c0b49a0 0x7fc08c0ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:18.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.467+0000 7fc0937b0640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc08c0b3fd0 con 0x7fc08c15a6f0 2024-04-25T02:29:18.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.467+0000 7fc0937b0640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc08c0b33c0 con 0x7fc08c0b49a0 2024-04-25T02:29:18.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.467+0000 7fc0937b0640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc08c0b36a0 con 0x7fc08c06e7a0 2024-04-25T02:29:18.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.467+0000 7fc09154c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc08c15a6f0 0x7fc08c0b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:18.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.467+0000 7fc09154c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc08c15a6f0 0x7fc08c0b2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37796/0 (socket says 172.21.15.67:37796) 2024-04-25T02:29:18.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.467+0000 7fc09154c640 1 -- 172.21.15.67:0/3145863416 learned_addr learned my addr 172.21.15.67:0/3145863416 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:18.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.467+0000 7fc090d4b640 1 --2- 172.21.15.67:0/3145863416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc08c06e7a0 0x7fc08c0b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:18.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.467+0000 7fc091d4d640 1 --2- 172.21.15.67:0/3145863416 >> v2:172.21.15.176:3300/0 conn(0x7fc08c0b49a0 0x7fc08c0ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:18.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.467+0000 7fc09154c640 1 -- 172.21.15.67:0/3145863416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc08c06e7a0 msgr2=0x7fc08c0b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:18.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.467+0000 7fc09154c640 1 --2- 172.21.15.67:0/3145863416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc08c06e7a0 0x7fc08c0b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.467+0000 7fc09154c640 1 -- 172.21.15.67:0/3145863416 >> v2:172.21.15.176:3300/0 conn(0x7fc08c0b49a0 msgr2=0x7fc08c0ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:18.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.467+0000 7fc09154c640 1 --2- 172.21.15.67:0/3145863416 >> v2:172.21.15.176:3300/0 conn(0x7fc08c0b49a0 0x7fc08c0ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.467+0000 7fc09154c640 1 -- 172.21.15.67:0/3145863416 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08c0b3980 con 0x7fc08c15a6f0 2024-04-25T02:29:18.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.468+0000 7fc09154c640 1 --2- 172.21.15.67:0/3145863416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc08c15a6f0 0x7fc08c0b2cc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0cc4b0 tx=0x7fc07c02c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6849f0b5fb8e69d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:18.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.468+0000 7fc08bfff640 1 -- 172.21.15.67:0/3145863416 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c035400 con 0x7fc08c15a6f0 2024-04-25T02:29:18.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.468+0000 7fc08bfff640 1 -- 172.21.15.67:0/3145863416 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc07c0355a0 con 0x7fc08c15a6f0 2024-04-25T02:29:18.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.468+0000 7fc08bfff640 1 -- 172.21.15.67:0/3145863416 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c035970 con 0x7fc08c15a6f0 2024-04-25T02:29:18.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.469+0000 7fc0937b0640 1 -- 172.21.15.67:0/3145863416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc08c15a6f0 msgr2=0x7fc08c0b2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:18.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.469+0000 7fc0937b0640 1 --2- 172.21.15.67:0/3145863416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc08c15a6f0 0x7fc08c0b2cc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0cc4b0 tx=0x7fc07c02c8a0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.469+0000 7fc0937b0640 1 -- 172.21.15.67:0/3145863416 shutdown_connections 2024-04-25T02:29:18.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.469+0000 7fc0937b0640 1 --2- 172.21.15.67:0/3145863416 >> v2:172.21.15.176:3300/0 conn(0x7fc08c0b49a0 0x7fc08c0ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.469+0000 7fc0937b0640 1 --2- 172.21.15.67:0/3145863416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc08c06e7a0 0x7fc08c0b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.469+0000 7fc0937b0640 1 --2- 172.21.15.67:0/3145863416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc08c15a6f0 0x7fc08c0b2cc0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.469+0000 7fc0937b0640 1 -- 172.21.15.67:0/3145863416 >> 172.21.15.67:0/3145863416 conn(0x7fc08c0b19c0 msgr2=0x7fc08c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:18.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.469+0000 7fc0937b0640 1 -- 172.21.15.67:0/3145863416 shutdown_connections 2024-04-25T02:29:18.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.469+0000 7fc0937b0640 1 -- 172.21.15.67:0/3145863416 wait complete. 2024-04-25T02:29:18.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.470+0000 7fc0937b0640 1 Processor -- start 2024-04-25T02:29:18.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.470+0000 7fc0937b0640 1 -- start start 2024-04-25T02:29:18.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc0937b0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc08c06e7a0 0x7fc08c14e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:18.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc0937b0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc08c0b49a0 0x7fc08c09c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:18.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc0937b0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc08c15a6f0 0x7fc08c15bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:18.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc0937b0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c15aad0 con 0x7fc08c15a6f0 2024-04-25T02:29:18.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc0937b0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c06ec00 con 0x7fc08c06e7a0 2024-04-25T02:29:18.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc0937b0640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc08c0ad5c0 con 0x7fc08c0b49a0 2024-04-25T02:29:18.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc091d4d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc08c15a6f0 0x7fc08c15bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:18.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc091d4d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc08c15a6f0 0x7fc08c15bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37812/0 (socket says 172.21.15.67:37812) 2024-04-25T02:29:18.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc091d4d640 1 -- 172.21.15.67:0/3686347458 learned_addr learned my addr 172.21.15.67:0/3686347458 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:18.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc090d4b640 1 --2- 172.21.15.67:0/3686347458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc08c0b49a0 0x7fc08c09c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:18.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc09154c640 1 --2- 172.21.15.67:0/3686347458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc08c06e7a0 0x7fc08c14e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:18.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc091d4d640 1 -- 172.21.15.67:0/3686347458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc08c0b49a0 msgr2=0x7fc08c09c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:18.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc091d4d640 1 --2- 172.21.15.67:0/3686347458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc08c0b49a0 0x7fc08c09c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc091d4d640 1 -- 172.21.15.67:0/3686347458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc08c06e7a0 msgr2=0x7fc08c14e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:18.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc091d4d640 1 --2- 172.21.15.67:0/3686347458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc08c06e7a0 0x7fc08c14e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc091d4d640 1 -- 172.21.15.67:0/3686347458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08c152b70 con 0x7fc08c15a6f0 2024-04-25T02:29:18.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc090d4b640 1 --2- 172.21.15.67:0/3686347458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc08c0b49a0 0x7fc08c09c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:18.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc09154c640 1 --2- 172.21.15.67:0/3686347458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc08c06e7a0 0x7fc08c14e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:18.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.471+0000 7fc091d4d640 1 --2- 172.21.15.67:0/3686347458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc08c15a6f0 0x7fc08c15bec0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc08400d580 tx=0x7fc08400da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:18.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.472+0000 7fc089ffb640 1 -- 172.21.15.67:0/3686347458 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0840125f0 con 0x7fc08c15a6f0 2024-04-25T02:29:18.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.472+0000 7fc089ffb640 1 -- 172.21.15.67:0/3686347458 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc084019070 con 0x7fc08c15a6f0 2024-04-25T02:29:18.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.472+0000 7fc0937b0640 1 -- 172.21.15.67:0/3686347458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc08c09aa70 con 0x7fc08c15a6f0 2024-04-25T02:29:18.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.472+0000 7fc089ffb640 1 -- 172.21.15.67:0/3686347458 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0840129f0 con 0x7fc08c15a6f0 2024-04-25T02:29:18.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.472+0000 7fc0937b0640 1 -- 172.21.15.67:0/3686347458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc08c09b030 con 0x7fc08c15a6f0 2024-04-25T02:29:18.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.473+0000 7fc0937b0640 1 -- 172.21.15.67:0/3686347458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc08c069110 con 0x7fc08c15a6f0 2024-04-25T02:29:18.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.473+0000 7fc089ffb640 1 -- 172.21.15.67:0/3686347458 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc084012b90 con 0x7fc08c15a6f0 2024-04-25T02:29:18.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.474+0000 7fc089ffb640 1 --2- 172.21.15.67:0/3686347458 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc07806be30 0x7fc07806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:18.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.474+0000 7fc089ffb640 1 -- 172.21.15.67:0/3686347458 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fc08408b190 con 0x7fc08c15a6f0 2024-04-25T02:29:18.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.474+0000 7fc09154c640 1 --2- 172.21.15.67:0/3686347458 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc07806be30 0x7fc07806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:18.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.475+0000 7fc09154c640 1 --2- 172.21.15.67:0/3686347458 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc07806be30 0x7fc07806e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc07c038000 tx=0x7fc07c031000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:18.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.478+0000 7fc089ffb640 1 -- 172.21.15.67:0/3686347458 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc084059b50 con 0x7fc08c15a6f0 2024-04-25T02:29:18.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.664+0000 7fc0937b0640 1 -- 172.21.15.67:0/3686347458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc08c06e150 con 0x7fc08c15a6f0 2024-04-25T02:29:18.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.665+0000 7fc089ffb640 1 -- 172.21.15.67:0/3686347458 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16658 (secure 0 0 0) 0x7fc084059450 con 0x7fc08c15a6f0 2024-04-25T02:29:18.669 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:18.669 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":32,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:29:17.693515+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:29:16.301169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T02:29:16.663379+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:29:18.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.667+0000 7fc0937b0640 1 -- 172.21.15.67:0/3686347458 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc07806be30 msgr2=0x7fc07806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:18.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.667+0000 7fc0937b0640 1 --2- 172.21.15.67:0/3686347458 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc07806be30 0x7fc07806e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc07c038000 tx=0x7fc07c031000 comp rx=0 tx=0).stop 2024-04-25T02:29:18.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.667+0000 7fc0937b0640 1 -- 172.21.15.67:0/3686347458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc08c15a6f0 msgr2=0x7fc08c15bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.667+0000 7fc0937b0640 1 --2- 172.21.15.67:0/3686347458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc08c15a6f0 0x7fc08c15bec0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc08400d580 tx=0x7fc08400da40 comp rx=0 tx=0).stop 2024-04-25T02:29:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.667+0000 7fc0937b0640 1 -- 172.21.15.67:0/3686347458 shutdown_connections 2024-04-25T02:29:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.667+0000 7fc0937b0640 1 --2- 172.21.15.67:0/3686347458 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc07806be30 0x7fc07806e2f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.667+0000 7fc0937b0640 1 --2- 172.21.15.67:0/3686347458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc08c15a6f0 0x7fc08c15bec0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.667+0000 7fc0937b0640 1 --2- 172.21.15.67:0/3686347458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc08c0b49a0 0x7fc08c09c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.667+0000 7fc0937b0640 1 --2- 172.21.15.67:0/3686347458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc08c06e7a0 0x7fc08c14e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.667+0000 7fc0937b0640 1 -- 172.21.15.67:0/3686347458 >> 172.21.15.67:0/3686347458 conn(0x7fc08c0b19c0 msgr2=0x7fc08c0b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.667+0000 7fc0937b0640 1 -- 172.21.15.67:0/3686347458 shutdown_connections 2024-04-25T02:29:18.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.667+0000 7fc0937b0640 1 -- 172.21.15.67:0/3686347458 wait complete. 2024-04-25T02:29:18.682 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:29:18.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.779+0000 7faff0253640 1 Processor -- start 2024-04-25T02:29:18.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.779+0000 7faff0253640 1 -- start start 2024-04-25T02:29:18.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.780+0000 7faff0253640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fafe815b220 0x7fafe8070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:18.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.780+0000 7faff0253640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafe80713d0 con 0x7fafe815ec70 2024-04-25T02:29:18.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.780+0000 7faff0253640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafe80ae4d0 con 0x7fafe815f800 2024-04-25T02:29:18.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.780+0000 7faff0253640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fafe80aee00 con 0x7fafe815b220 2024-04-25T02:29:18.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.780+0000 7fafed7ee640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fafe815ec70 0x7fafe815f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49408/0 (socket says 172.21.15.67:49408) 2024-04-25T02:29:18.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.780+0000 7fafed7ee640 1 -- 172.21.15.67:0/3182609360 learned_addr learned my addr 172.21.15.67:0/3182609360 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:18.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.780+0000 7fafedfef640 1 --2- 172.21.15.67:0/3182609360 >> v2:172.21.15.176:3300/0 conn(0x7fafe815b220 0x7fafe8070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:18.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.780+0000 7fafecfed640 1 -- 172.21.15.67:0/3182609360 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1799521257 0 0) 0x7fafe80713d0 con 0x7fafe815ec70 2024-04-25T02:29:18.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.780+0000 7fafecfed640 1 -- 172.21.15.67:0/3182609360 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafd4003520 con 0x7fafe815ec70 2024-04-25T02:29:18.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.780+0000 7fafecfed640 1 -- 172.21.15.67:0/3182609360 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 596554071 0 0) 0x7fafd4003520 con 0x7fafe815ec70 2024-04-25T02:29:18.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.780+0000 7fafedfef640 1 -- 172.21.15.67:0/3182609360 >> v1:172.21.15.176:6789/0 conn(0x7fafe815f800 legacy=0x7fafe80b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:18.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.780+0000 7fafedfef640 1 -- 172.21.15.67:0/3182609360 >> v1:172.21.15.67:6789/0 conn(0x7fafe815ec70 legacy=0x7fafe815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:18.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.780+0000 7fafedfef640 1 -- 172.21.15.67:0/3182609360 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe80ae7b0 con 0x7fafe815b220 2024-04-25T02:29:18.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.781+0000 7fafedfef640 1 --2- 172.21.15.67:0/3182609360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe815b220 0x7fafe8070df0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fafe40097a0 tx=0x7fafe402a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9980ed4ed8b66ed6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:18.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.781+0000 7fafecfed640 1 -- 172.21.15.67:0/3182609360 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe4037070 con 0x7fafe815b220 2024-04-25T02:29:18.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.781+0000 7fafecfed640 1 -- 172.21.15.67:0/3182609360 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe402ab60 con 0x7fafe815b220 2024-04-25T02:29:18.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.781+0000 7fafecfed640 1 -- 172.21.15.67:0/3182609360 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd8001670 con 0x7fafe815b220 2024-04-25T02:29:18.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.782+0000 7faff0253640 1 -- 172.21.15.67:0/3182609360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe815b220 msgr2=0x7fafe8070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:18.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.782+0000 7faff0253640 1 --2- 172.21.15.67:0/3182609360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe815b220 0x7fafe8070df0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fafe40097a0 tx=0x7fafe402a0d0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.782+0000 7faff0253640 1 -- 172.21.15.67:0/3182609360 shutdown_connections 2024-04-25T02:29:18.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.782+0000 7faff0253640 1 --2- 172.21.15.67:0/3182609360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe815b220 0x7fafe8070df0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.782+0000 7faff0253640 1 -- 172.21.15.67:0/3182609360 >> 172.21.15.67:0/3182609360 conn(0x7fafe80b19c0 msgr2=0x7fafe80b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:18.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.782+0000 7faff0253640 1 -- 172.21.15.67:0/3182609360 shutdown_connections 2024-04-25T02:29:18.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.782+0000 7faff0253640 1 -- 172.21.15.67:0/3182609360 wait complete. 2024-04-25T02:29:18.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.783+0000 7faff0253640 1 Processor -- start 2024-04-25T02:29:18.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.783+0000 7faff0253640 1 -- start start 2024-04-25T02:29:18.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.784+0000 7faff0253640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe815b220 0x7fafe8148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:18.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.784+0000 7faff0253640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafe815ec70 0x7fafe806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:18.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.784+0000 7faff0253640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafe815f800 0x7fafe806d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:18.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.784+0000 7faff0253640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fafe806ed10 con 0x7fafe815f800 2024-04-25T02:29:18.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.784+0000 7faff0253640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fafe806eb90 con 0x7fafe815b220 2024-04-25T02:29:18.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.784+0000 7faff0253640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fafe80b33d0 con 0x7fafe815ec70 2024-04-25T02:29:18.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.784+0000 7fafee7f0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafe815f800 0x7fafe806d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:18.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.784+0000 7fafee7f0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafe815f800 0x7fafe806d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37820/0 (socket says 172.21.15.67:37820) 2024-04-25T02:29:18.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.784+0000 7fafee7f0640 1 -- 172.21.15.67:0/3472293223 learned_addr learned my addr 172.21.15.67:0/3472293223 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:18.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.784+0000 7fafed7ee640 1 --2- 172.21.15.67:0/3472293223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafe815ec70 0x7fafe806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:18.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.784+0000 7fafedfef640 1 --2- 172.21.15.67:0/3472293223 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe815b220 0x7fafe8148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:18.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.784+0000 7fafee7f0640 1 -- 172.21.15.67:0/3472293223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafe815ec70 msgr2=0x7fafe806d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:18.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.784+0000 7fafee7f0640 1 --2- 172.21.15.67:0/3472293223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafe815ec70 0x7fafe806d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.784+0000 7fafee7f0640 1 -- 172.21.15.67:0/3472293223 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe815b220 msgr2=0x7fafe8148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:18.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.784+0000 7fafee7f0640 1 --2- 172.21.15.67:0/3472293223 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe815b220 0x7fafe8148a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.784+0000 7fafee7f0640 1 -- 172.21.15.67:0/3472293223 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe815d960 con 0x7fafe815f800 2024-04-25T02:29:18.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.785+0000 7fafee7f0640 1 --2- 172.21.15.67:0/3472293223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafe815f800 0x7fafe806d940 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fafe000c780 tx=0x7fafe000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:18.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.785+0000 7fafde7fc640 1 -- 172.21.15.67:0/3472293223 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe0017070 con 0x7fafe815f800 2024-04-25T02:29:18.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.785+0000 7fafde7fc640 1 -- 172.21.15.67:0/3472293223 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe0003da0 con 0x7fafe815f800 2024-04-25T02:29:18.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.785+0000 7faff0253640 1 -- 172.21.15.67:0/3472293223 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafe815dc40 con 0x7fafe815f800 2024-04-25T02:29:18.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.785+0000 7fafde7fc640 1 -- 172.21.15.67:0/3472293223 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe0005290 con 0x7fafe815f800 2024-04-25T02:29:18.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.785+0000 7faff0253640 1 -- 172.21.15.67:0/3472293223 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafe815d580 con 0x7fafe815f800 2024-04-25T02:29:18.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.786+0000 7faff0253640 1 -- 172.21.15.67:0/3472293223 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafe8069110 con 0x7fafe815f800 2024-04-25T02:29:18.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.786+0000 7fafde7fc640 1 -- 172.21.15.67:0/3472293223 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fafe001a070 con 0x7fafe815f800 2024-04-25T02:29:18.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.787+0000 7fafde7fc640 1 --2- 172.21.15.67:0/3472293223 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fafcc06be30 0x7fafcc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:18.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.787+0000 7fafde7fc640 1 -- 172.21.15.67:0/3472293223 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fafe008a460 con 0x7fafe815f800 2024-04-25T02:29:18.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.787+0000 7fafedfef640 1 --2- 172.21.15.67:0/3472293223 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fafcc06be30 0x7fafcc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:18.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.788+0000 7fafedfef640 1 --2- 172.21.15.67:0/3472293223 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fafcc06be30 0x7fafcc06e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fafe4034000 tx=0x7fafe402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:18.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.791+0000 7fafde7fc640 1 -- 172.21.15.67:0/3472293223 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fafe0058e20 con 0x7fafe815f800 2024-04-25T02:29:18.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.974+0000 7faff0253640 1 -- 172.21.15.67:0/3472293223 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fafe806e610 con 0x7fafe815f800 2024-04-25T02:29:18.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.975+0000 7fafde7fc640 1 -- 172.21.15.67:0/3472293223 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16658 (secure 0 0 0) 0x7fafe0058720 con 0x7fafe815f800 2024-04-25T02:29:18.979 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:18.980 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":32,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:29:17.693515+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:29:16.301169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T02:29:16.663379+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:29:18.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.977+0000 7faff0253640 1 -- 172.21.15.67:0/3472293223 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fafcc06be30 msgr2=0x7fafcc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:18.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.977+0000 7faff0253640 1 --2- 172.21.15.67:0/3472293223 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fafcc06be30 0x7fafcc06e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fafe4034000 tx=0x7fafe402e000 comp rx=0 tx=0).stop 2024-04-25T02:29:18.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.977+0000 7faff0253640 1 -- 172.21.15.67:0/3472293223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafe815f800 msgr2=0x7fafe806d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:18.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.977+0000 7faff0253640 1 --2- 172.21.15.67:0/3472293223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafe815f800 0x7fafe806d940 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fafe000c780 tx=0x7fafe000cc40 comp rx=0 tx=0).stop 2024-04-25T02:29:18.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.977+0000 7faff0253640 1 -- 172.21.15.67:0/3472293223 shutdown_connections 2024-04-25T02:29:18.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.977+0000 7faff0253640 1 --2- 172.21.15.67:0/3472293223 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fafcc06be30 0x7fafcc06e2f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.977+0000 7faff0253640 1 --2- 172.21.15.67:0/3472293223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafe815f800 0x7fafe806d940 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.977+0000 7faff0253640 1 --2- 172.21.15.67:0/3472293223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafe815ec70 0x7fafe806d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.977+0000 7faff0253640 1 --2- 172.21.15.67:0/3472293223 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe815b220 0x7fafe8148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:18.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.977+0000 7faff0253640 1 -- 172.21.15.67:0/3472293223 >> 172.21.15.67:0/3472293223 conn(0x7fafe80b19c0 msgr2=0x7fafe80b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:18.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.977+0000 7faff0253640 1 -- 172.21.15.67:0/3472293223 shutdown_connections 2024-04-25T02:29:18.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:18.977+0000 7faff0253640 1 -- 172.21.15.67:0/3472293223 wait complete. 2024-04-25T02:29:18.992 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T02:29:19.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.091+0000 7f5c0c9b7640 1 Processor -- start 2024-04-25T02:29:19.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.091+0000 7f5c0c9b7640 1 -- start start 2024-04-25T02:29:19.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.092+0000 7f5c0c9b7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c081551c0 0x7f5c0815e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:19.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.092+0000 7f5c0c9b7640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5c0806edb0 0x7f5c080b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:19.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.092+0000 7f5c0c9b7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c0815f750 con 0x7f5c080b3200 2024-04-25T02:29:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.092+0000 7f5c0c9b7640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f5c0815f190 con 0x7f5c0806edb0 2024-04-25T02:29:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.092+0000 7f5c0c9b7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5c0815f470 con 0x7f5c081551c0 2024-04-25T02:29:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.092+0000 7f5c06d9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5c080b3200 0x7f5c080726d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49410/0 (socket says 172.21.15.67:49410) 2024-04-25T02:29:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.092+0000 7f5c06d9d640 1 -- 172.21.15.67:0/1692405962 learned_addr learned my addr 172.21.15.67:0/1692405962 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.092+0000 7f5c0659c640 1 --2- 172.21.15.67:0/1692405962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c081551c0 0x7f5c0815e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.093+0000 7f5c05d9b640 1 --2- 172.21.15.67:0/1692405962 >> v2:172.21.15.176:3300/0 conn(0x7f5c0806edb0 0x7f5c080b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.093+0000 7f5c0559a640 1 -- 172.21.15.67:0/1692405962 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1222652894 0 0) 0x7f5c0815f750 con 0x7f5c080b3200 2024-04-25T02:29:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.093+0000 7f5c0559a640 1 -- 172.21.15.67:0/1692405962 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bf4003520 con 0x7f5c080b3200 2024-04-25T02:29:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.093+0000 7f5c0559a640 1 -- 172.21.15.67:0/1692405962 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1888920579 0 0) 0x7f5bf4003520 con 0x7f5c080b3200 2024-04-25T02:29:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.093+0000 7f5c0659c640 1 -- 172.21.15.67:0/1692405962 >> v2:172.21.15.176:3300/0 conn(0x7f5c0806edb0 msgr2=0x7f5c080b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.093+0000 7f5c0659c640 1 --2- 172.21.15.67:0/1692405962 >> v2:172.21.15.176:3300/0 conn(0x7f5c0806edb0 0x7f5c080b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.093+0000 7f5c0659c640 1 -- 172.21.15.67:0/1692405962 >> v1:172.21.15.67:6789/0 conn(0x7f5c080b3200 legacy=0x7f5c080726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.093+0000 7f5c0659c640 1 -- 172.21.15.67:0/1692405962 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c08071150 con 0x7f5c081551c0 2024-04-25T02:29:19.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.093+0000 7f5c05d9b640 1 --2- 172.21.15.67:0/1692405962 >> v2:172.21.15.176:3300/0 conn(0x7f5c0806edb0 0x7f5c080b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:19.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.094+0000 7f5c0659c640 1 --2- 172.21.15.67:0/1692405962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c081551c0 0x7f5c0815e7f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5c000097a0 tx=0x7f5c0002a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d168d3cf2cc70b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:19.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.094+0000 7f5c0559a640 1 -- 172.21.15.67:0/1692405962 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c00037070 con 0x7f5c081551c0 2024-04-25T02:29:19.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.094+0000 7f5c0559a640 1 -- 172.21.15.67:0/1692405962 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c0002ab10 con 0x7f5c081551c0 2024-04-25T02:29:19.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.094+0000 7f5c0559a640 1 -- 172.21.15.67:0/1692405962 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf80019f0 con 0x7f5c081551c0 2024-04-25T02:29:19.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.094+0000 7f5c0c9b7640 1 -- 172.21.15.67:0/1692405962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c081551c0 msgr2=0x7f5c0815e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:19.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.094+0000 7f5c0c9b7640 1 --2- 172.21.15.67:0/1692405962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c081551c0 0x7f5c0815e7f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5c000097a0 tx=0x7f5c0002a080 comp rx=0 tx=0).stop 2024-04-25T02:29:19.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.094+0000 7f5c0c9b7640 1 -- 172.21.15.67:0/1692405962 shutdown_connections 2024-04-25T02:29:19.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.094+0000 7f5c0c9b7640 1 --2- 172.21.15.67:0/1692405962 >> v2:172.21.15.176:3300/0 conn(0x7f5c0806edb0 0x7f5c080b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:19.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.094+0000 7f5c0c9b7640 1 --2- 172.21.15.67:0/1692405962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c081551c0 0x7f5c0815e7f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:19.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.094+0000 7f5c0c9b7640 1 -- 172.21.15.67:0/1692405962 >> 172.21.15.67:0/1692405962 conn(0x7f5c080b19c0 msgr2=0x7f5c080b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:19.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.094+0000 7f5c0c9b7640 1 -- 172.21.15.67:0/1692405962 shutdown_connections 2024-04-25T02:29:19.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.094+0000 7f5c0c9b7640 1 -- 172.21.15.67:0/1692405962 wait complete. 2024-04-25T02:29:19.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.096+0000 7f5c0c9b7640 1 Processor -- start 2024-04-25T02:29:19.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.096+0000 7f5c0c9b7640 1 -- start start 2024-04-25T02:29:19.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c0c9b7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c0806edb0 0x7f5c08142e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:19.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c0c9b7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c080b3200 0x7f5c081457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:19.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c0c9b7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c081551c0 0x7f5c08145d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:19.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c0c9b7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0815ed30 con 0x7f5c080b3200 2024-04-25T02:29:19.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c0c9b7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5c081555a0 con 0x7f5c081551c0 2024-04-25T02:29:19.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c0c9b7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5c0815eeb0 con 0x7f5c0806edb0 2024-04-25T02:29:19.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c05d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c080b3200 0x7f5c081457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:19.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c05d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c080b3200 0x7f5c081457d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37830/0 (socket says 172.21.15.67:37830) 2024-04-25T02:29:19.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c05d9b640 1 -- 172.21.15.67:0/1386741741 learned_addr learned my addr 172.21.15.67:0/1386741741 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:19.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c0659c640 1 --2- 172.21.15.67:0/1386741741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c0806edb0 0x7f5c08142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:19.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c06d9d640 1 --2- 172.21.15.67:0/1386741741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c081551c0 0x7f5c08145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:19.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c05d9b640 1 -- 172.21.15.67:0/1386741741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c0806edb0 msgr2=0x7f5c08142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:19.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c05d9b640 1 --2- 172.21.15.67:0/1386741741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c0806edb0 0x7f5c08142e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:19.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c05d9b640 1 -- 172.21.15.67:0/1386741741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c081551c0 msgr2=0x7f5c08145d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:19.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c05d9b640 1 --2- 172.21.15.67:0/1386741741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c081551c0 0x7f5c08145d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:19.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c05d9b640 1 -- 172.21.15.67:0/1386741741 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0809ca20 con 0x7f5c080b3200 2024-04-25T02:29:19.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c05d9b640 1 --2- 172.21.15.67:0/1386741741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c080b3200 0x7f5c081457d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000ebe0 tx=0x7f5bf000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:19.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5bfeffd640 1 -- 172.21.15.67:0/1386741741 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0017070 con 0x7f5c080b3200 2024-04-25T02:29:19.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5bfeffd640 1 -- 172.21.15.67:0/1386741741 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf000cc30 con 0x7f5c080b3200 2024-04-25T02:29:19.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c0c9b7640 1 -- 172.21.15.67:0/1386741741 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c0809cd00 con 0x7f5c080b3200 2024-04-25T02:29:19.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5bfeffd640 1 -- 172.21.15.67:0/1386741741 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0013470 con 0x7f5c080b3200 2024-04-25T02:29:19.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.097+0000 7f5c0c9b7640 1 -- 172.21.15.67:0/1386741741 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c081437b0 con 0x7f5c080b3200 2024-04-25T02:29:19.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.099+0000 7f5c0c9b7640 1 -- 172.21.15.67:0/1386741741 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c08069110 con 0x7f5c080b3200 2024-04-25T02:29:19.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.099+0000 7f5bfeffd640 1 -- 172.21.15.67:0/1386741741 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5bf001a070 con 0x7f5c080b3200 2024-04-25T02:29:19.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.099+0000 7f5bfeffd640 1 --2- 172.21.15.67:0/1386741741 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f5be806be30 0x7f5be806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:19.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.099+0000 7f5bfeffd640 1 -- 172.21.15.67:0/1386741741 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f5bf008ad10 con 0x7f5c080b3200 2024-04-25T02:29:19.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.100+0000 7f5c0659c640 1 --2- 172.21.15.67:0/1386741741 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f5be806be30 0x7f5be806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:19.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.100+0000 7f5c0659c640 1 --2- 172.21.15.67:0/1386741741 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f5be806be30 0x7f5be806e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5c00034000 tx=0x7f5c0002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:19.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.104+0000 7f5bfeffd640 1 -- 172.21.15.67:0/1386741741 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5bf0059750 con 0x7f5c080b3200 2024-04-25T02:29:19.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.324+0000 7f5c0c9b7640 1 -- 172.21.15.67:0/1386741741 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5c080b4e00 con 0x7f5c080b3200 2024-04-25T02:29:19.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.335+0000 7f5bfeffd640 1 -- 172.21.15.67:0/1386741741 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7f5bf0059050 con 0x7f5c080b3200 2024-04-25T02:29:19.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.337+0000 7f5c0c9b7640 1 -- 172.21.15.67:0/1386741741 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f5be806be30 msgr2=0x7f5be806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:19.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.337+0000 7f5c0c9b7640 1 --2- 172.21.15.67:0/1386741741 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f5be806be30 0x7f5be806e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5c00034000 tx=0x7f5c0002e000 comp rx=0 tx=0).stop 2024-04-25T02:29:19.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.337+0000 7f5c0c9b7640 1 -- 172.21.15.67:0/1386741741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c080b3200 msgr2=0x7f5c081457d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:19.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.337+0000 7f5c0c9b7640 1 --2- 172.21.15.67:0/1386741741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c080b3200 0x7f5c081457d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000ebe0 tx=0x7f5bf000c520 comp rx=0 tx=0).stop 2024-04-25T02:29:19.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.337+0000 7f5c0c9b7640 1 -- 172.21.15.67:0/1386741741 shutdown_connections 2024-04-25T02:29:19.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.337+0000 7f5c0c9b7640 1 --2- 172.21.15.67:0/1386741741 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f5be806be30 0x7f5be806e2f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:19.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.337+0000 7f5c0c9b7640 1 --2- 172.21.15.67:0/1386741741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c081551c0 0x7f5c08145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:19.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.337+0000 7f5c0c9b7640 1 --2- 172.21.15.67:0/1386741741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c080b3200 0x7f5c081457d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:19.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.337+0000 7f5c0c9b7640 1 --2- 172.21.15.67:0/1386741741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c0806edb0 0x7f5c08142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:19.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.337+0000 7f5c0c9b7640 1 -- 172.21.15.67:0/1386741741 >> 172.21.15.67:0/1386741741 conn(0x7f5c080b19c0 msgr2=0x7f5c080b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:19.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.337+0000 7f5c0c9b7640 1 -- 172.21.15.67:0/1386741741 shutdown_connections 2024-04-25T02:29:19.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.337+0000 7f5c0c9b7640 1 -- 172.21.15.67:0/1386741741 wait complete. 2024-04-25T02:29:19.353 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T02:29:19.353 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T02:29:19.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.453+0000 7ff5ed6fc640 1 Processor -- start 2024-04-25T02:29:19.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.453+0000 7ff5ed6fc640 1 -- start start 2024-04-25T02:29:19.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.454+0000 7ff5ed6fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff5e815e3b0 0x7ff5e80d2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:19.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.454+0000 7ff5ed6fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e80cf780 0x7ff5e80cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:19.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.454+0000 7ff5ed6fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff5e80d0ab0 0x7ff5e80d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:19.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.454+0000 7ff5ed6fc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff5e815e790 con 0x7ff5e80d0ab0 2024-04-25T02:29:19.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.454+0000 7ff5ed6fc640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff5e80d1d10 con 0x7ff5e815e3b0 2024-04-25T02:29:19.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.454+0000 7ff5ed6fc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff5e80d1ff0 con 0x7ff5e80cf780 2024-04-25T02:29:19.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.454+0000 7ff5e77fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff5e80d0ab0 0x7ff5e80d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:19.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.454+0000 7ff5e77fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff5e80d0ab0 0x7ff5e80d0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37846/0 (socket says 172.21.15.67:37846) 2024-04-25T02:29:19.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.454+0000 7ff5e77fe640 1 -- 172.21.15.67:0/563652022 learned_addr learned my addr 172.21.15.67:0/563652022 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:19.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.454+0000 7ff5e67fc640 1 --2- 172.21.15.67:0/563652022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e80cf780 0x7ff5e80cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:19.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.454+0000 7ff5e6ffd640 1 --2- 172.21.15.67:0/563652022 >> v2:172.21.15.176:3300/0 conn(0x7ff5e815e3b0 0x7ff5e80d2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:19.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.454+0000 7ff5e77fe640 1 -- 172.21.15.67:0/563652022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e80cf780 msgr2=0x7ff5e80cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:19.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.454+0000 7ff5e77fe640 1 --2- 172.21.15.67:0/563652022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e80cf780 0x7ff5e80cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:19.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.454+0000 7ff5e77fe640 1 -- 172.21.15.67:0/563652022 >> v2:172.21.15.176:3300/0 conn(0x7ff5e815e3b0 msgr2=0x7ff5e80d2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:19.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.454+0000 7ff5e77fe640 1 --2- 172.21.15.67:0/563652022 >> v2:172.21.15.176:3300/0 conn(0x7ff5e815e3b0 0x7ff5e80d2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:19.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.454+0000 7ff5e77fe640 1 -- 172.21.15.67:0/563652022 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e80d22d0 con 0x7ff5e80d0ab0 2024-04-25T02:29:19.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.454+0000 7ff5e6ffd640 1 --2- 172.21.15.67:0/563652022 >> v2:172.21.15.176:3300/0 conn(0x7ff5e815e3b0 0x7ff5e80d2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:19.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.455+0000 7ff5e77fe640 1 --2- 172.21.15.67:0/563652022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e80d0ab0 0x7ff5e80d0f40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff5e806b980 tx=0x7ff5d802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8919e410e132f817 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:19.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.455+0000 7ff5e5ffb640 1 -- 172.21.15.67:0/563652022 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8036070 con 0x7ff5e80d0ab0 2024-04-25T02:29:19.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.455+0000 7ff5e5ffb640 1 -- 172.21.15.67:0/563652022 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d8031600 con 0x7ff5e80d0ab0 2024-04-25T02:29:19.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.455+0000 7ff5e5ffb640 1 -- 172.21.15.67:0/563652022 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80319d0 con 0x7ff5e80d0ab0 2024-04-25T02:29:19.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.456+0000 7ff5ed6fc640 1 -- 172.21.15.67:0/563652022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e80d0ab0 msgr2=0x7ff5e80d0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:19.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.456+0000 7ff5ed6fc640 1 --2- 172.21.15.67:0/563652022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e80d0ab0 0x7ff5e80d0f40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff5e806b980 tx=0x7ff5d802a6a0 comp rx=0 tx=0).stop 2024-04-25T02:29:19.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.456+0000 7ff5ed6fc640 1 -- 172.21.15.67:0/563652022 shutdown_connections 2024-04-25T02:29:19.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.456+0000 7ff5ed6fc640 1 --2- 172.21.15.67:0/563652022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e80d0ab0 0x7ff5e80d0f40 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:19.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.456+0000 7ff5ed6fc640 1 --2- 172.21.15.67:0/563652022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e80cf780 0x7ff5e80cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:19.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.456+0000 7ff5ed6fc640 1 --2- 172.21.15.67:0/563652022 >> v2:172.21.15.176:3300/0 conn(0x7ff5e815e3b0 0x7ff5e80d2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:19.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.456+0000 7ff5ed6fc640 1 -- 172.21.15.67:0/563652022 >> 172.21.15.67:0/563652022 conn(0x7ff5e809d450 msgr2=0x7ff5e80d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:19.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.456+0000 7ff5ed6fc640 1 -- 172.21.15.67:0/563652022 shutdown_connections 2024-04-25T02:29:19.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.456+0000 7ff5ed6fc640 1 -- 172.21.15.67:0/563652022 wait complete. 2024-04-25T02:29:19.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.457+0000 7ff5ed6fc640 1 Processor -- start 2024-04-25T02:29:19.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.457+0000 7ff5ed6fc640 1 -- start start 2024-04-25T02:29:19.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.458+0000 7ff5ed6fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e80cf780 0x7ff5e815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:19.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.458+0000 7ff5ed6fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e80d0ab0 0x7ff5e814d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:19.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.458+0000 7ff5ed6fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e815e3b0 0x7ff5e80b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:19.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.458+0000 7ff5ed6fc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e80d4da0 con 0x7ff5e80cf780 2024-04-25T02:29:19.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.458+0000 7ff5ed6fc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e80d2890 con 0x7ff5e815e3b0 2024-04-25T02:29:19.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.458+0000 7ff5ed6fc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff5e80b3870 con 0x7ff5e80d0ab0 2024-04-25T02:29:19.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.458+0000 7ff5e6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e80cf780 0x7ff5e815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:19.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.458+0000 7ff5e6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e80cf780 0x7ff5e815ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37862/0 (socket says 172.21.15.67:37862) 2024-04-25T02:29:19.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.458+0000 7ff5e6ffd640 1 -- 172.21.15.67:0/2481546261 learned_addr learned my addr 172.21.15.67:0/2481546261 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:19.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.458+0000 7ff5e6ffd640 1 -- 172.21.15.67:0/2481546261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e80d0ab0 msgr2=0x7ff5e814d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:19.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.458+0000 7ff5e6ffd640 1 --2- 172.21.15.67:0/2481546261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e80d0ab0 0x7ff5e814d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:19.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.458+0000 7ff5e6ffd640 1 -- 172.21.15.67:0/2481546261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e815e3b0 msgr2=0x7ff5e80b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:19.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.458+0000 7ff5e6ffd640 1 --2- 172.21.15.67:0/2481546261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e815e3b0 0x7ff5e80b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:19.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.458+0000 7ff5e6ffd640 1 -- 172.21.15.67:0/2481546261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e80c7e20 con 0x7ff5e80cf780 2024-04-25T02:29:19.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.459+0000 7ff5e6ffd640 1 --2- 172.21.15.67:0/2481546261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e80cf780 0x7ff5e815ae70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000c820 tx=0x7ff5e000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:19.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.459+0000 7ff5df7fe640 1 -- 172.21.15.67:0/2481546261 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0015070 con 0x7ff5e80cf780 2024-04-25T02:29:19.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.459+0000 7ff5df7fe640 1 -- 172.21.15.67:0/2481546261 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e0007a30 con 0x7ff5e80cf780 2024-04-25T02:29:19.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.459+0000 7ff5ed6fc640 1 -- 172.21.15.67:0/2481546261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e80c8100 con 0x7ff5e80cf780 2024-04-25T02:29:19.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.459+0000 7ff5df7fe640 1 -- 172.21.15.67:0/2481546261 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0007de0 con 0x7ff5e80cf780 2024-04-25T02:29:19.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.459+0000 7ff5ed6fc640 1 -- 172.21.15.67:0/2481546261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e80c86c0 con 0x7ff5e80cf780 2024-04-25T02:29:19.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.460+0000 7ff5ed6fc640 1 -- 172.21.15.67:0/2481546261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e80caf20 con 0x7ff5e80cf780 2024-04-25T02:29:19.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.460+0000 7ff5df7fe640 1 -- 172.21.15.67:0/2481546261 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff5e0018070 con 0x7ff5e80cf780 2024-04-25T02:29:19.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.461+0000 7ff5df7fe640 1 --2- 172.21.15.67:0/2481546261 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff5c806be30 0x7ff5c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:19.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.461+0000 7ff5df7fe640 1 -- 172.21.15.67:0/2481546261 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff5e008ad80 con 0x7ff5e80cf780 2024-04-25T02:29:19.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.461+0000 7ff5e67fc640 1 --2- 172.21.15.67:0/2481546261 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff5c806be30 0x7ff5c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:19.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.462+0000 7ff5e67fc640 1 --2- 172.21.15.67:0/2481546261 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff5c806be30 0x7ff5c806e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff5e815b5a0 tx=0x7ff5d0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:19.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.465+0000 7ff5df7fe640 1 -- 172.21.15.67:0/2481546261 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff5e80caf20 con 0x7ff5e80cf780 2024-04-25T02:29:19.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:19.688+0000 7ff5ed6fc640 1 -- 172.21.15.67:0/2481546261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff5e8069110 con 0x7ff5e80cf780 2024-04-25T02:29:20.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.340+0000 7ff5df7fe640 1 -- 172.21.15.67:0/2481546261 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7ff5e0059730 con 0x7ff5e80cf780 2024-04-25T02:29:20.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.343+0000 7ff5ed6fc640 1 -- 172.21.15.67:0/2481546261 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff5c806be30 msgr2=0x7ff5c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:20.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.343+0000 7ff5ed6fc640 1 --2- 172.21.15.67:0/2481546261 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff5c806be30 0x7ff5c806e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff5e815b5a0 tx=0x7ff5d0008040 comp rx=0 tx=0).stop 2024-04-25T02:29:20.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.343+0000 7ff5ed6fc640 1 -- 172.21.15.67:0/2481546261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e80cf780 msgr2=0x7ff5e815ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:20.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.343+0000 7ff5ed6fc640 1 --2- 172.21.15.67:0/2481546261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e80cf780 0x7ff5e815ae70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000c820 tx=0x7ff5e000cce0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.343+0000 7ff5ed6fc640 1 -- 172.21.15.67:0/2481546261 shutdown_connections 2024-04-25T02:29:20.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.343+0000 7ff5ed6fc640 1 --2- 172.21.15.67:0/2481546261 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff5c806be30 0x7ff5c806e2f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.343+0000 7ff5ed6fc640 1 --2- 172.21.15.67:0/2481546261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e815e3b0 0x7ff5e80b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.343+0000 7ff5ed6fc640 1 --2- 172.21.15.67:0/2481546261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e80d0ab0 0x7ff5e814d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.343+0000 7ff5ed6fc640 1 --2- 172.21.15.67:0/2481546261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e80cf780 0x7ff5e815ae70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.343+0000 7ff5ed6fc640 1 -- 172.21.15.67:0/2481546261 >> 172.21.15.67:0/2481546261 conn(0x7ff5e809d450 msgr2=0x7ff5e80b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:20.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.343+0000 7ff5ed6fc640 1 -- 172.21.15.67:0/2481546261 shutdown_connections 2024-04-25T02:29:20.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.343+0000 7ff5ed6fc640 1 -- 172.21.15.67:0/2481546261 wait complete. 2024-04-25T02:29:20.360 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T02:29:20.361 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:29:20.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.463+0000 7f78b2215640 1 Processor -- start 2024-04-25T02:29:20.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.463+0000 7f78b2215640 1 -- start start 2024-04-25T02:29:20.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.464+0000 7f78b2215640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f78ac15e210 0x7f78ac06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.464+0000 7f78b2215640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f78ac15e5f0 0x7f78ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.464+0000 7f78b2215640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac0cecc0 0x7f78ac0cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.464+0000 7f78b2215640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f78ac06c6f0 con 0x7f78ac15e210 2024-04-25T02:29:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.464+0000 7f78b2215640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f78ac0d2cc0 con 0x7f78ac15e5f0 2024-04-25T02:29:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.464+0000 7f78b2215640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f78ac0d2fa0 con 0x7f78ac0cecc0 2024-04-25T02:29:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.464+0000 7f78ab7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f78ac15e210 0x7f78ac06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.464+0000 7f78ab7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f78ac15e210 0x7f78ac06cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37870/0 (socket says 172.21.15.67:37870) 2024-04-25T02:29:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.464+0000 7f78ab7fe640 1 -- 172.21.15.67:0/3430928921 learned_addr learned my addr 172.21.15.67:0/3430928921 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.465+0000 7f78aaffd640 1 --2- 172.21.15.67:0/3430928921 >> v2:172.21.15.176:3300/0 conn(0x7f78ac15e5f0 0x7f78ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.465+0000 7f78ab7fe640 1 -- 172.21.15.67:0/3430928921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac0cecc0 msgr2=0x7f78ac0cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.465+0000 7f78abfff640 1 --2- 172.21.15.67:0/3430928921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac0cecc0 0x7f78ac0cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.465+0000 7f78ab7fe640 1 --2- 172.21.15.67:0/3430928921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac0cecc0 0x7f78ac0cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.465+0000 7f78ab7fe640 1 -- 172.21.15.67:0/3430928921 >> v2:172.21.15.176:3300/0 conn(0x7f78ac15e5f0 msgr2=0x7f78ac06d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:20.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.465+0000 7f78ab7fe640 1 --2- 172.21.15.67:0/3430928921 >> v2:172.21.15.176:3300/0 conn(0x7f78ac15e5f0 0x7f78ac06d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.465+0000 7f78ab7fe640 1 -- 172.21.15.67:0/3430928921 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ac06c0a0 con 0x7f78ac15e210 2024-04-25T02:29:20.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.465+0000 7f78aaffd640 1 --2- 172.21.15.67:0/3430928921 >> v2:172.21.15.176:3300/0 conn(0x7f78ac15e5f0 0x7f78ac06d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:20.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.465+0000 7f78ab7fe640 1 --2- 172.21.15.67:0/3430928921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac15e210 0x7f78ac06cb80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f789c009870 tx=0x7f789c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12810882e0a7d380 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:20.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.466+0000 7f78aa7fc640 1 -- 172.21.15.67:0/3430928921 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c037070 con 0x7f78ac15e210 2024-04-25T02:29:20.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.466+0000 7f78aa7fc640 1 -- 172.21.15.67:0/3430928921 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789c032440 con 0x7f78ac15e210 2024-04-25T02:29:20.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.466+0000 7f78aa7fc640 1 -- 172.21.15.67:0/3430928921 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c032810 con 0x7f78ac15e210 2024-04-25T02:29:20.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.466+0000 7f78b2215640 1 -- 172.21.15.67:0/3430928921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac15e210 msgr2=0x7f78ac06cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:20.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.466+0000 7f78b2215640 1 --2- 172.21.15.67:0/3430928921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac15e210 0x7f78ac06cb80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f789c009870 tx=0x7f789c02a210 comp rx=0 tx=0).stop 2024-04-25T02:29:20.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.466+0000 7f78b2215640 1 -- 172.21.15.67:0/3430928921 shutdown_connections 2024-04-25T02:29:20.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.466+0000 7f78b2215640 1 --2- 172.21.15.67:0/3430928921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac0cecc0 0x7f78ac0cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.466+0000 7f78b2215640 1 --2- 172.21.15.67:0/3430928921 >> v2:172.21.15.176:3300/0 conn(0x7f78ac15e5f0 0x7f78ac06d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.466+0000 7f78b2215640 1 --2- 172.21.15.67:0/3430928921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac15e210 0x7f78ac06cb80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.466+0000 7f78b2215640 1 -- 172.21.15.67:0/3430928921 >> 172.21.15.67:0/3430928921 conn(0x7f78ac08dbb0 msgr2=0x7f78ac09d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:20.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.466+0000 7f78b2215640 1 -- 172.21.15.67:0/3430928921 shutdown_connections 2024-04-25T02:29:20.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.466+0000 7f78b2215640 1 -- 172.21.15.67:0/3430928921 wait complete. 2024-04-25T02:29:20.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.467+0000 7f78b2215640 1 Processor -- start 2024-04-25T02:29:20.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.468+0000 7f78b2215640 1 -- start start 2024-04-25T02:29:20.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.468+0000 7f78b2215640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac0cecc0 0x7f78ac150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.468+0000 7f78b2215640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac15e210 0x7f78ac0cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.468+0000 7f78b2215640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78ac15e5f0 0x7f78ac0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.468+0000 7f78b2215640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac0d3fe0 con 0x7f78ac0cecc0 2024-04-25T02:29:20.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.468+0000 7f78b2215640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac0d3e60 con 0x7f78ac15e5f0 2024-04-25T02:29:20.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.468+0000 7f78b2215640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f78ac0d4160 con 0x7f78ac15e210 2024-04-25T02:29:20.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.468+0000 7f78ab7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac0cecc0 0x7f78ac150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.468+0000 7f78ab7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac0cecc0 0x7f78ac150680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37880/0 (socket says 172.21.15.67:37880) 2024-04-25T02:29:20.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.468+0000 7f78ab7fe640 1 -- 172.21.15.67:0/578214392 learned_addr learned my addr 172.21.15.67:0/578214392 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:20.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.469+0000 7f78aaffd640 1 --2- 172.21.15.67:0/578214392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac15e210 0x7f78ac0cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.469+0000 7f78abfff640 1 --2- 172.21.15.67:0/578214392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78ac15e5f0 0x7f78ac0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.469+0000 7f78ab7fe640 1 -- 172.21.15.67:0/578214392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac15e210 msgr2=0x7f78ac0cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:20.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.469+0000 7f78ab7fe640 1 --2- 172.21.15.67:0/578214392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac15e210 0x7f78ac0cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.469+0000 7f78ab7fe640 1 -- 172.21.15.67:0/578214392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78ac15e5f0 msgr2=0x7f78ac0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:20.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.469+0000 7f78ab7fe640 1 --2- 172.21.15.67:0/578214392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78ac15e5f0 0x7f78ac0ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.469+0000 7f78ab7fe640 1 -- 172.21.15.67:0/578214392 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ac0b7d50 con 0x7f78ac0cecc0 2024-04-25T02:29:20.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.469+0000 7f78aaffd640 1 --2- 172.21.15.67:0/578214392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac15e210 0x7f78ac0cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:20.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.469+0000 7f78abfff640 1 --2- 172.21.15.67:0/578214392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78ac15e5f0 0x7f78ac0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:20.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.469+0000 7f78ab7fe640 1 --2- 172.21.15.67:0/578214392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac0cecc0 0x7f78ac150680 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f789c000c00 tx=0x7f789c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:20.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.469+0000 7f7893fff640 1 -- 172.21.15.67:0/578214392 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c037040 con 0x7f78ac0cecc0 2024-04-25T02:29:20.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.469+0000 7f7893fff640 1 -- 172.21.15.67:0/578214392 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789c042070 con 0x7f78ac0cecc0 2024-04-25T02:29:20.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.469+0000 7f78b2215640 1 -- 172.21.15.67:0/578214392 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78ac150bc0 con 0x7f78ac0cecc0 2024-04-25T02:29:20.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.469+0000 7f7893fff640 1 -- 172.21.15.67:0/578214392 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c030bd0 con 0x7f78ac0cecc0 2024-04-25T02:29:20.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.469+0000 7f78b2215640 1 -- 172.21.15.67:0/578214392 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ac15b220 con 0x7f78ac0cecc0 2024-04-25T02:29:20.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.470+0000 7f78b2215640 1 -- 172.21.15.67:0/578214392 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78ac069110 con 0x7f78ac0cecc0 2024-04-25T02:29:20.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.470+0000 7f7893fff640 1 -- 172.21.15.67:0/578214392 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f789c047460 con 0x7f78ac0cecc0 2024-04-25T02:29:20.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.471+0000 7f7893fff640 1 --2- 172.21.15.67:0/578214392 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f789806be30 0x7f789806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.471+0000 7f7893fff640 1 -- 172.21.15.67:0/578214392 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f789c0aba40 con 0x7f78ac0cecc0 2024-04-25T02:29:20.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.471+0000 7f78aaffd640 1 --2- 172.21.15.67:0/578214392 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f789806be30 0x7f789806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.472+0000 7f78aaffd640 1 --2- 172.21.15.67:0/578214392 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f789806be30 0x7f789806e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f78ac160670 tx=0x7f78a0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:20.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.475+0000 7f7893fff640 1 -- 172.21.15.67:0/578214392 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f789c045360 con 0x7f78ac0cecc0 2024-04-25T02:29:20.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.700+0000 7f78b2215640 1 -- 172.21.15.67:0/578214392 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78ac06be80 con 0x7f78ac0cecc0 2024-04-25T02:29:20.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.700+0000 7f7893fff640 1 -- 172.21.15.67:0/578214392 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5181 (secure 0 0 0) 0x7f789c0abe20 con 0x7f78ac0cecc0 2024-04-25T02:29:20.705 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:20.705 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/101037939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":101037939},{"type":"v1","addr":"172.21.15.176:6837","nonce":101037939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4873,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/958313587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":958313587},{"type":"v1","addr":"172.21.15.176:6836","nonce":958313587}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/2806970849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2806970849},{"type":"v1","addr":"172.21.15.67:6834","nonce":2806970849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:29:17.693906+0000","modified":"2024-04-25T02:29:19.690632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2564564590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":2564564590},{"type":"v1","addr":"172.21.15.67:6835","nonce":2564564590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5085,"qdb_cluster":[5085]},"id":2}]} 2024-04-25T02:29:20.705 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 14 2024-04-25T02:29:20.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.702+0000 7f78b2215640 1 -- 172.21.15.67:0/578214392 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f789806be30 msgr2=0x7f789806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:20.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.702+0000 7f78b2215640 1 --2- 172.21.15.67:0/578214392 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f789806be30 0x7f789806e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f78ac160670 tx=0x7f78a0008040 comp rx=0 tx=0).stop 2024-04-25T02:29:20.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.702+0000 7f78b2215640 1 -- 172.21.15.67:0/578214392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac0cecc0 msgr2=0x7f78ac150680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:20.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.702+0000 7f78b2215640 1 --2- 172.21.15.67:0/578214392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac0cecc0 0x7f78ac150680 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f789c000c00 tx=0x7f789c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.702+0000 7f78b2215640 1 -- 172.21.15.67:0/578214392 shutdown_connections 2024-04-25T02:29:20.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.702+0000 7f78b2215640 1 --2- 172.21.15.67:0/578214392 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f789806be30 0x7f789806e2f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.702+0000 7f78b2215640 1 --2- 172.21.15.67:0/578214392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78ac15e5f0 0x7f78ac0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.702+0000 7f78b2215640 1 --2- 172.21.15.67:0/578214392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac15e210 0x7f78ac0cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.702+0000 7f78b2215640 1 --2- 172.21.15.67:0/578214392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ac0cecc0 0x7f78ac150680 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.702+0000 7f78b2215640 1 -- 172.21.15.67:0/578214392 >> 172.21.15.67:0/578214392 conn(0x7f78ac08dbb0 msgr2=0x7f78ac0c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:20.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.703+0000 7f78b2215640 1 -- 172.21.15.67:0/578214392 shutdown_connections 2024-04-25T02:29:20.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.703+0000 7f78b2215640 1 -- 172.21.15.67:0/578214392 wait complete. 2024-04-25T02:29:20.717 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:29:20.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.814+0000 7fdd4a3a2640 1 Processor -- start 2024-04-25T02:29:20.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.814+0000 7fdd4a3a2640 1 -- start start 2024-04-25T02:29:20.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.814+0000 7fdd4a3a2640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdd4415e280 0x7fdd4406bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.814+0000 7fdd4a3a2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd44067200 0x7fdd440715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.814+0000 7fdd4a3a2640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4406c9b0 con 0x7fdd4415e660 2024-04-25T02:29:20.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.814+0000 7fdd4a3a2640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdd4406e990 con 0x7fdd4415e280 2024-04-25T02:29:20.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.814+0000 7fdd4a3a2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4406bc70 con 0x7fdd44067200 2024-04-25T02:29:20.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd437fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fdd4415e660 0x7fdd4406ee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49426/0 (socket says 172.21.15.67:49426) 2024-04-25T02:29:20.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd437fe640 1 -- 172.21.15.67:0/1339991279 learned_addr learned my addr 172.21.15.67:0/1339991279 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:20.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd43fff640 1 --2- 172.21.15.67:0/1339991279 >> v2:172.21.15.176:3300/0 conn(0x7fdd4415e280 0x7fdd4406bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd4893f640 1 --2- 172.21.15.67:0/1339991279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd44067200 0x7fdd440715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd42ffd640 1 -- 172.21.15.67:0/1339991279 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3502135778 0 0) 0x7fdd4406c9b0 con 0x7fdd4415e660 2024-04-25T02:29:20.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd42ffd640 1 -- 172.21.15.67:0/1339991279 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd2c003520 con 0x7fdd4415e660 2024-04-25T02:29:20.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd42ffd640 1 -- 172.21.15.67:0/1339991279 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2019332804 0 0) 0x7fdd2c003520 con 0x7fdd4415e660 2024-04-25T02:29:20.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd42ffd640 1 -- 172.21.15.67:0/1339991279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd44067200 msgr2=0x7fdd440715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:20.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd42ffd640 1 --2- 172.21.15.67:0/1339991279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd44067200 0x7fdd440715e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd42ffd640 1 -- 172.21.15.67:0/1339991279 >> v2:172.21.15.176:3300/0 conn(0x7fdd4415e280 msgr2=0x7fdd4406bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:20.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd42ffd640 1 --2- 172.21.15.67:0/1339991279 >> v2:172.21.15.176:3300/0 conn(0x7fdd4415e280 0x7fdd4406bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd42ffd640 1 -- 172.21.15.67:0/1339991279 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4406e340 con 0x7fdd4415e660 2024-04-25T02:29:20.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd42ffd640 1 -- 172.21.15.67:0/1339991279 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7fdd38001670 con 0x7fdd4415e660 2024-04-25T02:29:20.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd42ffd640 1 -- 172.21.15.67:0/1339991279 >> v1:172.21.15.67:6789/0 conn(0x7fdd4415e660 legacy=0x7fdd4406ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:20.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd42ffd640 1 --2- 172.21.15.67:0/1339991279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd2c0039b0 0x7fdd2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd42ffd640 1 --2- 172.21.15.67:0/1339991279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd44067200 0x7fdd2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd42ffd640 1 --2- 172.21.15.67:0/1339991279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd2c004d40 0x7fdd2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd42ffd640 1 -- 172.21.15.67:0/1339991279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4406e990 con 0x7fdd2c004d40 2024-04-25T02:29:20.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd42ffd640 1 -- 172.21.15.67:0/1339991279 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4406bc70 con 0x7fdd2c0039b0 2024-04-25T02:29:20.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd42ffd640 1 -- 172.21.15.67:0/1339991279 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdd2c00b9c0 con 0x7fdd44067200 2024-04-25T02:29:20.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd4893f640 1 --2- 172.21.15.67:0/1339991279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd2c004d40 0x7fdd2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd437fe640 1 --2- 172.21.15.67:0/1339991279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd44067200 0x7fdd2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.815+0000 7fdd43fff640 1 --2- 172.21.15.67:0/1339991279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd2c0039b0 0x7fdd2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.816+0000 7fdd4893f640 1 -- 172.21.15.67:0/1339991279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd44067200 msgr2=0x7fdd2c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:20.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.816+0000 7fdd4893f640 1 --2- 172.21.15.67:0/1339991279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd44067200 0x7fdd2c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.816+0000 7fdd4893f640 1 -- 172.21.15.67:0/1339991279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd2c0039b0 msgr2=0x7fdd2c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:20.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.816+0000 7fdd4893f640 1 --2- 172.21.15.67:0/1339991279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd2c0039b0 0x7fdd2c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.816+0000 7fdd4893f640 1 -- 172.21.15.67:0/1339991279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2c003520 con 0x7fdd2c004d40 2024-04-25T02:29:20.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.816+0000 7fdd4893f640 1 --2- 172.21.15.67:0/1339991279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd2c004d40 0x7fdd2c0051c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009fc0 tx=0x7fdd2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a57bc34e2c328a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:20.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.817+0000 7fdd42ffd640 1 -- 172.21.15.67:0/1339991279 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c009c10 con 0x7fdd2c004d40 2024-04-25T02:29:20.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.817+0000 7fdd42ffd640 1 -- 172.21.15.67:0/1339991279 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3c036070 con 0x7fdd2c004d40 2024-04-25T02:29:20.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.817+0000 7fdd42ffd640 1 -- 172.21.15.67:0/1339991279 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c031880 con 0x7fdd2c004d40 2024-04-25T02:29:20.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.817+0000 7fdd4a3a2640 1 -- 172.21.15.67:0/1339991279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd2c004d40 msgr2=0x7fdd2c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:20.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.817+0000 7fdd4a3a2640 1 --2- 172.21.15.67:0/1339991279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd2c004d40 0x7fdd2c0051c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009fc0 tx=0x7fdd2c005830 comp rx=0 tx=0).stop 2024-04-25T02:29:20.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.817+0000 7fdd4893f640 1 -- 172.21.15.67:0/1339991279 reap_dead start 2024-04-25T02:29:20.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.817+0000 7fdd4a3a2640 1 -- 172.21.15.67:0/1339991279 shutdown_connections 2024-04-25T02:29:20.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.817+0000 7fdd4a3a2640 1 -- 172.21.15.67:0/1339991279 >> 172.21.15.67:0/1339991279 conn(0x7fdd440d04f0 msgr2=0x7fdd440d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:20.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.817+0000 7fdd4a3a2640 1 -- 172.21.15.67:0/1339991279 shutdown_connections 2024-04-25T02:29:20.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.817+0000 7fdd4a3a2640 1 -- 172.21.15.67:0/1339991279 wait complete. 2024-04-25T02:29:20.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.818+0000 7fdd4a3a2640 1 Processor -- start 2024-04-25T02:29:20.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.819+0000 7fdd4a3a2640 1 -- start start 2024-04-25T02:29:20.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.819+0000 7fdd4a3a2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd44146320 0x7fdd440afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.819+0000 7fdd4a3a2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd440b0160 0x7fdd44159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.819+0000 7fdd4a3a2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd44159ca0 0x7fdd441f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.819+0000 7fdd4a3a2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdd440715e0 con 0x7fdd44146320 2024-04-25T02:29:20.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.819+0000 7fdd4a3a2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4406c450 con 0x7fdd44159ca0 2024-04-25T02:29:20.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.819+0000 7fdd4a3a2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdd44071760 con 0x7fdd440b0160 2024-04-25T02:29:20.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.819+0000 7fdd43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd44146320 0x7fdd440afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.819+0000 7fdd43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd44146320 0x7fdd440afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37908/0 (socket says 172.21.15.67:37908) 2024-04-25T02:29:20.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.819+0000 7fdd43fff640 1 -- 172.21.15.67:0/4032374548 learned_addr learned my addr 172.21.15.67:0/4032374548 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:20.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.820+0000 7fdd4893f640 1 --2- 172.21.15.67:0/4032374548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd44159ca0 0x7fdd441f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.820+0000 7fdd437fe640 1 --2- 172.21.15.67:0/4032374548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd440b0160 0x7fdd44159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.820+0000 7fdd43fff640 1 -- 172.21.15.67:0/4032374548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd440b0160 msgr2=0x7fdd44159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:20.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.820+0000 7fdd43fff640 1 --2- 172.21.15.67:0/4032374548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd440b0160 0x7fdd44159760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.820+0000 7fdd43fff640 1 -- 172.21.15.67:0/4032374548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd44159ca0 msgr2=0x7fdd441f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:20.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.820+0000 7fdd43fff640 1 --2- 172.21.15.67:0/4032374548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd44159ca0 0x7fdd441f78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.820+0000 7fdd43fff640 1 -- 172.21.15.67:0/4032374548 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd440ad8e0 con 0x7fdd44146320 2024-04-25T02:29:20.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.820+0000 7fdd43fff640 1 --2- 172.21.15.67:0/4032374548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd44146320 0x7fdd440afc20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdd34011990 tx=0x7fdd34011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:20.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.820+0000 7fdd40ff9640 1 -- 172.21.15.67:0/4032374548 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400fa70 con 0x7fdd44146320 2024-04-25T02:29:20.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.820+0000 7fdd40ff9640 1 -- 172.21.15.67:0/4032374548 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3400fc10 con 0x7fdd44146320 2024-04-25T02:29:20.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.820+0000 7fdd4a3a2640 1 -- 172.21.15.67:0/4032374548 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd440adbc0 con 0x7fdd44146320 2024-04-25T02:29:20.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.820+0000 7fdd40ff9640 1 -- 172.21.15.67:0/4032374548 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34014440 con 0x7fdd44146320 2024-04-25T02:29:20.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.820+0000 7fdd4a3a2640 1 -- 172.21.15.67:0/4032374548 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd440ae180 con 0x7fdd44146320 2024-04-25T02:29:20.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.821+0000 7fdd4a3a2640 1 -- 172.21.15.67:0/4032374548 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd44069110 con 0x7fdd44146320 2024-04-25T02:29:20.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.822+0000 7fdd40ff9640 1 -- 172.21.15.67:0/4032374548 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd34012040 con 0x7fdd44146320 2024-04-25T02:29:20.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.822+0000 7fdd40ff9640 1 --2- 172.21.15.67:0/4032374548 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdd3006be30 0x7fdd3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.822+0000 7fdd40ff9640 1 -- 172.21.15.67:0/4032374548 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fdd3408b460 con 0x7fdd44146320 2024-04-25T02:29:20.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.822+0000 7fdd437fe640 1 --2- 172.21.15.67:0/4032374548 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdd3006be30 0x7fdd3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.823+0000 7fdd437fe640 1 --2- 172.21.15.67:0/4032374548 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdd3006be30 0x7fdd3006e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdd38004840 tx=0x7fdd38009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:20.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:20.826+0000 7fdd40ff9640 1 -- 172.21.15.67:0/4032374548 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdd34019030 con 0x7fdd44146320 2024-04-25T02:29:21.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.008+0000 7fdd4a3a2640 1 -- 172.21.15.67:0/4032374548 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd440b0540 con 0x7fdd44146320 2024-04-25T02:29:21.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.009+0000 7fdd40ff9640 1 -- 172.21.15.67:0/4032374548 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16645 (secure 0 0 0) 0x7fdd34059e10 con 0x7fdd44146320 2024-04-25T02:29:21.013 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:21.014 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":33,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:29:19.335566+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:29:16.301169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T02:29:16.663379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:29:21.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.011+0000 7fdd4a3a2640 1 -- 172.21.15.67:0/4032374548 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdd3006be30 msgr2=0x7fdd3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.011+0000 7fdd4a3a2640 1 --2- 172.21.15.67:0/4032374548 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdd3006be30 0x7fdd3006e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdd38004840 tx=0x7fdd38009040 comp rx=0 tx=0).stop 2024-04-25T02:29:21.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.011+0000 7fdd4a3a2640 1 -- 172.21.15.67:0/4032374548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd44146320 msgr2=0x7fdd440afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.011+0000 7fdd4a3a2640 1 --2- 172.21.15.67:0/4032374548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd44146320 0x7fdd440afc20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdd34011990 tx=0x7fdd34011e50 comp rx=0 tx=0).stop 2024-04-25T02:29:21.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.011+0000 7fdd4a3a2640 1 -- 172.21.15.67:0/4032374548 shutdown_connections 2024-04-25T02:29:21.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.011+0000 7fdd4a3a2640 1 --2- 172.21.15.67:0/4032374548 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdd3006be30 0x7fdd3006e2f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.011+0000 7fdd4a3a2640 1 --2- 172.21.15.67:0/4032374548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd44159ca0 0x7fdd441f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.011+0000 7fdd4a3a2640 1 --2- 172.21.15.67:0/4032374548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd440b0160 0x7fdd44159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.011+0000 7fdd4a3a2640 1 --2- 172.21.15.67:0/4032374548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd44146320 0x7fdd440afc20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.011+0000 7fdd4a3a2640 1 -- 172.21.15.67:0/4032374548 >> 172.21.15.67:0/4032374548 conn(0x7fdd440d04f0 msgr2=0x7fdd441610c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:21.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.011+0000 7fdd4a3a2640 1 -- 172.21.15.67:0/4032374548 shutdown_connections 2024-04-25T02:29:21.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.011+0000 7fdd4a3a2640 1 -- 172.21.15.67:0/4032374548 wait complete. 2024-04-25T02:29:21.026 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T02:29:21.026 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:29:21.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.122+0000 7fc0071ee640 1 Processor -- start 2024-04-25T02:29:21.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.122+0000 7fc0071ee640 1 -- start start 2024-04-25T02:29:21.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.123+0000 7fc0071ee640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc0000d14a0 0x7fc00006e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.123+0000 7fc0071ee640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0000b4470 con 0x7fc000147040 2024-04-25T02:29:21.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.123+0000 7fc0071ee640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc000161f90 con 0x7fc0000d1010 2024-04-25T02:29:21.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.123+0000 7fc0071ee640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc0001628c0 con 0x7fc0000d14a0 2024-04-25T02:29:21.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.123+0000 7fc004f8a640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc000147040 0x7fc0000b3d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49442/0 (socket says 172.21.15.67:49442) 2024-04-25T02:29:21.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.123+0000 7fc004f8a640 1 -- 172.21.15.67:0/2993287935 learned_addr learned my addr 172.21.15.67:0/2993287935 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:21.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fc00578b640 1 --2- 172.21.15.67:0/2993287935 >> v2:172.21.15.176:3300/0 conn(0x7fc0000d14a0 0x7fc00006e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fbfff7fe640 1 -- 172.21.15.67:0/2993287935 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 591706442 0 0) 0x7fc0000b4470 con 0x7fc000147040 2024-04-25T02:29:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fbfff7fe640 1 -- 172.21.15.67:0/2993287935 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfe8003520 con 0x7fc000147040 2024-04-25T02:29:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fbfff7fe640 1 -- 172.21.15.67:0/2993287935 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1999216089 0 0) 0x7fbfe8003520 con 0x7fc000147040 2024-04-25T02:29:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fbfff7fe640 1 -- 172.21.15.67:0/2993287935 >> v2:172.21.15.176:3300/0 conn(0x7fc0000d14a0 msgr2=0x7fc00006e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fbfff7fe640 1 --2- 172.21.15.67:0/2993287935 >> v2:172.21.15.176:3300/0 conn(0x7fc0000d14a0 0x7fc00006e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fbfff7fe640 1 -- 172.21.15.67:0/2993287935 >> v1:172.21.15.176:6789/0 conn(0x7fc0000d1010 legacy=0x7fc00006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fbfff7fe640 1 -- 172.21.15.67:0/2993287935 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc000162270 con 0x7fc000147040 2024-04-25T02:29:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fbfff7fe640 1 -- 172.21.15.67:0/2993287935 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7fbff80019f0 con 0x7fc000147040 2024-04-25T02:29:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fbfff7fe640 1 -- 172.21.15.67:0/2993287935 >> v1:172.21.15.67:6789/0 conn(0x7fc000147040 legacy=0x7fc0000b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fbfff7fe640 1 --2- 172.21.15.67:0/2993287935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfe80039b0 0x7fbfe8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fbfff7fe640 1 --2- 172.21.15.67:0/2993287935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe80043b0 0x7fbfe8004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fbfff7fe640 1 --2- 172.21.15.67:0/2993287935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe8005120 0x7fbfe800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fbfff7fe640 1 -- 172.21.15.67:0/2993287935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc0001628c0 con 0x7fbfe8005120 2024-04-25T02:29:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fbfff7fe640 1 -- 172.21.15.67:0/2993287935 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe800c060 con 0x7fbfe80039b0 2024-04-25T02:29:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fbfff7fe640 1 -- 172.21.15.67:0/2993287935 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe800c260 con 0x7fbfe80043b0 2024-04-25T02:29:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fc00578b640 1 --2- 172.21.15.67:0/2993287935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe8005120 0x7fbfe800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fc004f8a640 1 --2- 172.21.15.67:0/2993287935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfe80039b0 0x7fbfe8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.124+0000 7fbffffff640 1 --2- 172.21.15.67:0/2993287935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe80043b0 0x7fbfe8004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.125+0000 7fc00578b640 1 -- 172.21.15.67:0/2993287935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe80043b0 msgr2=0x7fbfe8004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:21.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.125+0000 7fc00578b640 1 --2- 172.21.15.67:0/2993287935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe80043b0 0x7fbfe8004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.125+0000 7fc00578b640 1 -- 172.21.15.67:0/2993287935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfe80039b0 msgr2=0x7fbfe8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:21.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.125+0000 7fc00578b640 1 --2- 172.21.15.67:0/2993287935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfe80039b0 0x7fbfe8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.125+0000 7fc00578b640 1 -- 172.21.15.67:0/2993287935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe8003520 con 0x7fbfe8005120 2024-04-25T02:29:21.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.125+0000 7fbffffff640 1 --2- 172.21.15.67:0/2993287935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe80043b0 0x7fbfe8004880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:21.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.125+0000 7fc00578b640 1 -- 172.21.15.67:0/2993287935 reap_dead start 2024-04-25T02:29:21.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.125+0000 7fc00578b640 1 --2- 172.21.15.67:0/2993287935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe8005120 0x7fbfe800b9c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009ac0 tx=0x7fbfe8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45ecf11e761fee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:21.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.125+0000 7fbfff7fe640 1 -- 172.21.15.67:0/2993287935 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0009690 con 0x7fbfe8005120 2024-04-25T02:29:21.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.125+0000 7fbfff7fe640 1 -- 172.21.15.67:0/2993287935 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff0004020 con 0x7fbfe8005120 2024-04-25T02:29:21.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.125+0000 7fbfff7fe640 1 -- 172.21.15.67:0/2993287935 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0004410 con 0x7fbfe8005120 2024-04-25T02:29:21.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.126+0000 7fc0071ee640 1 -- 172.21.15.67:0/2993287935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe8005120 msgr2=0x7fbfe800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.126+0000 7fc0071ee640 1 --2- 172.21.15.67:0/2993287935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe8005120 0x7fbfe800b9c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009ac0 tx=0x7fbfe8005830 comp rx=0 tx=0).stop 2024-04-25T02:29:21.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.126+0000 7fc0071ee640 1 -- 172.21.15.67:0/2993287935 shutdown_connections 2024-04-25T02:29:21.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.126+0000 7fc0071ee640 1 --2- 172.21.15.67:0/2993287935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe8005120 0x7fbfe800b9c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.126+0000 7fc0071ee640 1 -- 172.21.15.67:0/2993287935 >> 172.21.15.67:0/2993287935 conn(0x7fc00006c3b0 msgr2=0x7fc00006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:21.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.126+0000 7fc0071ee640 1 -- 172.21.15.67:0/2993287935 shutdown_connections 2024-04-25T02:29:21.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.126+0000 7fc0071ee640 1 -- 172.21.15.67:0/2993287935 wait complete. 2024-04-25T02:29:21.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.127+0000 7fc0071ee640 1 Processor -- start 2024-04-25T02:29:21.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.127+0000 7fc0071ee640 1 -- start start 2024-04-25T02:29:21.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.128+0000 7fc0071ee640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe8005120 0x7fc00015d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.128+0000 7fc0071ee640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc000161170 0x7fc0001615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.128+0000 7fc0071ee640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0000c79b0 0x7fc0000c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.128+0000 7fc0071ee640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc000162d50 con 0x7fbfe8005120 2024-04-25T02:29:21.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.128+0000 7fc0071ee640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc0000d18f0 con 0x7fc000161170 2024-04-25T02:29:21.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.128+0000 7fc0071ee640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc0000b4740 con 0x7fc0000c79b0 2024-04-25T02:29:21.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.128+0000 7fc004f8a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe8005120 0x7fc00015d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.128+0000 7fc004f8a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe8005120 0x7fc00015d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37916/0 (socket says 172.21.15.67:37916) 2024-04-25T02:29:21.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.128+0000 7fc004f8a640 1 -- 172.21.15.67:0/31243192 learned_addr learned my addr 172.21.15.67:0/31243192 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:21.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.128+0000 7fc004f8a640 1 -- 172.21.15.67:0/31243192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0000c79b0 msgr2=0x7fc0000c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.128+0000 7fc004f8a640 1 --2- 172.21.15.67:0/31243192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0000c79b0 0x7fc0000c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.128+0000 7fc004f8a640 1 -- 172.21.15.67:0/31243192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc000161170 msgr2=0x7fc0001615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.128+0000 7fc004f8a640 1 --2- 172.21.15.67:0/31243192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc000161170 0x7fc0001615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.128+0000 7fc004f8a640 1 -- 172.21.15.67:0/31243192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0000c5cd0 con 0x7fbfe8005120 2024-04-25T02:29:21.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.129+0000 7fc004f8a640 1 --2- 172.21.15.67:0/31243192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe8005120 0x7fc00015d210 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbff80076b0 tx=0x7fbff8007b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:21.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.129+0000 7fbffd7fa640 1 -- 172.21.15.67:0/31243192 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8017020 con 0x7fbfe8005120 2024-04-25T02:29:21.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.129+0000 7fbffd7fa640 1 -- 172.21.15.67:0/31243192 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff800ac40 con 0x7fbfe8005120 2024-04-25T02:29:21.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.129+0000 7fc0071ee640 1 -- 172.21.15.67:0/31243192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0000c5fb0 con 0x7fbfe8005120 2024-04-25T02:29:21.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.129+0000 7fbffd7fa640 1 -- 172.21.15.67:0/31243192 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff80133f0 con 0x7fbfe8005120 2024-04-25T02:29:21.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.129+0000 7fc0071ee640 1 -- 172.21.15.67:0/31243192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0000c6570 con 0x7fbfe8005120 2024-04-25T02:29:21.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.130+0000 7fc0071ee640 1 -- 172.21.15.67:0/31243192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc000069110 con 0x7fbfe8005120 2024-04-25T02:29:21.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.130+0000 7fbffd7fa640 1 -- 172.21.15.67:0/31243192 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbff801a020 con 0x7fbfe8005120 2024-04-25T02:29:21.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.131+0000 7fbffd7fa640 1 --2- 172.21.15.67:0/31243192 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbfec06be30 0x7fbfec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.131+0000 7fbffd7fa640 1 -- 172.21.15.67:0/31243192 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fbff808b6e0 con 0x7fbfe8005120 2024-04-25T02:29:21.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.131+0000 7fbffffff640 1 --2- 172.21.15.67:0/31243192 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbfec06be30 0x7fbfec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.131+0000 7fbffffff640 1 --2- 172.21.15.67:0/31243192 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbfec06be30 0x7fbfec06e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbff4007fd0 tx=0x7fbff4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:21.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.135+0000 7fbffd7fa640 1 -- 172.21.15.67:0/31243192 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbff8021020 con 0x7fbfe8005120 2024-04-25T02:29:21.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.313+0000 7fc0071ee640 1 -- 172.21.15.67:0/31243192 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc000072bf0 con 0x7fbfec06be30 2024-04-25T02:29:21.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.320+0000 7fbffd7fa640 1 -- 172.21.15.67:0/31243192 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7fc000072bf0 con 0x7fbfec06be30 2024-04-25T02:29:21.327 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:21.328 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-25T02:29:21.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.323+0000 7fc0071ee640 1 -- 172.21.15.67:0/31243192 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbfec06be30 msgr2=0x7fbfec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.323+0000 7fc0071ee640 1 --2- 172.21.15.67:0/31243192 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbfec06be30 0x7fbfec06e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbff4007fd0 tx=0x7fbff4009040 comp rx=0 tx=0).stop 2024-04-25T02:29:21.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.323+0000 7fc0071ee640 1 -- 172.21.15.67:0/31243192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe8005120 msgr2=0x7fc00015d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.323+0000 7fc0071ee640 1 --2- 172.21.15.67:0/31243192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe8005120 0x7fc00015d210 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbff80076b0 tx=0x7fbff8007b70 comp rx=0 tx=0).stop 2024-04-25T02:29:21.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.323+0000 7fc0071ee640 1 -- 172.21.15.67:0/31243192 shutdown_connections 2024-04-25T02:29:21.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.323+0000 7fc0071ee640 1 --2- 172.21.15.67:0/31243192 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbfec06be30 0x7fbfec06e2f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.323+0000 7fc0071ee640 1 --2- 172.21.15.67:0/31243192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0000c79b0 0x7fc0000c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.323+0000 7fc0071ee640 1 --2- 172.21.15.67:0/31243192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc000161170 0x7fc0001615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.323+0000 7fc0071ee640 1 --2- 172.21.15.67:0/31243192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe8005120 0x7fc00015d210 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.323+0000 7fc0071ee640 1 -- 172.21.15.67:0/31243192 >> 172.21.15.67:0/31243192 conn(0x7fc00006c3b0 msgr2=0x7fc0000adfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:21.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.323+0000 7fc0071ee640 1 -- 172.21.15.67:0/31243192 shutdown_connections 2024-04-25T02:29:21.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.323+0000 7fc0071ee640 1 -- 172.21.15.67:0/31243192 wait complete. 2024-04-25T02:29:21.338 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-04-25T02:29:20.343199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591838,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220068,"kb_used_data":3880,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754652,"statfs":{"total":773094113280,"available":772868763648,"internally_reserved":0,"allocated":3973120,"data_stored":2249000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.029847"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353969+0000","last_change":"2024-04-25T02:29:18.346740+0000","last_active":"2024-04-25T02:29:18.353969+0000","last_peered":"2024-04-25T02:29:18.353969+0000","last_clean":"2024-04-25T02:29:18.353969+0000","last_became_active":"2024-04-25T02:29:18.346475+0000","last_became_peered":"2024-04-25T02:29:18.346475+0000","last_unstale":"2024-04-25T02:29:18.353969+0000","last_undegraded":"2024-04-25T02:29:18.353969+0000","last_fullsized":"2024-04-25T02:29:18.353969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352494+0000","last_change":"2024-04-25T02:29:18.347192+0000","last_active":"2024-04-25T02:29:18.352494+0000","last_peered":"2024-04-25T02:29:18.352494+0000","last_clean":"2024-04-25T02:29:18.352494+0000","last_became_active":"2024-04-25T02:29:18.346599+0000","last_became_peered":"2024-04-25T02:29:18.346599+0000","last_unstale":"2024-04-25T02:29:18.352494+0000","last_undegraded":"2024-04-25T02:29:18.352494+0000","last_fullsized":"2024-04-25T02:29:18.352494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:11.549908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348359+0000","last_change":"2024-04-25T02:29:18.344360+0000","last_active":"2024-04-25T02:29:18.348359+0000","last_peered":"2024-04-25T02:29:18.348359+0000","last_clean":"2024-04-25T02:29:18.348359+0000","last_became_active":"2024-04-25T02:29:18.343592+0000","last_became_peered":"2024-04-25T02:29:18.343592+0000","last_unstale":"2024-04-25T02:29:18.348359+0000","last_undegraded":"2024-04-25T02:29:18.348359+0000","last_fullsized":"2024-04-25T02:29:18.348359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:14.734561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353680+0000","last_change":"2024-04-25T02:29:18.353680+0000","last_active":"2024-04-25T02:29:18.353680+0000","last_peered":"2024-04-25T02:29:18.353680+0000","last_clean":"2024-04-25T02:29:18.353680+0000","last_became_active":"2024-04-25T02:29:18.353401+0000","last_became_peered":"2024-04-25T02:29:18.353401+0000","last_unstale":"2024-04-25T02:29:18.353680+0000","last_undegraded":"2024-04-25T02:29:18.353680+0000","last_fullsized":"2024-04-25T02:29:18.353680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:14.734561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351757+0000","last_change":"2024-04-25T02:29:18.349706+0000","last_active":"2024-04-25T02:29:18.351757+0000","last_peered":"2024-04-25T02:29:18.351757+0000","last_clean":"2024-04-25T02:29:18.351757+0000","last_became_active":"2024-04-25T02:29:18.349413+0000","last_became_peered":"2024-04-25T02:29:18.349413+0000","last_unstale":"2024-04-25T02:29:18.351757+0000","last_undegraded":"2024-04-25T02:29:18.351757+0000","last_fullsized":"2024-04-25T02:29:18.351757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:43:26.985827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353065+0000","last_change":"2024-04-25T02:29:18.348066+0000","last_active":"2024-04-25T02:29:18.353065+0000","last_peered":"2024-04-25T02:29:18.353065+0000","last_clean":"2024-04-25T02:29:18.353065+0000","last_became_active":"2024-04-25T02:29:18.347678+0000","last_became_peered":"2024-04-25T02:29:18.347678+0000","last_unstale":"2024-04-25T02:29:18.353065+0000","last_undegraded":"2024-04-25T02:29:18.353065+0000","last_fullsized":"2024-04-25T02:29:18.353065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:02:32.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351348+0000","last_change":"2024-04-25T02:29:18.347506+0000","last_active":"2024-04-25T02:29:18.351348+0000","last_peered":"2024-04-25T02:29:18.351348+0000","last_clean":"2024-04-25T02:29:18.351348+0000","last_became_active":"2024-04-25T02:29:18.347229+0000","last_became_peered":"2024-04-25T02:29:18.347229+0000","last_unstale":"2024-04-25T02:29:18.351348+0000","last_undegraded":"2024-04-25T02:29:18.351348+0000","last_fullsized":"2024-04-25T02:29:18.351348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.342548+0000","last_change":"2024-04-25T02:29:18.338526+0000","last_active":"2024-04-25T02:29:18.342548+0000","last_peered":"2024-04-25T02:29:18.342548+0000","last_clean":"2024-04-25T02:29:18.342548+0000","last_became_active":"2024-04-25T02:29:18.338272+0000","last_became_peered":"2024-04-25T02:29:18.338272+0000","last_unstale":"2024-04-25T02:29:18.342548+0000","last_undegraded":"2024-04-25T02:29:18.342548+0000","last_fullsized":"2024-04-25T02:29:18.342548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345636+0000","last_change":"2024-04-25T02:29:18.341056+0000","last_active":"2024-04-25T02:29:18.345636+0000","last_peered":"2024-04-25T02:29:18.345636+0000","last_clean":"2024-04-25T02:29:18.345636+0000","last_became_active":"2024-04-25T02:29:18.340660+0000","last_became_peered":"2024-04-25T02:29:18.340660+0000","last_unstale":"2024-04-25T02:29:18.345636+0000","last_undegraded":"2024-04-25T02:29:18.345636+0000","last_fullsized":"2024-04-25T02:29:18.345636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:25.532394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354625+0000","last_change":"2024-04-25T02:29:18.354625+0000","last_active":"2024-04-25T02:29:18.354625+0000","last_peered":"2024-04-25T02:29:18.354625+0000","last_clean":"2024-04-25T02:29:18.354625+0000","last_became_active":"2024-04-25T02:29:18.354339+0000","last_became_peered":"2024-04-25T02:29:18.354339+0000","last_unstale":"2024-04-25T02:29:18.354625+0000","last_undegraded":"2024-04-25T02:29:18.354625+0000","last_fullsized":"2024-04-25T02:29:18.354625+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:18.991459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.344927+0000","last_change":"2024-04-25T02:29:18.341907+0000","last_active":"2024-04-25T02:29:18.344927+0000","last_peered":"2024-04-25T02:29:18.344927+0000","last_clean":"2024-04-25T02:29:18.344927+0000","last_became_active":"2024-04-25T02:29:18.341644+0000","last_became_peered":"2024-04-25T02:29:18.341644+0000","last_unstale":"2024-04-25T02:29:18.344927+0000","last_undegraded":"2024-04-25T02:29:18.344927+0000","last_fullsized":"2024-04-25T02:29:18.344927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:33.371549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.349482+0000","last_change":"2024-04-25T02:29:18.349482+0000","last_active":"2024-04-25T02:29:18.349482+0000","last_peered":"2024-04-25T02:29:18.349482+0000","last_clean":"2024-04-25T02:29:18.349482+0000","last_became_active":"2024-04-25T02:29:18.349216+0000","last_became_peered":"2024-04-25T02:29:18.349216+0000","last_unstale":"2024-04-25T02:29:18.349482+0000","last_undegraded":"2024-04-25T02:29:18.349482+0000","last_fullsized":"2024-04-25T02:29:18.349482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:20.085001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345642+0000","last_change":"2024-04-25T02:29:18.340910+0000","last_active":"2024-04-25T02:29:18.345642+0000","last_peered":"2024-04-25T02:29:18.345642+0000","last_clean":"2024-04-25T02:29:18.345642+0000","last_became_active":"2024-04-25T02:29:18.340634+0000","last_became_peered":"2024-04-25T02:29:18.340634+0000","last_unstale":"2024-04-25T02:29:18.345642+0000","last_undegraded":"2024-04-25T02:29:18.345642+0000","last_fullsized":"2024-04-25T02:29:18.345642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:31.380254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348430+0000","last_change":"2024-04-25T02:29:18.341922+0000","last_active":"2024-04-25T02:29:18.348430+0000","last_peered":"2024-04-25T02:29:18.348430+0000","last_clean":"2024-04-25T02:29:18.348430+0000","last_became_active":"2024-04-25T02:29:18.341643+0000","last_became_peered":"2024-04-25T02:29:18.341643+0000","last_unstale":"2024-04-25T02:29:18.348430+0000","last_undegraded":"2024-04-25T02:29:18.348430+0000","last_fullsized":"2024-04-25T02:29:18.348430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:30.728990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345537+0000","last_change":"2024-04-25T02:29:18.336835+0000","last_active":"2024-04-25T02:29:18.345537+0000","last_peered":"2024-04-25T02:29:18.345537+0000","last_clean":"2024-04-25T02:29:18.345537+0000","last_became_active":"2024-04-25T02:29:18.336550+0000","last_became_peered":"2024-04-25T02:29:18.336550+0000","last_unstale":"2024-04-25T02:29:18.345537+0000","last_undegraded":"2024-04-25T02:29:18.345537+0000","last_fullsized":"2024-04-25T02:29:18.345537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:14.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352970+0000","last_change":"2024-04-25T02:29:18.352970+0000","last_active":"2024-04-25T02:29:18.352970+0000","last_peered":"2024-04-25T02:29:18.352970+0000","last_clean":"2024-04-25T02:29:18.352970+0000","last_became_active":"2024-04-25T02:29:18.352750+0000","last_became_peered":"2024-04-25T02:29:18.352750+0000","last_unstale":"2024-04-25T02:29:18.352970+0000","last_undegraded":"2024-04-25T02:29:18.352970+0000","last_fullsized":"2024-04-25T02:29:18.352970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:08.133055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354285+0000","last_change":"2024-04-25T02:29:18.350283+0000","last_active":"2024-04-25T02:29:18.354285+0000","last_peered":"2024-04-25T02:29:18.354285+0000","last_clean":"2024-04-25T02:29:18.354285+0000","last_became_active":"2024-04-25T02:29:18.349442+0000","last_became_peered":"2024-04-25T02:29:18.349442+0000","last_unstale":"2024-04-25T02:29:18.354285+0000","last_undegraded":"2024-04-25T02:29:18.354285+0000","last_fullsized":"2024-04-25T02:29:18.354285+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:50.388712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352469+0000","last_change":"2024-04-25T02:29:18.346919+0000","last_active":"2024-04-25T02:29:18.352469+0000","last_peered":"2024-04-25T02:29:18.352469+0000","last_clean":"2024-04-25T02:29:18.352469+0000","last_became_active":"2024-04-25T02:29:18.345267+0000","last_became_peered":"2024-04-25T02:29:18.345267+0000","last_unstale":"2024-04-25T02:29:18.352469+0000","last_undegraded":"2024-04-25T02:29:18.352469+0000","last_fullsized":"2024-04-25T02:29:18.352469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:08.133055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348478+0000","last_change":"2024-04-25T02:29:18.343532+0000","last_active":"2024-04-25T02:29:18.348478+0000","last_peered":"2024-04-25T02:29:18.348478+0000","last_clean":"2024-04-25T02:29:18.348478+0000","last_became_active":"2024-04-25T02:29:18.343242+0000","last_became_peered":"2024-04-25T02:29:18.343242+0000","last_unstale":"2024-04-25T02:29:18.348478+0000","last_undegraded":"2024-04-25T02:29:18.348478+0000","last_fullsized":"2024-04-25T02:29:18.348478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:14.025149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351721+0000","last_change":"2024-04-25T02:29:18.348342+0000","last_active":"2024-04-25T02:29:18.351721+0000","last_peered":"2024-04-25T02:29:18.351721+0000","last_clean":"2024-04-25T02:29:18.351721+0000","last_became_active":"2024-04-25T02:29:18.348055+0000","last_became_peered":"2024-04-25T02:29:18.348055+0000","last_unstale":"2024-04-25T02:29:18.351721+0000","last_undegraded":"2024-04-25T02:29:18.351721+0000","last_fullsized":"2024-04-25T02:29:18.351721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:00.533737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.346888+0000","last_change":"2024-04-25T02:29:18.339396+0000","last_active":"2024-04-25T02:29:18.346888+0000","last_peered":"2024-04-25T02:29:18.346888+0000","last_clean":"2024-04-25T02:29:18.346888+0000","last_became_active":"2024-04-25T02:29:18.339130+0000","last_became_peered":"2024-04-25T02:29:18.339130+0000","last_unstale":"2024-04-25T02:29:18.346888+0000","last_undegraded":"2024-04-25T02:29:18.346888+0000","last_fullsized":"2024-04-25T02:29:18.346888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:23.387620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.347319+0000","last_change":"2024-04-25T02:29:18.337818+0000","last_active":"2024-04-25T02:29:18.347319+0000","last_peered":"2024-04-25T02:29:18.347319+0000","last_clean":"2024-04-25T02:29:18.347319+0000","last_became_active":"2024-04-25T02:29:18.337470+0000","last_became_peered":"2024-04-25T02:29:18.337470+0000","last_unstale":"2024-04-25T02:29:18.347319+0000","last_undegraded":"2024-04-25T02:29:18.347319+0000","last_fullsized":"2024-04-25T02:29:18.347319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:53.335059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345890+0000","last_change":"2024-04-25T02:29:18.344898+0000","last_active":"2024-04-25T02:29:18.345890+0000","last_peered":"2024-04-25T02:29:18.345890+0000","last_clean":"2024-04-25T02:29:18.345890+0000","last_became_active":"2024-04-25T02:29:18.344617+0000","last_became_peered":"2024-04-25T02:29:18.344617+0000","last_unstale":"2024-04-25T02:29:18.345890+0000","last_undegraded":"2024-04-25T02:29:18.345890+0000","last_fullsized":"2024-04-25T02:29:18.345890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345770+0000","last_change":"2024-04-25T02:29:18.339252+0000","last_active":"2024-04-25T02:29:18.345770+0000","last_peered":"2024-04-25T02:29:18.345770+0000","last_clean":"2024-04-25T02:29:18.345770+0000","last_became_active":"2024-04-25T02:29:18.338939+0000","last_became_peered":"2024-04-25T02:29:18.338939+0000","last_unstale":"2024-04-25T02:29:18.345770+0000","last_undegraded":"2024-04-25T02:29:18.345770+0000","last_fullsized":"2024-04-25T02:29:18.345770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348292+0000","last_change":"2024-04-25T02:29:18.346821+0000","last_active":"2024-04-25T02:29:18.348292+0000","last_peered":"2024-04-25T02:29:18.348292+0000","last_clean":"2024-04-25T02:29:18.348292+0000","last_became_active":"2024-04-25T02:29:18.346488+0000","last_became_peered":"2024-04-25T02:29:18.346488+0000","last_unstale":"2024-04-25T02:29:18.348292+0000","last_undegraded":"2024-04-25T02:29:18.348292+0000","last_fullsized":"2024-04-25T02:29:18.348292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353188+0000","last_change":"2024-04-25T02:29:18.351850+0000","last_active":"2024-04-25T02:29:18.353188+0000","last_peered":"2024-04-25T02:29:18.353188+0000","last_clean":"2024-04-25T02:29:18.353188+0000","last_became_active":"2024-04-25T02:29:18.351485+0000","last_became_peered":"2024-04-25T02:29:18.351485+0000","last_unstale":"2024-04-25T02:29:18.353188+0000","last_undegraded":"2024-04-25T02:29:18.353188+0000","last_fullsized":"2024-04-25T02:29:18.353188+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:26.891694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":6,"reported_epoch":32,"state":"active","last_fresh":"2024-04-25T02:29:18.355802+0000","last_change":"2024-04-25T02:29:18.355742+0000","last_active":"2024-04-25T02:29:18.355802+0000","last_peered":"2024-04-25T02:29:18.355802+0000","last_clean":"2024-04-25T02:29:17.313167+0000","last_became_active":"2024-04-25T02:29:18.355742+0000","last_became_peered":"2024-04-25T02:29:18.355742+0000","last_unstale":"2024-04-25T02:29:18.355802+0000","last_undegraded":"2024-04-25T02:29:18.355802+0000","last_fullsized":"2024-04-25T02:29:18.355802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348814+0000","last_change":"2024-04-25T02:29:18.341797+0000","last_active":"2024-04-25T02:29:18.348814+0000","last_peered":"2024-04-25T02:29:18.348814+0000","last_clean":"2024-04-25T02:29:18.348814+0000","last_became_active":"2024-04-25T02:29:18.341492+0000","last_became_peered":"2024-04-25T02:29:18.341492+0000","last_unstale":"2024-04-25T02:29:18.348814+0000","last_undegraded":"2024-04-25T02:29:18.348814+0000","last_fullsized":"2024-04-25T02:29:18.348814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:33.371549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355282+0000","last_change":"2024-04-25T02:29:18.351144+0000","last_active":"2024-04-25T02:29:18.355282+0000","last_peered":"2024-04-25T02:29:18.355282+0000","last_clean":"2024-04-25T02:29:18.355282+0000","last_became_active":"2024-04-25T02:29:18.350844+0000","last_became_peered":"2024-04-25T02:29:18.350844+0000","last_unstale":"2024-04-25T02:29:18.355282+0000","last_undegraded":"2024-04-25T02:29:18.355282+0000","last_fullsized":"2024-04-25T02:29:18.355282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354443+0000","last_change":"2024-04-25T02:29:18.349494+0000","last_active":"2024-04-25T02:29:18.354443+0000","last_peered":"2024-04-25T02:29:18.354443+0000","last_clean":"2024-04-25T02:29:18.354443+0000","last_became_active":"2024-04-25T02:29:18.349186+0000","last_became_peered":"2024-04-25T02:29:18.349186+0000","last_unstale":"2024-04-25T02:29:18.354443+0000","last_undegraded":"2024-04-25T02:29:18.354443+0000","last_fullsized":"2024-04-25T02:29:18.354443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:14.025149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345264+0000","last_change":"2024-04-25T02:29:18.342571+0000","last_active":"2024-04-25T02:29:18.345264+0000","last_peered":"2024-04-25T02:29:18.345264+0000","last_clean":"2024-04-25T02:29:18.345264+0000","last_became_active":"2024-04-25T02:29:18.341248+0000","last_became_peered":"2024-04-25T02:29:18.341248+0000","last_unstale":"2024-04-25T02:29:18.345264+0000","last_undegraded":"2024-04-25T02:29:18.345264+0000","last_fullsized":"2024-04-25T02:29:18.345264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:37.293554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354254+0000","last_change":"2024-04-25T02:29:18.348376+0000","last_active":"2024-04-25T02:29:18.354254+0000","last_peered":"2024-04-25T02:29:18.354254+0000","last_clean":"2024-04-25T02:29:18.354254+0000","last_became_active":"2024-04-25T02:29:18.347730+0000","last_became_peered":"2024-04-25T02:29:18.347730+0000","last_unstale":"2024-04-25T02:29:18.354254+0000","last_undegraded":"2024-04-25T02:29:18.354254+0000","last_fullsized":"2024-04-25T02:29:18.354254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:30.728990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345232+0000","last_change":"2024-04-25T02:29:18.344161+0000","last_active":"2024-04-25T02:29:18.345232+0000","last_peered":"2024-04-25T02:29:18.345232+0000","last_clean":"2024-04-25T02:29:18.345232+0000","last_became_active":"2024-04-25T02:29:18.343890+0000","last_became_peered":"2024-04-25T02:29:18.343890+0000","last_unstale":"2024-04-25T02:29:18.345232+0000","last_undegraded":"2024-04-25T02:29:18.345232+0000","last_fullsized":"2024-04-25T02:29:18.345232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:14.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352113+0000","last_change":"2024-04-25T02:29:17.336150+0000","last_active":"2024-04-25T02:29:18.352113+0000","last_peered":"2024-04-25T02:29:18.352113+0000","last_clean":"2024-04-25T02:29:18.352113+0000","last_became_active":"2024-04-25T02:29:17.335858+0000","last_became_peered":"2024-04-25T02:29:17.335858+0000","last_unstale":"2024-04-25T02:29:18.352113+0000","last_undegraded":"2024-04-25T02:29:18.352113+0000","last_fullsized":"2024-04-25T02:29:18.352113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:22.380376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345244+0000","last_change":"2024-04-25T02:29:18.344188+0000","last_active":"2024-04-25T02:29:18.345244+0000","last_peered":"2024-04-25T02:29:18.345244+0000","last_clean":"2024-04-25T02:29:18.345244+0000","last_became_active":"2024-04-25T02:29:18.343887+0000","last_became_peered":"2024-04-25T02:29:18.343887+0000","last_unstale":"2024-04-25T02:29:18.345244+0000","last_undegraded":"2024-04-25T02:29:18.345244+0000","last_fullsized":"2024-04-25T02:29:18.345244+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:14.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.344334+0000","last_change":"2024-04-25T02:29:17.338792+0000","last_active":"2024-04-25T02:29:18.344334+0000","last_peered":"2024-04-25T02:29:18.344334+0000","last_clean":"2024-04-25T02:29:18.344334+0000","last_became_active":"2024-04-25T02:29:17.338431+0000","last_became_peered":"2024-04-25T02:29:17.338431+0000","last_unstale":"2024-04-25T02:29:18.344334+0000","last_undegraded":"2024-04-25T02:29:18.344334+0000","last_fullsized":"2024-04-25T02:29:18.344334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:37:20.446428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355215+0000","last_change":"2024-04-25T02:29:18.349592+0000","last_active":"2024-04-25T02:29:18.355215+0000","last_peered":"2024-04-25T02:29:18.355215+0000","last_clean":"2024-04-25T02:29:18.355215+0000","last_became_active":"2024-04-25T02:29:18.349296+0000","last_became_peered":"2024-04-25T02:29:18.349296+0000","last_unstale":"2024-04-25T02:29:18.355215+0000","last_undegraded":"2024-04-25T02:29:18.355215+0000","last_fullsized":"2024-04-25T02:29:18.355215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:25.036633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.358845+0000","last_change":"2024-04-25T02:29:17.343354+0000","last_active":"2024-04-25T02:29:18.358845+0000","last_peered":"2024-04-25T02:29:18.358845+0000","last_clean":"2024-04-25T02:29:18.358845+0000","last_became_active":"2024-04-25T02:29:17.343032+0000","last_became_peered":"2024-04-25T02:29:17.343032+0000","last_unstale":"2024-04-25T02:29:18.358845+0000","last_undegraded":"2024-04-25T02:29:18.358845+0000","last_fullsized":"2024-04-25T02:29:18.358845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:17.984215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354469+0000","last_change":"2024-04-25T02:29:18.354469+0000","last_active":"2024-04-25T02:29:18.354469+0000","last_peered":"2024-04-25T02:29:18.354469+0000","last_clean":"2024-04-25T02:29:18.354469+0000","last_became_active":"2024-04-25T02:29:18.354133+0000","last_became_peered":"2024-04-25T02:29:18.354133+0000","last_unstale":"2024-04-25T02:29:18.354469+0000","last_undegraded":"2024-04-25T02:29:18.354469+0000","last_fullsized":"2024-04-25T02:29:18.354469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.356147+0000","last_change":"2024-04-25T02:29:17.343565+0000","last_active":"2024-04-25T02:29:18.356147+0000","last_peered":"2024-04-25T02:29:18.356147+0000","last_clean":"2024-04-25T02:29:18.356147+0000","last_became_active":"2024-04-25T02:29:17.343267+0000","last_became_peered":"2024-04-25T02:29:17.343267+0000","last_unstale":"2024-04-25T02:29:18.356147+0000","last_undegraded":"2024-04-25T02:29:18.356147+0000","last_fullsized":"2024-04-25T02:29:18.356147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:58.779414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354465+0000","last_change":"2024-04-25T02:29:18.349899+0000","last_active":"2024-04-25T02:29:18.354465+0000","last_peered":"2024-04-25T02:29:18.354465+0000","last_clean":"2024-04-25T02:29:18.354465+0000","last_became_active":"2024-04-25T02:29:18.349625+0000","last_became_peered":"2024-04-25T02:29:18.349625+0000","last_unstale":"2024-04-25T02:29:18.354465+0000","last_undegraded":"2024-04-25T02:29:18.354465+0000","last_fullsized":"2024-04-25T02:29:18.354465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:20.085001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354265+0000","last_change":"2024-04-25T02:29:17.345642+0000","last_active":"2024-04-25T02:29:18.354265+0000","last_peered":"2024-04-25T02:29:18.354265+0000","last_clean":"2024-04-25T02:29:18.354265+0000","last_became_active":"2024-04-25T02:29:17.345311+0000","last_became_peered":"2024-04-25T02:29:17.345311+0000","last_unstale":"2024-04-25T02:29:18.354265+0000","last_undegraded":"2024-04-25T02:29:18.354265+0000","last_fullsized":"2024-04-25T02:29:18.354265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:48.636227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.347858+0000","last_change":"2024-04-25T02:29:18.342591+0000","last_active":"2024-04-25T02:29:18.347858+0000","last_peered":"2024-04-25T02:29:18.347858+0000","last_clean":"2024-04-25T02:29:18.347858+0000","last_became_active":"2024-04-25T02:29:18.341689+0000","last_became_peered":"2024-04-25T02:29:18.341689+0000","last_unstale":"2024-04-25T02:29:18.347858+0000","last_undegraded":"2024-04-25T02:29:18.347858+0000","last_fullsized":"2024-04-25T02:29:18.347858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:23.649134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354267+0000","last_change":"2024-04-25T02:29:17.345509+0000","last_active":"2024-04-25T02:29:18.354267+0000","last_peered":"2024-04-25T02:29:18.354267+0000","last_clean":"2024-04-25T02:29:18.354267+0000","last_became_active":"2024-04-25T02:29:17.345209+0000","last_became_peered":"2024-04-25T02:29:17.345209+0000","last_unstale":"2024-04-25T02:29:18.354267+0000","last_undegraded":"2024-04-25T02:29:18.354267+0000","last_fullsized":"2024-04-25T02:29:18.354267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:26.682356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345496+0000","last_change":"2024-04-25T02:29:18.334322+0000","last_active":"2024-04-25T02:29:18.345496+0000","last_peered":"2024-04-25T02:29:18.345496+0000","last_clean":"2024-04-25T02:29:18.345496+0000","last_became_active":"2024-04-25T02:29:18.334017+0000","last_became_peered":"2024-04-25T02:29:18.334017+0000","last_unstale":"2024-04-25T02:29:18.345496+0000","last_undegraded":"2024-04-25T02:29:18.345496+0000","last_fullsized":"2024-04-25T02:29:18.345496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:03:39.193545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.325803+0000","last_change":"2024-04-25T02:29:17.344030+0000","last_active":"2024-04-25T02:29:18.325803+0000","last_peered":"2024-04-25T02:29:18.325803+0000","last_clean":"2024-04-25T02:29:18.325803+0000","last_became_active":"2024-04-25T02:29:17.343766+0000","last_became_peered":"2024-04-25T02:29:17.343766+0000","last_unstale":"2024-04-25T02:29:18.325803+0000","last_undegraded":"2024-04-25T02:29:18.325803+0000","last_fullsized":"2024-04-25T02:29:18.325803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:32.364305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352367+0000","last_change":"2024-04-25T02:29:18.352367+0000","last_active":"2024-04-25T02:29:18.352367+0000","last_peered":"2024-04-25T02:29:18.352367+0000","last_clean":"2024-04-25T02:29:18.352367+0000","last_became_active":"2024-04-25T02:29:18.351998+0000","last_became_peered":"2024-04-25T02:29:18.351998+0000","last_unstale":"2024-04-25T02:29:18.352367+0000","last_undegraded":"2024-04-25T02:29:18.352367+0000","last_fullsized":"2024-04-25T02:29:18.352367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:23.649134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327586+0000","last_change":"2024-04-25T02:29:17.335287+0000","last_active":"2024-04-25T02:29:18.327586+0000","last_peered":"2024-04-25T02:29:18.327586+0000","last_clean":"2024-04-25T02:29:18.327586+0000","last_became_active":"2024-04-25T02:29:17.334613+0000","last_became_peered":"2024-04-25T02:29:17.334613+0000","last_unstale":"2024-04-25T02:29:18.327586+0000","last_undegraded":"2024-04-25T02:29:18.327586+0000","last_fullsized":"2024-04-25T02:29:18.327586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:24.711459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351260+0000","last_change":"2024-04-25T02:29:18.345717+0000","last_active":"2024-04-25T02:29:18.351260+0000","last_peered":"2024-04-25T02:29:18.351260+0000","last_clean":"2024-04-25T02:29:18.351260+0000","last_became_active":"2024-04-25T02:29:18.345430+0000","last_became_peered":"2024-04-25T02:29:18.345430+0000","last_unstale":"2024-04-25T02:29:18.351260+0000","last_undegraded":"2024-04-25T02:29:18.351260+0000","last_fullsized":"2024-04-25T02:29:18.351260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:18.991459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327056+0000","last_change":"2024-04-25T02:29:17.344786+0000","last_active":"2024-04-25T02:29:18.327056+0000","last_peered":"2024-04-25T02:29:18.327056+0000","last_clean":"2024-04-25T02:29:18.327056+0000","last_became_active":"2024-04-25T02:29:17.344395+0000","last_became_peered":"2024-04-25T02:29:17.344395+0000","last_unstale":"2024-04-25T02:29:18.327056+0000","last_undegraded":"2024-04-25T02:29:18.327056+0000","last_fullsized":"2024-04-25T02:29:18.327056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:12.515961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352117+0000","last_change":"2024-04-25T02:29:18.344217+0000","last_active":"2024-04-25T02:29:18.352117+0000","last_peered":"2024-04-25T02:29:18.352117+0000","last_clean":"2024-04-25T02:29:18.352117+0000","last_became_active":"2024-04-25T02:29:18.343885+0000","last_became_peered":"2024-04-25T02:29:18.343885+0000","last_unstale":"2024-04-25T02:29:18.352117+0000","last_undegraded":"2024-04-25T02:29:18.352117+0000","last_fullsized":"2024-04-25T02:29:18.352117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:20.085001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.333144+0000","last_change":"2024-04-25T02:29:17.344529+0000","last_active":"2024-04-25T02:29:18.333144+0000","last_peered":"2024-04-25T02:29:18.333144+0000","last_clean":"2024-04-25T02:29:18.333144+0000","last_became_active":"2024-04-25T02:29:17.344194+0000","last_became_peered":"2024-04-25T02:29:17.344194+0000","last_unstale":"2024-04-25T02:29:18.333144+0000","last_undegraded":"2024-04-25T02:29:18.333144+0000","last_fullsized":"2024-04-25T02:29:18.333144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:03:38.186300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353217+0000","last_change":"2024-04-25T02:29:18.350354+0000","last_active":"2024-04-25T02:29:18.353217+0000","last_peered":"2024-04-25T02:29:18.353217+0000","last_clean":"2024-04-25T02:29:18.353217+0000","last_became_active":"2024-04-25T02:29:18.350033+0000","last_became_peered":"2024-04-25T02:29:18.350033+0000","last_unstale":"2024-04-25T02:29:18.353217+0000","last_undegraded":"2024-04-25T02:29:18.353217+0000","last_fullsized":"2024-04-25T02:29:18.353217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:14.176273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351349+0000","last_change":"2024-04-25T02:29:17.339319+0000","last_active":"2024-04-25T02:29:18.351349+0000","last_peered":"2024-04-25T02:29:18.351349+0000","last_clean":"2024-04-25T02:29:18.351349+0000","last_became_active":"2024-04-25T02:29:17.339013+0000","last_became_peered":"2024-04-25T02:29:17.339013+0000","last_unstale":"2024-04-25T02:29:18.351349+0000","last_undegraded":"2024-04-25T02:29:18.351349+0000","last_fullsized":"2024-04-25T02:29:18.351349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:24.029388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351408+0000","last_change":"2024-04-25T02:29:18.345320+0000","last_active":"2024-04-25T02:29:18.351408+0000","last_peered":"2024-04-25T02:29:18.351408+0000","last_clean":"2024-04-25T02:29:18.351408+0000","last_became_active":"2024-04-25T02:29:18.345005+0000","last_became_peered":"2024-04-25T02:29:18.345005+0000","last_unstale":"2024-04-25T02:29:18.351408+0000","last_undegraded":"2024-04-25T02:29:18.351408+0000","last_fullsized":"2024-04-25T02:29:18.351408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'5","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.358670+0000","last_change":"2024-04-25T02:29:17.347025+0000","last_active":"2024-04-25T02:29:18.358670+0000","last_peered":"2024-04-25T02:29:18.358670+0000","last_clean":"2024-04-25T02:29:18.358670+0000","last_became_active":"2024-04-25T02:29:17.346724+0000","last_became_peered":"2024-04-25T02:29:17.346724+0000","last_unstale":"2024-04-25T02:29:18.358670+0000","last_undegraded":"2024-04-25T02:29:18.358670+0000","last_fullsized":"2024-04-25T02:29:18.358670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:13.727317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351533+0000","last_change":"2024-04-25T02:29:18.349195+0000","last_active":"2024-04-25T02:29:18.351533+0000","last_peered":"2024-04-25T02:29:18.351533+0000","last_clean":"2024-04-25T02:29:18.351533+0000","last_became_active":"2024-04-25T02:29:18.348904+0000","last_became_peered":"2024-04-25T02:29:18.348904+0000","last_unstale":"2024-04-25T02:29:18.351533+0000","last_undegraded":"2024-04-25T02:29:18.351533+0000","last_fullsized":"2024-04-25T02:29:18.351533+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:33.371549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355170+0000","last_change":"2024-04-25T02:29:17.333661+0000","last_active":"2024-04-25T02:29:18.355170+0000","last_peered":"2024-04-25T02:29:18.355170+0000","last_clean":"2024-04-25T02:29:18.355170+0000","last_became_active":"2024-04-25T02:29:17.333166+0000","last_became_peered":"2024-04-25T02:29:17.333166+0000","last_unstale":"2024-04-25T02:29:18.355170+0000","last_undegraded":"2024-04-25T02:29:18.355170+0000","last_fullsized":"2024-04-25T02:29:18.355170+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:37:20.446428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.358071+0000","last_change":"2024-04-25T02:29:18.351870+0000","last_active":"2024-04-25T02:29:18.358071+0000","last_peered":"2024-04-25T02:29:18.358071+0000","last_clean":"2024-04-25T02:29:18.358071+0000","last_became_active":"2024-04-25T02:29:18.347590+0000","last_became_peered":"2024-04-25T02:29:18.347590+0000","last_unstale":"2024-04-25T02:29:18.358071+0000","last_undegraded":"2024-04-25T02:29:18.358071+0000","last_fullsized":"2024-04-25T02:29:18.358071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:43.238638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.332322+0000","last_change":"2024-04-25T02:29:17.340109+0000","last_active":"2024-04-25T02:29:18.332322+0000","last_peered":"2024-04-25T02:29:18.332322+0000","last_clean":"2024-04-25T02:29:18.332322+0000","last_became_active":"2024-04-25T02:29:17.339787+0000","last_became_peered":"2024-04-25T02:29:17.339787+0000","last_unstale":"2024-04-25T02:29:18.332322+0000","last_undegraded":"2024-04-25T02:29:18.332322+0000","last_fullsized":"2024-04-25T02:29:18.332322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:24.525150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354229+0000","last_change":"2024-04-25T02:29:18.348361+0000","last_active":"2024-04-25T02:29:18.354229+0000","last_peered":"2024-04-25T02:29:18.354229+0000","last_clean":"2024-04-25T02:29:18.354229+0000","last_became_active":"2024-04-25T02:29:18.347942+0000","last_became_peered":"2024-04-25T02:29:18.347942+0000","last_unstale":"2024-04-25T02:29:18.354229+0000","last_undegraded":"2024-04-25T02:29:18.354229+0000","last_fullsized":"2024-04-25T02:29:18.354229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:18.991459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.325957+0000","last_change":"2024-04-25T02:29:17.344628+0000","last_active":"2024-04-25T02:29:18.325957+0000","last_peered":"2024-04-25T02:29:18.325957+0000","last_clean":"2024-04-25T02:29:18.325957+0000","last_became_active":"2024-04-25T02:29:17.344358+0000","last_became_peered":"2024-04-25T02:29:17.344358+0000","last_unstale":"2024-04-25T02:29:18.325957+0000","last_undegraded":"2024-04-25T02:29:18.325957+0000","last_fullsized":"2024-04-25T02:29:18.325957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:22.641889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345282+0000","last_change":"2024-04-25T02:29:18.344070+0000","last_active":"2024-04-25T02:29:18.345282+0000","last_peered":"2024-04-25T02:29:18.345282+0000","last_clean":"2024-04-25T02:29:18.345282+0000","last_became_active":"2024-04-25T02:29:18.343693+0000","last_became_peered":"2024-04-25T02:29:18.343693+0000","last_unstale":"2024-04-25T02:29:18.345282+0000","last_undegraded":"2024-04-25T02:29:18.345282+0000","last_fullsized":"2024-04-25T02:29:18.345282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:25.036633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.359172+0000","last_change":"2024-04-25T02:29:17.347108+0000","last_active":"2024-04-25T02:29:18.359172+0000","last_peered":"2024-04-25T02:29:18.359172+0000","last_clean":"2024-04-25T02:29:18.359172+0000","last_became_active":"2024-04-25T02:29:17.346804+0000","last_became_peered":"2024-04-25T02:29:17.346804+0000","last_unstale":"2024-04-25T02:29:18.359172+0000","last_undegraded":"2024-04-25T02:29:18.359172+0000","last_fullsized":"2024-04-25T02:29:18.359172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:47.231152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354232+0000","last_change":"2024-04-25T02:29:18.346263+0000","last_active":"2024-04-25T02:29:18.354232+0000","last_peered":"2024-04-25T02:29:18.354232+0000","last_clean":"2024-04-25T02:29:18.354232+0000","last_became_active":"2024-04-25T02:29:18.345025+0000","last_became_peered":"2024-04-25T02:29:18.345025+0000","last_unstale":"2024-04-25T02:29:18.354232+0000","last_undegraded":"2024-04-25T02:29:18.354232+0000","last_fullsized":"2024-04-25T02:29:18.354232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:37.293554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354159+0000","last_change":"2024-04-25T02:29:17.344650+0000","last_active":"2024-04-25T02:29:18.354159+0000","last_peered":"2024-04-25T02:29:18.354159+0000","last_clean":"2024-04-25T02:29:18.354159+0000","last_became_active":"2024-04-25T02:29:17.344289+0000","last_became_peered":"2024-04-25T02:29:17.344289+0000","last_unstale":"2024-04-25T02:29:18.354159+0000","last_undegraded":"2024-04-25T02:29:18.354159+0000","last_fullsized":"2024-04-25T02:29:18.354159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:36.286309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351371+0000","last_change":"2024-04-25T02:29:18.346031+0000","last_active":"2024-04-25T02:29:18.351371+0000","last_peered":"2024-04-25T02:29:18.351371+0000","last_clean":"2024-04-25T02:29:18.351371+0000","last_became_active":"2024-04-25T02:29:18.344184+0000","last_became_peered":"2024-04-25T02:29:18.344184+0000","last_unstale":"2024-04-25T02:29:18.351371+0000","last_undegraded":"2024-04-25T02:29:18.351371+0000","last_fullsized":"2024-04-25T02:29:18.351371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:30.728990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348015+0000","last_change":"2024-04-25T02:29:17.333575+0000","last_active":"2024-04-25T02:29:18.348015+0000","last_peered":"2024-04-25T02:29:18.348015+0000","last_clean":"2024-04-25T02:29:18.348015+0000","last_became_active":"2024-04-25T02:29:17.333263+0000","last_became_peered":"2024-04-25T02:29:17.333263+0000","last_unstale":"2024-04-25T02:29:18.348015+0000","last_undegraded":"2024-04-25T02:29:18.348015+0000","last_fullsized":"2024-04-25T02:29:18.348015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:17.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355310+0000","last_change":"2024-04-25T02:29:18.355310+0000","last_active":"2024-04-25T02:29:18.355310+0000","last_peered":"2024-04-25T02:29:18.355310+0000","last_clean":"2024-04-25T02:29:18.355310+0000","last_became_active":"2024-04-25T02:29:18.354835+0000","last_became_peered":"2024-04-25T02:29:18.354835+0000","last_unstale":"2024-04-25T02:29:18.355310+0000","last_undegraded":"2024-04-25T02:29:18.355310+0000","last_fullsized":"2024-04-25T02:29:18.355310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:30.728990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348745+0000","last_change":"2024-04-25T02:29:17.336493+0000","last_active":"2024-04-25T02:29:18.348745+0000","last_peered":"2024-04-25T02:29:18.348745+0000","last_clean":"2024-04-25T02:29:18.348745+0000","last_became_active":"2024-04-25T02:29:17.336162+0000","last_became_peered":"2024-04-25T02:29:17.336162+0000","last_unstale":"2024-04-25T02:29:18.348745+0000","last_undegraded":"2024-04-25T02:29:18.348745+0000","last_fullsized":"2024-04-25T02:29:18.348745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:30.373010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.342175+0000","last_change":"2024-04-25T02:29:18.337364+0000","last_active":"2024-04-25T02:29:18.342175+0000","last_peered":"2024-04-25T02:29:18.342175+0000","last_clean":"2024-04-25T02:29:18.342175+0000","last_became_active":"2024-04-25T02:29:18.336958+0000","last_became_peered":"2024-04-25T02:29:18.336958+0000","last_unstale":"2024-04-25T02:29:18.342175+0000","last_undegraded":"2024-04-25T02:29:18.342175+0000","last_fullsized":"2024-04-25T02:29:18.342175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:03:23.356365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327792+0000","last_change":"2024-04-25T02:29:17.345750+0000","last_active":"2024-04-25T02:29:18.327792+0000","last_peered":"2024-04-25T02:29:18.327792+0000","last_clean":"2024-04-25T02:29:18.327792+0000","last_became_active":"2024-04-25T02:29:17.345215+0000","last_became_peered":"2024-04-25T02:29:17.345215+0000","last_unstale":"2024-04-25T02:29:18.327792+0000","last_undegraded":"2024-04-25T02:29:18.327792+0000","last_fullsized":"2024-04-25T02:29:18.327792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:43:25.978582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.346132+0000","last_change":"2024-04-25T02:29:18.344512+0000","last_active":"2024-04-25T02:29:18.346132+0000","last_peered":"2024-04-25T02:29:18.346132+0000","last_clean":"2024-04-25T02:29:18.346132+0000","last_became_active":"2024-04-25T02:29:18.344002+0000","last_became_peered":"2024-04-25T02:29:18.344002+0000","last_unstale":"2024-04-25T02:29:18.346132+0000","last_undegraded":"2024-04-25T02:29:18.346132+0000","last_fullsized":"2024-04-25T02:29:18.346132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:18.639956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348772+0000","last_change":"2024-04-25T02:29:17.336327+0000","last_active":"2024-04-25T02:29:18.348772+0000","last_peered":"2024-04-25T02:29:18.348772+0000","last_clean":"2024-04-25T02:29:18.348772+0000","last_became_active":"2024-04-25T02:29:17.336061+0000","last_became_peered":"2024-04-25T02:29:17.336061+0000","last_unstale":"2024-04-25T02:29:18.348772+0000","last_undegraded":"2024-04-25T02:29:18.348772+0000","last_fullsized":"2024-04-25T02:29:18.348772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:22.380376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.342305+0000","last_change":"2024-04-25T02:29:18.338302+0000","last_active":"2024-04-25T02:29:18.342305+0000","last_peered":"2024-04-25T02:29:18.342305+0000","last_clean":"2024-04-25T02:29:18.342305+0000","last_became_active":"2024-04-25T02:29:18.338039+0000","last_became_peered":"2024-04-25T02:29:18.338039+0000","last_unstale":"2024-04-25T02:29:18.342305+0000","last_undegraded":"2024-04-25T02:29:18.342305+0000","last_fullsized":"2024-04-25T02:29:18.342305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:32.654953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.332282+0000","last_change":"2024-04-25T02:29:17.343462+0000","last_active":"2024-04-25T02:29:18.332282+0000","last_peered":"2024-04-25T02:29:18.332282+0000","last_clean":"2024-04-25T02:29:18.332282+0000","last_became_active":"2024-04-25T02:29:17.343181+0000","last_became_peered":"2024-04-25T02:29:17.343181+0000","last_unstale":"2024-04-25T02:29:18.332282+0000","last_undegraded":"2024-04-25T02:29:18.332282+0000","last_fullsized":"2024-04-25T02:29:18.332282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:52.327814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.342356+0000","last_change":"2024-04-25T02:29:18.338928+0000","last_active":"2024-04-25T02:29:18.342356+0000","last_peered":"2024-04-25T02:29:18.342356+0000","last_clean":"2024-04-25T02:29:18.342356+0000","last_became_active":"2024-04-25T02:29:18.338673+0000","last_became_peered":"2024-04-25T02:29:18.338673+0000","last_unstale":"2024-04-25T02:29:18.342356+0000","last_undegraded":"2024-04-25T02:29:18.342356+0000","last_fullsized":"2024-04-25T02:29:18.342356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:27.689600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327668+0000","last_change":"2024-04-25T02:29:17.335254+0000","last_active":"2024-04-25T02:29:18.327668+0000","last_peered":"2024-04-25T02:29:18.327668+0000","last_clean":"2024-04-25T02:29:18.327668+0000","last_became_active":"2024-04-25T02:29:17.334973+0000","last_became_peered":"2024-04-25T02:29:17.334973+0000","last_unstale":"2024-04-25T02:29:18.327668+0000","last_undegraded":"2024-04-25T02:29:18.327668+0000","last_fullsized":"2024-04-25T02:29:18.327668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:59.526492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351369+0000","last_change":"2024-04-25T02:29:18.347506+0000","last_active":"2024-04-25T02:29:18.351369+0000","last_peered":"2024-04-25T02:29:18.351369+0000","last_clean":"2024-04-25T02:29:18.351369+0000","last_became_active":"2024-04-25T02:29:18.347214+0000","last_became_peered":"2024-04-25T02:29:18.347214+0000","last_unstale":"2024-04-25T02:29:18.351369+0000","last_undegraded":"2024-04-25T02:29:18.351369+0000","last_fullsized":"2024-04-25T02:29:18.351369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:14.734561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.329668+0000","last_change":"2024-04-25T02:29:17.341124+0000","last_active":"2024-04-25T02:29:18.329668+0000","last_peered":"2024-04-25T02:29:18.329668+0000","last_clean":"2024-04-25T02:29:18.329668+0000","last_became_active":"2024-04-25T02:29:17.340870+0000","last_became_peered":"2024-04-25T02:29:17.340870+0000","last_unstale":"2024-04-25T02:29:18.329668+0000","last_undegraded":"2024-04-25T02:29:18.329668+0000","last_fullsized":"2024-04-25T02:29:18.329668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:36.286309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.347598+0000","last_change":"2024-04-25T02:29:18.346689+0000","last_active":"2024-04-25T02:29:18.347598+0000","last_peered":"2024-04-25T02:29:18.347598+0000","last_clean":"2024-04-25T02:29:18.347598+0000","last_became_active":"2024-04-25T02:29:18.346385+0000","last_became_peered":"2024-04-25T02:29:18.346385+0000","last_unstale":"2024-04-25T02:29:18.347598+0000","last_undegraded":"2024-04-25T02:29:18.347598+0000","last_fullsized":"2024-04-25T02:29:18.347598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:25.718704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355381+0000","last_change":"2024-04-25T02:29:17.341566+0000","last_active":"2024-04-25T02:29:18.355381+0000","last_peered":"2024-04-25T02:29:18.355381+0000","last_clean":"2024-04-25T02:29:18.355381+0000","last_became_active":"2024-04-25T02:29:17.341005+0000","last_became_peered":"2024-04-25T02:29:17.341005+0000","last_unstale":"2024-04-25T02:29:18.355381+0000","last_undegraded":"2024-04-25T02:29:18.355381+0000","last_fullsized":"2024-04-25T02:29:18.355381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:24.029388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351392+0000","last_change":"2024-04-25T02:29:18.346646+0000","last_active":"2024-04-25T02:29:18.351392+0000","last_peered":"2024-04-25T02:29:18.351392+0000","last_clean":"2024-04-25T02:29:18.351392+0000","last_became_active":"2024-04-25T02:29:18.346377+0000","last_became_peered":"2024-04-25T02:29:18.346377+0000","last_unstale":"2024-04-25T02:29:18.351392+0000","last_undegraded":"2024-04-25T02:29:18.351392+0000","last_fullsized":"2024-04-25T02:29:18.351392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:14.025149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.333287+0000","last_change":"2024-04-25T02:29:17.339450+0000","last_active":"2024-04-25T02:29:18.333287+0000","last_peered":"2024-04-25T02:29:18.333287+0000","last_clean":"2024-04-25T02:29:18.333287+0000","last_became_active":"2024-04-25T02:29:17.339041+0000","last_became_peered":"2024-04-25T02:29:17.339041+0000","last_unstale":"2024-04-25T02:29:18.333287+0000","last_undegraded":"2024-04-25T02:29:18.333287+0000","last_fullsized":"2024-04-25T02:29:18.333287+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:52.327814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345051+0000","last_change":"2024-04-25T02:29:18.343320+0000","last_active":"2024-04-25T02:29:18.345051+0000","last_peered":"2024-04-25T02:29:18.345051+0000","last_clean":"2024-04-25T02:29:18.345051+0000","last_became_active":"2024-04-25T02:29:18.343045+0000","last_became_peered":"2024-04-25T02:29:18.343045+0000","last_unstale":"2024-04-25T02:29:18.345051+0000","last_undegraded":"2024-04-25T02:29:18.345051+0000","last_fullsized":"2024-04-25T02:29:18.345051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:25.036633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.337918+0000","last_change":"2024-04-25T02:29:17.338937+0000","last_active":"2024-04-25T02:29:18.337918+0000","last_peered":"2024-04-25T02:29:18.337918+0000","last_clean":"2024-04-25T02:29:18.337918+0000","last_became_active":"2024-04-25T02:29:17.338636+0000","last_became_peered":"2024-04-25T02:29:17.338636+0000","last_unstale":"2024-04-25T02:29:18.337918+0000","last_undegraded":"2024-04-25T02:29:18.337918+0000","last_fullsized":"2024-04-25T02:29:18.337918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:13.412200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.344836+0000","last_change":"2024-04-25T02:29:18.341511+0000","last_active":"2024-04-25T02:29:18.344836+0000","last_peered":"2024-04-25T02:29:18.344836+0000","last_clean":"2024-04-25T02:29:18.344836+0000","last_became_active":"2024-04-25T02:29:18.341233+0000","last_became_peered":"2024-04-25T02:29:18.341233+0000","last_unstale":"2024-04-25T02:29:18.344836+0000","last_undegraded":"2024-04-25T02:29:18.344836+0000","last_fullsized":"2024-04-25T02:29:18.344836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:25.532394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.335068+0000","last_change":"2024-04-25T02:29:17.335618+0000","last_active":"2024-04-25T02:29:18.335068+0000","last_peered":"2024-04-25T02:29:18.335068+0000","last_clean":"2024-04-25T02:29:18.335068+0000","last_became_active":"2024-04-25T02:29:17.335113+0000","last_became_peered":"2024-04-25T02:29:17.335113+0000","last_unstale":"2024-04-25T02:29:18.335068+0000","last_undegraded":"2024-04-25T02:29:18.335068+0000","last_fullsized":"2024-04-25T02:29:18.335068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:24.525150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345451+0000","last_change":"2024-04-25T02:29:18.343189+0000","last_active":"2024-04-25T02:29:18.345451+0000","last_peered":"2024-04-25T02:29:18.345451+0000","last_clean":"2024-04-25T02:29:18.345451+0000","last_became_active":"2024-04-25T02:29:18.342880+0000","last_became_peered":"2024-04-25T02:29:18.342880+0000","last_unstale":"2024-04-25T02:29:18.345451+0000","last_undegraded":"2024-04-25T02:29:18.345451+0000","last_fullsized":"2024-04-25T02:29:18.345451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:37.293554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.332320+0000","last_change":"2024-04-25T02:29:17.342369+0000","last_active":"2024-04-25T02:29:18.332320+0000","last_peered":"2024-04-25T02:29:18.332320+0000","last_clean":"2024-04-25T02:29:18.332320+0000","last_became_active":"2024-04-25T02:29:17.342038+0000","last_became_peered":"2024-04-25T02:29:17.342038+0000","last_unstale":"2024-04-25T02:29:18.332320+0000","last_undegraded":"2024-04-25T02:29:18.332320+0000","last_fullsized":"2024-04-25T02:29:18.332320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:22.380376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352267+0000","last_change":"2024-04-25T02:29:18.346427+0000","last_active":"2024-04-25T02:29:18.352267+0000","last_peered":"2024-04-25T02:29:18.352267+0000","last_clean":"2024-04-25T02:29:18.352267+0000","last_became_active":"2024-04-25T02:29:18.344252+0000","last_became_peered":"2024-04-25T02:29:18.344252+0000","last_unstale":"2024-04-25T02:29:18.352267+0000","last_undegraded":"2024-04-25T02:29:18.352267+0000","last_fullsized":"2024-04-25T02:29:18.352267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:50.388712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327838+0000","last_change":"2024-04-25T02:29:17.334132+0000","last_active":"2024-04-25T02:29:18.327838+0000","last_peered":"2024-04-25T02:29:18.327838+0000","last_clean":"2024-04-25T02:29:18.327838+0000","last_became_active":"2024-04-25T02:29:17.333432+0000","last_became_peered":"2024-04-25T02:29:17.333432+0000","last_unstale":"2024-04-25T02:29:18.327838+0000","last_undegraded":"2024-04-25T02:29:18.327838+0000","last_fullsized":"2024-04-25T02:29:18.327838+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:12:36.993064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355265+0000","last_change":"2024-04-25T02:29:18.350496+0000","last_active":"2024-04-25T02:29:18.355265+0000","last_peered":"2024-04-25T02:29:18.355265+0000","last_clean":"2024-04-25T02:29:18.355265+0000","last_became_active":"2024-04-25T02:29:18.350230+0000","last_became_peered":"2024-04-25T02:29:18.350230+0000","last_unstale":"2024-04-25T02:29:18.355265+0000","last_undegraded":"2024-04-25T02:29:18.355265+0000","last_fullsized":"2024-04-25T02:29:18.355265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:14.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.325543+0000","last_change":"2024-04-25T02:29:17.345243+0000","last_active":"2024-04-25T02:29:18.325543+0000","last_peered":"2024-04-25T02:29:18.325543+0000","last_clean":"2024-04-25T02:29:18.325543+0000","last_became_active":"2024-04-25T02:29:17.344978+0000","last_became_peered":"2024-04-25T02:29:17.344978+0000","last_unstale":"2024-04-25T02:29:18.325543+0000","last_undegraded":"2024-04-25T02:29:18.325543+0000","last_fullsized":"2024-04-25T02:29:18.325543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:13.412200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351382+0000","last_change":"2024-04-25T02:29:18.346721+0000","last_active":"2024-04-25T02:29:18.351382+0000","last_peered":"2024-04-25T02:29:18.351382+0000","last_clean":"2024-04-25T02:29:18.351382+0000","last_became_active":"2024-04-25T02:29:18.346444+0000","last_became_peered":"2024-04-25T02:29:18.346444+0000","last_unstale":"2024-04-25T02:29:18.351382+0000","last_undegraded":"2024-04-25T02:29:18.351382+0000","last_fullsized":"2024-04-25T02:29:18.351382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:23.649134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.331945+0000","last_change":"2024-04-25T02:29:17.336098+0000","last_active":"2024-04-25T02:29:18.331945+0000","last_peered":"2024-04-25T02:29:18.331945+0000","last_clean":"2024-04-25T02:29:18.331945+0000","last_became_active":"2024-04-25T02:29:17.335825+0000","last_became_peered":"2024-04-25T02:29:17.335825+0000","last_unstale":"2024-04-25T02:29:18.331945+0000","last_undegraded":"2024-04-25T02:29:18.331945+0000","last_fullsized":"2024-04-25T02:29:18.331945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:03:38.186300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.331621+0000","last_change":"2024-04-25T02:28:15.520345+0000","last_active":"2024-04-25T02:29:18.331621+0000","last_peered":"2024-04-25T02:29:18.331621+0000","last_clean":"2024-04-25T02:29:18.331621+0000","last_became_active":"2024-04-25T02:28:15.519317+0000","last_became_peered":"2024-04-25T02:28:15.519317+0000","last_unstale":"2024-04-25T02:29:18.331621+0000","last_undegraded":"2024-04-25T02:29:18.331621+0000","last_fullsized":"2024-04-25T02:29:18.331621+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_clean_scrub_stamp":"2024-04-25T02:28:14.374327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:20.125523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":723901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":723901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:29:21.342 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:29:21.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.474+0000 7ff9f8aae640 1 Processor -- start 2024-04-25T02:29:21.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.474+0000 7ff9f8aae640 1 -- start start 2024-04-25T02:29:21.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.475+0000 7ff9f8aae640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9f415e210 0x7ff9f406cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.475+0000 7ff9f8aae640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f40d2cc0 con 0x7ff9f40cf3d0 2024-04-25T02:29:21.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.475+0000 7ff9f8aae640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f40d2fa0 con 0x7ff9f415e5f0 2024-04-25T02:29:21.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.475+0000 7ff9f8aae640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f406c6f0 con 0x7ff9f415e210 2024-04-25T02:29:21.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.475+0000 7ff9f2d9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff9f40cf3d0 0x7ff9f40d3e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49444/0 (socket says 172.21.15.67:49444) 2024-04-25T02:29:21.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.475+0000 7ff9f2d9d640 1 -- 172.21.15.67:0/3191323121 learned_addr learned my addr 172.21.15.67:0/3191323121 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:21.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f259c640 1 --2- 172.21.15.67:0/3191323121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9f415e210 0x7ff9f406cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f159a640 1 -- 172.21.15.67:0/3191323121 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 571187046 0 0) 0x7ff9f40d2cc0 con 0x7ff9f40cf3d0 2024-04-25T02:29:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f159a640 1 -- 172.21.15.67:0/3191323121 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9e0003520 con 0x7ff9f40cf3d0 2024-04-25T02:29:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f159a640 1 -- 172.21.15.67:0/3191323121 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2770065369 0 0) 0x7ff9e0003520 con 0x7ff9f40cf3d0 2024-04-25T02:29:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f159a640 1 -- 172.21.15.67:0/3191323121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9f415e210 msgr2=0x7ff9f406cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f159a640 1 --2- 172.21.15.67:0/3191323121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9f415e210 0x7ff9f406cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f159a640 1 -- 172.21.15.67:0/3191323121 >> v1:172.21.15.176:6789/0 conn(0x7ff9f415e5f0 legacy=0x7ff9f40cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f159a640 1 -- 172.21.15.67:0/3191323121 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f406c0a0 con 0x7ff9f40cf3d0 2024-04-25T02:29:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f159a640 1 -- 172.21.15.67:0/3191323121 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7ff9e40019f0 con 0x7ff9f40cf3d0 2024-04-25T02:29:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f159a640 1 -- 172.21.15.67:0/3191323121 >> v1:172.21.15.67:6789/0 conn(0x7ff9f40cf3d0 legacy=0x7ff9f40d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f159a640 1 --2- 172.21.15.67:0/3191323121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e00039e0 0x7ff9e0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f159a640 1 --2- 172.21.15.67:0/3191323121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9e0004800 0x7ff9e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f159a640 1 --2- 172.21.15.67:0/3191323121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9f415e210 0x7ff9e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f159a640 1 -- 172.21.15.67:0/3191323121 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f406c6f0 con 0x7ff9e0004800 2024-04-25T02:29:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f159a640 1 -- 172.21.15.67:0/3191323121 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e000ba70 con 0x7ff9e00039e0 2024-04-25T02:29:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f159a640 1 -- 172.21.15.67:0/3191323121 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e000bc70 con 0x7ff9f415e210 2024-04-25T02:29:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f1d9b640 1 --2- 172.21.15.67:0/3191323121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9e0004800 0x7ff9e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f259c640 1 --2- 172.21.15.67:0/3191323121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e00039e0 0x7ff9e0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f2d9d640 1 --2- 172.21.15.67:0/3191323121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9f415e210 0x7ff9e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f1d9b640 1 -- 172.21.15.67:0/3191323121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9f415e210 msgr2=0x7ff9e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f1d9b640 1 --2- 172.21.15.67:0/3191323121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9f415e210 0x7ff9e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f1d9b640 1 -- 172.21.15.67:0/3191323121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e00039e0 msgr2=0x7ff9e0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f1d9b640 1 --2- 172.21.15.67:0/3191323121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e00039e0 0x7ff9e0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f1d9b640 1 -- 172.21.15.67:0/3191323121 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e0003520 con 0x7ff9e0004800 2024-04-25T02:29:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.476+0000 7ff9f2d9d640 1 --2- 172.21.15.67:0/3191323121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9f415e210 0x7ff9e00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.477+0000 7ff9f1d9b640 1 --2- 172.21.15.67:0/3191323121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9e0004800 0x7ff9e0004c80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff9f415e9f0 tx=0x7ff9e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644f4f9d14ac0985 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.477+0000 7ff9f159a640 1 -- 172.21.15.67:0/3191323121 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc001370 con 0x7ff9e0004800 2024-04-25T02:29:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.477+0000 7ff9f159a640 1 -- 172.21.15.67:0/3191323121 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9dc0052d0 con 0x7ff9e0004800 2024-04-25T02:29:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.477+0000 7ff9f159a640 1 -- 172.21.15.67:0/3191323121 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc02ab70 con 0x7ff9e0004800 2024-04-25T02:29:21.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.478+0000 7ff9f8aae640 1 -- 172.21.15.67:0/3191323121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9e0004800 msgr2=0x7ff9e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.478+0000 7ff9f8aae640 1 --2- 172.21.15.67:0/3191323121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9e0004800 0x7ff9e0004c80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff9f415e9f0 tx=0x7ff9e0005830 comp rx=0 tx=0).stop 2024-04-25T02:29:21.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.478+0000 7ff9f2d9d640 1 -- 172.21.15.67:0/3191323121 reap_dead start 2024-04-25T02:29:21.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.478+0000 7ff9f8aae640 1 -- 172.21.15.67:0/3191323121 shutdown_connections 2024-04-25T02:29:21.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.478+0000 7ff9f8aae640 1 -- 172.21.15.67:0/3191323121 >> 172.21.15.67:0/3191323121 conn(0x7ff9f408dbb0 msgr2=0x7ff9f409d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:21.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.478+0000 7ff9f8aae640 1 -- 172.21.15.67:0/3191323121 shutdown_connections 2024-04-25T02:29:21.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.478+0000 7ff9f8aae640 1 -- 172.21.15.67:0/3191323121 wait complete. 2024-04-25T02:29:21.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.479+0000 7ff9f8aae640 1 Processor -- start 2024-04-25T02:29:21.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.479+0000 7ff9f8aae640 1 -- start start 2024-04-25T02:29:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.480+0000 7ff9f8aae640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9e0004800 0x7ff9f41f7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.480+0000 7ff9f8aae640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f40cce10 0x7ff9f40c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.480+0000 7ff9f8aae640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9f40cd290 0x7ff9f40c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.480+0000 7ff9f8aae640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f40d4730 con 0x7ff9f40cce10 2024-04-25T02:29:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.480+0000 7ff9f8aae640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f40d45b0 con 0x7ff9f40cd290 2024-04-25T02:29:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.480+0000 7ff9f8aae640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f40d48b0 con 0x7ff9e0004800 2024-04-25T02:29:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.480+0000 7ff9f1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f40cce10 0x7ff9f40c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.480+0000 7ff9f1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f40cce10 0x7ff9f40c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37930/0 (socket says 172.21.15.67:37930) 2024-04-25T02:29:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.480+0000 7ff9f1d9b640 1 -- 172.21.15.67:0/1155415099 learned_addr learned my addr 172.21.15.67:0/1155415099 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.480+0000 7ff9f259c640 1 --2- 172.21.15.67:0/1155415099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9e0004800 0x7ff9f41f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.480+0000 7ff9f2d9d640 1 --2- 172.21.15.67:0/1155415099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9f40cd290 0x7ff9f40c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.480+0000 7ff9f1d9b640 1 -- 172.21.15.67:0/1155415099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9e0004800 msgr2=0x7ff9f41f7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.480+0000 7ff9f1d9b640 1 --2- 172.21.15.67:0/1155415099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9e0004800 0x7ff9f41f7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.480+0000 7ff9f1d9b640 1 -- 172.21.15.67:0/1155415099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9f40cd290 msgr2=0x7ff9f40c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.480+0000 7ff9f1d9b640 1 --2- 172.21.15.67:0/1155415099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9f40cd290 0x7ff9f40c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.480+0000 7ff9f1d9b640 1 -- 172.21.15.67:0/1155415099 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f40cb460 con 0x7ff9f40cce10 2024-04-25T02:29:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.481+0000 7ff9f1d9b640 1 --2- 172.21.15.67:0/1155415099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f40cce10 0x7ff9f40c7cc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc02a520 tx=0x7ff9dc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.481+0000 7ff9eaffd640 1 -- 172.21.15.67:0/1155415099 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc042070 con 0x7ff9f40cce10 2024-04-25T02:29:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.481+0000 7ff9eaffd640 1 -- 172.21.15.67:0/1155415099 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9dc005480 con 0x7ff9f40cce10 2024-04-25T02:29:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.481+0000 7ff9f8aae640 1 -- 172.21.15.67:0/1155415099 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f40cb740 con 0x7ff9f40cce10 2024-04-25T02:29:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.481+0000 7ff9eaffd640 1 -- 172.21.15.67:0/1155415099 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc037040 con 0x7ff9f40cce10 2024-04-25T02:29:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.481+0000 7ff9f8aae640 1 -- 172.21.15.67:0/1155415099 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f40cbd00 con 0x7ff9f40cce10 2024-04-25T02:29:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.482+0000 7ff9f8aae640 1 -- 172.21.15.67:0/1155415099 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f4069110 con 0x7ff9f40cce10 2024-04-25T02:29:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.482+0000 7ff9eaffd640 1 -- 172.21.15.67:0/1155415099 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9dc045070 con 0x7ff9f40cce10 2024-04-25T02:29:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.483+0000 7ff9eaffd640 1 --2- 172.21.15.67:0/1155415099 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff9d406be60 0x7ff9d406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.483+0000 7ff9eaffd640 1 -- 172.21.15.67:0/1155415099 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff9dc0aa650 con 0x7ff9f40cce10 2024-04-25T02:29:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.483+0000 7ff9f259c640 1 --2- 172.21.15.67:0/1155415099 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff9d406be60 0x7ff9d406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.484+0000 7ff9f259c640 1 --2- 172.21.15.67:0/1155415099 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff9d406be60 0x7ff9d406e320 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009b00 tx=0x7ff9ec008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:21.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.487+0000 7ff9eaffd640 1 -- 172.21.15.67:0/1155415099 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff9dc079000 con 0x7ff9f40cce10 2024-04-25T02:29:21.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.665+0000 7ff9f8aae640 1 -- 172.21.15.67:0/1155415099 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9f406be80 con 0x7ff9d406be60 2024-04-25T02:29:21.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.672+0000 7ff9eaffd640 1 -- 172.21.15.67:0/1155415099 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7ff9f406be80 con 0x7ff9d406be60 2024-04-25T02:29:21.678 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:21.679 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-25T02:29:21.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.674+0000 7ff9f8aae640 1 -- 172.21.15.67:0/1155415099 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff9d406be60 msgr2=0x7ff9d406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.674+0000 7ff9f8aae640 1 --2- 172.21.15.67:0/1155415099 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff9d406be60 0x7ff9d406e320 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009b00 tx=0x7ff9ec008040 comp rx=0 tx=0).stop 2024-04-25T02:29:21.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.674+0000 7ff9f8aae640 1 -- 172.21.15.67:0/1155415099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f40cce10 msgr2=0x7ff9f40c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.674+0000 7ff9f8aae640 1 --2- 172.21.15.67:0/1155415099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f40cce10 0x7ff9f40c7cc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc02a520 tx=0x7ff9dc001120 comp rx=0 tx=0).stop 2024-04-25T02:29:21.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.675+0000 7ff9f8aae640 1 -- 172.21.15.67:0/1155415099 shutdown_connections 2024-04-25T02:29:21.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.675+0000 7ff9f8aae640 1 --2- 172.21.15.67:0/1155415099 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff9d406be60 0x7ff9d406e320 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.675+0000 7ff9f8aae640 1 --2- 172.21.15.67:0/1155415099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9f40cd290 0x7ff9f40c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.675+0000 7ff9f8aae640 1 --2- 172.21.15.67:0/1155415099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f40cce10 0x7ff9f40c7cc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.675+0000 7ff9f8aae640 1 --2- 172.21.15.67:0/1155415099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9e0004800 0x7ff9f41f7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.675+0000 7ff9f8aae640 1 -- 172.21.15.67:0/1155415099 >> 172.21.15.67:0/1155415099 conn(0x7ff9f408dbb0 msgr2=0x7ff9f40ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:21.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.675+0000 7ff9f8aae640 1 -- 172.21.15.67:0/1155415099 shutdown_connections 2024-04-25T02:29:21.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.675+0000 7ff9f8aae640 1 -- 172.21.15.67:0/1155415099 wait complete. 2024-04-25T02:29:21.689 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-04-25T02:29:20.343199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591838,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220068,"kb_used_data":3880,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754652,"statfs":{"total":773094113280,"available":772868763648,"internally_reserved":0,"allocated":3973120,"data_stored":2249000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.029847"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353969+0000","last_change":"2024-04-25T02:29:18.346740+0000","last_active":"2024-04-25T02:29:18.353969+0000","last_peered":"2024-04-25T02:29:18.353969+0000","last_clean":"2024-04-25T02:29:18.353969+0000","last_became_active":"2024-04-25T02:29:18.346475+0000","last_became_peered":"2024-04-25T02:29:18.346475+0000","last_unstale":"2024-04-25T02:29:18.353969+0000","last_undegraded":"2024-04-25T02:29:18.353969+0000","last_fullsized":"2024-04-25T02:29:18.353969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352494+0000","last_change":"2024-04-25T02:29:18.347192+0000","last_active":"2024-04-25T02:29:18.352494+0000","last_peered":"2024-04-25T02:29:18.352494+0000","last_clean":"2024-04-25T02:29:18.352494+0000","last_became_active":"2024-04-25T02:29:18.346599+0000","last_became_peered":"2024-04-25T02:29:18.346599+0000","last_unstale":"2024-04-25T02:29:18.352494+0000","last_undegraded":"2024-04-25T02:29:18.352494+0000","last_fullsized":"2024-04-25T02:29:18.352494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:11.549908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348359+0000","last_change":"2024-04-25T02:29:18.344360+0000","last_active":"2024-04-25T02:29:18.348359+0000","last_peered":"2024-04-25T02:29:18.348359+0000","last_clean":"2024-04-25T02:29:18.348359+0000","last_became_active":"2024-04-25T02:29:18.343592+0000","last_became_peered":"2024-04-25T02:29:18.343592+0000","last_unstale":"2024-04-25T02:29:18.348359+0000","last_undegraded":"2024-04-25T02:29:18.348359+0000","last_fullsized":"2024-04-25T02:29:18.348359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:14.734561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353680+0000","last_change":"2024-04-25T02:29:18.353680+0000","last_active":"2024-04-25T02:29:18.353680+0000","last_peered":"2024-04-25T02:29:18.353680+0000","last_clean":"2024-04-25T02:29:18.353680+0000","last_became_active":"2024-04-25T02:29:18.353401+0000","last_became_peered":"2024-04-25T02:29:18.353401+0000","last_unstale":"2024-04-25T02:29:18.353680+0000","last_undegraded":"2024-04-25T02:29:18.353680+0000","last_fullsized":"2024-04-25T02:29:18.353680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:14.734561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351757+0000","last_change":"2024-04-25T02:29:18.349706+0000","last_active":"2024-04-25T02:29:18.351757+0000","last_peered":"2024-04-25T02:29:18.351757+0000","last_clean":"2024-04-25T02:29:18.351757+0000","last_became_active":"2024-04-25T02:29:18.349413+0000","last_became_peered":"2024-04-25T02:29:18.349413+0000","last_unstale":"2024-04-25T02:29:18.351757+0000","last_undegraded":"2024-04-25T02:29:18.351757+0000","last_fullsized":"2024-04-25T02:29:18.351757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:43:26.985827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353065+0000","last_change":"2024-04-25T02:29:18.348066+0000","last_active":"2024-04-25T02:29:18.353065+0000","last_peered":"2024-04-25T02:29:18.353065+0000","last_clean":"2024-04-25T02:29:18.353065+0000","last_became_active":"2024-04-25T02:29:18.347678+0000","last_became_peered":"2024-04-25T02:29:18.347678+0000","last_unstale":"2024-04-25T02:29:18.353065+0000","last_undegraded":"2024-04-25T02:29:18.353065+0000","last_fullsized":"2024-04-25T02:29:18.353065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:02:32.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351348+0000","last_change":"2024-04-25T02:29:18.347506+0000","last_active":"2024-04-25T02:29:18.351348+0000","last_peered":"2024-04-25T02:29:18.351348+0000","last_clean":"2024-04-25T02:29:18.351348+0000","last_became_active":"2024-04-25T02:29:18.347229+0000","last_became_peered":"2024-04-25T02:29:18.347229+0000","last_unstale":"2024-04-25T02:29:18.351348+0000","last_undegraded":"2024-04-25T02:29:18.351348+0000","last_fullsized":"2024-04-25T02:29:18.351348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.342548+0000","last_change":"2024-04-25T02:29:18.338526+0000","last_active":"2024-04-25T02:29:18.342548+0000","last_peered":"2024-04-25T02:29:18.342548+0000","last_clean":"2024-04-25T02:29:18.342548+0000","last_became_active":"2024-04-25T02:29:18.338272+0000","last_became_peered":"2024-04-25T02:29:18.338272+0000","last_unstale":"2024-04-25T02:29:18.342548+0000","last_undegraded":"2024-04-25T02:29:18.342548+0000","last_fullsized":"2024-04-25T02:29:18.342548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345636+0000","last_change":"2024-04-25T02:29:18.341056+0000","last_active":"2024-04-25T02:29:18.345636+0000","last_peered":"2024-04-25T02:29:18.345636+0000","last_clean":"2024-04-25T02:29:18.345636+0000","last_became_active":"2024-04-25T02:29:18.340660+0000","last_became_peered":"2024-04-25T02:29:18.340660+0000","last_unstale":"2024-04-25T02:29:18.345636+0000","last_undegraded":"2024-04-25T02:29:18.345636+0000","last_fullsized":"2024-04-25T02:29:18.345636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:25.532394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354625+0000","last_change":"2024-04-25T02:29:18.354625+0000","last_active":"2024-04-25T02:29:18.354625+0000","last_peered":"2024-04-25T02:29:18.354625+0000","last_clean":"2024-04-25T02:29:18.354625+0000","last_became_active":"2024-04-25T02:29:18.354339+0000","last_became_peered":"2024-04-25T02:29:18.354339+0000","last_unstale":"2024-04-25T02:29:18.354625+0000","last_undegraded":"2024-04-25T02:29:18.354625+0000","last_fullsized":"2024-04-25T02:29:18.354625+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:18.991459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.344927+0000","last_change":"2024-04-25T02:29:18.341907+0000","last_active":"2024-04-25T02:29:18.344927+0000","last_peered":"2024-04-25T02:29:18.344927+0000","last_clean":"2024-04-25T02:29:18.344927+0000","last_became_active":"2024-04-25T02:29:18.341644+0000","last_became_peered":"2024-04-25T02:29:18.341644+0000","last_unstale":"2024-04-25T02:29:18.344927+0000","last_undegraded":"2024-04-25T02:29:18.344927+0000","last_fullsized":"2024-04-25T02:29:18.344927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:33.371549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.349482+0000","last_change":"2024-04-25T02:29:18.349482+0000","last_active":"2024-04-25T02:29:18.349482+0000","last_peered":"2024-04-25T02:29:18.349482+0000","last_clean":"2024-04-25T02:29:18.349482+0000","last_became_active":"2024-04-25T02:29:18.349216+0000","last_became_peered":"2024-04-25T02:29:18.349216+0000","last_unstale":"2024-04-25T02:29:18.349482+0000","last_undegraded":"2024-04-25T02:29:18.349482+0000","last_fullsized":"2024-04-25T02:29:18.349482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:20.085001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345642+0000","last_change":"2024-04-25T02:29:18.340910+0000","last_active":"2024-04-25T02:29:18.345642+0000","last_peered":"2024-04-25T02:29:18.345642+0000","last_clean":"2024-04-25T02:29:18.345642+0000","last_became_active":"2024-04-25T02:29:18.340634+0000","last_became_peered":"2024-04-25T02:29:18.340634+0000","last_unstale":"2024-04-25T02:29:18.345642+0000","last_undegraded":"2024-04-25T02:29:18.345642+0000","last_fullsized":"2024-04-25T02:29:18.345642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:31.380254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348430+0000","last_change":"2024-04-25T02:29:18.341922+0000","last_active":"2024-04-25T02:29:18.348430+0000","last_peered":"2024-04-25T02:29:18.348430+0000","last_clean":"2024-04-25T02:29:18.348430+0000","last_became_active":"2024-04-25T02:29:18.341643+0000","last_became_peered":"2024-04-25T02:29:18.341643+0000","last_unstale":"2024-04-25T02:29:18.348430+0000","last_undegraded":"2024-04-25T02:29:18.348430+0000","last_fullsized":"2024-04-25T02:29:18.348430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:30.728990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345537+0000","last_change":"2024-04-25T02:29:18.336835+0000","last_active":"2024-04-25T02:29:18.345537+0000","last_peered":"2024-04-25T02:29:18.345537+0000","last_clean":"2024-04-25T02:29:18.345537+0000","last_became_active":"2024-04-25T02:29:18.336550+0000","last_became_peered":"2024-04-25T02:29:18.336550+0000","last_unstale":"2024-04-25T02:29:18.345537+0000","last_undegraded":"2024-04-25T02:29:18.345537+0000","last_fullsized":"2024-04-25T02:29:18.345537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:14.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352970+0000","last_change":"2024-04-25T02:29:18.352970+0000","last_active":"2024-04-25T02:29:18.352970+0000","last_peered":"2024-04-25T02:29:18.352970+0000","last_clean":"2024-04-25T02:29:18.352970+0000","last_became_active":"2024-04-25T02:29:18.352750+0000","last_became_peered":"2024-04-25T02:29:18.352750+0000","last_unstale":"2024-04-25T02:29:18.352970+0000","last_undegraded":"2024-04-25T02:29:18.352970+0000","last_fullsized":"2024-04-25T02:29:18.352970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:08.133055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354285+0000","last_change":"2024-04-25T02:29:18.350283+0000","last_active":"2024-04-25T02:29:18.354285+0000","last_peered":"2024-04-25T02:29:18.354285+0000","last_clean":"2024-04-25T02:29:18.354285+0000","last_became_active":"2024-04-25T02:29:18.349442+0000","last_became_peered":"2024-04-25T02:29:18.349442+0000","last_unstale":"2024-04-25T02:29:18.354285+0000","last_undegraded":"2024-04-25T02:29:18.354285+0000","last_fullsized":"2024-04-25T02:29:18.354285+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:50.388712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352469+0000","last_change":"2024-04-25T02:29:18.346919+0000","last_active":"2024-04-25T02:29:18.352469+0000","last_peered":"2024-04-25T02:29:18.352469+0000","last_clean":"2024-04-25T02:29:18.352469+0000","last_became_active":"2024-04-25T02:29:18.345267+0000","last_became_peered":"2024-04-25T02:29:18.345267+0000","last_unstale":"2024-04-25T02:29:18.352469+0000","last_undegraded":"2024-04-25T02:29:18.352469+0000","last_fullsized":"2024-04-25T02:29:18.352469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:08.133055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348478+0000","last_change":"2024-04-25T02:29:18.343532+0000","last_active":"2024-04-25T02:29:18.348478+0000","last_peered":"2024-04-25T02:29:18.348478+0000","last_clean":"2024-04-25T02:29:18.348478+0000","last_became_active":"2024-04-25T02:29:18.343242+0000","last_became_peered":"2024-04-25T02:29:18.343242+0000","last_unstale":"2024-04-25T02:29:18.348478+0000","last_undegraded":"2024-04-25T02:29:18.348478+0000","last_fullsized":"2024-04-25T02:29:18.348478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:14.025149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351721+0000","last_change":"2024-04-25T02:29:18.348342+0000","last_active":"2024-04-25T02:29:18.351721+0000","last_peered":"2024-04-25T02:29:18.351721+0000","last_clean":"2024-04-25T02:29:18.351721+0000","last_became_active":"2024-04-25T02:29:18.348055+0000","last_became_peered":"2024-04-25T02:29:18.348055+0000","last_unstale":"2024-04-25T02:29:18.351721+0000","last_undegraded":"2024-04-25T02:29:18.351721+0000","last_fullsized":"2024-04-25T02:29:18.351721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:00.533737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.346888+0000","last_change":"2024-04-25T02:29:18.339396+0000","last_active":"2024-04-25T02:29:18.346888+0000","last_peered":"2024-04-25T02:29:18.346888+0000","last_clean":"2024-04-25T02:29:18.346888+0000","last_became_active":"2024-04-25T02:29:18.339130+0000","last_became_peered":"2024-04-25T02:29:18.339130+0000","last_unstale":"2024-04-25T02:29:18.346888+0000","last_undegraded":"2024-04-25T02:29:18.346888+0000","last_fullsized":"2024-04-25T02:29:18.346888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:23.387620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.347319+0000","last_change":"2024-04-25T02:29:18.337818+0000","last_active":"2024-04-25T02:29:18.347319+0000","last_peered":"2024-04-25T02:29:18.347319+0000","last_clean":"2024-04-25T02:29:18.347319+0000","last_became_active":"2024-04-25T02:29:18.337470+0000","last_became_peered":"2024-04-25T02:29:18.337470+0000","last_unstale":"2024-04-25T02:29:18.347319+0000","last_undegraded":"2024-04-25T02:29:18.347319+0000","last_fullsized":"2024-04-25T02:29:18.347319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:53.335059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345890+0000","last_change":"2024-04-25T02:29:18.344898+0000","last_active":"2024-04-25T02:29:18.345890+0000","last_peered":"2024-04-25T02:29:18.345890+0000","last_clean":"2024-04-25T02:29:18.345890+0000","last_became_active":"2024-04-25T02:29:18.344617+0000","last_became_peered":"2024-04-25T02:29:18.344617+0000","last_unstale":"2024-04-25T02:29:18.345890+0000","last_undegraded":"2024-04-25T02:29:18.345890+0000","last_fullsized":"2024-04-25T02:29:18.345890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345770+0000","last_change":"2024-04-25T02:29:18.339252+0000","last_active":"2024-04-25T02:29:18.345770+0000","last_peered":"2024-04-25T02:29:18.345770+0000","last_clean":"2024-04-25T02:29:18.345770+0000","last_became_active":"2024-04-25T02:29:18.338939+0000","last_became_peered":"2024-04-25T02:29:18.338939+0000","last_unstale":"2024-04-25T02:29:18.345770+0000","last_undegraded":"2024-04-25T02:29:18.345770+0000","last_fullsized":"2024-04-25T02:29:18.345770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348292+0000","last_change":"2024-04-25T02:29:18.346821+0000","last_active":"2024-04-25T02:29:18.348292+0000","last_peered":"2024-04-25T02:29:18.348292+0000","last_clean":"2024-04-25T02:29:18.348292+0000","last_became_active":"2024-04-25T02:29:18.346488+0000","last_became_peered":"2024-04-25T02:29:18.346488+0000","last_unstale":"2024-04-25T02:29:18.348292+0000","last_undegraded":"2024-04-25T02:29:18.348292+0000","last_fullsized":"2024-04-25T02:29:18.348292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353188+0000","last_change":"2024-04-25T02:29:18.351850+0000","last_active":"2024-04-25T02:29:18.353188+0000","last_peered":"2024-04-25T02:29:18.353188+0000","last_clean":"2024-04-25T02:29:18.353188+0000","last_became_active":"2024-04-25T02:29:18.351485+0000","last_became_peered":"2024-04-25T02:29:18.351485+0000","last_unstale":"2024-04-25T02:29:18.353188+0000","last_undegraded":"2024-04-25T02:29:18.353188+0000","last_fullsized":"2024-04-25T02:29:18.353188+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:26.891694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":6,"reported_epoch":32,"state":"active","last_fresh":"2024-04-25T02:29:18.355802+0000","last_change":"2024-04-25T02:29:18.355742+0000","last_active":"2024-04-25T02:29:18.355802+0000","last_peered":"2024-04-25T02:29:18.355802+0000","last_clean":"2024-04-25T02:29:17.313167+0000","last_became_active":"2024-04-25T02:29:18.355742+0000","last_became_peered":"2024-04-25T02:29:18.355742+0000","last_unstale":"2024-04-25T02:29:18.355802+0000","last_undegraded":"2024-04-25T02:29:18.355802+0000","last_fullsized":"2024-04-25T02:29:18.355802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348814+0000","last_change":"2024-04-25T02:29:18.341797+0000","last_active":"2024-04-25T02:29:18.348814+0000","last_peered":"2024-04-25T02:29:18.348814+0000","last_clean":"2024-04-25T02:29:18.348814+0000","last_became_active":"2024-04-25T02:29:18.341492+0000","last_became_peered":"2024-04-25T02:29:18.341492+0000","last_unstale":"2024-04-25T02:29:18.348814+0000","last_undegraded":"2024-04-25T02:29:18.348814+0000","last_fullsized":"2024-04-25T02:29:18.348814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:33.371549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355282+0000","last_change":"2024-04-25T02:29:18.351144+0000","last_active":"2024-04-25T02:29:18.355282+0000","last_peered":"2024-04-25T02:29:18.355282+0000","last_clean":"2024-04-25T02:29:18.355282+0000","last_became_active":"2024-04-25T02:29:18.350844+0000","last_became_peered":"2024-04-25T02:29:18.350844+0000","last_unstale":"2024-04-25T02:29:18.355282+0000","last_undegraded":"2024-04-25T02:29:18.355282+0000","last_fullsized":"2024-04-25T02:29:18.355282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354443+0000","last_change":"2024-04-25T02:29:18.349494+0000","last_active":"2024-04-25T02:29:18.354443+0000","last_peered":"2024-04-25T02:29:18.354443+0000","last_clean":"2024-04-25T02:29:18.354443+0000","last_became_active":"2024-04-25T02:29:18.349186+0000","last_became_peered":"2024-04-25T02:29:18.349186+0000","last_unstale":"2024-04-25T02:29:18.354443+0000","last_undegraded":"2024-04-25T02:29:18.354443+0000","last_fullsized":"2024-04-25T02:29:18.354443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:14.025149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345264+0000","last_change":"2024-04-25T02:29:18.342571+0000","last_active":"2024-04-25T02:29:18.345264+0000","last_peered":"2024-04-25T02:29:18.345264+0000","last_clean":"2024-04-25T02:29:18.345264+0000","last_became_active":"2024-04-25T02:29:18.341248+0000","last_became_peered":"2024-04-25T02:29:18.341248+0000","last_unstale":"2024-04-25T02:29:18.345264+0000","last_undegraded":"2024-04-25T02:29:18.345264+0000","last_fullsized":"2024-04-25T02:29:18.345264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:37.293554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354254+0000","last_change":"2024-04-25T02:29:18.348376+0000","last_active":"2024-04-25T02:29:18.354254+0000","last_peered":"2024-04-25T02:29:18.354254+0000","last_clean":"2024-04-25T02:29:18.354254+0000","last_became_active":"2024-04-25T02:29:18.347730+0000","last_became_peered":"2024-04-25T02:29:18.347730+0000","last_unstale":"2024-04-25T02:29:18.354254+0000","last_undegraded":"2024-04-25T02:29:18.354254+0000","last_fullsized":"2024-04-25T02:29:18.354254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:30.728990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345232+0000","last_change":"2024-04-25T02:29:18.344161+0000","last_active":"2024-04-25T02:29:18.345232+0000","last_peered":"2024-04-25T02:29:18.345232+0000","last_clean":"2024-04-25T02:29:18.345232+0000","last_became_active":"2024-04-25T02:29:18.343890+0000","last_became_peered":"2024-04-25T02:29:18.343890+0000","last_unstale":"2024-04-25T02:29:18.345232+0000","last_undegraded":"2024-04-25T02:29:18.345232+0000","last_fullsized":"2024-04-25T02:29:18.345232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:14.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352113+0000","last_change":"2024-04-25T02:29:17.336150+0000","last_active":"2024-04-25T02:29:18.352113+0000","last_peered":"2024-04-25T02:29:18.352113+0000","last_clean":"2024-04-25T02:29:18.352113+0000","last_became_active":"2024-04-25T02:29:17.335858+0000","last_became_peered":"2024-04-25T02:29:17.335858+0000","last_unstale":"2024-04-25T02:29:18.352113+0000","last_undegraded":"2024-04-25T02:29:18.352113+0000","last_fullsized":"2024-04-25T02:29:18.352113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:22.380376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345244+0000","last_change":"2024-04-25T02:29:18.344188+0000","last_active":"2024-04-25T02:29:18.345244+0000","last_peered":"2024-04-25T02:29:18.345244+0000","last_clean":"2024-04-25T02:29:18.345244+0000","last_became_active":"2024-04-25T02:29:18.343887+0000","last_became_peered":"2024-04-25T02:29:18.343887+0000","last_unstale":"2024-04-25T02:29:18.345244+0000","last_undegraded":"2024-04-25T02:29:18.345244+0000","last_fullsized":"2024-04-25T02:29:18.345244+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:14.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.344334+0000","last_change":"2024-04-25T02:29:17.338792+0000","last_active":"2024-04-25T02:29:18.344334+0000","last_peered":"2024-04-25T02:29:18.344334+0000","last_clean":"2024-04-25T02:29:18.344334+0000","last_became_active":"2024-04-25T02:29:17.338431+0000","last_became_peered":"2024-04-25T02:29:17.338431+0000","last_unstale":"2024-04-25T02:29:18.344334+0000","last_undegraded":"2024-04-25T02:29:18.344334+0000","last_fullsized":"2024-04-25T02:29:18.344334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:37:20.446428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355215+0000","last_change":"2024-04-25T02:29:18.349592+0000","last_active":"2024-04-25T02:29:18.355215+0000","last_peered":"2024-04-25T02:29:18.355215+0000","last_clean":"2024-04-25T02:29:18.355215+0000","last_became_active":"2024-04-25T02:29:18.349296+0000","last_became_peered":"2024-04-25T02:29:18.349296+0000","last_unstale":"2024-04-25T02:29:18.355215+0000","last_undegraded":"2024-04-25T02:29:18.355215+0000","last_fullsized":"2024-04-25T02:29:18.355215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:25.036633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.358845+0000","last_change":"2024-04-25T02:29:17.343354+0000","last_active":"2024-04-25T02:29:18.358845+0000","last_peered":"2024-04-25T02:29:18.358845+0000","last_clean":"2024-04-25T02:29:18.358845+0000","last_became_active":"2024-04-25T02:29:17.343032+0000","last_became_peered":"2024-04-25T02:29:17.343032+0000","last_unstale":"2024-04-25T02:29:18.358845+0000","last_undegraded":"2024-04-25T02:29:18.358845+0000","last_fullsized":"2024-04-25T02:29:18.358845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:17.984215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354469+0000","last_change":"2024-04-25T02:29:18.354469+0000","last_active":"2024-04-25T02:29:18.354469+0000","last_peered":"2024-04-25T02:29:18.354469+0000","last_clean":"2024-04-25T02:29:18.354469+0000","last_became_active":"2024-04-25T02:29:18.354133+0000","last_became_peered":"2024-04-25T02:29:18.354133+0000","last_unstale":"2024-04-25T02:29:18.354469+0000","last_undegraded":"2024-04-25T02:29:18.354469+0000","last_fullsized":"2024-04-25T02:29:18.354469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.356147+0000","last_change":"2024-04-25T02:29:17.343565+0000","last_active":"2024-04-25T02:29:18.356147+0000","last_peered":"2024-04-25T02:29:18.356147+0000","last_clean":"2024-04-25T02:29:18.356147+0000","last_became_active":"2024-04-25T02:29:17.343267+0000","last_became_peered":"2024-04-25T02:29:17.343267+0000","last_unstale":"2024-04-25T02:29:18.356147+0000","last_undegraded":"2024-04-25T02:29:18.356147+0000","last_fullsized":"2024-04-25T02:29:18.356147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:58.779414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354465+0000","last_change":"2024-04-25T02:29:18.349899+0000","last_active":"2024-04-25T02:29:18.354465+0000","last_peered":"2024-04-25T02:29:18.354465+0000","last_clean":"2024-04-25T02:29:18.354465+0000","last_became_active":"2024-04-25T02:29:18.349625+0000","last_became_peered":"2024-04-25T02:29:18.349625+0000","last_unstale":"2024-04-25T02:29:18.354465+0000","last_undegraded":"2024-04-25T02:29:18.354465+0000","last_fullsized":"2024-04-25T02:29:18.354465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:20.085001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354265+0000","last_change":"2024-04-25T02:29:17.345642+0000","last_active":"2024-04-25T02:29:18.354265+0000","last_peered":"2024-04-25T02:29:18.354265+0000","last_clean":"2024-04-25T02:29:18.354265+0000","last_became_active":"2024-04-25T02:29:17.345311+0000","last_became_peered":"2024-04-25T02:29:17.345311+0000","last_unstale":"2024-04-25T02:29:18.354265+0000","last_undegraded":"2024-04-25T02:29:18.354265+0000","last_fullsized":"2024-04-25T02:29:18.354265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:48.636227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.347858+0000","last_change":"2024-04-25T02:29:18.342591+0000","last_active":"2024-04-25T02:29:18.347858+0000","last_peered":"2024-04-25T02:29:18.347858+0000","last_clean":"2024-04-25T02:29:18.347858+0000","last_became_active":"2024-04-25T02:29:18.341689+0000","last_became_peered":"2024-04-25T02:29:18.341689+0000","last_unstale":"2024-04-25T02:29:18.347858+0000","last_undegraded":"2024-04-25T02:29:18.347858+0000","last_fullsized":"2024-04-25T02:29:18.347858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:23.649134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354267+0000","last_change":"2024-04-25T02:29:17.345509+0000","last_active":"2024-04-25T02:29:18.354267+0000","last_peered":"2024-04-25T02:29:18.354267+0000","last_clean":"2024-04-25T02:29:18.354267+0000","last_became_active":"2024-04-25T02:29:17.345209+0000","last_became_peered":"2024-04-25T02:29:17.345209+0000","last_unstale":"2024-04-25T02:29:18.354267+0000","last_undegraded":"2024-04-25T02:29:18.354267+0000","last_fullsized":"2024-04-25T02:29:18.354267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:26.682356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345496+0000","last_change":"2024-04-25T02:29:18.334322+0000","last_active":"2024-04-25T02:29:18.345496+0000","last_peered":"2024-04-25T02:29:18.345496+0000","last_clean":"2024-04-25T02:29:18.345496+0000","last_became_active":"2024-04-25T02:29:18.334017+0000","last_became_peered":"2024-04-25T02:29:18.334017+0000","last_unstale":"2024-04-25T02:29:18.345496+0000","last_undegraded":"2024-04-25T02:29:18.345496+0000","last_fullsized":"2024-04-25T02:29:18.345496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:03:39.193545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.325803+0000","last_change":"2024-04-25T02:29:17.344030+0000","last_active":"2024-04-25T02:29:18.325803+0000","last_peered":"2024-04-25T02:29:18.325803+0000","last_clean":"2024-04-25T02:29:18.325803+0000","last_became_active":"2024-04-25T02:29:17.343766+0000","last_became_peered":"2024-04-25T02:29:17.343766+0000","last_unstale":"2024-04-25T02:29:18.325803+0000","last_undegraded":"2024-04-25T02:29:18.325803+0000","last_fullsized":"2024-04-25T02:29:18.325803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:32.364305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352367+0000","last_change":"2024-04-25T02:29:18.352367+0000","last_active":"2024-04-25T02:29:18.352367+0000","last_peered":"2024-04-25T02:29:18.352367+0000","last_clean":"2024-04-25T02:29:18.352367+0000","last_became_active":"2024-04-25T02:29:18.351998+0000","last_became_peered":"2024-04-25T02:29:18.351998+0000","last_unstale":"2024-04-25T02:29:18.352367+0000","last_undegraded":"2024-04-25T02:29:18.352367+0000","last_fullsized":"2024-04-25T02:29:18.352367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:23.649134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327586+0000","last_change":"2024-04-25T02:29:17.335287+0000","last_active":"2024-04-25T02:29:18.327586+0000","last_peered":"2024-04-25T02:29:18.327586+0000","last_clean":"2024-04-25T02:29:18.327586+0000","last_became_active":"2024-04-25T02:29:17.334613+0000","last_became_peered":"2024-04-25T02:29:17.334613+0000","last_unstale":"2024-04-25T02:29:18.327586+0000","last_undegraded":"2024-04-25T02:29:18.327586+0000","last_fullsized":"2024-04-25T02:29:18.327586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:24.711459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351260+0000","last_change":"2024-04-25T02:29:18.345717+0000","last_active":"2024-04-25T02:29:18.351260+0000","last_peered":"2024-04-25T02:29:18.351260+0000","last_clean":"2024-04-25T02:29:18.351260+0000","last_became_active":"2024-04-25T02:29:18.345430+0000","last_became_peered":"2024-04-25T02:29:18.345430+0000","last_unstale":"2024-04-25T02:29:18.351260+0000","last_undegraded":"2024-04-25T02:29:18.351260+0000","last_fullsized":"2024-04-25T02:29:18.351260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:18.991459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327056+0000","last_change":"2024-04-25T02:29:17.344786+0000","last_active":"2024-04-25T02:29:18.327056+0000","last_peered":"2024-04-25T02:29:18.327056+0000","last_clean":"2024-04-25T02:29:18.327056+0000","last_became_active":"2024-04-25T02:29:17.344395+0000","last_became_peered":"2024-04-25T02:29:17.344395+0000","last_unstale":"2024-04-25T02:29:18.327056+0000","last_undegraded":"2024-04-25T02:29:18.327056+0000","last_fullsized":"2024-04-25T02:29:18.327056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:12.515961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352117+0000","last_change":"2024-04-25T02:29:18.344217+0000","last_active":"2024-04-25T02:29:18.352117+0000","last_peered":"2024-04-25T02:29:18.352117+0000","last_clean":"2024-04-25T02:29:18.352117+0000","last_became_active":"2024-04-25T02:29:18.343885+0000","last_became_peered":"2024-04-25T02:29:18.343885+0000","last_unstale":"2024-04-25T02:29:18.352117+0000","last_undegraded":"2024-04-25T02:29:18.352117+0000","last_fullsized":"2024-04-25T02:29:18.352117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:20.085001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.333144+0000","last_change":"2024-04-25T02:29:17.344529+0000","last_active":"2024-04-25T02:29:18.333144+0000","last_peered":"2024-04-25T02:29:18.333144+0000","last_clean":"2024-04-25T02:29:18.333144+0000","last_became_active":"2024-04-25T02:29:17.344194+0000","last_became_peered":"2024-04-25T02:29:17.344194+0000","last_unstale":"2024-04-25T02:29:18.333144+0000","last_undegraded":"2024-04-25T02:29:18.333144+0000","last_fullsized":"2024-04-25T02:29:18.333144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:03:38.186300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353217+0000","last_change":"2024-04-25T02:29:18.350354+0000","last_active":"2024-04-25T02:29:18.353217+0000","last_peered":"2024-04-25T02:29:18.353217+0000","last_clean":"2024-04-25T02:29:18.353217+0000","last_became_active":"2024-04-25T02:29:18.350033+0000","last_became_peered":"2024-04-25T02:29:18.350033+0000","last_unstale":"2024-04-25T02:29:18.353217+0000","last_undegraded":"2024-04-25T02:29:18.353217+0000","last_fullsized":"2024-04-25T02:29:18.353217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:14.176273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351349+0000","last_change":"2024-04-25T02:29:17.339319+0000","last_active":"2024-04-25T02:29:18.351349+0000","last_peered":"2024-04-25T02:29:18.351349+0000","last_clean":"2024-04-25T02:29:18.351349+0000","last_became_active":"2024-04-25T02:29:17.339013+0000","last_became_peered":"2024-04-25T02:29:17.339013+0000","last_unstale":"2024-04-25T02:29:18.351349+0000","last_undegraded":"2024-04-25T02:29:18.351349+0000","last_fullsized":"2024-04-25T02:29:18.351349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:24.029388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351408+0000","last_change":"2024-04-25T02:29:18.345320+0000","last_active":"2024-04-25T02:29:18.351408+0000","last_peered":"2024-04-25T02:29:18.351408+0000","last_clean":"2024-04-25T02:29:18.351408+0000","last_became_active":"2024-04-25T02:29:18.345005+0000","last_became_peered":"2024-04-25T02:29:18.345005+0000","last_unstale":"2024-04-25T02:29:18.351408+0000","last_undegraded":"2024-04-25T02:29:18.351408+0000","last_fullsized":"2024-04-25T02:29:18.351408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'5","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.358670+0000","last_change":"2024-04-25T02:29:17.347025+0000","last_active":"2024-04-25T02:29:18.358670+0000","last_peered":"2024-04-25T02:29:18.358670+0000","last_clean":"2024-04-25T02:29:18.358670+0000","last_became_active":"2024-04-25T02:29:17.346724+0000","last_became_peered":"2024-04-25T02:29:17.346724+0000","last_unstale":"2024-04-25T02:29:18.358670+0000","last_undegraded":"2024-04-25T02:29:18.358670+0000","last_fullsized":"2024-04-25T02:29:18.358670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:13.727317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351533+0000","last_change":"2024-04-25T02:29:18.349195+0000","last_active":"2024-04-25T02:29:18.351533+0000","last_peered":"2024-04-25T02:29:18.351533+0000","last_clean":"2024-04-25T02:29:18.351533+0000","last_became_active":"2024-04-25T02:29:18.348904+0000","last_became_peered":"2024-04-25T02:29:18.348904+0000","last_unstale":"2024-04-25T02:29:18.351533+0000","last_undegraded":"2024-04-25T02:29:18.351533+0000","last_fullsized":"2024-04-25T02:29:18.351533+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:33.371549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355170+0000","last_change":"2024-04-25T02:29:17.333661+0000","last_active":"2024-04-25T02:29:18.355170+0000","last_peered":"2024-04-25T02:29:18.355170+0000","last_clean":"2024-04-25T02:29:18.355170+0000","last_became_active":"2024-04-25T02:29:17.333166+0000","last_became_peered":"2024-04-25T02:29:17.333166+0000","last_unstale":"2024-04-25T02:29:18.355170+0000","last_undegraded":"2024-04-25T02:29:18.355170+0000","last_fullsized":"2024-04-25T02:29:18.355170+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:37:20.446428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.358071+0000","last_change":"2024-04-25T02:29:18.351870+0000","last_active":"2024-04-25T02:29:18.358071+0000","last_peered":"2024-04-25T02:29:18.358071+0000","last_clean":"2024-04-25T02:29:18.358071+0000","last_became_active":"2024-04-25T02:29:18.347590+0000","last_became_peered":"2024-04-25T02:29:18.347590+0000","last_unstale":"2024-04-25T02:29:18.358071+0000","last_undegraded":"2024-04-25T02:29:18.358071+0000","last_fullsized":"2024-04-25T02:29:18.358071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:43.238638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.332322+0000","last_change":"2024-04-25T02:29:17.340109+0000","last_active":"2024-04-25T02:29:18.332322+0000","last_peered":"2024-04-25T02:29:18.332322+0000","last_clean":"2024-04-25T02:29:18.332322+0000","last_became_active":"2024-04-25T02:29:17.339787+0000","last_became_peered":"2024-04-25T02:29:17.339787+0000","last_unstale":"2024-04-25T02:29:18.332322+0000","last_undegraded":"2024-04-25T02:29:18.332322+0000","last_fullsized":"2024-04-25T02:29:18.332322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:24.525150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354229+0000","last_change":"2024-04-25T02:29:18.348361+0000","last_active":"2024-04-25T02:29:18.354229+0000","last_peered":"2024-04-25T02:29:18.354229+0000","last_clean":"2024-04-25T02:29:18.354229+0000","last_became_active":"2024-04-25T02:29:18.347942+0000","last_became_peered":"2024-04-25T02:29:18.347942+0000","last_unstale":"2024-04-25T02:29:18.354229+0000","last_undegraded":"2024-04-25T02:29:18.354229+0000","last_fullsized":"2024-04-25T02:29:18.354229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:18.991459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.325957+0000","last_change":"2024-04-25T02:29:17.344628+0000","last_active":"2024-04-25T02:29:18.325957+0000","last_peered":"2024-04-25T02:29:18.325957+0000","last_clean":"2024-04-25T02:29:18.325957+0000","last_became_active":"2024-04-25T02:29:17.344358+0000","last_became_peered":"2024-04-25T02:29:17.344358+0000","last_unstale":"2024-04-25T02:29:18.325957+0000","last_undegraded":"2024-04-25T02:29:18.325957+0000","last_fullsized":"2024-04-25T02:29:18.325957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:22.641889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345282+0000","last_change":"2024-04-25T02:29:18.344070+0000","last_active":"2024-04-25T02:29:18.345282+0000","last_peered":"2024-04-25T02:29:18.345282+0000","last_clean":"2024-04-25T02:29:18.345282+0000","last_became_active":"2024-04-25T02:29:18.343693+0000","last_became_peered":"2024-04-25T02:29:18.343693+0000","last_unstale":"2024-04-25T02:29:18.345282+0000","last_undegraded":"2024-04-25T02:29:18.345282+0000","last_fullsized":"2024-04-25T02:29:18.345282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:25.036633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.359172+0000","last_change":"2024-04-25T02:29:17.347108+0000","last_active":"2024-04-25T02:29:18.359172+0000","last_peered":"2024-04-25T02:29:18.359172+0000","last_clean":"2024-04-25T02:29:18.359172+0000","last_became_active":"2024-04-25T02:29:17.346804+0000","last_became_peered":"2024-04-25T02:29:17.346804+0000","last_unstale":"2024-04-25T02:29:18.359172+0000","last_undegraded":"2024-04-25T02:29:18.359172+0000","last_fullsized":"2024-04-25T02:29:18.359172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:47.231152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354232+0000","last_change":"2024-04-25T02:29:18.346263+0000","last_active":"2024-04-25T02:29:18.354232+0000","last_peered":"2024-04-25T02:29:18.354232+0000","last_clean":"2024-04-25T02:29:18.354232+0000","last_became_active":"2024-04-25T02:29:18.345025+0000","last_became_peered":"2024-04-25T02:29:18.345025+0000","last_unstale":"2024-04-25T02:29:18.354232+0000","last_undegraded":"2024-04-25T02:29:18.354232+0000","last_fullsized":"2024-04-25T02:29:18.354232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:37.293554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354159+0000","last_change":"2024-04-25T02:29:17.344650+0000","last_active":"2024-04-25T02:29:18.354159+0000","last_peered":"2024-04-25T02:29:18.354159+0000","last_clean":"2024-04-25T02:29:18.354159+0000","last_became_active":"2024-04-25T02:29:17.344289+0000","last_became_peered":"2024-04-25T02:29:17.344289+0000","last_unstale":"2024-04-25T02:29:18.354159+0000","last_undegraded":"2024-04-25T02:29:18.354159+0000","last_fullsized":"2024-04-25T02:29:18.354159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:36.286309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351371+0000","last_change":"2024-04-25T02:29:18.346031+0000","last_active":"2024-04-25T02:29:18.351371+0000","last_peered":"2024-04-25T02:29:18.351371+0000","last_clean":"2024-04-25T02:29:18.351371+0000","last_became_active":"2024-04-25T02:29:18.344184+0000","last_became_peered":"2024-04-25T02:29:18.344184+0000","last_unstale":"2024-04-25T02:29:18.351371+0000","last_undegraded":"2024-04-25T02:29:18.351371+0000","last_fullsized":"2024-04-25T02:29:18.351371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:30.728990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348015+0000","last_change":"2024-04-25T02:29:17.333575+0000","last_active":"2024-04-25T02:29:18.348015+0000","last_peered":"2024-04-25T02:29:18.348015+0000","last_clean":"2024-04-25T02:29:18.348015+0000","last_became_active":"2024-04-25T02:29:17.333263+0000","last_became_peered":"2024-04-25T02:29:17.333263+0000","last_unstale":"2024-04-25T02:29:18.348015+0000","last_undegraded":"2024-04-25T02:29:18.348015+0000","last_fullsized":"2024-04-25T02:29:18.348015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:17.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355310+0000","last_change":"2024-04-25T02:29:18.355310+0000","last_active":"2024-04-25T02:29:18.355310+0000","last_peered":"2024-04-25T02:29:18.355310+0000","last_clean":"2024-04-25T02:29:18.355310+0000","last_became_active":"2024-04-25T02:29:18.354835+0000","last_became_peered":"2024-04-25T02:29:18.354835+0000","last_unstale":"2024-04-25T02:29:18.355310+0000","last_undegraded":"2024-04-25T02:29:18.355310+0000","last_fullsized":"2024-04-25T02:29:18.355310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:30.728990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348745+0000","last_change":"2024-04-25T02:29:17.336493+0000","last_active":"2024-04-25T02:29:18.348745+0000","last_peered":"2024-04-25T02:29:18.348745+0000","last_clean":"2024-04-25T02:29:18.348745+0000","last_became_active":"2024-04-25T02:29:17.336162+0000","last_became_peered":"2024-04-25T02:29:17.336162+0000","last_unstale":"2024-04-25T02:29:18.348745+0000","last_undegraded":"2024-04-25T02:29:18.348745+0000","last_fullsized":"2024-04-25T02:29:18.348745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:30.373010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.342175+0000","last_change":"2024-04-25T02:29:18.337364+0000","last_active":"2024-04-25T02:29:18.342175+0000","last_peered":"2024-04-25T02:29:18.342175+0000","last_clean":"2024-04-25T02:29:18.342175+0000","last_became_active":"2024-04-25T02:29:18.336958+0000","last_became_peered":"2024-04-25T02:29:18.336958+0000","last_unstale":"2024-04-25T02:29:18.342175+0000","last_undegraded":"2024-04-25T02:29:18.342175+0000","last_fullsized":"2024-04-25T02:29:18.342175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:03:23.356365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327792+0000","last_change":"2024-04-25T02:29:17.345750+0000","last_active":"2024-04-25T02:29:18.327792+0000","last_peered":"2024-04-25T02:29:18.327792+0000","last_clean":"2024-04-25T02:29:18.327792+0000","last_became_active":"2024-04-25T02:29:17.345215+0000","last_became_peered":"2024-04-25T02:29:17.345215+0000","last_unstale":"2024-04-25T02:29:18.327792+0000","last_undegraded":"2024-04-25T02:29:18.327792+0000","last_fullsized":"2024-04-25T02:29:18.327792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:43:25.978582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.346132+0000","last_change":"2024-04-25T02:29:18.344512+0000","last_active":"2024-04-25T02:29:18.346132+0000","last_peered":"2024-04-25T02:29:18.346132+0000","last_clean":"2024-04-25T02:29:18.346132+0000","last_became_active":"2024-04-25T02:29:18.344002+0000","last_became_peered":"2024-04-25T02:29:18.344002+0000","last_unstale":"2024-04-25T02:29:18.346132+0000","last_undegraded":"2024-04-25T02:29:18.346132+0000","last_fullsized":"2024-04-25T02:29:18.346132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:18.639956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348772+0000","last_change":"2024-04-25T02:29:17.336327+0000","last_active":"2024-04-25T02:29:18.348772+0000","last_peered":"2024-04-25T02:29:18.348772+0000","last_clean":"2024-04-25T02:29:18.348772+0000","last_became_active":"2024-04-25T02:29:17.336061+0000","last_became_peered":"2024-04-25T02:29:17.336061+0000","last_unstale":"2024-04-25T02:29:18.348772+0000","last_undegraded":"2024-04-25T02:29:18.348772+0000","last_fullsized":"2024-04-25T02:29:18.348772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:22.380376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.342305+0000","last_change":"2024-04-25T02:29:18.338302+0000","last_active":"2024-04-25T02:29:18.342305+0000","last_peered":"2024-04-25T02:29:18.342305+0000","last_clean":"2024-04-25T02:29:18.342305+0000","last_became_active":"2024-04-25T02:29:18.338039+0000","last_became_peered":"2024-04-25T02:29:18.338039+0000","last_unstale":"2024-04-25T02:29:18.342305+0000","last_undegraded":"2024-04-25T02:29:18.342305+0000","last_fullsized":"2024-04-25T02:29:18.342305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:32.654953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.332282+0000","last_change":"2024-04-25T02:29:17.343462+0000","last_active":"2024-04-25T02:29:18.332282+0000","last_peered":"2024-04-25T02:29:18.332282+0000","last_clean":"2024-04-25T02:29:18.332282+0000","last_became_active":"2024-04-25T02:29:17.343181+0000","last_became_peered":"2024-04-25T02:29:17.343181+0000","last_unstale":"2024-04-25T02:29:18.332282+0000","last_undegraded":"2024-04-25T02:29:18.332282+0000","last_fullsized":"2024-04-25T02:29:18.332282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:52.327814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.342356+0000","last_change":"2024-04-25T02:29:18.338928+0000","last_active":"2024-04-25T02:29:18.342356+0000","last_peered":"2024-04-25T02:29:18.342356+0000","last_clean":"2024-04-25T02:29:18.342356+0000","last_became_active":"2024-04-25T02:29:18.338673+0000","last_became_peered":"2024-04-25T02:29:18.338673+0000","last_unstale":"2024-04-25T02:29:18.342356+0000","last_undegraded":"2024-04-25T02:29:18.342356+0000","last_fullsized":"2024-04-25T02:29:18.342356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:27.689600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327668+0000","last_change":"2024-04-25T02:29:17.335254+0000","last_active":"2024-04-25T02:29:18.327668+0000","last_peered":"2024-04-25T02:29:18.327668+0000","last_clean":"2024-04-25T02:29:18.327668+0000","last_became_active":"2024-04-25T02:29:17.334973+0000","last_became_peered":"2024-04-25T02:29:17.334973+0000","last_unstale":"2024-04-25T02:29:18.327668+0000","last_undegraded":"2024-04-25T02:29:18.327668+0000","last_fullsized":"2024-04-25T02:29:18.327668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:59.526492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351369+0000","last_change":"2024-04-25T02:29:18.347506+0000","last_active":"2024-04-25T02:29:18.351369+0000","last_peered":"2024-04-25T02:29:18.351369+0000","last_clean":"2024-04-25T02:29:18.351369+0000","last_became_active":"2024-04-25T02:29:18.347214+0000","last_became_peered":"2024-04-25T02:29:18.347214+0000","last_unstale":"2024-04-25T02:29:18.351369+0000","last_undegraded":"2024-04-25T02:29:18.351369+0000","last_fullsized":"2024-04-25T02:29:18.351369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:14.734561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.329668+0000","last_change":"2024-04-25T02:29:17.341124+0000","last_active":"2024-04-25T02:29:18.329668+0000","last_peered":"2024-04-25T02:29:18.329668+0000","last_clean":"2024-04-25T02:29:18.329668+0000","last_became_active":"2024-04-25T02:29:17.340870+0000","last_became_peered":"2024-04-25T02:29:17.340870+0000","last_unstale":"2024-04-25T02:29:18.329668+0000","last_undegraded":"2024-04-25T02:29:18.329668+0000","last_fullsized":"2024-04-25T02:29:18.329668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:36.286309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.347598+0000","last_change":"2024-04-25T02:29:18.346689+0000","last_active":"2024-04-25T02:29:18.347598+0000","last_peered":"2024-04-25T02:29:18.347598+0000","last_clean":"2024-04-25T02:29:18.347598+0000","last_became_active":"2024-04-25T02:29:18.346385+0000","last_became_peered":"2024-04-25T02:29:18.346385+0000","last_unstale":"2024-04-25T02:29:18.347598+0000","last_undegraded":"2024-04-25T02:29:18.347598+0000","last_fullsized":"2024-04-25T02:29:18.347598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:25.718704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355381+0000","last_change":"2024-04-25T02:29:17.341566+0000","last_active":"2024-04-25T02:29:18.355381+0000","last_peered":"2024-04-25T02:29:18.355381+0000","last_clean":"2024-04-25T02:29:18.355381+0000","last_became_active":"2024-04-25T02:29:17.341005+0000","last_became_peered":"2024-04-25T02:29:17.341005+0000","last_unstale":"2024-04-25T02:29:18.355381+0000","last_undegraded":"2024-04-25T02:29:18.355381+0000","last_fullsized":"2024-04-25T02:29:18.355381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:24.029388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351392+0000","last_change":"2024-04-25T02:29:18.346646+0000","last_active":"2024-04-25T02:29:18.351392+0000","last_peered":"2024-04-25T02:29:18.351392+0000","last_clean":"2024-04-25T02:29:18.351392+0000","last_became_active":"2024-04-25T02:29:18.346377+0000","last_became_peered":"2024-04-25T02:29:18.346377+0000","last_unstale":"2024-04-25T02:29:18.351392+0000","last_undegraded":"2024-04-25T02:29:18.351392+0000","last_fullsized":"2024-04-25T02:29:18.351392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:14.025149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.333287+0000","last_change":"2024-04-25T02:29:17.339450+0000","last_active":"2024-04-25T02:29:18.333287+0000","last_peered":"2024-04-25T02:29:18.333287+0000","last_clean":"2024-04-25T02:29:18.333287+0000","last_became_active":"2024-04-25T02:29:17.339041+0000","last_became_peered":"2024-04-25T02:29:17.339041+0000","last_unstale":"2024-04-25T02:29:18.333287+0000","last_undegraded":"2024-04-25T02:29:18.333287+0000","last_fullsized":"2024-04-25T02:29:18.333287+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:52.327814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345051+0000","last_change":"2024-04-25T02:29:18.343320+0000","last_active":"2024-04-25T02:29:18.345051+0000","last_peered":"2024-04-25T02:29:18.345051+0000","last_clean":"2024-04-25T02:29:18.345051+0000","last_became_active":"2024-04-25T02:29:18.343045+0000","last_became_peered":"2024-04-25T02:29:18.343045+0000","last_unstale":"2024-04-25T02:29:18.345051+0000","last_undegraded":"2024-04-25T02:29:18.345051+0000","last_fullsized":"2024-04-25T02:29:18.345051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:25.036633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.337918+0000","last_change":"2024-04-25T02:29:17.338937+0000","last_active":"2024-04-25T02:29:18.337918+0000","last_peered":"2024-04-25T02:29:18.337918+0000","last_clean":"2024-04-25T02:29:18.337918+0000","last_became_active":"2024-04-25T02:29:17.338636+0000","last_became_peered":"2024-04-25T02:29:17.338636+0000","last_unstale":"2024-04-25T02:29:18.337918+0000","last_undegraded":"2024-04-25T02:29:18.337918+0000","last_fullsized":"2024-04-25T02:29:18.337918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:13.412200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.344836+0000","last_change":"2024-04-25T02:29:18.341511+0000","last_active":"2024-04-25T02:29:18.344836+0000","last_peered":"2024-04-25T02:29:18.344836+0000","last_clean":"2024-04-25T02:29:18.344836+0000","last_became_active":"2024-04-25T02:29:18.341233+0000","last_became_peered":"2024-04-25T02:29:18.341233+0000","last_unstale":"2024-04-25T02:29:18.344836+0000","last_undegraded":"2024-04-25T02:29:18.344836+0000","last_fullsized":"2024-04-25T02:29:18.344836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:25.532394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.335068+0000","last_change":"2024-04-25T02:29:17.335618+0000","last_active":"2024-04-25T02:29:18.335068+0000","last_peered":"2024-04-25T02:29:18.335068+0000","last_clean":"2024-04-25T02:29:18.335068+0000","last_became_active":"2024-04-25T02:29:17.335113+0000","last_became_peered":"2024-04-25T02:29:17.335113+0000","last_unstale":"2024-04-25T02:29:18.335068+0000","last_undegraded":"2024-04-25T02:29:18.335068+0000","last_fullsized":"2024-04-25T02:29:18.335068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:24.525150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345451+0000","last_change":"2024-04-25T02:29:18.343189+0000","last_active":"2024-04-25T02:29:18.345451+0000","last_peered":"2024-04-25T02:29:18.345451+0000","last_clean":"2024-04-25T02:29:18.345451+0000","last_became_active":"2024-04-25T02:29:18.342880+0000","last_became_peered":"2024-04-25T02:29:18.342880+0000","last_unstale":"2024-04-25T02:29:18.345451+0000","last_undegraded":"2024-04-25T02:29:18.345451+0000","last_fullsized":"2024-04-25T02:29:18.345451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:37.293554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.332320+0000","last_change":"2024-04-25T02:29:17.342369+0000","last_active":"2024-04-25T02:29:18.332320+0000","last_peered":"2024-04-25T02:29:18.332320+0000","last_clean":"2024-04-25T02:29:18.332320+0000","last_became_active":"2024-04-25T02:29:17.342038+0000","last_became_peered":"2024-04-25T02:29:17.342038+0000","last_unstale":"2024-04-25T02:29:18.332320+0000","last_undegraded":"2024-04-25T02:29:18.332320+0000","last_fullsized":"2024-04-25T02:29:18.332320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:22.380376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352267+0000","last_change":"2024-04-25T02:29:18.346427+0000","last_active":"2024-04-25T02:29:18.352267+0000","last_peered":"2024-04-25T02:29:18.352267+0000","last_clean":"2024-04-25T02:29:18.352267+0000","last_became_active":"2024-04-25T02:29:18.344252+0000","last_became_peered":"2024-04-25T02:29:18.344252+0000","last_unstale":"2024-04-25T02:29:18.352267+0000","last_undegraded":"2024-04-25T02:29:18.352267+0000","last_fullsized":"2024-04-25T02:29:18.352267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:50.388712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327838+0000","last_change":"2024-04-25T02:29:17.334132+0000","last_active":"2024-04-25T02:29:18.327838+0000","last_peered":"2024-04-25T02:29:18.327838+0000","last_clean":"2024-04-25T02:29:18.327838+0000","last_became_active":"2024-04-25T02:29:17.333432+0000","last_became_peered":"2024-04-25T02:29:17.333432+0000","last_unstale":"2024-04-25T02:29:18.327838+0000","last_undegraded":"2024-04-25T02:29:18.327838+0000","last_fullsized":"2024-04-25T02:29:18.327838+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:12:36.993064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355265+0000","last_change":"2024-04-25T02:29:18.350496+0000","last_active":"2024-04-25T02:29:18.355265+0000","last_peered":"2024-04-25T02:29:18.355265+0000","last_clean":"2024-04-25T02:29:18.355265+0000","last_became_active":"2024-04-25T02:29:18.350230+0000","last_became_peered":"2024-04-25T02:29:18.350230+0000","last_unstale":"2024-04-25T02:29:18.355265+0000","last_undegraded":"2024-04-25T02:29:18.355265+0000","last_fullsized":"2024-04-25T02:29:18.355265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:14.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.325543+0000","last_change":"2024-04-25T02:29:17.345243+0000","last_active":"2024-04-25T02:29:18.325543+0000","last_peered":"2024-04-25T02:29:18.325543+0000","last_clean":"2024-04-25T02:29:18.325543+0000","last_became_active":"2024-04-25T02:29:17.344978+0000","last_became_peered":"2024-04-25T02:29:17.344978+0000","last_unstale":"2024-04-25T02:29:18.325543+0000","last_undegraded":"2024-04-25T02:29:18.325543+0000","last_fullsized":"2024-04-25T02:29:18.325543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:13.412200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351382+0000","last_change":"2024-04-25T02:29:18.346721+0000","last_active":"2024-04-25T02:29:18.351382+0000","last_peered":"2024-04-25T02:29:18.351382+0000","last_clean":"2024-04-25T02:29:18.351382+0000","last_became_active":"2024-04-25T02:29:18.346444+0000","last_became_peered":"2024-04-25T02:29:18.346444+0000","last_unstale":"2024-04-25T02:29:18.351382+0000","last_undegraded":"2024-04-25T02:29:18.351382+0000","last_fullsized":"2024-04-25T02:29:18.351382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:23.649134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.331945+0000","last_change":"2024-04-25T02:29:17.336098+0000","last_active":"2024-04-25T02:29:18.331945+0000","last_peered":"2024-04-25T02:29:18.331945+0000","last_clean":"2024-04-25T02:29:18.331945+0000","last_became_active":"2024-04-25T02:29:17.335825+0000","last_became_peered":"2024-04-25T02:29:17.335825+0000","last_unstale":"2024-04-25T02:29:18.331945+0000","last_undegraded":"2024-04-25T02:29:18.331945+0000","last_fullsized":"2024-04-25T02:29:18.331945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:03:38.186300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.331621+0000","last_change":"2024-04-25T02:28:15.520345+0000","last_active":"2024-04-25T02:29:18.331621+0000","last_peered":"2024-04-25T02:29:18.331621+0000","last_clean":"2024-04-25T02:29:18.331621+0000","last_became_active":"2024-04-25T02:28:15.519317+0000","last_became_peered":"2024-04-25T02:28:15.519317+0000","last_unstale":"2024-04-25T02:29:18.331621+0000","last_undegraded":"2024-04-25T02:29:18.331621+0000","last_fullsized":"2024-04-25T02:29:18.331621+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_clean_scrub_stamp":"2024-04-25T02:28:14.374327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:20.125523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":723901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":723901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:29:21.693 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:29:21.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.826+0000 7fdb56e2c640 1 Processor -- start 2024-04-25T02:29:21.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.826+0000 7fdb56e2c640 1 -- start start 2024-04-25T02:29:21.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.827+0000 7fdb56e2c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb5015b220 0x7fdb50070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.827+0000 7fdb56e2c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdb5015ec70 0x7fdb5015f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.827+0000 7fdb56e2c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdb5015f630 0x7fdb50071660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.827+0000 7fdb56e2c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fdb500aee00 con 0x7fdb5015f630 2024-04-25T02:29:21.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.827+0000 7fdb56e2c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdb5015fac0 con 0x7fdb5015ec70 2024-04-25T02:29:21.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.827+0000 7fdb56e2c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdb500713d0 con 0x7fdb5015b220 2024-04-25T02:29:21.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.827+0000 7fdb553c9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdb5015f630 0x7fdb50071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.827+0000 7fdb553c9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdb5015f630 0x7fdb50071660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49336/0 (socket says 172.21.15.67:49336) 2024-04-25T02:29:21.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.827+0000 7fdb553c9640 1 -- 172.21.15.67:0/123082037 learned_addr learned my addr 172.21.15.67:0/123082037 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:21.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.827+0000 7fdb54bc8640 1 --2- 172.21.15.67:0/123082037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb5015b220 0x7fdb50070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.828+0000 7fdb4ffff640 1 --2- 172.21.15.67:0/123082037 >> v2:172.21.15.176:3300/0 conn(0x7fdb5015ec70 0x7fdb5015f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.828+0000 7fdb553c9640 1 -- 172.21.15.67:0/123082037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb5015b220 msgr2=0x7fdb50070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:21.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.828+0000 7fdb553c9640 1 --2- 172.21.15.67:0/123082037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb5015b220 0x7fdb50070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.828+0000 7fdb553c9640 1 -- 172.21.15.67:0/123082037 >> v2:172.21.15.176:3300/0 conn(0x7fdb5015ec70 msgr2=0x7fdb5015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:21.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.828+0000 7fdb553c9640 1 --2- 172.21.15.67:0/123082037 >> v2:172.21.15.176:3300/0 conn(0x7fdb5015ec70 0x7fdb5015f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.828+0000 7fdb553c9640 1 -- 172.21.15.67:0/123082037 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb500ae4d0 con 0x7fdb5015f630 2024-04-25T02:29:21.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.828+0000 7fdb4ffff640 1 --2- 172.21.15.67:0/123082037 >> v2:172.21.15.176:3300/0 conn(0x7fdb5015ec70 0x7fdb5015f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:21.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.828+0000 7fdb553c9640 1 --2- 172.21.15.67:0/123082037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5015f630 0x7fdb50071660 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdb500d0d30 tx=0x7fdb4002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcaaa1f95a384d56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:21.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.829+0000 7fdb4f7fe640 1 -- 172.21.15.67:0/123082037 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40037070 con 0x7fdb5015f630 2024-04-25T02:29:21.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.829+0000 7fdb4f7fe640 1 -- 172.21.15.67:0/123082037 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb40032440 con 0x7fdb5015f630 2024-04-25T02:29:21.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.829+0000 7fdb4f7fe640 1 -- 172.21.15.67:0/123082037 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40032810 con 0x7fdb5015f630 2024-04-25T02:29:21.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.829+0000 7fdb56e2c640 1 -- 172.21.15.67:0/123082037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5015f630 msgr2=0x7fdb50071660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.829+0000 7fdb56e2c640 1 --2- 172.21.15.67:0/123082037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5015f630 0x7fdb50071660 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdb500d0d30 tx=0x7fdb4002a1e0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.829+0000 7fdb56e2c640 1 -- 172.21.15.67:0/123082037 shutdown_connections 2024-04-25T02:29:21.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.829+0000 7fdb56e2c640 1 --2- 172.21.15.67:0/123082037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5015f630 0x7fdb50071660 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.829+0000 7fdb56e2c640 1 --2- 172.21.15.67:0/123082037 >> v2:172.21.15.176:3300/0 conn(0x7fdb5015ec70 0x7fdb5015f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.829+0000 7fdb56e2c640 1 --2- 172.21.15.67:0/123082037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb5015b220 0x7fdb50070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.829+0000 7fdb56e2c640 1 -- 172.21.15.67:0/123082037 >> 172.21.15.67:0/123082037 conn(0x7fdb500b19c0 msgr2=0x7fdb500b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:21.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.829+0000 7fdb56e2c640 1 -- 172.21.15.67:0/123082037 shutdown_connections 2024-04-25T02:29:21.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.829+0000 7fdb56e2c640 1 -- 172.21.15.67:0/123082037 wait complete. 2024-04-25T02:29:21.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.830+0000 7fdb56e2c640 1 Processor -- start 2024-04-25T02:29:21.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.830+0000 7fdb56e2c640 1 -- start start 2024-04-25T02:29:21.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.831+0000 7fdb56e2c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb5015b220 0x7fdb50144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.831+0000 7fdb56e2c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5015ec70 0x7fdb500b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.831+0000 7fdb56e2c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb5015f630 0x7fdb50151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.831+0000 7fdb56e2c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5006eb90 con 0x7fdb5015ec70 2024-04-25T02:29:21.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.831+0000 7fdb56e2c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdb500aea90 con 0x7fdb5015f630 2024-04-25T02:29:21.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.831+0000 7fdb56e2c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5006ed10 con 0x7fdb5015b220 2024-04-25T02:29:21.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.831+0000 7fdb4ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5015ec70 0x7fdb500b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.831+0000 7fdb4ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5015ec70 0x7fdb500b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49348/0 (socket says 172.21.15.67:49348) 2024-04-25T02:29:21.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.831+0000 7fdb4ffff640 1 -- 172.21.15.67:0/3677770534 learned_addr learned my addr 172.21.15.67:0/3677770534 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:21.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.831+0000 7fdb4ffff640 1 -- 172.21.15.67:0/3677770534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb5015b220 msgr2=0x7fdb50144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.831+0000 7fdb4ffff640 1 --2- 172.21.15.67:0/3677770534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb5015b220 0x7fdb50144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.831+0000 7fdb553c9640 1 --2- 172.21.15.67:0/3677770534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb5015f630 0x7fdb50151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.831+0000 7fdb4ffff640 1 -- 172.21.15.67:0/3677770534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb5015f630 msgr2=0x7fdb50151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:21.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.832+0000 7fdb4ffff640 1 --2- 172.21.15.67:0/3677770534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb5015f630 0x7fdb50151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:21.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.832+0000 7fdb4ffff640 1 -- 172.21.15.67:0/3677770534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5014cec0 con 0x7fdb5015ec70 2024-04-25T02:29:21.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.832+0000 7fdb553c9640 1 --2- 172.21.15.67:0/3677770534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb5015f630 0x7fdb50151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:21.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.832+0000 7fdb4ffff640 1 --2- 172.21.15.67:0/3677770534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5015ec70 0x7fdb500b3b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400e810 tx=0x7fdb4400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:21.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.832+0000 7fdb4d7fa640 1 -- 172.21.15.67:0/3677770534 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4400f040 con 0x7fdb5015ec70 2024-04-25T02:29:21.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.832+0000 7fdb4d7fa640 1 -- 172.21.15.67:0/3677770534 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb44004030 con 0x7fdb5015ec70 2024-04-25T02:29:21.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.832+0000 7fdb56e2c640 1 -- 172.21.15.67:0/3677770534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5014d130 con 0x7fdb5015ec70 2024-04-25T02:29:21.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.832+0000 7fdb4d7fa640 1 -- 172.21.15.67:0/3677770534 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb44004400 con 0x7fdb5015ec70 2024-04-25T02:29:21.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.832+0000 7fdb56e2c640 1 -- 172.21.15.67:0/3677770534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb5014d6f0 con 0x7fdb5015ec70 2024-04-25T02:29:21.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.833+0000 7fdb56e2c640 1 -- 172.21.15.67:0/3677770534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb50069110 con 0x7fdb5015ec70 2024-04-25T02:29:21.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.833+0000 7fdb4d7fa640 1 -- 172.21.15.67:0/3677770534 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb4400c6d0 con 0x7fdb5015ec70 2024-04-25T02:29:21.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.834+0000 7fdb4d7fa640 1 --2- 172.21.15.67:0/3677770534 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:21.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.834+0000 7fdb4d7fa640 1 -- 172.21.15.67:0/3677770534 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fdb4408abf0 con 0x7fdb5015ec70 2024-04-25T02:29:21.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.834+0000 7fdb54bc8640 1 --2- 172.21.15.67:0/3677770534 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:21.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.835+0000 7fdb54bc8640 1 --2- 172.21.15.67:0/3677770534 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009dd0 tx=0x7fdb48009450 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:21.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:21.838+0000 7fdb4d7fa640 1 -- 172.21.15.67:0/3677770534 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdb44017020 con 0x7fdb5015ec70 2024-04-25T02:29:22.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.017+0000 7fdb56e2c640 1 -- 172.21.15.67:0/3677770534 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb5006e610 con 0x7fdb3c06be30 2024-04-25T02:29:22.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.023+0000 7fdb4d7fa640 1 -- 172.21.15.67:0/3677770534 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7fdb5006e610 con 0x7fdb3c06be30 2024-04-25T02:29:22.030 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:22.031 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-25T02:29:22.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.026+0000 7fdb56e2c640 1 -- 172.21.15.67:0/3677770534 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdb3c06be30 msgr2=0x7fdb3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:22.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.026+0000 7fdb56e2c640 1 --2- 172.21.15.67:0/3677770534 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009dd0 tx=0x7fdb48009450 comp rx=0 tx=0).stop 2024-04-25T02:29:22.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.026+0000 7fdb56e2c640 1 -- 172.21.15.67:0/3677770534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5015ec70 msgr2=0x7fdb500b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:22.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.026+0000 7fdb56e2c640 1 --2- 172.21.15.67:0/3677770534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5015ec70 0x7fdb500b3b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400e810 tx=0x7fdb4400ecd0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.027+0000 7fdb56e2c640 1 -- 172.21.15.67:0/3677770534 shutdown_connections 2024-04-25T02:29:22.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.027+0000 7fdb56e2c640 1 --2- 172.21.15.67:0/3677770534 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdb3c06be30 0x7fdb3c06e2f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.027+0000 7fdb56e2c640 1 --2- 172.21.15.67:0/3677770534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb5015f630 0x7fdb50151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.027+0000 7fdb56e2c640 1 --2- 172.21.15.67:0/3677770534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5015ec70 0x7fdb500b3b10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.027+0000 7fdb56e2c640 1 --2- 172.21.15.67:0/3677770534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb5015b220 0x7fdb50144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.027+0000 7fdb56e2c640 1 -- 172.21.15.67:0/3677770534 >> 172.21.15.67:0/3677770534 conn(0x7fdb500b19c0 msgr2=0x7fdb50153920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:22.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.027+0000 7fdb56e2c640 1 -- 172.21.15.67:0/3677770534 shutdown_connections 2024-04-25T02:29:22.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.027+0000 7fdb56e2c640 1 -- 172.21.15.67:0/3677770534 wait complete. 2024-04-25T02:29:22.041 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-04-25T02:29:20.343199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591838,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220068,"kb_used_data":3880,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754652,"statfs":{"total":773094113280,"available":772868763648,"internally_reserved":0,"allocated":3973120,"data_stored":2249000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.029847"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353969+0000","last_change":"2024-04-25T02:29:18.346740+0000","last_active":"2024-04-25T02:29:18.353969+0000","last_peered":"2024-04-25T02:29:18.353969+0000","last_clean":"2024-04-25T02:29:18.353969+0000","last_became_active":"2024-04-25T02:29:18.346475+0000","last_became_peered":"2024-04-25T02:29:18.346475+0000","last_unstale":"2024-04-25T02:29:18.353969+0000","last_undegraded":"2024-04-25T02:29:18.353969+0000","last_fullsized":"2024-04-25T02:29:18.353969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352494+0000","last_change":"2024-04-25T02:29:18.347192+0000","last_active":"2024-04-25T02:29:18.352494+0000","last_peered":"2024-04-25T02:29:18.352494+0000","last_clean":"2024-04-25T02:29:18.352494+0000","last_became_active":"2024-04-25T02:29:18.346599+0000","last_became_peered":"2024-04-25T02:29:18.346599+0000","last_unstale":"2024-04-25T02:29:18.352494+0000","last_undegraded":"2024-04-25T02:29:18.352494+0000","last_fullsized":"2024-04-25T02:29:18.352494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:11.549908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348359+0000","last_change":"2024-04-25T02:29:18.344360+0000","last_active":"2024-04-25T02:29:18.348359+0000","last_peered":"2024-04-25T02:29:18.348359+0000","last_clean":"2024-04-25T02:29:18.348359+0000","last_became_active":"2024-04-25T02:29:18.343592+0000","last_became_peered":"2024-04-25T02:29:18.343592+0000","last_unstale":"2024-04-25T02:29:18.348359+0000","last_undegraded":"2024-04-25T02:29:18.348359+0000","last_fullsized":"2024-04-25T02:29:18.348359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:14.734561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353680+0000","last_change":"2024-04-25T02:29:18.353680+0000","last_active":"2024-04-25T02:29:18.353680+0000","last_peered":"2024-04-25T02:29:18.353680+0000","last_clean":"2024-04-25T02:29:18.353680+0000","last_became_active":"2024-04-25T02:29:18.353401+0000","last_became_peered":"2024-04-25T02:29:18.353401+0000","last_unstale":"2024-04-25T02:29:18.353680+0000","last_undegraded":"2024-04-25T02:29:18.353680+0000","last_fullsized":"2024-04-25T02:29:18.353680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:14.734561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351757+0000","last_change":"2024-04-25T02:29:18.349706+0000","last_active":"2024-04-25T02:29:18.351757+0000","last_peered":"2024-04-25T02:29:18.351757+0000","last_clean":"2024-04-25T02:29:18.351757+0000","last_became_active":"2024-04-25T02:29:18.349413+0000","last_became_peered":"2024-04-25T02:29:18.349413+0000","last_unstale":"2024-04-25T02:29:18.351757+0000","last_undegraded":"2024-04-25T02:29:18.351757+0000","last_fullsized":"2024-04-25T02:29:18.351757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:43:26.985827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353065+0000","last_change":"2024-04-25T02:29:18.348066+0000","last_active":"2024-04-25T02:29:18.353065+0000","last_peered":"2024-04-25T02:29:18.353065+0000","last_clean":"2024-04-25T02:29:18.353065+0000","last_became_active":"2024-04-25T02:29:18.347678+0000","last_became_peered":"2024-04-25T02:29:18.347678+0000","last_unstale":"2024-04-25T02:29:18.353065+0000","last_undegraded":"2024-04-25T02:29:18.353065+0000","last_fullsized":"2024-04-25T02:29:18.353065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:02:32.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351348+0000","last_change":"2024-04-25T02:29:18.347506+0000","last_active":"2024-04-25T02:29:18.351348+0000","last_peered":"2024-04-25T02:29:18.351348+0000","last_clean":"2024-04-25T02:29:18.351348+0000","last_became_active":"2024-04-25T02:29:18.347229+0000","last_became_peered":"2024-04-25T02:29:18.347229+0000","last_unstale":"2024-04-25T02:29:18.351348+0000","last_undegraded":"2024-04-25T02:29:18.351348+0000","last_fullsized":"2024-04-25T02:29:18.351348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.342548+0000","last_change":"2024-04-25T02:29:18.338526+0000","last_active":"2024-04-25T02:29:18.342548+0000","last_peered":"2024-04-25T02:29:18.342548+0000","last_clean":"2024-04-25T02:29:18.342548+0000","last_became_active":"2024-04-25T02:29:18.338272+0000","last_became_peered":"2024-04-25T02:29:18.338272+0000","last_unstale":"2024-04-25T02:29:18.342548+0000","last_undegraded":"2024-04-25T02:29:18.342548+0000","last_fullsized":"2024-04-25T02:29:18.342548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345636+0000","last_change":"2024-04-25T02:29:18.341056+0000","last_active":"2024-04-25T02:29:18.345636+0000","last_peered":"2024-04-25T02:29:18.345636+0000","last_clean":"2024-04-25T02:29:18.345636+0000","last_became_active":"2024-04-25T02:29:18.340660+0000","last_became_peered":"2024-04-25T02:29:18.340660+0000","last_unstale":"2024-04-25T02:29:18.345636+0000","last_undegraded":"2024-04-25T02:29:18.345636+0000","last_fullsized":"2024-04-25T02:29:18.345636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:25.532394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354625+0000","last_change":"2024-04-25T02:29:18.354625+0000","last_active":"2024-04-25T02:29:18.354625+0000","last_peered":"2024-04-25T02:29:18.354625+0000","last_clean":"2024-04-25T02:29:18.354625+0000","last_became_active":"2024-04-25T02:29:18.354339+0000","last_became_peered":"2024-04-25T02:29:18.354339+0000","last_unstale":"2024-04-25T02:29:18.354625+0000","last_undegraded":"2024-04-25T02:29:18.354625+0000","last_fullsized":"2024-04-25T02:29:18.354625+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:18.991459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.344927+0000","last_change":"2024-04-25T02:29:18.341907+0000","last_active":"2024-04-25T02:29:18.344927+0000","last_peered":"2024-04-25T02:29:18.344927+0000","last_clean":"2024-04-25T02:29:18.344927+0000","last_became_active":"2024-04-25T02:29:18.341644+0000","last_became_peered":"2024-04-25T02:29:18.341644+0000","last_unstale":"2024-04-25T02:29:18.344927+0000","last_undegraded":"2024-04-25T02:29:18.344927+0000","last_fullsized":"2024-04-25T02:29:18.344927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:33.371549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.349482+0000","last_change":"2024-04-25T02:29:18.349482+0000","last_active":"2024-04-25T02:29:18.349482+0000","last_peered":"2024-04-25T02:29:18.349482+0000","last_clean":"2024-04-25T02:29:18.349482+0000","last_became_active":"2024-04-25T02:29:18.349216+0000","last_became_peered":"2024-04-25T02:29:18.349216+0000","last_unstale":"2024-04-25T02:29:18.349482+0000","last_undegraded":"2024-04-25T02:29:18.349482+0000","last_fullsized":"2024-04-25T02:29:18.349482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:20.085001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345642+0000","last_change":"2024-04-25T02:29:18.340910+0000","last_active":"2024-04-25T02:29:18.345642+0000","last_peered":"2024-04-25T02:29:18.345642+0000","last_clean":"2024-04-25T02:29:18.345642+0000","last_became_active":"2024-04-25T02:29:18.340634+0000","last_became_peered":"2024-04-25T02:29:18.340634+0000","last_unstale":"2024-04-25T02:29:18.345642+0000","last_undegraded":"2024-04-25T02:29:18.345642+0000","last_fullsized":"2024-04-25T02:29:18.345642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:31.380254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348430+0000","last_change":"2024-04-25T02:29:18.341922+0000","last_active":"2024-04-25T02:29:18.348430+0000","last_peered":"2024-04-25T02:29:18.348430+0000","last_clean":"2024-04-25T02:29:18.348430+0000","last_became_active":"2024-04-25T02:29:18.341643+0000","last_became_peered":"2024-04-25T02:29:18.341643+0000","last_unstale":"2024-04-25T02:29:18.348430+0000","last_undegraded":"2024-04-25T02:29:18.348430+0000","last_fullsized":"2024-04-25T02:29:18.348430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:30.728990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345537+0000","last_change":"2024-04-25T02:29:18.336835+0000","last_active":"2024-04-25T02:29:18.345537+0000","last_peered":"2024-04-25T02:29:18.345537+0000","last_clean":"2024-04-25T02:29:18.345537+0000","last_became_active":"2024-04-25T02:29:18.336550+0000","last_became_peered":"2024-04-25T02:29:18.336550+0000","last_unstale":"2024-04-25T02:29:18.345537+0000","last_undegraded":"2024-04-25T02:29:18.345537+0000","last_fullsized":"2024-04-25T02:29:18.345537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:14.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352970+0000","last_change":"2024-04-25T02:29:18.352970+0000","last_active":"2024-04-25T02:29:18.352970+0000","last_peered":"2024-04-25T02:29:18.352970+0000","last_clean":"2024-04-25T02:29:18.352970+0000","last_became_active":"2024-04-25T02:29:18.352750+0000","last_became_peered":"2024-04-25T02:29:18.352750+0000","last_unstale":"2024-04-25T02:29:18.352970+0000","last_undegraded":"2024-04-25T02:29:18.352970+0000","last_fullsized":"2024-04-25T02:29:18.352970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:08.133055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354285+0000","last_change":"2024-04-25T02:29:18.350283+0000","last_active":"2024-04-25T02:29:18.354285+0000","last_peered":"2024-04-25T02:29:18.354285+0000","last_clean":"2024-04-25T02:29:18.354285+0000","last_became_active":"2024-04-25T02:29:18.349442+0000","last_became_peered":"2024-04-25T02:29:18.349442+0000","last_unstale":"2024-04-25T02:29:18.354285+0000","last_undegraded":"2024-04-25T02:29:18.354285+0000","last_fullsized":"2024-04-25T02:29:18.354285+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:50.388712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352469+0000","last_change":"2024-04-25T02:29:18.346919+0000","last_active":"2024-04-25T02:29:18.352469+0000","last_peered":"2024-04-25T02:29:18.352469+0000","last_clean":"2024-04-25T02:29:18.352469+0000","last_became_active":"2024-04-25T02:29:18.345267+0000","last_became_peered":"2024-04-25T02:29:18.345267+0000","last_unstale":"2024-04-25T02:29:18.352469+0000","last_undegraded":"2024-04-25T02:29:18.352469+0000","last_fullsized":"2024-04-25T02:29:18.352469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:08.133055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348478+0000","last_change":"2024-04-25T02:29:18.343532+0000","last_active":"2024-04-25T02:29:18.348478+0000","last_peered":"2024-04-25T02:29:18.348478+0000","last_clean":"2024-04-25T02:29:18.348478+0000","last_became_active":"2024-04-25T02:29:18.343242+0000","last_became_peered":"2024-04-25T02:29:18.343242+0000","last_unstale":"2024-04-25T02:29:18.348478+0000","last_undegraded":"2024-04-25T02:29:18.348478+0000","last_fullsized":"2024-04-25T02:29:18.348478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:14.025149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351721+0000","last_change":"2024-04-25T02:29:18.348342+0000","last_active":"2024-04-25T02:29:18.351721+0000","last_peered":"2024-04-25T02:29:18.351721+0000","last_clean":"2024-04-25T02:29:18.351721+0000","last_became_active":"2024-04-25T02:29:18.348055+0000","last_became_peered":"2024-04-25T02:29:18.348055+0000","last_unstale":"2024-04-25T02:29:18.351721+0000","last_undegraded":"2024-04-25T02:29:18.351721+0000","last_fullsized":"2024-04-25T02:29:18.351721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:00.533737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.346888+0000","last_change":"2024-04-25T02:29:18.339396+0000","last_active":"2024-04-25T02:29:18.346888+0000","last_peered":"2024-04-25T02:29:18.346888+0000","last_clean":"2024-04-25T02:29:18.346888+0000","last_became_active":"2024-04-25T02:29:18.339130+0000","last_became_peered":"2024-04-25T02:29:18.339130+0000","last_unstale":"2024-04-25T02:29:18.346888+0000","last_undegraded":"2024-04-25T02:29:18.346888+0000","last_fullsized":"2024-04-25T02:29:18.346888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:23.387620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.347319+0000","last_change":"2024-04-25T02:29:18.337818+0000","last_active":"2024-04-25T02:29:18.347319+0000","last_peered":"2024-04-25T02:29:18.347319+0000","last_clean":"2024-04-25T02:29:18.347319+0000","last_became_active":"2024-04-25T02:29:18.337470+0000","last_became_peered":"2024-04-25T02:29:18.337470+0000","last_unstale":"2024-04-25T02:29:18.347319+0000","last_undegraded":"2024-04-25T02:29:18.347319+0000","last_fullsized":"2024-04-25T02:29:18.347319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:53.335059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345890+0000","last_change":"2024-04-25T02:29:18.344898+0000","last_active":"2024-04-25T02:29:18.345890+0000","last_peered":"2024-04-25T02:29:18.345890+0000","last_clean":"2024-04-25T02:29:18.345890+0000","last_became_active":"2024-04-25T02:29:18.344617+0000","last_became_peered":"2024-04-25T02:29:18.344617+0000","last_unstale":"2024-04-25T02:29:18.345890+0000","last_undegraded":"2024-04-25T02:29:18.345890+0000","last_fullsized":"2024-04-25T02:29:18.345890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345770+0000","last_change":"2024-04-25T02:29:18.339252+0000","last_active":"2024-04-25T02:29:18.345770+0000","last_peered":"2024-04-25T02:29:18.345770+0000","last_clean":"2024-04-25T02:29:18.345770+0000","last_became_active":"2024-04-25T02:29:18.338939+0000","last_became_peered":"2024-04-25T02:29:18.338939+0000","last_unstale":"2024-04-25T02:29:18.345770+0000","last_undegraded":"2024-04-25T02:29:18.345770+0000","last_fullsized":"2024-04-25T02:29:18.345770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348292+0000","last_change":"2024-04-25T02:29:18.346821+0000","last_active":"2024-04-25T02:29:18.348292+0000","last_peered":"2024-04-25T02:29:18.348292+0000","last_clean":"2024-04-25T02:29:18.348292+0000","last_became_active":"2024-04-25T02:29:18.346488+0000","last_became_peered":"2024-04-25T02:29:18.346488+0000","last_unstale":"2024-04-25T02:29:18.348292+0000","last_undegraded":"2024-04-25T02:29:18.348292+0000","last_fullsized":"2024-04-25T02:29:18.348292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353188+0000","last_change":"2024-04-25T02:29:18.351850+0000","last_active":"2024-04-25T02:29:18.353188+0000","last_peered":"2024-04-25T02:29:18.353188+0000","last_clean":"2024-04-25T02:29:18.353188+0000","last_became_active":"2024-04-25T02:29:18.351485+0000","last_became_peered":"2024-04-25T02:29:18.351485+0000","last_unstale":"2024-04-25T02:29:18.353188+0000","last_undegraded":"2024-04-25T02:29:18.353188+0000","last_fullsized":"2024-04-25T02:29:18.353188+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:26.891694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":6,"reported_epoch":32,"state":"active","last_fresh":"2024-04-25T02:29:18.355802+0000","last_change":"2024-04-25T02:29:18.355742+0000","last_active":"2024-04-25T02:29:18.355802+0000","last_peered":"2024-04-25T02:29:18.355802+0000","last_clean":"2024-04-25T02:29:17.313167+0000","last_became_active":"2024-04-25T02:29:18.355742+0000","last_became_peered":"2024-04-25T02:29:18.355742+0000","last_unstale":"2024-04-25T02:29:18.355802+0000","last_undegraded":"2024-04-25T02:29:18.355802+0000","last_fullsized":"2024-04-25T02:29:18.355802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348814+0000","last_change":"2024-04-25T02:29:18.341797+0000","last_active":"2024-04-25T02:29:18.348814+0000","last_peered":"2024-04-25T02:29:18.348814+0000","last_clean":"2024-04-25T02:29:18.348814+0000","last_became_active":"2024-04-25T02:29:18.341492+0000","last_became_peered":"2024-04-25T02:29:18.341492+0000","last_unstale":"2024-04-25T02:29:18.348814+0000","last_undegraded":"2024-04-25T02:29:18.348814+0000","last_fullsized":"2024-04-25T02:29:18.348814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:33.371549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355282+0000","last_change":"2024-04-25T02:29:18.351144+0000","last_active":"2024-04-25T02:29:18.355282+0000","last_peered":"2024-04-25T02:29:18.355282+0000","last_clean":"2024-04-25T02:29:18.355282+0000","last_became_active":"2024-04-25T02:29:18.350844+0000","last_became_peered":"2024-04-25T02:29:18.350844+0000","last_unstale":"2024-04-25T02:29:18.355282+0000","last_undegraded":"2024-04-25T02:29:18.355282+0000","last_fullsized":"2024-04-25T02:29:18.355282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354443+0000","last_change":"2024-04-25T02:29:18.349494+0000","last_active":"2024-04-25T02:29:18.354443+0000","last_peered":"2024-04-25T02:29:18.354443+0000","last_clean":"2024-04-25T02:29:18.354443+0000","last_became_active":"2024-04-25T02:29:18.349186+0000","last_became_peered":"2024-04-25T02:29:18.349186+0000","last_unstale":"2024-04-25T02:29:18.354443+0000","last_undegraded":"2024-04-25T02:29:18.354443+0000","last_fullsized":"2024-04-25T02:29:18.354443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:14.025149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345264+0000","last_change":"2024-04-25T02:29:18.342571+0000","last_active":"2024-04-25T02:29:18.345264+0000","last_peered":"2024-04-25T02:29:18.345264+0000","last_clean":"2024-04-25T02:29:18.345264+0000","last_became_active":"2024-04-25T02:29:18.341248+0000","last_became_peered":"2024-04-25T02:29:18.341248+0000","last_unstale":"2024-04-25T02:29:18.345264+0000","last_undegraded":"2024-04-25T02:29:18.345264+0000","last_fullsized":"2024-04-25T02:29:18.345264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:37.293554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354254+0000","last_change":"2024-04-25T02:29:18.348376+0000","last_active":"2024-04-25T02:29:18.354254+0000","last_peered":"2024-04-25T02:29:18.354254+0000","last_clean":"2024-04-25T02:29:18.354254+0000","last_became_active":"2024-04-25T02:29:18.347730+0000","last_became_peered":"2024-04-25T02:29:18.347730+0000","last_unstale":"2024-04-25T02:29:18.354254+0000","last_undegraded":"2024-04-25T02:29:18.354254+0000","last_fullsized":"2024-04-25T02:29:18.354254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:30.728990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345232+0000","last_change":"2024-04-25T02:29:18.344161+0000","last_active":"2024-04-25T02:29:18.345232+0000","last_peered":"2024-04-25T02:29:18.345232+0000","last_clean":"2024-04-25T02:29:18.345232+0000","last_became_active":"2024-04-25T02:29:18.343890+0000","last_became_peered":"2024-04-25T02:29:18.343890+0000","last_unstale":"2024-04-25T02:29:18.345232+0000","last_undegraded":"2024-04-25T02:29:18.345232+0000","last_fullsized":"2024-04-25T02:29:18.345232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:14.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352113+0000","last_change":"2024-04-25T02:29:17.336150+0000","last_active":"2024-04-25T02:29:18.352113+0000","last_peered":"2024-04-25T02:29:18.352113+0000","last_clean":"2024-04-25T02:29:18.352113+0000","last_became_active":"2024-04-25T02:29:17.335858+0000","last_became_peered":"2024-04-25T02:29:17.335858+0000","last_unstale":"2024-04-25T02:29:18.352113+0000","last_undegraded":"2024-04-25T02:29:18.352113+0000","last_fullsized":"2024-04-25T02:29:18.352113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:22.380376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345244+0000","last_change":"2024-04-25T02:29:18.344188+0000","last_active":"2024-04-25T02:29:18.345244+0000","last_peered":"2024-04-25T02:29:18.345244+0000","last_clean":"2024-04-25T02:29:18.345244+0000","last_became_active":"2024-04-25T02:29:18.343887+0000","last_became_peered":"2024-04-25T02:29:18.343887+0000","last_unstale":"2024-04-25T02:29:18.345244+0000","last_undegraded":"2024-04-25T02:29:18.345244+0000","last_fullsized":"2024-04-25T02:29:18.345244+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:14.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.344334+0000","last_change":"2024-04-25T02:29:17.338792+0000","last_active":"2024-04-25T02:29:18.344334+0000","last_peered":"2024-04-25T02:29:18.344334+0000","last_clean":"2024-04-25T02:29:18.344334+0000","last_became_active":"2024-04-25T02:29:17.338431+0000","last_became_peered":"2024-04-25T02:29:17.338431+0000","last_unstale":"2024-04-25T02:29:18.344334+0000","last_undegraded":"2024-04-25T02:29:18.344334+0000","last_fullsized":"2024-04-25T02:29:18.344334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:37:20.446428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355215+0000","last_change":"2024-04-25T02:29:18.349592+0000","last_active":"2024-04-25T02:29:18.355215+0000","last_peered":"2024-04-25T02:29:18.355215+0000","last_clean":"2024-04-25T02:29:18.355215+0000","last_became_active":"2024-04-25T02:29:18.349296+0000","last_became_peered":"2024-04-25T02:29:18.349296+0000","last_unstale":"2024-04-25T02:29:18.355215+0000","last_undegraded":"2024-04-25T02:29:18.355215+0000","last_fullsized":"2024-04-25T02:29:18.355215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:25.036633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.358845+0000","last_change":"2024-04-25T02:29:17.343354+0000","last_active":"2024-04-25T02:29:18.358845+0000","last_peered":"2024-04-25T02:29:18.358845+0000","last_clean":"2024-04-25T02:29:18.358845+0000","last_became_active":"2024-04-25T02:29:17.343032+0000","last_became_peered":"2024-04-25T02:29:17.343032+0000","last_unstale":"2024-04-25T02:29:18.358845+0000","last_undegraded":"2024-04-25T02:29:18.358845+0000","last_fullsized":"2024-04-25T02:29:18.358845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:17.984215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354469+0000","last_change":"2024-04-25T02:29:18.354469+0000","last_active":"2024-04-25T02:29:18.354469+0000","last_peered":"2024-04-25T02:29:18.354469+0000","last_clean":"2024-04-25T02:29:18.354469+0000","last_became_active":"2024-04-25T02:29:18.354133+0000","last_became_peered":"2024-04-25T02:29:18.354133+0000","last_unstale":"2024-04-25T02:29:18.354469+0000","last_undegraded":"2024-04-25T02:29:18.354469+0000","last_fullsized":"2024-04-25T02:29:18.354469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.356147+0000","last_change":"2024-04-25T02:29:17.343565+0000","last_active":"2024-04-25T02:29:18.356147+0000","last_peered":"2024-04-25T02:29:18.356147+0000","last_clean":"2024-04-25T02:29:18.356147+0000","last_became_active":"2024-04-25T02:29:17.343267+0000","last_became_peered":"2024-04-25T02:29:17.343267+0000","last_unstale":"2024-04-25T02:29:18.356147+0000","last_undegraded":"2024-04-25T02:29:18.356147+0000","last_fullsized":"2024-04-25T02:29:18.356147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:58.779414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354465+0000","last_change":"2024-04-25T02:29:18.349899+0000","last_active":"2024-04-25T02:29:18.354465+0000","last_peered":"2024-04-25T02:29:18.354465+0000","last_clean":"2024-04-25T02:29:18.354465+0000","last_became_active":"2024-04-25T02:29:18.349625+0000","last_became_peered":"2024-04-25T02:29:18.349625+0000","last_unstale":"2024-04-25T02:29:18.354465+0000","last_undegraded":"2024-04-25T02:29:18.354465+0000","last_fullsized":"2024-04-25T02:29:18.354465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:20.085001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354265+0000","last_change":"2024-04-25T02:29:17.345642+0000","last_active":"2024-04-25T02:29:18.354265+0000","last_peered":"2024-04-25T02:29:18.354265+0000","last_clean":"2024-04-25T02:29:18.354265+0000","last_became_active":"2024-04-25T02:29:17.345311+0000","last_became_peered":"2024-04-25T02:29:17.345311+0000","last_unstale":"2024-04-25T02:29:18.354265+0000","last_undegraded":"2024-04-25T02:29:18.354265+0000","last_fullsized":"2024-04-25T02:29:18.354265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:48.636227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.347858+0000","last_change":"2024-04-25T02:29:18.342591+0000","last_active":"2024-04-25T02:29:18.347858+0000","last_peered":"2024-04-25T02:29:18.347858+0000","last_clean":"2024-04-25T02:29:18.347858+0000","last_became_active":"2024-04-25T02:29:18.341689+0000","last_became_peered":"2024-04-25T02:29:18.341689+0000","last_unstale":"2024-04-25T02:29:18.347858+0000","last_undegraded":"2024-04-25T02:29:18.347858+0000","last_fullsized":"2024-04-25T02:29:18.347858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:23.649134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354267+0000","last_change":"2024-04-25T02:29:17.345509+0000","last_active":"2024-04-25T02:29:18.354267+0000","last_peered":"2024-04-25T02:29:18.354267+0000","last_clean":"2024-04-25T02:29:18.354267+0000","last_became_active":"2024-04-25T02:29:17.345209+0000","last_became_peered":"2024-04-25T02:29:17.345209+0000","last_unstale":"2024-04-25T02:29:18.354267+0000","last_undegraded":"2024-04-25T02:29:18.354267+0000","last_fullsized":"2024-04-25T02:29:18.354267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:26.682356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345496+0000","last_change":"2024-04-25T02:29:18.334322+0000","last_active":"2024-04-25T02:29:18.345496+0000","last_peered":"2024-04-25T02:29:18.345496+0000","last_clean":"2024-04-25T02:29:18.345496+0000","last_became_active":"2024-04-25T02:29:18.334017+0000","last_became_peered":"2024-04-25T02:29:18.334017+0000","last_unstale":"2024-04-25T02:29:18.345496+0000","last_undegraded":"2024-04-25T02:29:18.345496+0000","last_fullsized":"2024-04-25T02:29:18.345496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:03:39.193545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.325803+0000","last_change":"2024-04-25T02:29:17.344030+0000","last_active":"2024-04-25T02:29:18.325803+0000","last_peered":"2024-04-25T02:29:18.325803+0000","last_clean":"2024-04-25T02:29:18.325803+0000","last_became_active":"2024-04-25T02:29:17.343766+0000","last_became_peered":"2024-04-25T02:29:17.343766+0000","last_unstale":"2024-04-25T02:29:18.325803+0000","last_undegraded":"2024-04-25T02:29:18.325803+0000","last_fullsized":"2024-04-25T02:29:18.325803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:32.364305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352367+0000","last_change":"2024-04-25T02:29:18.352367+0000","last_active":"2024-04-25T02:29:18.352367+0000","last_peered":"2024-04-25T02:29:18.352367+0000","last_clean":"2024-04-25T02:29:18.352367+0000","last_became_active":"2024-04-25T02:29:18.351998+0000","last_became_peered":"2024-04-25T02:29:18.351998+0000","last_unstale":"2024-04-25T02:29:18.352367+0000","last_undegraded":"2024-04-25T02:29:18.352367+0000","last_fullsized":"2024-04-25T02:29:18.352367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:23.649134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327586+0000","last_change":"2024-04-25T02:29:17.335287+0000","last_active":"2024-04-25T02:29:18.327586+0000","last_peered":"2024-04-25T02:29:18.327586+0000","last_clean":"2024-04-25T02:29:18.327586+0000","last_became_active":"2024-04-25T02:29:17.334613+0000","last_became_peered":"2024-04-25T02:29:17.334613+0000","last_unstale":"2024-04-25T02:29:18.327586+0000","last_undegraded":"2024-04-25T02:29:18.327586+0000","last_fullsized":"2024-04-25T02:29:18.327586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:24.711459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351260+0000","last_change":"2024-04-25T02:29:18.345717+0000","last_active":"2024-04-25T02:29:18.351260+0000","last_peered":"2024-04-25T02:29:18.351260+0000","last_clean":"2024-04-25T02:29:18.351260+0000","last_became_active":"2024-04-25T02:29:18.345430+0000","last_became_peered":"2024-04-25T02:29:18.345430+0000","last_unstale":"2024-04-25T02:29:18.351260+0000","last_undegraded":"2024-04-25T02:29:18.351260+0000","last_fullsized":"2024-04-25T02:29:18.351260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:18.991459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327056+0000","last_change":"2024-04-25T02:29:17.344786+0000","last_active":"2024-04-25T02:29:18.327056+0000","last_peered":"2024-04-25T02:29:18.327056+0000","last_clean":"2024-04-25T02:29:18.327056+0000","last_became_active":"2024-04-25T02:29:17.344395+0000","last_became_peered":"2024-04-25T02:29:17.344395+0000","last_unstale":"2024-04-25T02:29:18.327056+0000","last_undegraded":"2024-04-25T02:29:18.327056+0000","last_fullsized":"2024-04-25T02:29:18.327056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:12.515961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352117+0000","last_change":"2024-04-25T02:29:18.344217+0000","last_active":"2024-04-25T02:29:18.352117+0000","last_peered":"2024-04-25T02:29:18.352117+0000","last_clean":"2024-04-25T02:29:18.352117+0000","last_became_active":"2024-04-25T02:29:18.343885+0000","last_became_peered":"2024-04-25T02:29:18.343885+0000","last_unstale":"2024-04-25T02:29:18.352117+0000","last_undegraded":"2024-04-25T02:29:18.352117+0000","last_fullsized":"2024-04-25T02:29:18.352117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:20.085001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.333144+0000","last_change":"2024-04-25T02:29:17.344529+0000","last_active":"2024-04-25T02:29:18.333144+0000","last_peered":"2024-04-25T02:29:18.333144+0000","last_clean":"2024-04-25T02:29:18.333144+0000","last_became_active":"2024-04-25T02:29:17.344194+0000","last_became_peered":"2024-04-25T02:29:17.344194+0000","last_unstale":"2024-04-25T02:29:18.333144+0000","last_undegraded":"2024-04-25T02:29:18.333144+0000","last_fullsized":"2024-04-25T02:29:18.333144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:03:38.186300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353217+0000","last_change":"2024-04-25T02:29:18.350354+0000","last_active":"2024-04-25T02:29:18.353217+0000","last_peered":"2024-04-25T02:29:18.353217+0000","last_clean":"2024-04-25T02:29:18.353217+0000","last_became_active":"2024-04-25T02:29:18.350033+0000","last_became_peered":"2024-04-25T02:29:18.350033+0000","last_unstale":"2024-04-25T02:29:18.353217+0000","last_undegraded":"2024-04-25T02:29:18.353217+0000","last_fullsized":"2024-04-25T02:29:18.353217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:14.176273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351349+0000","last_change":"2024-04-25T02:29:17.339319+0000","last_active":"2024-04-25T02:29:18.351349+0000","last_peered":"2024-04-25T02:29:18.351349+0000","last_clean":"2024-04-25T02:29:18.351349+0000","last_became_active":"2024-04-25T02:29:17.339013+0000","last_became_peered":"2024-04-25T02:29:17.339013+0000","last_unstale":"2024-04-25T02:29:18.351349+0000","last_undegraded":"2024-04-25T02:29:18.351349+0000","last_fullsized":"2024-04-25T02:29:18.351349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:24.029388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351408+0000","last_change":"2024-04-25T02:29:18.345320+0000","last_active":"2024-04-25T02:29:18.351408+0000","last_peered":"2024-04-25T02:29:18.351408+0000","last_clean":"2024-04-25T02:29:18.351408+0000","last_became_active":"2024-04-25T02:29:18.345005+0000","last_became_peered":"2024-04-25T02:29:18.345005+0000","last_unstale":"2024-04-25T02:29:18.351408+0000","last_undegraded":"2024-04-25T02:29:18.351408+0000","last_fullsized":"2024-04-25T02:29:18.351408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'5","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.358670+0000","last_change":"2024-04-25T02:29:17.347025+0000","last_active":"2024-04-25T02:29:18.358670+0000","last_peered":"2024-04-25T02:29:18.358670+0000","last_clean":"2024-04-25T02:29:18.358670+0000","last_became_active":"2024-04-25T02:29:17.346724+0000","last_became_peered":"2024-04-25T02:29:17.346724+0000","last_unstale":"2024-04-25T02:29:18.358670+0000","last_undegraded":"2024-04-25T02:29:18.358670+0000","last_fullsized":"2024-04-25T02:29:18.358670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:13.727317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351533+0000","last_change":"2024-04-25T02:29:18.349195+0000","last_active":"2024-04-25T02:29:18.351533+0000","last_peered":"2024-04-25T02:29:18.351533+0000","last_clean":"2024-04-25T02:29:18.351533+0000","last_became_active":"2024-04-25T02:29:18.348904+0000","last_became_peered":"2024-04-25T02:29:18.348904+0000","last_unstale":"2024-04-25T02:29:18.351533+0000","last_undegraded":"2024-04-25T02:29:18.351533+0000","last_fullsized":"2024-04-25T02:29:18.351533+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:33.371549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355170+0000","last_change":"2024-04-25T02:29:17.333661+0000","last_active":"2024-04-25T02:29:18.355170+0000","last_peered":"2024-04-25T02:29:18.355170+0000","last_clean":"2024-04-25T02:29:18.355170+0000","last_became_active":"2024-04-25T02:29:17.333166+0000","last_became_peered":"2024-04-25T02:29:17.333166+0000","last_unstale":"2024-04-25T02:29:18.355170+0000","last_undegraded":"2024-04-25T02:29:18.355170+0000","last_fullsized":"2024-04-25T02:29:18.355170+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:37:20.446428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.358071+0000","last_change":"2024-04-25T02:29:18.351870+0000","last_active":"2024-04-25T02:29:18.358071+0000","last_peered":"2024-04-25T02:29:18.358071+0000","last_clean":"2024-04-25T02:29:18.358071+0000","last_became_active":"2024-04-25T02:29:18.347590+0000","last_became_peered":"2024-04-25T02:29:18.347590+0000","last_unstale":"2024-04-25T02:29:18.358071+0000","last_undegraded":"2024-04-25T02:29:18.358071+0000","last_fullsized":"2024-04-25T02:29:18.358071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:43.238638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.332322+0000","last_change":"2024-04-25T02:29:17.340109+0000","last_active":"2024-04-25T02:29:18.332322+0000","last_peered":"2024-04-25T02:29:18.332322+0000","last_clean":"2024-04-25T02:29:18.332322+0000","last_became_active":"2024-04-25T02:29:17.339787+0000","last_became_peered":"2024-04-25T02:29:17.339787+0000","last_unstale":"2024-04-25T02:29:18.332322+0000","last_undegraded":"2024-04-25T02:29:18.332322+0000","last_fullsized":"2024-04-25T02:29:18.332322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:24.525150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354229+0000","last_change":"2024-04-25T02:29:18.348361+0000","last_active":"2024-04-25T02:29:18.354229+0000","last_peered":"2024-04-25T02:29:18.354229+0000","last_clean":"2024-04-25T02:29:18.354229+0000","last_became_active":"2024-04-25T02:29:18.347942+0000","last_became_peered":"2024-04-25T02:29:18.347942+0000","last_unstale":"2024-04-25T02:29:18.354229+0000","last_undegraded":"2024-04-25T02:29:18.354229+0000","last_fullsized":"2024-04-25T02:29:18.354229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:18.991459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.325957+0000","last_change":"2024-04-25T02:29:17.344628+0000","last_active":"2024-04-25T02:29:18.325957+0000","last_peered":"2024-04-25T02:29:18.325957+0000","last_clean":"2024-04-25T02:29:18.325957+0000","last_became_active":"2024-04-25T02:29:17.344358+0000","last_became_peered":"2024-04-25T02:29:17.344358+0000","last_unstale":"2024-04-25T02:29:18.325957+0000","last_undegraded":"2024-04-25T02:29:18.325957+0000","last_fullsized":"2024-04-25T02:29:18.325957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:22.641889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345282+0000","last_change":"2024-04-25T02:29:18.344070+0000","last_active":"2024-04-25T02:29:18.345282+0000","last_peered":"2024-04-25T02:29:18.345282+0000","last_clean":"2024-04-25T02:29:18.345282+0000","last_became_active":"2024-04-25T02:29:18.343693+0000","last_became_peered":"2024-04-25T02:29:18.343693+0000","last_unstale":"2024-04-25T02:29:18.345282+0000","last_undegraded":"2024-04-25T02:29:18.345282+0000","last_fullsized":"2024-04-25T02:29:18.345282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:25.036633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.359172+0000","last_change":"2024-04-25T02:29:17.347108+0000","last_active":"2024-04-25T02:29:18.359172+0000","last_peered":"2024-04-25T02:29:18.359172+0000","last_clean":"2024-04-25T02:29:18.359172+0000","last_became_active":"2024-04-25T02:29:17.346804+0000","last_became_peered":"2024-04-25T02:29:17.346804+0000","last_unstale":"2024-04-25T02:29:18.359172+0000","last_undegraded":"2024-04-25T02:29:18.359172+0000","last_fullsized":"2024-04-25T02:29:18.359172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:47.231152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354232+0000","last_change":"2024-04-25T02:29:18.346263+0000","last_active":"2024-04-25T02:29:18.354232+0000","last_peered":"2024-04-25T02:29:18.354232+0000","last_clean":"2024-04-25T02:29:18.354232+0000","last_became_active":"2024-04-25T02:29:18.345025+0000","last_became_peered":"2024-04-25T02:29:18.345025+0000","last_unstale":"2024-04-25T02:29:18.354232+0000","last_undegraded":"2024-04-25T02:29:18.354232+0000","last_fullsized":"2024-04-25T02:29:18.354232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:37.293554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354159+0000","last_change":"2024-04-25T02:29:17.344650+0000","last_active":"2024-04-25T02:29:18.354159+0000","last_peered":"2024-04-25T02:29:18.354159+0000","last_clean":"2024-04-25T02:29:18.354159+0000","last_became_active":"2024-04-25T02:29:17.344289+0000","last_became_peered":"2024-04-25T02:29:17.344289+0000","last_unstale":"2024-04-25T02:29:18.354159+0000","last_undegraded":"2024-04-25T02:29:18.354159+0000","last_fullsized":"2024-04-25T02:29:18.354159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:36.286309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351371+0000","last_change":"2024-04-25T02:29:18.346031+0000","last_active":"2024-04-25T02:29:18.351371+0000","last_peered":"2024-04-25T02:29:18.351371+0000","last_clean":"2024-04-25T02:29:18.351371+0000","last_became_active":"2024-04-25T02:29:18.344184+0000","last_became_peered":"2024-04-25T02:29:18.344184+0000","last_unstale":"2024-04-25T02:29:18.351371+0000","last_undegraded":"2024-04-25T02:29:18.351371+0000","last_fullsized":"2024-04-25T02:29:18.351371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:30.728990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348015+0000","last_change":"2024-04-25T02:29:17.333575+0000","last_active":"2024-04-25T02:29:18.348015+0000","last_peered":"2024-04-25T02:29:18.348015+0000","last_clean":"2024-04-25T02:29:18.348015+0000","last_became_active":"2024-04-25T02:29:17.333263+0000","last_became_peered":"2024-04-25T02:29:17.333263+0000","last_unstale":"2024-04-25T02:29:18.348015+0000","last_undegraded":"2024-04-25T02:29:18.348015+0000","last_fullsized":"2024-04-25T02:29:18.348015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:17.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355310+0000","last_change":"2024-04-25T02:29:18.355310+0000","last_active":"2024-04-25T02:29:18.355310+0000","last_peered":"2024-04-25T02:29:18.355310+0000","last_clean":"2024-04-25T02:29:18.355310+0000","last_became_active":"2024-04-25T02:29:18.354835+0000","last_became_peered":"2024-04-25T02:29:18.354835+0000","last_unstale":"2024-04-25T02:29:18.355310+0000","last_undegraded":"2024-04-25T02:29:18.355310+0000","last_fullsized":"2024-04-25T02:29:18.355310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:30.728990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348745+0000","last_change":"2024-04-25T02:29:17.336493+0000","last_active":"2024-04-25T02:29:18.348745+0000","last_peered":"2024-04-25T02:29:18.348745+0000","last_clean":"2024-04-25T02:29:18.348745+0000","last_became_active":"2024-04-25T02:29:17.336162+0000","last_became_peered":"2024-04-25T02:29:17.336162+0000","last_unstale":"2024-04-25T02:29:18.348745+0000","last_undegraded":"2024-04-25T02:29:18.348745+0000","last_fullsized":"2024-04-25T02:29:18.348745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:30.373010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.342175+0000","last_change":"2024-04-25T02:29:18.337364+0000","last_active":"2024-04-25T02:29:18.342175+0000","last_peered":"2024-04-25T02:29:18.342175+0000","last_clean":"2024-04-25T02:29:18.342175+0000","last_became_active":"2024-04-25T02:29:18.336958+0000","last_became_peered":"2024-04-25T02:29:18.336958+0000","last_unstale":"2024-04-25T02:29:18.342175+0000","last_undegraded":"2024-04-25T02:29:18.342175+0000","last_fullsized":"2024-04-25T02:29:18.342175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:03:23.356365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327792+0000","last_change":"2024-04-25T02:29:17.345750+0000","last_active":"2024-04-25T02:29:18.327792+0000","last_peered":"2024-04-25T02:29:18.327792+0000","last_clean":"2024-04-25T02:29:18.327792+0000","last_became_active":"2024-04-25T02:29:17.345215+0000","last_became_peered":"2024-04-25T02:29:17.345215+0000","last_unstale":"2024-04-25T02:29:18.327792+0000","last_undegraded":"2024-04-25T02:29:18.327792+0000","last_fullsized":"2024-04-25T02:29:18.327792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:43:25.978582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.346132+0000","last_change":"2024-04-25T02:29:18.344512+0000","last_active":"2024-04-25T02:29:18.346132+0000","last_peered":"2024-04-25T02:29:18.346132+0000","last_clean":"2024-04-25T02:29:18.346132+0000","last_became_active":"2024-04-25T02:29:18.344002+0000","last_became_peered":"2024-04-25T02:29:18.344002+0000","last_unstale":"2024-04-25T02:29:18.346132+0000","last_undegraded":"2024-04-25T02:29:18.346132+0000","last_fullsized":"2024-04-25T02:29:18.346132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:18.639956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348772+0000","last_change":"2024-04-25T02:29:17.336327+0000","last_active":"2024-04-25T02:29:18.348772+0000","last_peered":"2024-04-25T02:29:18.348772+0000","last_clean":"2024-04-25T02:29:18.348772+0000","last_became_active":"2024-04-25T02:29:17.336061+0000","last_became_peered":"2024-04-25T02:29:17.336061+0000","last_unstale":"2024-04-25T02:29:18.348772+0000","last_undegraded":"2024-04-25T02:29:18.348772+0000","last_fullsized":"2024-04-25T02:29:18.348772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:22.380376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.342305+0000","last_change":"2024-04-25T02:29:18.338302+0000","last_active":"2024-04-25T02:29:18.342305+0000","last_peered":"2024-04-25T02:29:18.342305+0000","last_clean":"2024-04-25T02:29:18.342305+0000","last_became_active":"2024-04-25T02:29:18.338039+0000","last_became_peered":"2024-04-25T02:29:18.338039+0000","last_unstale":"2024-04-25T02:29:18.342305+0000","last_undegraded":"2024-04-25T02:29:18.342305+0000","last_fullsized":"2024-04-25T02:29:18.342305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:32.654953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.332282+0000","last_change":"2024-04-25T02:29:17.343462+0000","last_active":"2024-04-25T02:29:18.332282+0000","last_peered":"2024-04-25T02:29:18.332282+0000","last_clean":"2024-04-25T02:29:18.332282+0000","last_became_active":"2024-04-25T02:29:17.343181+0000","last_became_peered":"2024-04-25T02:29:17.343181+0000","last_unstale":"2024-04-25T02:29:18.332282+0000","last_undegraded":"2024-04-25T02:29:18.332282+0000","last_fullsized":"2024-04-25T02:29:18.332282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:52.327814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.342356+0000","last_change":"2024-04-25T02:29:18.338928+0000","last_active":"2024-04-25T02:29:18.342356+0000","last_peered":"2024-04-25T02:29:18.342356+0000","last_clean":"2024-04-25T02:29:18.342356+0000","last_became_active":"2024-04-25T02:29:18.338673+0000","last_became_peered":"2024-04-25T02:29:18.338673+0000","last_unstale":"2024-04-25T02:29:18.342356+0000","last_undegraded":"2024-04-25T02:29:18.342356+0000","last_fullsized":"2024-04-25T02:29:18.342356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:27.689600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327668+0000","last_change":"2024-04-25T02:29:17.335254+0000","last_active":"2024-04-25T02:29:18.327668+0000","last_peered":"2024-04-25T02:29:18.327668+0000","last_clean":"2024-04-25T02:29:18.327668+0000","last_became_active":"2024-04-25T02:29:17.334973+0000","last_became_peered":"2024-04-25T02:29:17.334973+0000","last_unstale":"2024-04-25T02:29:18.327668+0000","last_undegraded":"2024-04-25T02:29:18.327668+0000","last_fullsized":"2024-04-25T02:29:18.327668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:59.526492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351369+0000","last_change":"2024-04-25T02:29:18.347506+0000","last_active":"2024-04-25T02:29:18.351369+0000","last_peered":"2024-04-25T02:29:18.351369+0000","last_clean":"2024-04-25T02:29:18.351369+0000","last_became_active":"2024-04-25T02:29:18.347214+0000","last_became_peered":"2024-04-25T02:29:18.347214+0000","last_unstale":"2024-04-25T02:29:18.351369+0000","last_undegraded":"2024-04-25T02:29:18.351369+0000","last_fullsized":"2024-04-25T02:29:18.351369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:14.734561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.329668+0000","last_change":"2024-04-25T02:29:17.341124+0000","last_active":"2024-04-25T02:29:18.329668+0000","last_peered":"2024-04-25T02:29:18.329668+0000","last_clean":"2024-04-25T02:29:18.329668+0000","last_became_active":"2024-04-25T02:29:17.340870+0000","last_became_peered":"2024-04-25T02:29:17.340870+0000","last_unstale":"2024-04-25T02:29:18.329668+0000","last_undegraded":"2024-04-25T02:29:18.329668+0000","last_fullsized":"2024-04-25T02:29:18.329668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:36.286309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.347598+0000","last_change":"2024-04-25T02:29:18.346689+0000","last_active":"2024-04-25T02:29:18.347598+0000","last_peered":"2024-04-25T02:29:18.347598+0000","last_clean":"2024-04-25T02:29:18.347598+0000","last_became_active":"2024-04-25T02:29:18.346385+0000","last_became_peered":"2024-04-25T02:29:18.346385+0000","last_unstale":"2024-04-25T02:29:18.347598+0000","last_undegraded":"2024-04-25T02:29:18.347598+0000","last_fullsized":"2024-04-25T02:29:18.347598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:25.718704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355381+0000","last_change":"2024-04-25T02:29:17.341566+0000","last_active":"2024-04-25T02:29:18.355381+0000","last_peered":"2024-04-25T02:29:18.355381+0000","last_clean":"2024-04-25T02:29:18.355381+0000","last_became_active":"2024-04-25T02:29:17.341005+0000","last_became_peered":"2024-04-25T02:29:17.341005+0000","last_unstale":"2024-04-25T02:29:18.355381+0000","last_undegraded":"2024-04-25T02:29:18.355381+0000","last_fullsized":"2024-04-25T02:29:18.355381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:24.029388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351392+0000","last_change":"2024-04-25T02:29:18.346646+0000","last_active":"2024-04-25T02:29:18.351392+0000","last_peered":"2024-04-25T02:29:18.351392+0000","last_clean":"2024-04-25T02:29:18.351392+0000","last_became_active":"2024-04-25T02:29:18.346377+0000","last_became_peered":"2024-04-25T02:29:18.346377+0000","last_unstale":"2024-04-25T02:29:18.351392+0000","last_undegraded":"2024-04-25T02:29:18.351392+0000","last_fullsized":"2024-04-25T02:29:18.351392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:14.025149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.333287+0000","last_change":"2024-04-25T02:29:17.339450+0000","last_active":"2024-04-25T02:29:18.333287+0000","last_peered":"2024-04-25T02:29:18.333287+0000","last_clean":"2024-04-25T02:29:18.333287+0000","last_became_active":"2024-04-25T02:29:17.339041+0000","last_became_peered":"2024-04-25T02:29:17.339041+0000","last_unstale":"2024-04-25T02:29:18.333287+0000","last_undegraded":"2024-04-25T02:29:18.333287+0000","last_fullsized":"2024-04-25T02:29:18.333287+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:52.327814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345051+0000","last_change":"2024-04-25T02:29:18.343320+0000","last_active":"2024-04-25T02:29:18.345051+0000","last_peered":"2024-04-25T02:29:18.345051+0000","last_clean":"2024-04-25T02:29:18.345051+0000","last_became_active":"2024-04-25T02:29:18.343045+0000","last_became_peered":"2024-04-25T02:29:18.343045+0000","last_unstale":"2024-04-25T02:29:18.345051+0000","last_undegraded":"2024-04-25T02:29:18.345051+0000","last_fullsized":"2024-04-25T02:29:18.345051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:25.036633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.337918+0000","last_change":"2024-04-25T02:29:17.338937+0000","last_active":"2024-04-25T02:29:18.337918+0000","last_peered":"2024-04-25T02:29:18.337918+0000","last_clean":"2024-04-25T02:29:18.337918+0000","last_became_active":"2024-04-25T02:29:17.338636+0000","last_became_peered":"2024-04-25T02:29:17.338636+0000","last_unstale":"2024-04-25T02:29:18.337918+0000","last_undegraded":"2024-04-25T02:29:18.337918+0000","last_fullsized":"2024-04-25T02:29:18.337918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:13.412200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.344836+0000","last_change":"2024-04-25T02:29:18.341511+0000","last_active":"2024-04-25T02:29:18.344836+0000","last_peered":"2024-04-25T02:29:18.344836+0000","last_clean":"2024-04-25T02:29:18.344836+0000","last_became_active":"2024-04-25T02:29:18.341233+0000","last_became_peered":"2024-04-25T02:29:18.341233+0000","last_unstale":"2024-04-25T02:29:18.344836+0000","last_undegraded":"2024-04-25T02:29:18.344836+0000","last_fullsized":"2024-04-25T02:29:18.344836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:25.532394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.335068+0000","last_change":"2024-04-25T02:29:17.335618+0000","last_active":"2024-04-25T02:29:18.335068+0000","last_peered":"2024-04-25T02:29:18.335068+0000","last_clean":"2024-04-25T02:29:18.335068+0000","last_became_active":"2024-04-25T02:29:17.335113+0000","last_became_peered":"2024-04-25T02:29:17.335113+0000","last_unstale":"2024-04-25T02:29:18.335068+0000","last_undegraded":"2024-04-25T02:29:18.335068+0000","last_fullsized":"2024-04-25T02:29:18.335068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:24.525150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345451+0000","last_change":"2024-04-25T02:29:18.343189+0000","last_active":"2024-04-25T02:29:18.345451+0000","last_peered":"2024-04-25T02:29:18.345451+0000","last_clean":"2024-04-25T02:29:18.345451+0000","last_became_active":"2024-04-25T02:29:18.342880+0000","last_became_peered":"2024-04-25T02:29:18.342880+0000","last_unstale":"2024-04-25T02:29:18.345451+0000","last_undegraded":"2024-04-25T02:29:18.345451+0000","last_fullsized":"2024-04-25T02:29:18.345451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:37.293554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.332320+0000","last_change":"2024-04-25T02:29:17.342369+0000","last_active":"2024-04-25T02:29:18.332320+0000","last_peered":"2024-04-25T02:29:18.332320+0000","last_clean":"2024-04-25T02:29:18.332320+0000","last_became_active":"2024-04-25T02:29:17.342038+0000","last_became_peered":"2024-04-25T02:29:17.342038+0000","last_unstale":"2024-04-25T02:29:18.332320+0000","last_undegraded":"2024-04-25T02:29:18.332320+0000","last_fullsized":"2024-04-25T02:29:18.332320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:22.380376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352267+0000","last_change":"2024-04-25T02:29:18.346427+0000","last_active":"2024-04-25T02:29:18.352267+0000","last_peered":"2024-04-25T02:29:18.352267+0000","last_clean":"2024-04-25T02:29:18.352267+0000","last_became_active":"2024-04-25T02:29:18.344252+0000","last_became_peered":"2024-04-25T02:29:18.344252+0000","last_unstale":"2024-04-25T02:29:18.352267+0000","last_undegraded":"2024-04-25T02:29:18.352267+0000","last_fullsized":"2024-04-25T02:29:18.352267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:50.388712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327838+0000","last_change":"2024-04-25T02:29:17.334132+0000","last_active":"2024-04-25T02:29:18.327838+0000","last_peered":"2024-04-25T02:29:18.327838+0000","last_clean":"2024-04-25T02:29:18.327838+0000","last_became_active":"2024-04-25T02:29:17.333432+0000","last_became_peered":"2024-04-25T02:29:17.333432+0000","last_unstale":"2024-04-25T02:29:18.327838+0000","last_undegraded":"2024-04-25T02:29:18.327838+0000","last_fullsized":"2024-04-25T02:29:18.327838+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:12:36.993064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355265+0000","last_change":"2024-04-25T02:29:18.350496+0000","last_active":"2024-04-25T02:29:18.355265+0000","last_peered":"2024-04-25T02:29:18.355265+0000","last_clean":"2024-04-25T02:29:18.355265+0000","last_became_active":"2024-04-25T02:29:18.350230+0000","last_became_peered":"2024-04-25T02:29:18.350230+0000","last_unstale":"2024-04-25T02:29:18.355265+0000","last_undegraded":"2024-04-25T02:29:18.355265+0000","last_fullsized":"2024-04-25T02:29:18.355265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:14.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.325543+0000","last_change":"2024-04-25T02:29:17.345243+0000","last_active":"2024-04-25T02:29:18.325543+0000","last_peered":"2024-04-25T02:29:18.325543+0000","last_clean":"2024-04-25T02:29:18.325543+0000","last_became_active":"2024-04-25T02:29:17.344978+0000","last_became_peered":"2024-04-25T02:29:17.344978+0000","last_unstale":"2024-04-25T02:29:18.325543+0000","last_undegraded":"2024-04-25T02:29:18.325543+0000","last_fullsized":"2024-04-25T02:29:18.325543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:13.412200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351382+0000","last_change":"2024-04-25T02:29:18.346721+0000","last_active":"2024-04-25T02:29:18.351382+0000","last_peered":"2024-04-25T02:29:18.351382+0000","last_clean":"2024-04-25T02:29:18.351382+0000","last_became_active":"2024-04-25T02:29:18.346444+0000","last_became_peered":"2024-04-25T02:29:18.346444+0000","last_unstale":"2024-04-25T02:29:18.351382+0000","last_undegraded":"2024-04-25T02:29:18.351382+0000","last_fullsized":"2024-04-25T02:29:18.351382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:23.649134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.331945+0000","last_change":"2024-04-25T02:29:17.336098+0000","last_active":"2024-04-25T02:29:18.331945+0000","last_peered":"2024-04-25T02:29:18.331945+0000","last_clean":"2024-04-25T02:29:18.331945+0000","last_became_active":"2024-04-25T02:29:17.335825+0000","last_became_peered":"2024-04-25T02:29:17.335825+0000","last_unstale":"2024-04-25T02:29:18.331945+0000","last_undegraded":"2024-04-25T02:29:18.331945+0000","last_fullsized":"2024-04-25T02:29:18.331945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:03:38.186300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.331621+0000","last_change":"2024-04-25T02:28:15.520345+0000","last_active":"2024-04-25T02:29:18.331621+0000","last_peered":"2024-04-25T02:29:18.331621+0000","last_clean":"2024-04-25T02:29:18.331621+0000","last_became_active":"2024-04-25T02:28:15.519317+0000","last_became_peered":"2024-04-25T02:28:15.519317+0000","last_unstale":"2024-04-25T02:29:18.331621+0000","last_undegraded":"2024-04-25T02:29:18.331621+0000","last_fullsized":"2024-04-25T02:29:18.331621+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_clean_scrub_stamp":"2024-04-25T02:28:14.374327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:20.125523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":723901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":723901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:29:22.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-04-25T02:29:22.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 6, 'reported_epoch': 32, 'state': 'active', 'last_fresh': '2024-04-25T02:29:18.355802+0000', 'last_change': '2024-04-25T02:29:18.355742+0000', 'last_active': '2024-04-25T02:29:18.355802+0000', 'last_peered': '2024-04-25T02:29:18.355802+0000', 'last_clean': '2024-04-25T02:29:17.313167+0000', 'last_became_active': '2024-04-25T02:29:18.355742+0000', 'last_became_peered': '2024-04-25T02:29:18.355742+0000', 'last_unstale': '2024-04-25T02:29:18.355802+0000', 'last_undegraded': '2024-04-25T02:29:18.355802+0000', 'last_fullsized': '2024-04-25T02:29:18.355802+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:29:17.313167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:29:17.313167+0000', 'last_clean_scrub_stamp': '2024-04-25T02:29:17.313167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': ['1', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:29:22.045 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T02:29:22.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.178+0000 7fe5764a5640 1 Processor -- start 2024-04-25T02:29:22.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.178+0000 7fe5764a5640 1 -- start start 2024-04-25T02:29:22.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.179+0000 7fe5764a5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe57015eab0 0x7fe5700b4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:22.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.179+0000 7fe5764a5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe5700d00b0 0x7fe5700d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:22.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.179+0000 7fe5764a5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe57015f9c0 con 0x7fe570072a90 2024-04-25T02:29:22.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.179+0000 7fe5764a5640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe5700d0a60 con 0x7fe5700d00b0 2024-04-25T02:29:22.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.179+0000 7fe5764a5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe5700b48d0 con 0x7fe57015eab0 2024-04-25T02:29:22.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.179+0000 7fe56ffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe570072a90 0x7fe570071b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57528/0 (socket says 172.21.15.67:57528) 2024-04-25T02:29:22.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.179+0000 7fe56ffff640 1 -- 172.21.15.67:0/558486072 learned_addr learned my addr 172.21.15.67:0/558486072 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:22.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.179+0000 7fe574a42640 1 --2- 172.21.15.67:0/558486072 >> v2:172.21.15.176:3300/0 conn(0x7fe5700d00b0 0x7fe5700d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:22.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.179+0000 7fe56f7fe640 1 --2- 172.21.15.67:0/558486072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe57015eab0 0x7fe5700b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:22.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.179+0000 7fe56effd640 1 -- 172.21.15.67:0/558486072 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 702459503 0 0) 0x7fe57015f9c0 con 0x7fe570072a90 2024-04-25T02:29:22.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.179+0000 7fe56effd640 1 -- 172.21.15.67:0/558486072 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe558003520 con 0x7fe570072a90 2024-04-25T02:29:22.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.179+0000 7fe56effd640 1 -- 172.21.15.67:0/558486072 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2392877748 0 0) 0x7fe558003520 con 0x7fe570072a90 2024-04-25T02:29:22.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.179+0000 7fe56effd640 1 -- 172.21.15.67:0/558486072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe57015eab0 msgr2=0x7fe5700b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:22.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.179+0000 7fe56effd640 1 --2- 172.21.15.67:0/558486072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe57015eab0 0x7fe5700b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.179+0000 7fe56effd640 1 -- 172.21.15.67:0/558486072 >> v2:172.21.15.176:3300/0 conn(0x7fe5700d00b0 msgr2=0x7fe5700d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:22.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.179+0000 7fe56effd640 1 --2- 172.21.15.67:0/558486072 >> v2:172.21.15.176:3300/0 conn(0x7fe5700d00b0 0x7fe5700d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.179+0000 7fe56effd640 1 -- 172.21.15.67:0/558486072 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe57015f120 con 0x7fe570072a90 2024-04-25T02:29:22.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.179+0000 7fe56effd640 1 -- 172.21.15.67:0/558486072 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7fe564001690 con 0x7fe570072a90 2024-04-25T02:29:22.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.180+0000 7fe56effd640 1 -- 172.21.15.67:0/558486072 >> v1:172.21.15.67:6789/0 conn(0x7fe570072a90 legacy=0x7fe570071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:22.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.180+0000 7fe56effd640 1 --2- 172.21.15.67:0/558486072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5580039b0 0x7fe558003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:22.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.180+0000 7fe56effd640 1 --2- 172.21.15.67:0/558486072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe57015eab0 0x7fe558004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:22.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.180+0000 7fe56effd640 1 --2- 172.21.15.67:0/558486072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe558004d40 0x7fe5580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:22.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.180+0000 7fe56effd640 1 -- 172.21.15.67:0/558486072 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe5700d0a60 con 0x7fe558004d40 2024-04-25T02:29:22.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.180+0000 7fe56effd640 1 -- 172.21.15.67:0/558486072 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe5700b48d0 con 0x7fe5580039b0 2024-04-25T02:29:22.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.180+0000 7fe56effd640 1 -- 172.21.15.67:0/558486072 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe55800b9c0 con 0x7fe57015eab0 2024-04-25T02:29:22.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.180+0000 7fe574a42640 1 --2- 172.21.15.67:0/558486072 >> v2:172.21.15.176:3300/0 conn(0x7fe5700d00b0 0x7fe5700d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:22.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.180+0000 7fe574a42640 1 --2- 172.21.15.67:0/558486072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe558004d40 0x7fe5580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.180+0000 7fe56f7fe640 1 --2- 172.21.15.67:0/558486072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe57015eab0 0x7fe558004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.180+0000 7fe56ffff640 1 --2- 172.21.15.67:0/558486072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5580039b0 0x7fe558003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.180+0000 7fe574a42640 1 -- 172.21.15.67:0/558486072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe57015eab0 msgr2=0x7fe558004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.180+0000 7fe574a42640 1 --2- 172.21.15.67:0/558486072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe57015eab0 0x7fe558004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.180+0000 7fe574a42640 1 -- 172.21.15.67:0/558486072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5580039b0 msgr2=0x7fe558003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.180+0000 7fe574a42640 1 --2- 172.21.15.67:0/558486072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5580039b0 0x7fe558003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.180+0000 7fe574a42640 1 -- 172.21.15.67:0/558486072 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe558003520 con 0x7fe558004d40 2024-04-25T02:29:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.181+0000 7fe574a42640 1 --2- 172.21.15.67:0/558486072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe558004d40 0x7fe5580051c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe56800e350 tx=0x7fe558005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ddc2e436d529c5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.181+0000 7fe56effd640 1 -- 172.21.15.67:0/558486072 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe568009dc0 con 0x7fe558004d40 2024-04-25T02:29:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.181+0000 7fe56effd640 1 -- 172.21.15.67:0/558486072 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe568003b90 con 0x7fe558004d40 2024-04-25T02:29:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.181+0000 7fe56effd640 1 -- 172.21.15.67:0/558486072 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe568004020 con 0x7fe558004d40 2024-04-25T02:29:22.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.181+0000 7fe5764a5640 1 -- 172.21.15.67:0/558486072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe558004d40 msgr2=0x7fe5580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:22.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.181+0000 7fe5764a5640 1 --2- 172.21.15.67:0/558486072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe558004d40 0x7fe5580051c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe56800e350 tx=0x7fe558005830 comp rx=0 tx=0).stop 2024-04-25T02:29:22.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.181+0000 7fe574a42640 1 -- 172.21.15.67:0/558486072 reap_dead start 2024-04-25T02:29:22.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.181+0000 7fe5764a5640 1 -- 172.21.15.67:0/558486072 shutdown_connections 2024-04-25T02:29:22.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.181+0000 7fe5764a5640 1 -- 172.21.15.67:0/558486072 >> 172.21.15.67:0/558486072 conn(0x7fe57006b4e0 msgr2=0x7fe57006b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:22.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.181+0000 7fe5764a5640 1 -- 172.21.15.67:0/558486072 shutdown_connections 2024-04-25T02:29:22.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.181+0000 7fe5764a5640 1 -- 172.21.15.67:0/558486072 wait complete. 2024-04-25T02:29:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.183+0000 7fe5764a5640 1 Processor -- start 2024-04-25T02:29:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.183+0000 7fe5764a5640 1 -- start start 2024-04-25T02:29:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.183+0000 7fe5764a5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5701f2030 0x7fe57013ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.183+0000 7fe5764a5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5700b1290 0x7fe57015dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.183+0000 7fe5764a5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe57015e320 0x7fe5701561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe5764a5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe57015b5d0 con 0x7fe5701f2030 2024-04-25T02:29:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe5764a5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe57015f6e0 con 0x7fe5700b1290 2024-04-25T02:29:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe5764a5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe570072290 con 0x7fe57015e320 2024-04-25T02:29:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe56ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5701f2030 0x7fe57013ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe56ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5701f2030 0x7fe57013ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49364/0 (socket says 172.21.15.67:49364) 2024-04-25T02:29:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe56ffff640 1 -- 172.21.15.67:0/545187064 learned_addr learned my addr 172.21.15.67:0/545187064 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe574a42640 1 --2- 172.21.15.67:0/545187064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe57015e320 0x7fe5701561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe56f7fe640 1 --2- 172.21.15.67:0/545187064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5700b1290 0x7fe57015dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe56ffff640 1 -- 172.21.15.67:0/545187064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe57015e320 msgr2=0x7fe5701561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe56ffff640 1 --2- 172.21.15.67:0/545187064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe57015e320 0x7fe5701561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe56ffff640 1 -- 172.21.15.67:0/545187064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5700b1290 msgr2=0x7fe57015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe56ffff640 1 --2- 172.21.15.67:0/545187064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5700b1290 0x7fe57015dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe56ffff640 1 -- 172.21.15.67:0/545187064 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5700b1a30 con 0x7fe5701f2030 2024-04-25T02:29:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe56ffff640 1 --2- 172.21.15.67:0/545187064 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5701f2030 0x7fe57013ec50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe564007290 tx=0x7fe564007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe56cff9640 1 -- 172.21.15.67:0/545187064 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56400f9c0 con 0x7fe5701f2030 2024-04-25T02:29:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe56cff9640 1 -- 172.21.15.67:0/545187064 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe564018070 con 0x7fe5701f2030 2024-04-25T02:29:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe5764a5640 1 -- 172.21.15.67:0/545187064 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5700b1d10 con 0x7fe5701f2030 2024-04-25T02:29:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe56cff9640 1 -- 172.21.15.67:0/545187064 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56400fde0 con 0x7fe5701f2030 2024-04-25T02:29:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.184+0000 7fe5764a5640 1 -- 172.21.15.67:0/545187064 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5700b22d0 con 0x7fe5701f2030 2024-04-25T02:29:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.185+0000 7fe5764a5640 1 -- 172.21.15.67:0/545187064 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe570069110 con 0x7fe5701f2030 2024-04-25T02:29:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.186+0000 7fe56cff9640 1 -- 172.21.15.67:0/545187064 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe56401d460 con 0x7fe5701f2030 2024-04-25T02:29:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.186+0000 7fe56cff9640 1 --2- 172.21.15.67:0/545187064 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe55c06be30 0x7fe55c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.186+0000 7fe56cff9640 1 -- 172.21.15.67:0/545187064 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe56408afd0 con 0x7fe5701f2030 2024-04-25T02:29:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.186+0000 7fe56f7fe640 1 --2- 172.21.15.67:0/545187064 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe55c06be30 0x7fe55c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:22.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.187+0000 7fe56f7fe640 1 --2- 172.21.15.67:0/545187064 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe55c06be30 0x7fe55c06e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe57006db90 tx=0x7fe560008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:22.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.191+0000 7fe56cff9640 1 -- 172.21.15.67:0/545187064 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe564059980 con 0x7fe5701f2030 2024-04-25T02:29:22.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.453+0000 7fe5764a5640 1 -- 172.21.15.67:0/545187064 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe57009daa0 con 0x7fe5701f2030 2024-04-25T02:29:22.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.454+0000 7fe56cff9640 1 -- 172.21.15.67:0/545187064 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1594 (secure 0 0 0) 0x7fe564059280 con 0x7fe5701f2030 2024-04-25T02:29:22.458 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:22.458 INFO:teuthology.orchestra.run.smithi067.stdout:{"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":80,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1714012093,"num_in_osds":8,"osd_in_since":1714012084,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":96},{"state_name":"active","count":1}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":591838,"bytes_used":225349632,"bytes_avail":772868763648,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":14,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5085}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-25T02:29:14.341923+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T02:29:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.456+0000 7fe5764a5640 1 -- 172.21.15.67:0/545187064 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe55c06be30 msgr2=0x7fe55c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.456+0000 7fe5764a5640 1 --2- 172.21.15.67:0/545187064 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe55c06be30 0x7fe55c06e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe57006db90 tx=0x7fe560008040 comp rx=0 tx=0).stop 2024-04-25T02:29:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.456+0000 7fe5764a5640 1 -- 172.21.15.67:0/545187064 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5701f2030 msgr2=0x7fe57013ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.456+0000 7fe5764a5640 1 --2- 172.21.15.67:0/545187064 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5701f2030 0x7fe57013ec50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe564007290 tx=0x7fe564007750 comp rx=0 tx=0).stop 2024-04-25T02:29:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.456+0000 7fe5764a5640 1 -- 172.21.15.67:0/545187064 shutdown_connections 2024-04-25T02:29:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.456+0000 7fe5764a5640 1 --2- 172.21.15.67:0/545187064 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe55c06be30 0x7fe55c06e2f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.456+0000 7fe5764a5640 1 --2- 172.21.15.67:0/545187064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe57015e320 0x7fe5701561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.456+0000 7fe5764a5640 1 --2- 172.21.15.67:0/545187064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5700b1290 0x7fe57015dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.456+0000 7fe5764a5640 1 --2- 172.21.15.67:0/545187064 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5701f2030 0x7fe57013ec50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.456+0000 7fe5764a5640 1 -- 172.21.15.67:0/545187064 >> 172.21.15.67:0/545187064 conn(0x7fe57006b4e0 msgr2=0x7fe5700ae610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:22.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.456+0000 7fe5764a5640 1 -- 172.21.15.67:0/545187064 shutdown_connections 2024-04-25T02:29:22.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.456+0000 7fe5764a5640 1 -- 172.21.15.67:0/545187064 wait complete. 2024-04-25T02:29:22.471 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T02:29:22.471 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:29:22.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.567+0000 7fb364329640 1 Processor -- start 2024-04-25T02:29:22.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.567+0000 7fb364329640 1 -- start start 2024-04-25T02:29:22.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.568+0000 7fb364329640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb35c15e210 0x7fb35c06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:22.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.568+0000 7fb364329640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb35c0cf3d0 0x7fb35c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:22.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.568+0000 7fb364329640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb35c0d2cc0 con 0x7fb35c15e5f0 2024-04-25T02:29:22.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.568+0000 7fb364329640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb35c06c6f0 con 0x7fb35c15e210 2024-04-25T02:29:22.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.568+0000 7fb364329640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb35c0d2fa0 con 0x7fb35c0cf3d0 2024-04-25T02:29:22.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.568+0000 7fb3620c5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb35c15e210 0x7fb35c06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:22.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.568+0000 7fb3620c5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb35c15e210 0x7fb35c06cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49372/0 (socket says 172.21.15.67:49372) 2024-04-25T02:29:22.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.568+0000 7fb3620c5640 1 -- 172.21.15.67:0/3673298219 learned_addr learned my addr 172.21.15.67:0/3673298219 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:22.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.569+0000 7fb3628c6640 1 --2- 172.21.15.67:0/3673298219 >> v2:172.21.15.176:3300/0 conn(0x7fb35c0cf3d0 0x7fb35c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:22.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.569+0000 7fb3620c5640 1 -- 172.21.15.67:0/3673298219 >> v2:172.21.15.176:3300/0 conn(0x7fb35c0cf3d0 msgr2=0x7fb35c06d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:22.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.569+0000 7fb3620c5640 1 --2- 172.21.15.67:0/3673298219 >> v2:172.21.15.176:3300/0 conn(0x7fb35c0cf3d0 0x7fb35c06d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.569+0000 7fb3620c5640 1 -- 172.21.15.67:0/3673298219 >> v1:172.21.15.176:6789/0 conn(0x7fb35c15e5f0 legacy=0x7fb35c0cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:22.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.569+0000 7fb3620c5640 1 -- 172.21.15.67:0/3673298219 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35c06c0a0 con 0x7fb35c15e210 2024-04-25T02:29:22.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.569+0000 7fb3620c5640 1 --2- 172.21.15.67:0/3673298219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb35c15e210 0x7fb35c06cb80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb35c08e0d0 tx=0x7fb35402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80727f84b85bf919 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:22.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.570+0000 7fb3610c3640 1 -- 172.21.15.67:0/3673298219 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354037070 con 0x7fb35c15e210 2024-04-25T02:29:22.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.570+0000 7fb3610c3640 1 -- 172.21.15.67:0/3673298219 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb354032440 con 0x7fb35c15e210 2024-04-25T02:29:22.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.570+0000 7fb3610c3640 1 -- 172.21.15.67:0/3673298219 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354032810 con 0x7fb35c15e210 2024-04-25T02:29:22.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.570+0000 7fb364329640 1 -- 172.21.15.67:0/3673298219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb35c15e210 msgr2=0x7fb35c06cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:22.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.570+0000 7fb364329640 1 --2- 172.21.15.67:0/3673298219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb35c15e210 0x7fb35c06cb80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb35c08e0d0 tx=0x7fb35402a270 comp rx=0 tx=0).stop 2024-04-25T02:29:22.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.570+0000 7fb364329640 1 -- 172.21.15.67:0/3673298219 shutdown_connections 2024-04-25T02:29:22.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.570+0000 7fb364329640 1 --2- 172.21.15.67:0/3673298219 >> v2:172.21.15.176:3300/0 conn(0x7fb35c0cf3d0 0x7fb35c06d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.570+0000 7fb364329640 1 --2- 172.21.15.67:0/3673298219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb35c15e210 0x7fb35c06cb80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.570+0000 7fb364329640 1 -- 172.21.15.67:0/3673298219 >> 172.21.15.67:0/3673298219 conn(0x7fb35c08dbb0 msgr2=0x7fb35c09d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:22.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.570+0000 7fb364329640 1 -- 172.21.15.67:0/3673298219 shutdown_connections 2024-04-25T02:29:22.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.570+0000 7fb364329640 1 -- 172.21.15.67:0/3673298219 wait complete. 2024-04-25T02:29:22.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.571+0000 7fb364329640 1 Processor -- start 2024-04-25T02:29:22.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.571+0000 7fb364329640 1 -- start start 2024-04-25T02:29:22.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.572+0000 7fb364329640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb35c0cf3d0 0x7fb35c1f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:22.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.572+0000 7fb364329640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb35c15e210 0x7fb35c0b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:22.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.572+0000 7fb364329640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb35c15e5f0 0x7fb35c15c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:22.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.572+0000 7fb364329640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb35c0d3fe0 con 0x7fb35c0cf3d0 2024-04-25T02:29:22.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.572+0000 7fb364329640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb35c0d3e60 con 0x7fb35c15e210 2024-04-25T02:29:22.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.572+0000 7fb364329640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb35c0d4160 con 0x7fb35c15e5f0 2024-04-25T02:29:22.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.572+0000 7fb3620c5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb35c0cf3d0 0x7fb35c1f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:22.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.572+0000 7fb3620c5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb35c0cf3d0 0x7fb35c1f44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49376/0 (socket says 172.21.15.67:49376) 2024-04-25T02:29:22.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.572+0000 7fb3620c5640 1 -- 172.21.15.67:0/2568930684 learned_addr learned my addr 172.21.15.67:0/2568930684 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:22.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.572+0000 7fb3628c6640 1 --2- 172.21.15.67:0/2568930684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb35c15e5f0 0x7fb35c15c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:22.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.572+0000 7fb3618c4640 1 --2- 172.21.15.67:0/2568930684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb35c15e210 0x7fb35c0b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:22.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.572+0000 7fb3620c5640 1 -- 172.21.15.67:0/2568930684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb35c15e5f0 msgr2=0x7fb35c15c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:22.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.572+0000 7fb3620c5640 1 --2- 172.21.15.67:0/2568930684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb35c15e5f0 0x7fb35c15c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.572+0000 7fb3620c5640 1 -- 172.21.15.67:0/2568930684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb35c15e210 msgr2=0x7fb35c0b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:22.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.572+0000 7fb3620c5640 1 --2- 172.21.15.67:0/2568930684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb35c15e210 0x7fb35c0b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.572+0000 7fb3620c5640 1 -- 172.21.15.67:0/2568930684 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35c15d030 con 0x7fb35c0cf3d0 2024-04-25T02:29:22.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.572+0000 7fb3628c6640 1 --2- 172.21.15.67:0/2568930684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb35c15e5f0 0x7fb35c15c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:22.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.572+0000 7fb3618c4640 1 --2- 172.21.15.67:0/2568930684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb35c15e210 0x7fb35c0b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:22.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.573+0000 7fb3620c5640 1 --2- 172.21.15.67:0/2568930684 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb35c0cf3d0 0x7fb35c1f44e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb35402a2b0 tx=0x7fb3540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:22.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.573+0000 7fb35affd640 1 -- 172.21.15.67:0/2568930684 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354041020 con 0x7fb35c0cf3d0 2024-04-25T02:29:22.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.573+0000 7fb35affd640 1 -- 172.21.15.67:0/2568930684 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3540306c0 con 0x7fb35c0cf3d0 2024-04-25T02:29:22.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.573+0000 7fb364329640 1 -- 172.21.15.67:0/2568930684 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb35c15d310 con 0x7fb35c0cf3d0 2024-04-25T02:29:22.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.573+0000 7fb35affd640 1 -- 172.21.15.67:0/2568930684 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354037040 con 0x7fb35c0cf3d0 2024-04-25T02:29:22.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.573+0000 7fb364329640 1 -- 172.21.15.67:0/2568930684 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb35c0cc5d0 con 0x7fb35c0cf3d0 2024-04-25T02:29:22.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.574+0000 7fb364329640 1 -- 172.21.15.67:0/2568930684 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb35c069110 con 0x7fb35c0cf3d0 2024-04-25T02:29:22.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.574+0000 7fb35affd640 1 -- 172.21.15.67:0/2568930684 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb354044020 con 0x7fb35c0cf3d0 2024-04-25T02:29:22.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.575+0000 7fb35affd640 1 --2- 172.21.15.67:0/2568930684 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb34806be30 0x7fb34806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:22.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.575+0000 7fb35affd640 1 -- 172.21.15.67:0/2568930684 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb3540ab610 con 0x7fb35c0cf3d0 2024-04-25T02:29:22.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.575+0000 7fb3618c4640 1 --2- 172.21.15.67:0/2568930684 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb34806be30 0x7fb34806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:22.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.576+0000 7fb3618c4640 1 --2- 172.21.15.67:0/2568930684 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb34806be30 0x7fb34806e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0b7b70 tx=0x7fb350009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:22.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.579+0000 7fb35affd640 1 -- 172.21.15.67:0/2568930684 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb35404b030 con 0x7fb35c0cf3d0 2024-04-25T02:29:22.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.759+0000 7fb364329640 1 -- 172.21.15.67:0/2568930684 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb35c06be80 con 0x7fb34806be30 2024-04-25T02:29:22.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.766+0000 7fb35affd640 1 -- 172.21.15.67:0/2568930684 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7fb35c06be80 con 0x7fb34806be30 2024-04-25T02:29:22.772 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:22.773 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-25T02:29:22.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.769+0000 7fb364329640 1 -- 172.21.15.67:0/2568930684 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb34806be30 msgr2=0x7fb34806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:22.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.769+0000 7fb364329640 1 --2- 172.21.15.67:0/2568930684 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb34806be30 0x7fb34806e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0b7b70 tx=0x7fb350009040 comp rx=0 tx=0).stop 2024-04-25T02:29:22.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.769+0000 7fb364329640 1 -- 172.21.15.67:0/2568930684 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb35c0cf3d0 msgr2=0x7fb35c1f44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:22.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.769+0000 7fb364329640 1 --2- 172.21.15.67:0/2568930684 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb35c0cf3d0 0x7fb35c1f44e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb35402a2b0 tx=0x7fb3540046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.769+0000 7fb364329640 1 -- 172.21.15.67:0/2568930684 shutdown_connections 2024-04-25T02:29:22.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.769+0000 7fb364329640 1 --2- 172.21.15.67:0/2568930684 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb34806be30 0x7fb34806e2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.769+0000 7fb364329640 1 --2- 172.21.15.67:0/2568930684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb35c15e5f0 0x7fb35c15c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.769+0000 7fb364329640 1 --2- 172.21.15.67:0/2568930684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb35c15e210 0x7fb35c0b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.769+0000 7fb364329640 1 --2- 172.21.15.67:0/2568930684 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb35c0cf3d0 0x7fb35c1f44e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:22.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.769+0000 7fb364329640 1 -- 172.21.15.67:0/2568930684 >> 172.21.15.67:0/2568930684 conn(0x7fb35c08dbb0 msgr2=0x7fb35c1603e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:22.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.769+0000 7fb364329640 1 -- 172.21.15.67:0/2568930684 shutdown_connections 2024-04-25T02:29:22.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:22.769+0000 7fb364329640 1 -- 172.21.15.67:0/2568930684 wait complete. 2024-04-25T02:29:22.783 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-04-25T02:29:22.343562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591838,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220068,"kb_used_data":3880,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754652,"statfs":{"total":773094113280,"available":772868763648,"internally_reserved":0,"allocated":3973120,"data_stored":2249000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001260"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353969+0000","last_change":"2024-04-25T02:29:18.346740+0000","last_active":"2024-04-25T02:29:18.353969+0000","last_peered":"2024-04-25T02:29:18.353969+0000","last_clean":"2024-04-25T02:29:18.353969+0000","last_became_active":"2024-04-25T02:29:18.346475+0000","last_became_peered":"2024-04-25T02:29:18.346475+0000","last_unstale":"2024-04-25T02:29:18.353969+0000","last_undegraded":"2024-04-25T02:29:18.353969+0000","last_fullsized":"2024-04-25T02:29:18.353969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352494+0000","last_change":"2024-04-25T02:29:18.347192+0000","last_active":"2024-04-25T02:29:18.352494+0000","last_peered":"2024-04-25T02:29:18.352494+0000","last_clean":"2024-04-25T02:29:18.352494+0000","last_became_active":"2024-04-25T02:29:18.346599+0000","last_became_peered":"2024-04-25T02:29:18.346599+0000","last_unstale":"2024-04-25T02:29:18.352494+0000","last_undegraded":"2024-04-25T02:29:18.352494+0000","last_fullsized":"2024-04-25T02:29:18.352494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:11.549908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348359+0000","last_change":"2024-04-25T02:29:18.344360+0000","last_active":"2024-04-25T02:29:18.348359+0000","last_peered":"2024-04-25T02:29:18.348359+0000","last_clean":"2024-04-25T02:29:18.348359+0000","last_became_active":"2024-04-25T02:29:18.343592+0000","last_became_peered":"2024-04-25T02:29:18.343592+0000","last_unstale":"2024-04-25T02:29:18.348359+0000","last_undegraded":"2024-04-25T02:29:18.348359+0000","last_fullsized":"2024-04-25T02:29:18.348359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:14.734561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353680+0000","last_change":"2024-04-25T02:29:18.353680+0000","last_active":"2024-04-25T02:29:18.353680+0000","last_peered":"2024-04-25T02:29:18.353680+0000","last_clean":"2024-04-25T02:29:18.353680+0000","last_became_active":"2024-04-25T02:29:18.353401+0000","last_became_peered":"2024-04-25T02:29:18.353401+0000","last_unstale":"2024-04-25T02:29:18.353680+0000","last_undegraded":"2024-04-25T02:29:18.353680+0000","last_fullsized":"2024-04-25T02:29:18.353680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:14.734561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351757+0000","last_change":"2024-04-25T02:29:18.349706+0000","last_active":"2024-04-25T02:29:18.351757+0000","last_peered":"2024-04-25T02:29:18.351757+0000","last_clean":"2024-04-25T02:29:18.351757+0000","last_became_active":"2024-04-25T02:29:18.349413+0000","last_became_peered":"2024-04-25T02:29:18.349413+0000","last_unstale":"2024-04-25T02:29:18.351757+0000","last_undegraded":"2024-04-25T02:29:18.351757+0000","last_fullsized":"2024-04-25T02:29:18.351757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:43:26.985827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353065+0000","last_change":"2024-04-25T02:29:18.348066+0000","last_active":"2024-04-25T02:29:18.353065+0000","last_peered":"2024-04-25T02:29:18.353065+0000","last_clean":"2024-04-25T02:29:18.353065+0000","last_became_active":"2024-04-25T02:29:18.347678+0000","last_became_peered":"2024-04-25T02:29:18.347678+0000","last_unstale":"2024-04-25T02:29:18.353065+0000","last_undegraded":"2024-04-25T02:29:18.353065+0000","last_fullsized":"2024-04-25T02:29:18.353065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:02:32.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351348+0000","last_change":"2024-04-25T02:29:18.347506+0000","last_active":"2024-04-25T02:29:18.351348+0000","last_peered":"2024-04-25T02:29:18.351348+0000","last_clean":"2024-04-25T02:29:18.351348+0000","last_became_active":"2024-04-25T02:29:18.347229+0000","last_became_peered":"2024-04-25T02:29:18.347229+0000","last_unstale":"2024-04-25T02:29:18.351348+0000","last_undegraded":"2024-04-25T02:29:18.351348+0000","last_fullsized":"2024-04-25T02:29:18.351348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.342548+0000","last_change":"2024-04-25T02:29:18.338526+0000","last_active":"2024-04-25T02:29:18.342548+0000","last_peered":"2024-04-25T02:29:18.342548+0000","last_clean":"2024-04-25T02:29:18.342548+0000","last_became_active":"2024-04-25T02:29:18.338272+0000","last_became_peered":"2024-04-25T02:29:18.338272+0000","last_unstale":"2024-04-25T02:29:18.342548+0000","last_undegraded":"2024-04-25T02:29:18.342548+0000","last_fullsized":"2024-04-25T02:29:18.342548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345636+0000","last_change":"2024-04-25T02:29:18.341056+0000","last_active":"2024-04-25T02:29:18.345636+0000","last_peered":"2024-04-25T02:29:18.345636+0000","last_clean":"2024-04-25T02:29:18.345636+0000","last_became_active":"2024-04-25T02:29:18.340660+0000","last_became_peered":"2024-04-25T02:29:18.340660+0000","last_unstale":"2024-04-25T02:29:18.345636+0000","last_undegraded":"2024-04-25T02:29:18.345636+0000","last_fullsized":"2024-04-25T02:29:18.345636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:25.532394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354625+0000","last_change":"2024-04-25T02:29:18.354625+0000","last_active":"2024-04-25T02:29:18.354625+0000","last_peered":"2024-04-25T02:29:18.354625+0000","last_clean":"2024-04-25T02:29:18.354625+0000","last_became_active":"2024-04-25T02:29:18.354339+0000","last_became_peered":"2024-04-25T02:29:18.354339+0000","last_unstale":"2024-04-25T02:29:18.354625+0000","last_undegraded":"2024-04-25T02:29:18.354625+0000","last_fullsized":"2024-04-25T02:29:18.354625+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:18.991459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.344927+0000","last_change":"2024-04-25T02:29:18.341907+0000","last_active":"2024-04-25T02:29:18.344927+0000","last_peered":"2024-04-25T02:29:18.344927+0000","last_clean":"2024-04-25T02:29:18.344927+0000","last_became_active":"2024-04-25T02:29:18.341644+0000","last_became_peered":"2024-04-25T02:29:18.341644+0000","last_unstale":"2024-04-25T02:29:18.344927+0000","last_undegraded":"2024-04-25T02:29:18.344927+0000","last_fullsized":"2024-04-25T02:29:18.344927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:33.371549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.349482+0000","last_change":"2024-04-25T02:29:18.349482+0000","last_active":"2024-04-25T02:29:18.349482+0000","last_peered":"2024-04-25T02:29:18.349482+0000","last_clean":"2024-04-25T02:29:18.349482+0000","last_became_active":"2024-04-25T02:29:18.349216+0000","last_became_peered":"2024-04-25T02:29:18.349216+0000","last_unstale":"2024-04-25T02:29:18.349482+0000","last_undegraded":"2024-04-25T02:29:18.349482+0000","last_fullsized":"2024-04-25T02:29:18.349482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:20.085001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345642+0000","last_change":"2024-04-25T02:29:18.340910+0000","last_active":"2024-04-25T02:29:18.345642+0000","last_peered":"2024-04-25T02:29:18.345642+0000","last_clean":"2024-04-25T02:29:18.345642+0000","last_became_active":"2024-04-25T02:29:18.340634+0000","last_became_peered":"2024-04-25T02:29:18.340634+0000","last_unstale":"2024-04-25T02:29:18.345642+0000","last_undegraded":"2024-04-25T02:29:18.345642+0000","last_fullsized":"2024-04-25T02:29:18.345642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:31.380254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348430+0000","last_change":"2024-04-25T02:29:18.341922+0000","last_active":"2024-04-25T02:29:18.348430+0000","last_peered":"2024-04-25T02:29:18.348430+0000","last_clean":"2024-04-25T02:29:18.348430+0000","last_became_active":"2024-04-25T02:29:18.341643+0000","last_became_peered":"2024-04-25T02:29:18.341643+0000","last_unstale":"2024-04-25T02:29:18.348430+0000","last_undegraded":"2024-04-25T02:29:18.348430+0000","last_fullsized":"2024-04-25T02:29:18.348430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:30.728990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345537+0000","last_change":"2024-04-25T02:29:18.336835+0000","last_active":"2024-04-25T02:29:18.345537+0000","last_peered":"2024-04-25T02:29:18.345537+0000","last_clean":"2024-04-25T02:29:18.345537+0000","last_became_active":"2024-04-25T02:29:18.336550+0000","last_became_peered":"2024-04-25T02:29:18.336550+0000","last_unstale":"2024-04-25T02:29:18.345537+0000","last_undegraded":"2024-04-25T02:29:18.345537+0000","last_fullsized":"2024-04-25T02:29:18.345537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:14.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352970+0000","last_change":"2024-04-25T02:29:18.352970+0000","last_active":"2024-04-25T02:29:18.352970+0000","last_peered":"2024-04-25T02:29:18.352970+0000","last_clean":"2024-04-25T02:29:18.352970+0000","last_became_active":"2024-04-25T02:29:18.352750+0000","last_became_peered":"2024-04-25T02:29:18.352750+0000","last_unstale":"2024-04-25T02:29:18.352970+0000","last_undegraded":"2024-04-25T02:29:18.352970+0000","last_fullsized":"2024-04-25T02:29:18.352970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:08.133055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354285+0000","last_change":"2024-04-25T02:29:18.350283+0000","last_active":"2024-04-25T02:29:18.354285+0000","last_peered":"2024-04-25T02:29:18.354285+0000","last_clean":"2024-04-25T02:29:18.354285+0000","last_became_active":"2024-04-25T02:29:18.349442+0000","last_became_peered":"2024-04-25T02:29:18.349442+0000","last_unstale":"2024-04-25T02:29:18.354285+0000","last_undegraded":"2024-04-25T02:29:18.354285+0000","last_fullsized":"2024-04-25T02:29:18.354285+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:50.388712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352469+0000","last_change":"2024-04-25T02:29:18.346919+0000","last_active":"2024-04-25T02:29:18.352469+0000","last_peered":"2024-04-25T02:29:18.352469+0000","last_clean":"2024-04-25T02:29:18.352469+0000","last_became_active":"2024-04-25T02:29:18.345267+0000","last_became_peered":"2024-04-25T02:29:18.345267+0000","last_unstale":"2024-04-25T02:29:18.352469+0000","last_undegraded":"2024-04-25T02:29:18.352469+0000","last_fullsized":"2024-04-25T02:29:18.352469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:08.133055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348478+0000","last_change":"2024-04-25T02:29:18.343532+0000","last_active":"2024-04-25T02:29:18.348478+0000","last_peered":"2024-04-25T02:29:18.348478+0000","last_clean":"2024-04-25T02:29:18.348478+0000","last_became_active":"2024-04-25T02:29:18.343242+0000","last_became_peered":"2024-04-25T02:29:18.343242+0000","last_unstale":"2024-04-25T02:29:18.348478+0000","last_undegraded":"2024-04-25T02:29:18.348478+0000","last_fullsized":"2024-04-25T02:29:18.348478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:14.025149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351721+0000","last_change":"2024-04-25T02:29:18.348342+0000","last_active":"2024-04-25T02:29:18.351721+0000","last_peered":"2024-04-25T02:29:18.351721+0000","last_clean":"2024-04-25T02:29:18.351721+0000","last_became_active":"2024-04-25T02:29:18.348055+0000","last_became_peered":"2024-04-25T02:29:18.348055+0000","last_unstale":"2024-04-25T02:29:18.351721+0000","last_undegraded":"2024-04-25T02:29:18.351721+0000","last_fullsized":"2024-04-25T02:29:18.351721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:00.533737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.346888+0000","last_change":"2024-04-25T02:29:18.339396+0000","last_active":"2024-04-25T02:29:18.346888+0000","last_peered":"2024-04-25T02:29:18.346888+0000","last_clean":"2024-04-25T02:29:18.346888+0000","last_became_active":"2024-04-25T02:29:18.339130+0000","last_became_peered":"2024-04-25T02:29:18.339130+0000","last_unstale":"2024-04-25T02:29:18.346888+0000","last_undegraded":"2024-04-25T02:29:18.346888+0000","last_fullsized":"2024-04-25T02:29:18.346888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:23.387620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.347319+0000","last_change":"2024-04-25T02:29:18.337818+0000","last_active":"2024-04-25T02:29:18.347319+0000","last_peered":"2024-04-25T02:29:18.347319+0000","last_clean":"2024-04-25T02:29:18.347319+0000","last_became_active":"2024-04-25T02:29:18.337470+0000","last_became_peered":"2024-04-25T02:29:18.337470+0000","last_unstale":"2024-04-25T02:29:18.347319+0000","last_undegraded":"2024-04-25T02:29:18.347319+0000","last_fullsized":"2024-04-25T02:29:18.347319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:53.335059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345890+0000","last_change":"2024-04-25T02:29:18.344898+0000","last_active":"2024-04-25T02:29:18.345890+0000","last_peered":"2024-04-25T02:29:18.345890+0000","last_clean":"2024-04-25T02:29:18.345890+0000","last_became_active":"2024-04-25T02:29:18.344617+0000","last_became_peered":"2024-04-25T02:29:18.344617+0000","last_unstale":"2024-04-25T02:29:18.345890+0000","last_undegraded":"2024-04-25T02:29:18.345890+0000","last_fullsized":"2024-04-25T02:29:18.345890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345770+0000","last_change":"2024-04-25T02:29:18.339252+0000","last_active":"2024-04-25T02:29:18.345770+0000","last_peered":"2024-04-25T02:29:18.345770+0000","last_clean":"2024-04-25T02:29:18.345770+0000","last_became_active":"2024-04-25T02:29:18.338939+0000","last_became_peered":"2024-04-25T02:29:18.338939+0000","last_unstale":"2024-04-25T02:29:18.345770+0000","last_undegraded":"2024-04-25T02:29:18.345770+0000","last_fullsized":"2024-04-25T02:29:18.345770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348292+0000","last_change":"2024-04-25T02:29:18.346821+0000","last_active":"2024-04-25T02:29:18.348292+0000","last_peered":"2024-04-25T02:29:18.348292+0000","last_clean":"2024-04-25T02:29:18.348292+0000","last_became_active":"2024-04-25T02:29:18.346488+0000","last_became_peered":"2024-04-25T02:29:18.346488+0000","last_unstale":"2024-04-25T02:29:18.348292+0000","last_undegraded":"2024-04-25T02:29:18.348292+0000","last_fullsized":"2024-04-25T02:29:18.348292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353188+0000","last_change":"2024-04-25T02:29:18.351850+0000","last_active":"2024-04-25T02:29:18.353188+0000","last_peered":"2024-04-25T02:29:18.353188+0000","last_clean":"2024-04-25T02:29:18.353188+0000","last_became_active":"2024-04-25T02:29:18.351485+0000","last_became_peered":"2024-04-25T02:29:18.351485+0000","last_unstale":"2024-04-25T02:29:18.353188+0000","last_undegraded":"2024-04-25T02:29:18.353188+0000","last_fullsized":"2024-04-25T02:29:18.353188+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:26.891694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":6,"reported_epoch":32,"state":"active","last_fresh":"2024-04-25T02:29:18.355802+0000","last_change":"2024-04-25T02:29:18.355742+0000","last_active":"2024-04-25T02:29:18.355802+0000","last_peered":"2024-04-25T02:29:18.355802+0000","last_clean":"2024-04-25T02:29:17.313167+0000","last_became_active":"2024-04-25T02:29:18.355742+0000","last_became_peered":"2024-04-25T02:29:18.355742+0000","last_unstale":"2024-04-25T02:29:18.355802+0000","last_undegraded":"2024-04-25T02:29:18.355802+0000","last_fullsized":"2024-04-25T02:29:18.355802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348814+0000","last_change":"2024-04-25T02:29:18.341797+0000","last_active":"2024-04-25T02:29:18.348814+0000","last_peered":"2024-04-25T02:29:18.348814+0000","last_clean":"2024-04-25T02:29:18.348814+0000","last_became_active":"2024-04-25T02:29:18.341492+0000","last_became_peered":"2024-04-25T02:29:18.341492+0000","last_unstale":"2024-04-25T02:29:18.348814+0000","last_undegraded":"2024-04-25T02:29:18.348814+0000","last_fullsized":"2024-04-25T02:29:18.348814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:33.371549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355282+0000","last_change":"2024-04-25T02:29:18.351144+0000","last_active":"2024-04-25T02:29:18.355282+0000","last_peered":"2024-04-25T02:29:18.355282+0000","last_clean":"2024-04-25T02:29:18.355282+0000","last_became_active":"2024-04-25T02:29:18.350844+0000","last_became_peered":"2024-04-25T02:29:18.350844+0000","last_unstale":"2024-04-25T02:29:18.355282+0000","last_undegraded":"2024-04-25T02:29:18.355282+0000","last_fullsized":"2024-04-25T02:29:18.355282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:48.238396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354443+0000","last_change":"2024-04-25T02:29:18.349494+0000","last_active":"2024-04-25T02:29:18.354443+0000","last_peered":"2024-04-25T02:29:18.354443+0000","last_clean":"2024-04-25T02:29:18.354443+0000","last_became_active":"2024-04-25T02:29:18.349186+0000","last_became_peered":"2024-04-25T02:29:18.349186+0000","last_unstale":"2024-04-25T02:29:18.354443+0000","last_undegraded":"2024-04-25T02:29:18.354443+0000","last_fullsized":"2024-04-25T02:29:18.354443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:14.025149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345264+0000","last_change":"2024-04-25T02:29:18.342571+0000","last_active":"2024-04-25T02:29:18.345264+0000","last_peered":"2024-04-25T02:29:18.345264+0000","last_clean":"2024-04-25T02:29:18.345264+0000","last_became_active":"2024-04-25T02:29:18.341248+0000","last_became_peered":"2024-04-25T02:29:18.341248+0000","last_unstale":"2024-04-25T02:29:18.345264+0000","last_undegraded":"2024-04-25T02:29:18.345264+0000","last_fullsized":"2024-04-25T02:29:18.345264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:37.293554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354254+0000","last_change":"2024-04-25T02:29:18.348376+0000","last_active":"2024-04-25T02:29:18.354254+0000","last_peered":"2024-04-25T02:29:18.354254+0000","last_clean":"2024-04-25T02:29:18.354254+0000","last_became_active":"2024-04-25T02:29:18.347730+0000","last_became_peered":"2024-04-25T02:29:18.347730+0000","last_unstale":"2024-04-25T02:29:18.354254+0000","last_undegraded":"2024-04-25T02:29:18.354254+0000","last_fullsized":"2024-04-25T02:29:18.354254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:30.728990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345232+0000","last_change":"2024-04-25T02:29:18.344161+0000","last_active":"2024-04-25T02:29:18.345232+0000","last_peered":"2024-04-25T02:29:18.345232+0000","last_clean":"2024-04-25T02:29:18.345232+0000","last_became_active":"2024-04-25T02:29:18.343890+0000","last_became_peered":"2024-04-25T02:29:18.343890+0000","last_unstale":"2024-04-25T02:29:18.345232+0000","last_undegraded":"2024-04-25T02:29:18.345232+0000","last_fullsized":"2024-04-25T02:29:18.345232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:14.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352113+0000","last_change":"2024-04-25T02:29:17.336150+0000","last_active":"2024-04-25T02:29:18.352113+0000","last_peered":"2024-04-25T02:29:18.352113+0000","last_clean":"2024-04-25T02:29:18.352113+0000","last_became_active":"2024-04-25T02:29:17.335858+0000","last_became_peered":"2024-04-25T02:29:17.335858+0000","last_unstale":"2024-04-25T02:29:18.352113+0000","last_undegraded":"2024-04-25T02:29:18.352113+0000","last_fullsized":"2024-04-25T02:29:18.352113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:22.380376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345244+0000","last_change":"2024-04-25T02:29:18.344188+0000","last_active":"2024-04-25T02:29:18.345244+0000","last_peered":"2024-04-25T02:29:18.345244+0000","last_clean":"2024-04-25T02:29:18.345244+0000","last_became_active":"2024-04-25T02:29:18.343887+0000","last_became_peered":"2024-04-25T02:29:18.343887+0000","last_unstale":"2024-04-25T02:29:18.345244+0000","last_undegraded":"2024-04-25T02:29:18.345244+0000","last_fullsized":"2024-04-25T02:29:18.345244+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:14.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.344334+0000","last_change":"2024-04-25T02:29:17.338792+0000","last_active":"2024-04-25T02:29:18.344334+0000","last_peered":"2024-04-25T02:29:18.344334+0000","last_clean":"2024-04-25T02:29:18.344334+0000","last_became_active":"2024-04-25T02:29:17.338431+0000","last_became_peered":"2024-04-25T02:29:17.338431+0000","last_unstale":"2024-04-25T02:29:18.344334+0000","last_undegraded":"2024-04-25T02:29:18.344334+0000","last_fullsized":"2024-04-25T02:29:18.344334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:37:20.446428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355215+0000","last_change":"2024-04-25T02:29:18.349592+0000","last_active":"2024-04-25T02:29:18.355215+0000","last_peered":"2024-04-25T02:29:18.355215+0000","last_clean":"2024-04-25T02:29:18.355215+0000","last_became_active":"2024-04-25T02:29:18.349296+0000","last_became_peered":"2024-04-25T02:29:18.349296+0000","last_unstale":"2024-04-25T02:29:18.355215+0000","last_undegraded":"2024-04-25T02:29:18.355215+0000","last_fullsized":"2024-04-25T02:29:18.355215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:25.036633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.358845+0000","last_change":"2024-04-25T02:29:17.343354+0000","last_active":"2024-04-25T02:29:18.358845+0000","last_peered":"2024-04-25T02:29:18.358845+0000","last_clean":"2024-04-25T02:29:18.358845+0000","last_became_active":"2024-04-25T02:29:17.343032+0000","last_became_peered":"2024-04-25T02:29:17.343032+0000","last_unstale":"2024-04-25T02:29:18.358845+0000","last_undegraded":"2024-04-25T02:29:18.358845+0000","last_fullsized":"2024-04-25T02:29:18.358845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:17.984215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354469+0000","last_change":"2024-04-25T02:29:18.354469+0000","last_active":"2024-04-25T02:29:18.354469+0000","last_peered":"2024-04-25T02:29:18.354469+0000","last_clean":"2024-04-25T02:29:18.354469+0000","last_became_active":"2024-04-25T02:29:18.354133+0000","last_became_peered":"2024-04-25T02:29:18.354133+0000","last_unstale":"2024-04-25T02:29:18.354469+0000","last_undegraded":"2024-04-25T02:29:18.354469+0000","last_fullsized":"2024-04-25T02:29:18.354469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.356147+0000","last_change":"2024-04-25T02:29:17.343565+0000","last_active":"2024-04-25T02:29:18.356147+0000","last_peered":"2024-04-25T02:29:18.356147+0000","last_clean":"2024-04-25T02:29:18.356147+0000","last_became_active":"2024-04-25T02:29:17.343267+0000","last_became_peered":"2024-04-25T02:29:17.343267+0000","last_unstale":"2024-04-25T02:29:18.356147+0000","last_undegraded":"2024-04-25T02:29:18.356147+0000","last_fullsized":"2024-04-25T02:29:18.356147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:58.779414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354465+0000","last_change":"2024-04-25T02:29:18.349899+0000","last_active":"2024-04-25T02:29:18.354465+0000","last_peered":"2024-04-25T02:29:18.354465+0000","last_clean":"2024-04-25T02:29:18.354465+0000","last_became_active":"2024-04-25T02:29:18.349625+0000","last_became_peered":"2024-04-25T02:29:18.349625+0000","last_unstale":"2024-04-25T02:29:18.354465+0000","last_undegraded":"2024-04-25T02:29:18.354465+0000","last_fullsized":"2024-04-25T02:29:18.354465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:20.085001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354265+0000","last_change":"2024-04-25T02:29:17.345642+0000","last_active":"2024-04-25T02:29:18.354265+0000","last_peered":"2024-04-25T02:29:18.354265+0000","last_clean":"2024-04-25T02:29:18.354265+0000","last_became_active":"2024-04-25T02:29:17.345311+0000","last_became_peered":"2024-04-25T02:29:17.345311+0000","last_unstale":"2024-04-25T02:29:18.354265+0000","last_undegraded":"2024-04-25T02:29:18.354265+0000","last_fullsized":"2024-04-25T02:29:18.354265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:48.636227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.347858+0000","last_change":"2024-04-25T02:29:18.342591+0000","last_active":"2024-04-25T02:29:18.347858+0000","last_peered":"2024-04-25T02:29:18.347858+0000","last_clean":"2024-04-25T02:29:18.347858+0000","last_became_active":"2024-04-25T02:29:18.341689+0000","last_became_peered":"2024-04-25T02:29:18.341689+0000","last_unstale":"2024-04-25T02:29:18.347858+0000","last_undegraded":"2024-04-25T02:29:18.347858+0000","last_fullsized":"2024-04-25T02:29:18.347858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:23.649134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354267+0000","last_change":"2024-04-25T02:29:17.345509+0000","last_active":"2024-04-25T02:29:18.354267+0000","last_peered":"2024-04-25T02:29:18.354267+0000","last_clean":"2024-04-25T02:29:18.354267+0000","last_became_active":"2024-04-25T02:29:17.345209+0000","last_became_peered":"2024-04-25T02:29:17.345209+0000","last_unstale":"2024-04-25T02:29:18.354267+0000","last_undegraded":"2024-04-25T02:29:18.354267+0000","last_fullsized":"2024-04-25T02:29:18.354267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:26.682356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345496+0000","last_change":"2024-04-25T02:29:18.334322+0000","last_active":"2024-04-25T02:29:18.345496+0000","last_peered":"2024-04-25T02:29:18.345496+0000","last_clean":"2024-04-25T02:29:18.345496+0000","last_became_active":"2024-04-25T02:29:18.334017+0000","last_became_peered":"2024-04-25T02:29:18.334017+0000","last_unstale":"2024-04-25T02:29:18.345496+0000","last_undegraded":"2024-04-25T02:29:18.345496+0000","last_fullsized":"2024-04-25T02:29:18.345496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:03:39.193545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.325803+0000","last_change":"2024-04-25T02:29:17.344030+0000","last_active":"2024-04-25T02:29:18.325803+0000","last_peered":"2024-04-25T02:29:18.325803+0000","last_clean":"2024-04-25T02:29:18.325803+0000","last_became_active":"2024-04-25T02:29:17.343766+0000","last_became_peered":"2024-04-25T02:29:17.343766+0000","last_unstale":"2024-04-25T02:29:18.325803+0000","last_undegraded":"2024-04-25T02:29:18.325803+0000","last_fullsized":"2024-04-25T02:29:18.325803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:32.364305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352367+0000","last_change":"2024-04-25T02:29:18.352367+0000","last_active":"2024-04-25T02:29:18.352367+0000","last_peered":"2024-04-25T02:29:18.352367+0000","last_clean":"2024-04-25T02:29:18.352367+0000","last_became_active":"2024-04-25T02:29:18.351998+0000","last_became_peered":"2024-04-25T02:29:18.351998+0000","last_unstale":"2024-04-25T02:29:18.352367+0000","last_undegraded":"2024-04-25T02:29:18.352367+0000","last_fullsized":"2024-04-25T02:29:18.352367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:23.649134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327586+0000","last_change":"2024-04-25T02:29:17.335287+0000","last_active":"2024-04-25T02:29:18.327586+0000","last_peered":"2024-04-25T02:29:18.327586+0000","last_clean":"2024-04-25T02:29:18.327586+0000","last_became_active":"2024-04-25T02:29:17.334613+0000","last_became_peered":"2024-04-25T02:29:17.334613+0000","last_unstale":"2024-04-25T02:29:18.327586+0000","last_undegraded":"2024-04-25T02:29:18.327586+0000","last_fullsized":"2024-04-25T02:29:18.327586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:24.711459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351260+0000","last_change":"2024-04-25T02:29:18.345717+0000","last_active":"2024-04-25T02:29:18.351260+0000","last_peered":"2024-04-25T02:29:18.351260+0000","last_clean":"2024-04-25T02:29:18.351260+0000","last_became_active":"2024-04-25T02:29:18.345430+0000","last_became_peered":"2024-04-25T02:29:18.345430+0000","last_unstale":"2024-04-25T02:29:18.351260+0000","last_undegraded":"2024-04-25T02:29:18.351260+0000","last_fullsized":"2024-04-25T02:29:18.351260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:18.991459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327056+0000","last_change":"2024-04-25T02:29:17.344786+0000","last_active":"2024-04-25T02:29:18.327056+0000","last_peered":"2024-04-25T02:29:18.327056+0000","last_clean":"2024-04-25T02:29:18.327056+0000","last_became_active":"2024-04-25T02:29:17.344395+0000","last_became_peered":"2024-04-25T02:29:17.344395+0000","last_unstale":"2024-04-25T02:29:18.327056+0000","last_undegraded":"2024-04-25T02:29:18.327056+0000","last_fullsized":"2024-04-25T02:29:18.327056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:12.515961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352117+0000","last_change":"2024-04-25T02:29:18.344217+0000","last_active":"2024-04-25T02:29:18.352117+0000","last_peered":"2024-04-25T02:29:18.352117+0000","last_clean":"2024-04-25T02:29:18.352117+0000","last_became_active":"2024-04-25T02:29:18.343885+0000","last_became_peered":"2024-04-25T02:29:18.343885+0000","last_unstale":"2024-04-25T02:29:18.352117+0000","last_undegraded":"2024-04-25T02:29:18.352117+0000","last_fullsized":"2024-04-25T02:29:18.352117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:20.085001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.333144+0000","last_change":"2024-04-25T02:29:17.344529+0000","last_active":"2024-04-25T02:29:18.333144+0000","last_peered":"2024-04-25T02:29:18.333144+0000","last_clean":"2024-04-25T02:29:18.333144+0000","last_became_active":"2024-04-25T02:29:17.344194+0000","last_became_peered":"2024-04-25T02:29:17.344194+0000","last_unstale":"2024-04-25T02:29:18.333144+0000","last_undegraded":"2024-04-25T02:29:18.333144+0000","last_fullsized":"2024-04-25T02:29:18.333144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:03:38.186300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.353217+0000","last_change":"2024-04-25T02:29:18.350354+0000","last_active":"2024-04-25T02:29:18.353217+0000","last_peered":"2024-04-25T02:29:18.353217+0000","last_clean":"2024-04-25T02:29:18.353217+0000","last_became_active":"2024-04-25T02:29:18.350033+0000","last_became_peered":"2024-04-25T02:29:18.350033+0000","last_unstale":"2024-04-25T02:29:18.353217+0000","last_undegraded":"2024-04-25T02:29:18.353217+0000","last_fullsized":"2024-04-25T02:29:18.353217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:14.176273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351349+0000","last_change":"2024-04-25T02:29:17.339319+0000","last_active":"2024-04-25T02:29:18.351349+0000","last_peered":"2024-04-25T02:29:18.351349+0000","last_clean":"2024-04-25T02:29:18.351349+0000","last_became_active":"2024-04-25T02:29:17.339013+0000","last_became_peered":"2024-04-25T02:29:17.339013+0000","last_unstale":"2024-04-25T02:29:18.351349+0000","last_undegraded":"2024-04-25T02:29:18.351349+0000","last_fullsized":"2024-04-25T02:29:18.351349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:24.029388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351408+0000","last_change":"2024-04-25T02:29:18.345320+0000","last_active":"2024-04-25T02:29:18.351408+0000","last_peered":"2024-04-25T02:29:18.351408+0000","last_clean":"2024-04-25T02:29:18.351408+0000","last_became_active":"2024-04-25T02:29:18.345005+0000","last_became_peered":"2024-04-25T02:29:18.345005+0000","last_unstale":"2024-04-25T02:29:18.351408+0000","last_undegraded":"2024-04-25T02:29:18.351408+0000","last_fullsized":"2024-04-25T02:29:18.351408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'5","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.358670+0000","last_change":"2024-04-25T02:29:17.347025+0000","last_active":"2024-04-25T02:29:18.358670+0000","last_peered":"2024-04-25T02:29:18.358670+0000","last_clean":"2024-04-25T02:29:18.358670+0000","last_became_active":"2024-04-25T02:29:17.346724+0000","last_became_peered":"2024-04-25T02:29:17.346724+0000","last_unstale":"2024-04-25T02:29:18.358670+0000","last_undegraded":"2024-04-25T02:29:18.358670+0000","last_fullsized":"2024-04-25T02:29:18.358670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:13.727317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351533+0000","last_change":"2024-04-25T02:29:18.349195+0000","last_active":"2024-04-25T02:29:18.351533+0000","last_peered":"2024-04-25T02:29:18.351533+0000","last_clean":"2024-04-25T02:29:18.351533+0000","last_became_active":"2024-04-25T02:29:18.348904+0000","last_became_peered":"2024-04-25T02:29:18.348904+0000","last_unstale":"2024-04-25T02:29:18.351533+0000","last_undegraded":"2024-04-25T02:29:18.351533+0000","last_fullsized":"2024-04-25T02:29:18.351533+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:33.371549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355170+0000","last_change":"2024-04-25T02:29:17.333661+0000","last_active":"2024-04-25T02:29:18.355170+0000","last_peered":"2024-04-25T02:29:18.355170+0000","last_clean":"2024-04-25T02:29:18.355170+0000","last_became_active":"2024-04-25T02:29:17.333166+0000","last_became_peered":"2024-04-25T02:29:17.333166+0000","last_unstale":"2024-04-25T02:29:18.355170+0000","last_undegraded":"2024-04-25T02:29:18.355170+0000","last_fullsized":"2024-04-25T02:29:18.355170+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:37:20.446428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.358071+0000","last_change":"2024-04-25T02:29:18.351870+0000","last_active":"2024-04-25T02:29:18.358071+0000","last_peered":"2024-04-25T02:29:18.358071+0000","last_clean":"2024-04-25T02:29:18.358071+0000","last_became_active":"2024-04-25T02:29:18.347590+0000","last_became_peered":"2024-04-25T02:29:18.347590+0000","last_unstale":"2024-04-25T02:29:18.358071+0000","last_undegraded":"2024-04-25T02:29:18.358071+0000","last_fullsized":"2024-04-25T02:29:18.358071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:43.238638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.332322+0000","last_change":"2024-04-25T02:29:17.340109+0000","last_active":"2024-04-25T02:29:18.332322+0000","last_peered":"2024-04-25T02:29:18.332322+0000","last_clean":"2024-04-25T02:29:18.332322+0000","last_became_active":"2024-04-25T02:29:17.339787+0000","last_became_peered":"2024-04-25T02:29:17.339787+0000","last_unstale":"2024-04-25T02:29:18.332322+0000","last_undegraded":"2024-04-25T02:29:18.332322+0000","last_fullsized":"2024-04-25T02:29:18.332322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:24.525150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354229+0000","last_change":"2024-04-25T02:29:18.348361+0000","last_active":"2024-04-25T02:29:18.354229+0000","last_peered":"2024-04-25T02:29:18.354229+0000","last_clean":"2024-04-25T02:29:18.354229+0000","last_became_active":"2024-04-25T02:29:18.347942+0000","last_became_peered":"2024-04-25T02:29:18.347942+0000","last_unstale":"2024-04-25T02:29:18.354229+0000","last_undegraded":"2024-04-25T02:29:18.354229+0000","last_fullsized":"2024-04-25T02:29:18.354229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:18.991459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.325957+0000","last_change":"2024-04-25T02:29:17.344628+0000","last_active":"2024-04-25T02:29:18.325957+0000","last_peered":"2024-04-25T02:29:18.325957+0000","last_clean":"2024-04-25T02:29:18.325957+0000","last_became_active":"2024-04-25T02:29:17.344358+0000","last_became_peered":"2024-04-25T02:29:17.344358+0000","last_unstale":"2024-04-25T02:29:18.325957+0000","last_undegraded":"2024-04-25T02:29:18.325957+0000","last_fullsized":"2024-04-25T02:29:18.325957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:22.641889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345282+0000","last_change":"2024-04-25T02:29:18.344070+0000","last_active":"2024-04-25T02:29:18.345282+0000","last_peered":"2024-04-25T02:29:18.345282+0000","last_clean":"2024-04-25T02:29:18.345282+0000","last_became_active":"2024-04-25T02:29:18.343693+0000","last_became_peered":"2024-04-25T02:29:18.343693+0000","last_unstale":"2024-04-25T02:29:18.345282+0000","last_undegraded":"2024-04-25T02:29:18.345282+0000","last_fullsized":"2024-04-25T02:29:18.345282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:25.036633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.359172+0000","last_change":"2024-04-25T02:29:17.347108+0000","last_active":"2024-04-25T02:29:18.359172+0000","last_peered":"2024-04-25T02:29:18.359172+0000","last_clean":"2024-04-25T02:29:18.359172+0000","last_became_active":"2024-04-25T02:29:17.346804+0000","last_became_peered":"2024-04-25T02:29:17.346804+0000","last_unstale":"2024-04-25T02:29:18.359172+0000","last_undegraded":"2024-04-25T02:29:18.359172+0000","last_fullsized":"2024-04-25T02:29:18.359172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:47.231152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354232+0000","last_change":"2024-04-25T02:29:18.346263+0000","last_active":"2024-04-25T02:29:18.354232+0000","last_peered":"2024-04-25T02:29:18.354232+0000","last_clean":"2024-04-25T02:29:18.354232+0000","last_became_active":"2024-04-25T02:29:18.345025+0000","last_became_peered":"2024-04-25T02:29:18.345025+0000","last_unstale":"2024-04-25T02:29:18.354232+0000","last_undegraded":"2024-04-25T02:29:18.354232+0000","last_fullsized":"2024-04-25T02:29:18.354232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:37.293554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.354159+0000","last_change":"2024-04-25T02:29:17.344650+0000","last_active":"2024-04-25T02:29:18.354159+0000","last_peered":"2024-04-25T02:29:18.354159+0000","last_clean":"2024-04-25T02:29:18.354159+0000","last_became_active":"2024-04-25T02:29:17.344289+0000","last_became_peered":"2024-04-25T02:29:17.344289+0000","last_unstale":"2024-04-25T02:29:18.354159+0000","last_undegraded":"2024-04-25T02:29:18.354159+0000","last_fullsized":"2024-04-25T02:29:18.354159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:36.286309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351371+0000","last_change":"2024-04-25T02:29:18.346031+0000","last_active":"2024-04-25T02:29:18.351371+0000","last_peered":"2024-04-25T02:29:18.351371+0000","last_clean":"2024-04-25T02:29:18.351371+0000","last_became_active":"2024-04-25T02:29:18.344184+0000","last_became_peered":"2024-04-25T02:29:18.344184+0000","last_unstale":"2024-04-25T02:29:18.351371+0000","last_undegraded":"2024-04-25T02:29:18.351371+0000","last_fullsized":"2024-04-25T02:29:18.351371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:30.728990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348015+0000","last_change":"2024-04-25T02:29:17.333575+0000","last_active":"2024-04-25T02:29:18.348015+0000","last_peered":"2024-04-25T02:29:18.348015+0000","last_clean":"2024-04-25T02:29:18.348015+0000","last_became_active":"2024-04-25T02:29:17.333263+0000","last_became_peered":"2024-04-25T02:29:17.333263+0000","last_unstale":"2024-04-25T02:29:18.348015+0000","last_undegraded":"2024-04-25T02:29:18.348015+0000","last_fullsized":"2024-04-25T02:29:18.348015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:17.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355310+0000","last_change":"2024-04-25T02:29:18.355310+0000","last_active":"2024-04-25T02:29:18.355310+0000","last_peered":"2024-04-25T02:29:18.355310+0000","last_clean":"2024-04-25T02:29:18.355310+0000","last_became_active":"2024-04-25T02:29:18.354835+0000","last_became_peered":"2024-04-25T02:29:18.354835+0000","last_unstale":"2024-04-25T02:29:18.355310+0000","last_undegraded":"2024-04-25T02:29:18.355310+0000","last_fullsized":"2024-04-25T02:29:18.355310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:30.728990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348745+0000","last_change":"2024-04-25T02:29:17.336493+0000","last_active":"2024-04-25T02:29:18.348745+0000","last_peered":"2024-04-25T02:29:18.348745+0000","last_clean":"2024-04-25T02:29:18.348745+0000","last_became_active":"2024-04-25T02:29:17.336162+0000","last_became_peered":"2024-04-25T02:29:17.336162+0000","last_unstale":"2024-04-25T02:29:18.348745+0000","last_undegraded":"2024-04-25T02:29:18.348745+0000","last_fullsized":"2024-04-25T02:29:18.348745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:30.373010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.342175+0000","last_change":"2024-04-25T02:29:18.337364+0000","last_active":"2024-04-25T02:29:18.342175+0000","last_peered":"2024-04-25T02:29:18.342175+0000","last_clean":"2024-04-25T02:29:18.342175+0000","last_became_active":"2024-04-25T02:29:18.336958+0000","last_became_peered":"2024-04-25T02:29:18.336958+0000","last_unstale":"2024-04-25T02:29:18.342175+0000","last_undegraded":"2024-04-25T02:29:18.342175+0000","last_fullsized":"2024-04-25T02:29:18.342175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:03:23.356365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327792+0000","last_change":"2024-04-25T02:29:17.345750+0000","last_active":"2024-04-25T02:29:18.327792+0000","last_peered":"2024-04-25T02:29:18.327792+0000","last_clean":"2024-04-25T02:29:18.327792+0000","last_became_active":"2024-04-25T02:29:17.345215+0000","last_became_peered":"2024-04-25T02:29:17.345215+0000","last_unstale":"2024-04-25T02:29:18.327792+0000","last_undegraded":"2024-04-25T02:29:18.327792+0000","last_fullsized":"2024-04-25T02:29:18.327792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:43:25.978582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.346132+0000","last_change":"2024-04-25T02:29:18.344512+0000","last_active":"2024-04-25T02:29:18.346132+0000","last_peered":"2024-04-25T02:29:18.346132+0000","last_clean":"2024-04-25T02:29:18.346132+0000","last_became_active":"2024-04-25T02:29:18.344002+0000","last_became_peered":"2024-04-25T02:29:18.344002+0000","last_unstale":"2024-04-25T02:29:18.346132+0000","last_undegraded":"2024-04-25T02:29:18.346132+0000","last_fullsized":"2024-04-25T02:29:18.346132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:18.639956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.348772+0000","last_change":"2024-04-25T02:29:17.336327+0000","last_active":"2024-04-25T02:29:18.348772+0000","last_peered":"2024-04-25T02:29:18.348772+0000","last_clean":"2024-04-25T02:29:18.348772+0000","last_became_active":"2024-04-25T02:29:17.336061+0000","last_became_peered":"2024-04-25T02:29:17.336061+0000","last_unstale":"2024-04-25T02:29:18.348772+0000","last_undegraded":"2024-04-25T02:29:18.348772+0000","last_fullsized":"2024-04-25T02:29:18.348772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:22.380376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.342305+0000","last_change":"2024-04-25T02:29:18.338302+0000","last_active":"2024-04-25T02:29:18.342305+0000","last_peered":"2024-04-25T02:29:18.342305+0000","last_clean":"2024-04-25T02:29:18.342305+0000","last_became_active":"2024-04-25T02:29:18.338039+0000","last_became_peered":"2024-04-25T02:29:18.338039+0000","last_unstale":"2024-04-25T02:29:18.342305+0000","last_undegraded":"2024-04-25T02:29:18.342305+0000","last_fullsized":"2024-04-25T02:29:18.342305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:32.654953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.332282+0000","last_change":"2024-04-25T02:29:17.343462+0000","last_active":"2024-04-25T02:29:18.332282+0000","last_peered":"2024-04-25T02:29:18.332282+0000","last_clean":"2024-04-25T02:29:18.332282+0000","last_became_active":"2024-04-25T02:29:17.343181+0000","last_became_peered":"2024-04-25T02:29:17.343181+0000","last_unstale":"2024-04-25T02:29:18.332282+0000","last_undegraded":"2024-04-25T02:29:18.332282+0000","last_fullsized":"2024-04-25T02:29:18.332282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:52.327814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.342356+0000","last_change":"2024-04-25T02:29:18.338928+0000","last_active":"2024-04-25T02:29:18.342356+0000","last_peered":"2024-04-25T02:29:18.342356+0000","last_clean":"2024-04-25T02:29:18.342356+0000","last_became_active":"2024-04-25T02:29:18.338673+0000","last_became_peered":"2024-04-25T02:29:18.338673+0000","last_unstale":"2024-04-25T02:29:18.342356+0000","last_undegraded":"2024-04-25T02:29:18.342356+0000","last_fullsized":"2024-04-25T02:29:18.342356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:27.689600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327668+0000","last_change":"2024-04-25T02:29:17.335254+0000","last_active":"2024-04-25T02:29:18.327668+0000","last_peered":"2024-04-25T02:29:18.327668+0000","last_clean":"2024-04-25T02:29:18.327668+0000","last_became_active":"2024-04-25T02:29:17.334973+0000","last_became_peered":"2024-04-25T02:29:17.334973+0000","last_unstale":"2024-04-25T02:29:18.327668+0000","last_undegraded":"2024-04-25T02:29:18.327668+0000","last_fullsized":"2024-04-25T02:29:18.327668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:59.526492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351369+0000","last_change":"2024-04-25T02:29:18.347506+0000","last_active":"2024-04-25T02:29:18.351369+0000","last_peered":"2024-04-25T02:29:18.351369+0000","last_clean":"2024-04-25T02:29:18.351369+0000","last_became_active":"2024-04-25T02:29:18.347214+0000","last_became_peered":"2024-04-25T02:29:18.347214+0000","last_unstale":"2024-04-25T02:29:18.351369+0000","last_undegraded":"2024-04-25T02:29:18.351369+0000","last_fullsized":"2024-04-25T02:29:18.351369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:14.734561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.329668+0000","last_change":"2024-04-25T02:29:17.341124+0000","last_active":"2024-04-25T02:29:18.329668+0000","last_peered":"2024-04-25T02:29:18.329668+0000","last_clean":"2024-04-25T02:29:18.329668+0000","last_became_active":"2024-04-25T02:29:17.340870+0000","last_became_peered":"2024-04-25T02:29:17.340870+0000","last_unstale":"2024-04-25T02:29:18.329668+0000","last_undegraded":"2024-04-25T02:29:18.329668+0000","last_fullsized":"2024-04-25T02:29:18.329668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:36.286309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.347598+0000","last_change":"2024-04-25T02:29:18.346689+0000","last_active":"2024-04-25T02:29:18.347598+0000","last_peered":"2024-04-25T02:29:18.347598+0000","last_clean":"2024-04-25T02:29:18.347598+0000","last_became_active":"2024-04-25T02:29:18.346385+0000","last_became_peered":"2024-04-25T02:29:18.346385+0000","last_unstale":"2024-04-25T02:29:18.347598+0000","last_undegraded":"2024-04-25T02:29:18.347598+0000","last_fullsized":"2024-04-25T02:29:18.347598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:25.718704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355381+0000","last_change":"2024-04-25T02:29:17.341566+0000","last_active":"2024-04-25T02:29:18.355381+0000","last_peered":"2024-04-25T02:29:18.355381+0000","last_clean":"2024-04-25T02:29:18.355381+0000","last_became_active":"2024-04-25T02:29:17.341005+0000","last_became_peered":"2024-04-25T02:29:17.341005+0000","last_unstale":"2024-04-25T02:29:18.355381+0000","last_undegraded":"2024-04-25T02:29:18.355381+0000","last_fullsized":"2024-04-25T02:29:18.355381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:24.029388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351392+0000","last_change":"2024-04-25T02:29:18.346646+0000","last_active":"2024-04-25T02:29:18.351392+0000","last_peered":"2024-04-25T02:29:18.351392+0000","last_clean":"2024-04-25T02:29:18.351392+0000","last_became_active":"2024-04-25T02:29:18.346377+0000","last_became_peered":"2024-04-25T02:29:18.346377+0000","last_unstale":"2024-04-25T02:29:18.351392+0000","last_undegraded":"2024-04-25T02:29:18.351392+0000","last_fullsized":"2024-04-25T02:29:18.351392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:14.025149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.333287+0000","last_change":"2024-04-25T02:29:17.339450+0000","last_active":"2024-04-25T02:29:18.333287+0000","last_peered":"2024-04-25T02:29:18.333287+0000","last_clean":"2024-04-25T02:29:18.333287+0000","last_became_active":"2024-04-25T02:29:17.339041+0000","last_became_peered":"2024-04-25T02:29:17.339041+0000","last_unstale":"2024-04-25T02:29:18.333287+0000","last_undegraded":"2024-04-25T02:29:18.333287+0000","last_fullsized":"2024-04-25T02:29:18.333287+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:52.327814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345051+0000","last_change":"2024-04-25T02:29:18.343320+0000","last_active":"2024-04-25T02:29:18.345051+0000","last_peered":"2024-04-25T02:29:18.345051+0000","last_clean":"2024-04-25T02:29:18.345051+0000","last_became_active":"2024-04-25T02:29:18.343045+0000","last_became_peered":"2024-04-25T02:29:18.343045+0000","last_unstale":"2024-04-25T02:29:18.345051+0000","last_undegraded":"2024-04-25T02:29:18.345051+0000","last_fullsized":"2024-04-25T02:29:18.345051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:25.036633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.337918+0000","last_change":"2024-04-25T02:29:17.338937+0000","last_active":"2024-04-25T02:29:18.337918+0000","last_peered":"2024-04-25T02:29:18.337918+0000","last_clean":"2024-04-25T02:29:18.337918+0000","last_became_active":"2024-04-25T02:29:17.338636+0000","last_became_peered":"2024-04-25T02:29:17.338636+0000","last_unstale":"2024-04-25T02:29:18.337918+0000","last_undegraded":"2024-04-25T02:29:18.337918+0000","last_fullsized":"2024-04-25T02:29:18.337918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:13.412200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.344836+0000","last_change":"2024-04-25T02:29:18.341511+0000","last_active":"2024-04-25T02:29:18.344836+0000","last_peered":"2024-04-25T02:29:18.344836+0000","last_clean":"2024-04-25T02:29:18.344836+0000","last_became_active":"2024-04-25T02:29:18.341233+0000","last_became_peered":"2024-04-25T02:29:18.341233+0000","last_unstale":"2024-04-25T02:29:18.344836+0000","last_undegraded":"2024-04-25T02:29:18.344836+0000","last_fullsized":"2024-04-25T02:29:18.344836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:25.532394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.335068+0000","last_change":"2024-04-25T02:29:17.335618+0000","last_active":"2024-04-25T02:29:18.335068+0000","last_peered":"2024-04-25T02:29:18.335068+0000","last_clean":"2024-04-25T02:29:18.335068+0000","last_became_active":"2024-04-25T02:29:17.335113+0000","last_became_peered":"2024-04-25T02:29:17.335113+0000","last_unstale":"2024-04-25T02:29:18.335068+0000","last_undegraded":"2024-04-25T02:29:18.335068+0000","last_fullsized":"2024-04-25T02:29:18.335068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:24.525150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.345451+0000","last_change":"2024-04-25T02:29:18.343189+0000","last_active":"2024-04-25T02:29:18.345451+0000","last_peered":"2024-04-25T02:29:18.345451+0000","last_clean":"2024-04-25T02:29:18.345451+0000","last_became_active":"2024-04-25T02:29:18.342880+0000","last_became_peered":"2024-04-25T02:29:18.342880+0000","last_unstale":"2024-04-25T02:29:18.345451+0000","last_undegraded":"2024-04-25T02:29:18.345451+0000","last_fullsized":"2024-04-25T02:29:18.345451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:37.293554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.332320+0000","last_change":"2024-04-25T02:29:17.342369+0000","last_active":"2024-04-25T02:29:18.332320+0000","last_peered":"2024-04-25T02:29:18.332320+0000","last_clean":"2024-04-25T02:29:18.332320+0000","last_became_active":"2024-04-25T02:29:17.342038+0000","last_became_peered":"2024-04-25T02:29:17.342038+0000","last_unstale":"2024-04-25T02:29:18.332320+0000","last_undegraded":"2024-04-25T02:29:18.332320+0000","last_fullsized":"2024-04-25T02:29:18.332320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:22.380376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.352267+0000","last_change":"2024-04-25T02:29:18.346427+0000","last_active":"2024-04-25T02:29:18.352267+0000","last_peered":"2024-04-25T02:29:18.352267+0000","last_clean":"2024-04-25T02:29:18.352267+0000","last_became_active":"2024-04-25T02:29:18.344252+0000","last_became_peered":"2024-04-25T02:29:18.344252+0000","last_unstale":"2024-04-25T02:29:18.352267+0000","last_undegraded":"2024-04-25T02:29:18.352267+0000","last_fullsized":"2024-04-25T02:29:18.352267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:50.388712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.327838+0000","last_change":"2024-04-25T02:29:17.334132+0000","last_active":"2024-04-25T02:29:18.327838+0000","last_peered":"2024-04-25T02:29:18.327838+0000","last_clean":"2024-04-25T02:29:18.327838+0000","last_became_active":"2024-04-25T02:29:17.333432+0000","last_became_peered":"2024-04-25T02:29:17.333432+0000","last_unstale":"2024-04-25T02:29:18.327838+0000","last_undegraded":"2024-04-25T02:29:18.327838+0000","last_fullsized":"2024-04-25T02:29:18.327838+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:12:36.993064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.355265+0000","last_change":"2024-04-25T02:29:18.350496+0000","last_active":"2024-04-25T02:29:18.355265+0000","last_peered":"2024-04-25T02:29:18.355265+0000","last_clean":"2024-04-25T02:29:18.355265+0000","last_became_active":"2024-04-25T02:29:18.350230+0000","last_became_peered":"2024-04-25T02:29:18.350230+0000","last_unstale":"2024-04-25T02:29:18.355265+0000","last_undegraded":"2024-04-25T02:29:18.355265+0000","last_fullsized":"2024-04-25T02:29:18.355265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:14.419444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.325543+0000","last_change":"2024-04-25T02:29:17.345243+0000","last_active":"2024-04-25T02:29:18.325543+0000","last_peered":"2024-04-25T02:29:18.325543+0000","last_clean":"2024-04-25T02:29:18.325543+0000","last_became_active":"2024-04-25T02:29:17.344978+0000","last_became_peered":"2024-04-25T02:29:17.344978+0000","last_unstale":"2024-04-25T02:29:18.325543+0000","last_undegraded":"2024-04-25T02:29:18.325543+0000","last_fullsized":"2024-04-25T02:29:18.325543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:13.412200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.351382+0000","last_change":"2024-04-25T02:29:18.346721+0000","last_active":"2024-04-25T02:29:18.351382+0000","last_peered":"2024-04-25T02:29:18.351382+0000","last_clean":"2024-04-25T02:29:18.351382+0000","last_became_active":"2024-04-25T02:29:18.346444+0000","last_became_peered":"2024-04-25T02:29:18.346444+0000","last_unstale":"2024-04-25T02:29:18.351382+0000","last_undegraded":"2024-04-25T02:29:18.351382+0000","last_fullsized":"2024-04-25T02:29:18.351382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:23.649134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.331945+0000","last_change":"2024-04-25T02:29:17.336098+0000","last_active":"2024-04-25T02:29:18.331945+0000","last_peered":"2024-04-25T02:29:18.331945+0000","last_clean":"2024-04-25T02:29:18.331945+0000","last_became_active":"2024-04-25T02:29:17.335825+0000","last_became_peered":"2024-04-25T02:29:17.335825+0000","last_unstale":"2024-04-25T02:29:18.331945+0000","last_undegraded":"2024-04-25T02:29:18.331945+0000","last_fullsized":"2024-04-25T02:29:18.331945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:03:38.186300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.331621+0000","last_change":"2024-04-25T02:28:15.520345+0000","last_active":"2024-04-25T02:29:18.331621+0000","last_peered":"2024-04-25T02:29:18.331621+0000","last_clean":"2024-04-25T02:29:18.331621+0000","last_became_active":"2024-04-25T02:28:15.519317+0000","last_became_peered":"2024-04-25T02:28:15.519317+0000","last_unstale":"2024-04-25T02:29:18.331621+0000","last_undegraded":"2024-04-25T02:29:18.331621+0000","last_fullsized":"2024-04-25T02:29:18.331621+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_clean_scrub_stamp":"2024-04-25T02:28:14.374327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:20.125523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":723901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":133533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":723901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:29:23.303 INFO:tasks.ceph.mds.a.smithi067.stderr:2024-04-25T02:29:23.299+0000 7ff1934e9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:29:25.787 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:29:25.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.892+0000 7f898a2e1640 1 Processor -- start 2024-04-25T02:29:25.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.892+0000 7f898a2e1640 1 -- start start 2024-04-25T02:29:25.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.893+0000 7f898a2e1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f898415e660 0x7f898406ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:25.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.893+0000 7f898a2e1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8984067200 0x7f89840715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:25.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.893+0000 7f898a2e1640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f898406c9b0 con 0x7f898415e280 2024-04-25T02:29:25.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.893+0000 7f898a2e1640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f898406e990 con 0x7f8984067200 2024-04-25T02:29:25.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.893+0000 7f898a2e1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f898406bc70 con 0x7f898415e660 2024-04-25T02:29:25.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.893+0000 7f898887e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8984067200 0x7f89840715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:25.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.894+0000 7f898887e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8984067200 0x7f89840715e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49380/0 (socket says 172.21.15.67:49380) 2024-04-25T02:29:25.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.894+0000 7f898887e640 1 -- 172.21.15.67:0/985387648 learned_addr learned my addr 172.21.15.67:0/985387648 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:25.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.894+0000 7f89837fe640 1 --2- 172.21.15.67:0/985387648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f898415e660 0x7f898406ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:25.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.894+0000 7f898887e640 1 -- 172.21.15.67:0/985387648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f898415e660 msgr2=0x7f898406ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:25.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.894+0000 7f898887e640 1 --2- 172.21.15.67:0/985387648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f898415e660 0x7f898406ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:25.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.894+0000 7f898887e640 1 -- 172.21.15.67:0/985387648 >> v1:172.21.15.176:6789/0 conn(0x7f898415e280 legacy=0x7f898406bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:25.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.894+0000 7f898887e640 1 -- 172.21.15.67:0/985387648 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898406e340 con 0x7f8984067200 2024-04-25T02:29:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.895+0000 7f898887e640 1 --2- 172.21.15.67:0/985387648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8984067200 0x7f89840715e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f897c009e50 tx=0x7f897c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f8be8443675597 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.895+0000 7f8982ffd640 1 -- 172.21.15.67:0/985387648 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897c036070 con 0x7f8984067200 2024-04-25T02:29:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.895+0000 7f8982ffd640 1 -- 172.21.15.67:0/985387648 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f897c031600 con 0x7f8984067200 2024-04-25T02:29:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.895+0000 7f8982ffd640 1 -- 172.21.15.67:0/985387648 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897c0319d0 con 0x7f8984067200 2024-04-25T02:29:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.895+0000 7f898a2e1640 1 -- 172.21.15.67:0/985387648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8984067200 msgr2=0x7f89840715e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.895+0000 7f898a2e1640 1 --2- 172.21.15.67:0/985387648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8984067200 0x7f89840715e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f897c009e50 tx=0x7f897c02a710 comp rx=0 tx=0).stop 2024-04-25T02:29:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.895+0000 7f898a2e1640 1 -- 172.21.15.67:0/985387648 shutdown_connections 2024-04-25T02:29:25.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.895+0000 7f898a2e1640 1 --2- 172.21.15.67:0/985387648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8984067200 0x7f89840715e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:25.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.895+0000 7f898a2e1640 1 --2- 172.21.15.67:0/985387648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f898415e660 0x7f898406ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:25.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.895+0000 7f898a2e1640 1 -- 172.21.15.67:0/985387648 >> 172.21.15.67:0/985387648 conn(0x7f89840d04f0 msgr2=0x7f89840d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:25.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.895+0000 7f898a2e1640 1 -- 172.21.15.67:0/985387648 shutdown_connections 2024-04-25T02:29:25.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.895+0000 7f898a2e1640 1 -- 172.21.15.67:0/985387648 wait complete. 2024-04-25T02:29:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.897+0000 7f898a2e1640 1 Processor -- start 2024-04-25T02:29:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.897+0000 7f898a2e1640 1 -- start start 2024-04-25T02:29:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.897+0000 7f898a2e1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8984067200 0x7f898415bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f898a2e1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f898415e280 0x7f89841592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f898a2e1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f898415e660 0x7f8984159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f898a2e1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f898406f4e0 con 0x7f898415e660 2024-04-25T02:29:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f898a2e1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f898406f360 con 0x7f8984067200 2024-04-25T02:29:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f898a2e1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8984071b20 con 0x7f898415e280 2024-04-25T02:29:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f898887e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f898415e660 0x7f8984159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f898887e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f898415e660 0x7f8984159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49382/0 (socket says 172.21.15.67:49382) 2024-04-25T02:29:25.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f898887e640 1 -- 172.21.15.67:0/3742710405 learned_addr learned my addr 172.21.15.67:0/3742710405 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:25.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f89837fe640 1 --2- 172.21.15.67:0/3742710405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f898415e280 0x7f89841592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:25.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f8983fff640 1 --2- 172.21.15.67:0/3742710405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8984067200 0x7f898415bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:25.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f898887e640 1 -- 172.21.15.67:0/3742710405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f898415e280 msgr2=0x7f89841592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:25.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f898887e640 1 --2- 172.21.15.67:0/3742710405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f898415e280 0x7f89841592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:25.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f898887e640 1 -- 172.21.15.67:0/3742710405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8984067200 msgr2=0x7f898415bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:25.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f898887e640 1 --2- 172.21.15.67:0/3742710405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8984067200 0x7f898415bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:25.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f898887e640 1 -- 172.21.15.67:0/3742710405 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898415c170 con 0x7f898415e660 2024-04-25T02:29:25.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f898887e640 1 --2- 172.21.15.67:0/3742710405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f898415e660 0x7f8984159830 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f897c009f70 tx=0x7f897c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:25.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f8980ff9640 1 -- 172.21.15.67:0/3742710405 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897c03f020 con 0x7f898415e660 2024-04-25T02:29:25.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f8980ff9640 1 -- 172.21.15.67:0/3742710405 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f897c037040 con 0x7f898415e660 2024-04-25T02:29:25.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f898a2e1640 1 -- 172.21.15.67:0/3742710405 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89841600e0 con 0x7f898415e660 2024-04-25T02:29:25.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.898+0000 7f8980ff9640 1 -- 172.21.15.67:0/3742710405 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897c036070 con 0x7f898415e660 2024-04-25T02:29:25.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.899+0000 7f898a2e1640 1 -- 172.21.15.67:0/3742710405 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89841606a0 con 0x7f898415e660 2024-04-25T02:29:25.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.900+0000 7f898a2e1640 1 -- 172.21.15.67:0/3742710405 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8984069110 con 0x7f898415e660 2024-04-25T02:29:25.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.900+0000 7f8980ff9640 1 -- 172.21.15.67:0/3742710405 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f897c042020 con 0x7f898415e660 2024-04-25T02:29:25.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.900+0000 7f8980ff9640 1 --2- 172.21.15.67:0/3742710405 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f897006be30 0x7f897006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:25.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.901+0000 7f8980ff9640 1 -- 172.21.15.67:0/3742710405 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f897c0ab0b0 con 0x7f898415e660 2024-04-25T02:29:25.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.901+0000 7f8983fff640 1 --2- 172.21.15.67:0/3742710405 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f897006be30 0x7f897006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:25.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.901+0000 7f8983fff640 1 --2- 172.21.15.67:0/3742710405 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f897006be30 0x7f897006e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8974001780 tx=0x7f8974009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:25.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:25.905+0000 7f8980ff9640 1 -- 172.21.15.67:0/3742710405 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f897c049030 con 0x7f898415e660 2024-04-25T02:29:26.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.087+0000 7f898a2e1640 1 -- 172.21.15.67:0/3742710405 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8984071ef0 con 0x7f897006be30 2024-04-25T02:29:26.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.093+0000 7f8980ff9640 1 -- 172.21.15.67:0/3742710405 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251951 (secure 0 0 0) 0x7f8984071ef0 con 0x7f897006be30 2024-04-25T02:29:26.099 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:26.101 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-25T02:29:26.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.096+0000 7f898a2e1640 1 -- 172.21.15.67:0/3742710405 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f897006be30 msgr2=0x7f897006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:26.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.096+0000 7f898a2e1640 1 --2- 172.21.15.67:0/3742710405 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f897006be30 0x7f897006e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8974001780 tx=0x7f8974009040 comp rx=0 tx=0).stop 2024-04-25T02:29:26.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.096+0000 7f898a2e1640 1 -- 172.21.15.67:0/3742710405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f898415e660 msgr2=0x7f8984159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:26.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.096+0000 7f898a2e1640 1 --2- 172.21.15.67:0/3742710405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f898415e660 0x7f8984159830 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f897c009f70 tx=0x7f897c004a40 comp rx=0 tx=0).stop 2024-04-25T02:29:26.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.096+0000 7f898a2e1640 1 -- 172.21.15.67:0/3742710405 shutdown_connections 2024-04-25T02:29:26.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.096+0000 7f898a2e1640 1 --2- 172.21.15.67:0/3742710405 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f897006be30 0x7f897006e2f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.096+0000 7f898a2e1640 1 --2- 172.21.15.67:0/3742710405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f898415e660 0x7f8984159830 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.096+0000 7f898a2e1640 1 --2- 172.21.15.67:0/3742710405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f898415e280 0x7f89841592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.096+0000 7f898a2e1640 1 --2- 172.21.15.67:0/3742710405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8984067200 0x7f898415bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.096+0000 7f898a2e1640 1 -- 172.21.15.67:0/3742710405 >> 172.21.15.67:0/3742710405 conn(0x7f89840d04f0 msgr2=0x7f898415ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:26.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.096+0000 7f898a2e1640 1 -- 172.21.15.67:0/3742710405 shutdown_connections 2024-04-25T02:29:26.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.096+0000 7f898a2e1640 1 -- 172.21.15.67:0/3742710405 wait complete. 2024-04-25T02:29:26.111 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-04-25T02:29:24.343943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220324,"kb_used_data":4136,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754396,"statfs":{"total":773094113280,"available":772868501504,"internally_reserved":0,"allocated":4235264,"data_stored":2358420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.021119"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671977+0000","last_change":"2024-04-25T02:29:18.346740+0000","last_active":"2024-04-25T02:29:19.671977+0000","last_peered":"2024-04-25T02:29:19.671977+0000","last_clean":"2024-04-25T02:29:19.671977+0000","last_became_active":"2024-04-25T02:29:18.346475+0000","last_became_peered":"2024-04-25T02:29:18.346475+0000","last_unstale":"2024-04-25T02:29:19.671977+0000","last_undegraded":"2024-04-25T02:29:19.671977+0000","last_fullsized":"2024-04-25T02:29:19.671977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.393028+0000","last_change":"2024-04-25T02:29:18.347192+0000","last_active":"2024-04-25T02:29:19.393028+0000","last_peered":"2024-04-25T02:29:19.393028+0000","last_clean":"2024-04-25T02:29:19.393028+0000","last_became_active":"2024-04-25T02:29:18.346599+0000","last_became_peered":"2024-04-25T02:29:18.346599+0000","last_unstale":"2024-04-25T02:29:19.393028+0000","last_undegraded":"2024-04-25T02:29:19.393028+0000","last_fullsized":"2024-04-25T02:29:19.393028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:46:34.211675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.344522+0000","last_change":"2024-04-25T02:29:18.344360+0000","last_active":"2024-04-25T02:29:19.344522+0000","last_peered":"2024-04-25T02:29:19.344522+0000","last_clean":"2024-04-25T02:29:19.344522+0000","last_became_active":"2024-04-25T02:29:18.343592+0000","last_became_peered":"2024-04-25T02:29:18.343592+0000","last_unstale":"2024-04-25T02:29:19.344522+0000","last_undegraded":"2024-04-25T02:29:19.344522+0000","last_fullsized":"2024-04-25T02:29:19.344522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:28.243340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.672494+0000","last_change":"2024-04-25T02:29:18.353680+0000","last_active":"2024-04-25T02:29:19.672494+0000","last_peered":"2024-04-25T02:29:19.672494+0000","last_clean":"2024-04-25T02:29:19.672494+0000","last_became_active":"2024-04-25T02:29:18.353401+0000","last_became_peered":"2024-04-25T02:29:18.353401+0000","last_unstale":"2024-04-25T02:29:19.672494+0000","last_undegraded":"2024-04-25T02:29:19.672494+0000","last_fullsized":"2024-04-25T02:29:19.672494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:02:32.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671663+0000","last_change":"2024-04-25T02:29:18.349706+0000","last_active":"2024-04-25T02:29:19.671663+0000","last_peered":"2024-04-25T02:29:19.671663+0000","last_clean":"2024-04-25T02:29:19.671663+0000","last_became_active":"2024-04-25T02:29:18.349413+0000","last_became_peered":"2024-04-25T02:29:18.349413+0000","last_unstale":"2024-04-25T02:29:19.671663+0000","last_undegraded":"2024-04-25T02:29:19.671663+0000","last_fullsized":"2024-04-25T02:29:19.671663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:12:38.000309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.392530+0000","last_change":"2024-04-25T02:29:18.348066+0000","last_active":"2024-04-25T02:29:19.392530+0000","last_peered":"2024-04-25T02:29:19.392530+0000","last_clean":"2024-04-25T02:29:19.392530+0000","last_became_active":"2024-04-25T02:29:18.347678+0000","last_became_peered":"2024-04-25T02:29:18.347678+0000","last_unstale":"2024-04-25T02:29:19.392530+0000","last_undegraded":"2024-04-25T02:29:19.392530+0000","last_fullsized":"2024-04-25T02:29:19.392530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:51.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.672163+0000","last_change":"2024-04-25T02:29:18.347506+0000","last_active":"2024-04-25T02:29:19.672163+0000","last_peered":"2024-04-25T02:29:19.672163+0000","last_clean":"2024-04-25T02:29:19.672163+0000","last_became_active":"2024-04-25T02:29:18.347229+0000","last_became_peered":"2024-04-25T02:29:18.347229+0000","last_unstale":"2024-04-25T02:29:19.672163+0000","last_undegraded":"2024-04-25T02:29:19.672163+0000","last_fullsized":"2024-04-25T02:29:19.672163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:11.463910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.672240+0000","last_change":"2024-04-25T02:29:18.338526+0000","last_active":"2024-04-25T02:29:19.672240+0000","last_peered":"2024-04-25T02:29:19.672240+0000","last_clean":"2024-04-25T02:29:19.672240+0000","last_became_active":"2024-04-25T02:29:18.338272+0000","last_became_peered":"2024-04-25T02:29:18.338272+0000","last_unstale":"2024-04-25T02:29:19.672240+0000","last_undegraded":"2024-04-25T02:29:19.672240+0000","last_fullsized":"2024-04-25T02:29:19.672240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:18:37.891123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.344470+0000","last_change":"2024-04-25T02:29:18.341056+0000","last_active":"2024-04-25T02:29:19.344470+0000","last_peered":"2024-04-25T02:29:19.344470+0000","last_clean":"2024-04-25T02:29:19.344470+0000","last_became_active":"2024-04-25T02:29:18.340660+0000","last_became_peered":"2024-04-25T02:29:18.340660+0000","last_unstale":"2024-04-25T02:29:19.344470+0000","last_undegraded":"2024-04-25T02:29:19.344470+0000","last_fullsized":"2024-04-25T02:29:19.344470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:14.025149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.672157+0000","last_change":"2024-04-25T02:29:18.354625+0000","last_active":"2024-04-25T02:29:19.672157+0000","last_peered":"2024-04-25T02:29:19.672157+0000","last_clean":"2024-04-25T02:29:19.672157+0000","last_became_active":"2024-04-25T02:29:18.354339+0000","last_became_peered":"2024-04-25T02:29:18.354339+0000","last_unstale":"2024-04-25T02:29:19.672157+0000","last_undegraded":"2024-04-25T02:29:19.672157+0000","last_fullsized":"2024-04-25T02:29:19.672157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:08.133055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.672315+0000","last_change":"2024-04-25T02:29:18.341907+0000","last_active":"2024-04-25T02:29:19.672315+0000","last_peered":"2024-04-25T02:29:19.672315+0000","last_clean":"2024-04-25T02:29:19.672315+0000","last_became_active":"2024-04-25T02:29:18.341644+0000","last_became_peered":"2024-04-25T02:29:18.341644+0000","last_unstale":"2024-04-25T02:29:19.672315+0000","last_undegraded":"2024-04-25T02:29:19.672315+0000","last_fullsized":"2024-04-25T02:29:19.672315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:12.331317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.343881+0000","last_change":"2024-04-25T02:29:18.349482+0000","last_active":"2024-04-25T02:29:19.343881+0000","last_peered":"2024-04-25T02:29:19.343881+0000","last_clean":"2024-04-25T02:29:19.343881+0000","last_became_active":"2024-04-25T02:29:18.349216+0000","last_became_peered":"2024-04-25T02:29:18.349216+0000","last_unstale":"2024-04-25T02:29:19.343881+0000","last_undegraded":"2024-04-25T02:29:19.343881+0000","last_fullsized":"2024-04-25T02:29:19.343881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:11.549908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671823+0000","last_change":"2024-04-25T02:29:18.340910+0000","last_active":"2024-04-25T02:29:19.671823+0000","last_peered":"2024-04-25T02:29:19.671823+0000","last_clean":"2024-04-25T02:29:19.671823+0000","last_became_active":"2024-04-25T02:29:18.340634+0000","last_became_peered":"2024-04-25T02:29:18.340634+0000","last_unstale":"2024-04-25T02:29:19.671823+0000","last_undegraded":"2024-04-25T02:29:19.671823+0000","last_fullsized":"2024-04-25T02:29:19.671823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:03:39.193545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.392666+0000","last_change":"2024-04-25T02:29:18.341922+0000","last_active":"2024-04-25T02:29:19.392666+0000","last_peered":"2024-04-25T02:29:19.392666+0000","last_clean":"2024-04-25T02:29:19.392666+0000","last_became_active":"2024-04-25T02:29:18.341643+0000","last_became_peered":"2024-04-25T02:29:18.341643+0000","last_unstale":"2024-04-25T02:29:19.392666+0000","last_undegraded":"2024-04-25T02:29:19.392666+0000","last_fullsized":"2024-04-25T02:29:19.392666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:11.463910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.343701+0000","last_change":"2024-04-25T02:29:18.336835+0000","last_active":"2024-04-25T02:29:19.343701+0000","last_peered":"2024-04-25T02:29:19.343701+0000","last_clean":"2024-04-25T02:29:19.343701+0000","last_became_active":"2024-04-25T02:29:18.336550+0000","last_became_peered":"2024-04-25T02:29:18.336550+0000","last_unstale":"2024-04-25T02:29:19.343701+0000","last_undegraded":"2024-04-25T02:29:19.343701+0000","last_fullsized":"2024-04-25T02:29:19.343701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:08.133055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.672104+0000","last_change":"2024-04-25T02:29:18.352970+0000","last_active":"2024-04-25T02:29:19.672104+0000","last_peered":"2024-04-25T02:29:19.672104+0000","last_clean":"2024-04-25T02:29:19.672104+0000","last_became_active":"2024-04-25T02:29:18.352750+0000","last_became_peered":"2024-04-25T02:29:18.352750+0000","last_unstale":"2024-04-25T02:29:19.672104+0000","last_undegraded":"2024-04-25T02:29:19.672104+0000","last_fullsized":"2024-04-25T02:29:19.672104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:51.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.672433+0000","last_change":"2024-04-25T02:29:18.350283+0000","last_active":"2024-04-25T02:29:19.672433+0000","last_peered":"2024-04-25T02:29:19.672433+0000","last_clean":"2024-04-25T02:29:19.672433+0000","last_became_active":"2024-04-25T02:29:18.349442+0000","last_became_peered":"2024-04-25T02:29:18.349442+0000","last_unstale":"2024-04-25T02:29:19.672433+0000","last_undegraded":"2024-04-25T02:29:19.672433+0000","last_fullsized":"2024-04-25T02:29:19.672433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:43.794215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.393069+0000","last_change":"2024-04-25T02:29:18.346919+0000","last_active":"2024-04-25T02:29:19.393069+0000","last_peered":"2024-04-25T02:29:19.393069+0000","last_clean":"2024-04-25T02:29:19.393069+0000","last_became_active":"2024-04-25T02:29:18.345267+0000","last_became_peered":"2024-04-25T02:29:18.345267+0000","last_unstale":"2024-04-25T02:29:19.393069+0000","last_undegraded":"2024-04-25T02:29:19.393069+0000","last_fullsized":"2024-04-25T02:29:19.393069+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:30:19.816087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.392883+0000","last_change":"2024-04-25T02:29:18.343532+0000","last_active":"2024-04-25T02:29:19.392883+0000","last_peered":"2024-04-25T02:29:19.392883+0000","last_clean":"2024-04-25T02:29:19.392883+0000","last_became_active":"2024-04-25T02:29:18.343242+0000","last_became_peered":"2024-04-25T02:29:18.343242+0000","last_unstale":"2024-04-25T02:29:19.392883+0000","last_undegraded":"2024-04-25T02:29:19.392883+0000","last_fullsized":"2024-04-25T02:29:19.392883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:12.331317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671843+0000","last_change":"2024-04-25T02:29:18.348342+0000","last_active":"2024-04-25T02:29:19.671843+0000","last_peered":"2024-04-25T02:29:19.671843+0000","last_clean":"2024-04-25T02:29:19.671843+0000","last_became_active":"2024-04-25T02:29:18.348055+0000","last_became_peered":"2024-04-25T02:29:18.348055+0000","last_unstale":"2024-04-25T02:29:19.671843+0000","last_undegraded":"2024-04-25T02:29:19.671843+0000","last_fullsized":"2024-04-25T02:29:19.671843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:53.335059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.344044+0000","last_change":"2024-04-25T02:29:18.339396+0000","last_active":"2024-04-25T02:29:19.344044+0000","last_peered":"2024-04-25T02:29:19.344044+0000","last_clean":"2024-04-25T02:29:19.344044+0000","last_became_active":"2024-04-25T02:29:18.339130+0000","last_became_peered":"2024-04-25T02:29:18.339130+0000","last_unstale":"2024-04-25T02:29:19.344044+0000","last_undegraded":"2024-04-25T02:29:19.344044+0000","last_fullsized":"2024-04-25T02:29:19.344044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.343877+0000","last_change":"2024-04-25T02:29:18.337818+0000","last_active":"2024-04-25T02:29:19.343877+0000","last_peered":"2024-04-25T02:29:19.343877+0000","last_clean":"2024-04-25T02:29:19.343877+0000","last_became_active":"2024-04-25T02:29:18.337470+0000","last_became_peered":"2024-04-25T02:29:18.337470+0000","last_unstale":"2024-04-25T02:29:19.343877+0000","last_undegraded":"2024-04-25T02:29:19.343877+0000","last_fullsized":"2024-04-25T02:29:19.343877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:23.649134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.342303+0000","last_change":"2024-04-25T02:29:18.344898+0000","last_active":"2024-04-25T02:29:19.342303+0000","last_peered":"2024-04-25T02:29:19.342303+0000","last_clean":"2024-04-25T02:29:19.342303+0000","last_became_active":"2024-04-25T02:29:18.344617+0000","last_became_peered":"2024-04-25T02:29:18.344617+0000","last_unstale":"2024-04-25T02:29:19.342303+0000","last_undegraded":"2024-04-25T02:29:19.342303+0000","last_fullsized":"2024-04-25T02:29:19.342303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:33.371549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.343585+0000","last_change":"2024-04-25T02:29:18.339252+0000","last_active":"2024-04-25T02:29:19.343585+0000","last_peered":"2024-04-25T02:29:19.343585+0000","last_clean":"2024-04-25T02:29:19.343585+0000","last_became_active":"2024-04-25T02:29:18.338939+0000","last_became_peered":"2024-04-25T02:29:18.338939+0000","last_unstale":"2024-04-25T02:29:19.343585+0000","last_undegraded":"2024-04-25T02:29:19.343585+0000","last_fullsized":"2024-04-25T02:29:19.343585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:50.388712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.672303+0000","last_change":"2024-04-25T02:29:18.346821+0000","last_active":"2024-04-25T02:29:19.672303+0000","last_peered":"2024-04-25T02:29:19.672303+0000","last_clean":"2024-04-25T02:29:19.672303+0000","last_became_active":"2024-04-25T02:29:18.346488+0000","last_became_peered":"2024-04-25T02:29:18.346488+0000","last_unstale":"2024-04-25T02:29:19.672303+0000","last_undegraded":"2024-04-25T02:29:19.672303+0000","last_fullsized":"2024-04-25T02:29:19.672303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:11.549908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.393120+0000","last_change":"2024-04-25T02:29:18.351850+0000","last_active":"2024-04-25T02:29:19.393120+0000","last_peered":"2024-04-25T02:29:19.393120+0000","last_clean":"2024-04-25T02:29:19.393120+0000","last_became_active":"2024-04-25T02:29:18.351485+0000","last_became_peered":"2024-04-25T02:29:18.351485+0000","last_unstale":"2024-04-25T02:29:19.393120+0000","last_undegraded":"2024-04-25T02:29:19.393120+0000","last_fullsized":"2024-04-25T02:29:19.393120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:48.106103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.673122+0000","last_change":"2024-04-25T02:29:18.356143+0000","last_active":"2024-04-25T02:29:19.673122+0000","last_peered":"2024-04-25T02:29:19.673122+0000","last_clean":"2024-04-25T02:29:19.673122+0000","last_became_active":"2024-04-25T02:29:18.355742+0000","last_became_peered":"2024-04-25T02:29:18.355742+0000","last_unstale":"2024-04-25T02:29:19.673122+0000","last_undegraded":"2024-04-25T02:29:19.673122+0000","last_fullsized":"2024-04-25T02:29:19.673122+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:26.891694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.344219+0000","last_change":"2024-04-25T02:29:18.341797+0000","last_active":"2024-04-25T02:29:19.344219+0000","last_peered":"2024-04-25T02:29:19.344219+0000","last_clean":"2024-04-25T02:29:19.344219+0000","last_became_active":"2024-04-25T02:29:18.341492+0000","last_became_peered":"2024-04-25T02:29:18.341492+0000","last_unstale":"2024-04-25T02:29:19.344219+0000","last_undegraded":"2024-04-25T02:29:19.344219+0000","last_fullsized":"2024-04-25T02:29:19.344219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:14.176273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.344229+0000","last_change":"2024-04-25T02:29:18.351144+0000","last_active":"2024-04-25T02:29:19.344229+0000","last_peered":"2024-04-25T02:29:19.344229+0000","last_clean":"2024-04-25T02:29:19.344229+0000","last_became_active":"2024-04-25T02:29:18.350844+0000","last_became_peered":"2024-04-25T02:29:18.350844+0000","last_unstale":"2024-04-25T02:29:19.344229+0000","last_undegraded":"2024-04-25T02:29:19.344229+0000","last_fullsized":"2024-04-25T02:29:19.344229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:30.728990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.672018+0000","last_change":"2024-04-25T02:29:18.349494+0000","last_active":"2024-04-25T02:29:19.672018+0000","last_peered":"2024-04-25T02:29:19.672018+0000","last_clean":"2024-04-25T02:29:19.672018+0000","last_became_active":"2024-04-25T02:29:18.349186+0000","last_became_peered":"2024-04-25T02:29:18.349186+0000","last_unstale":"2024-04-25T02:29:19.672018+0000","last_undegraded":"2024-04-25T02:29:19.672018+0000","last_fullsized":"2024-04-25T02:29:19.672018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:28.243340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671694+0000","last_change":"2024-04-25T02:29:18.342571+0000","last_active":"2024-04-25T02:29:19.671694+0000","last_peered":"2024-04-25T02:29:19.671694+0000","last_clean":"2024-04-25T02:29:19.671694+0000","last_became_active":"2024-04-25T02:29:18.341248+0000","last_became_peered":"2024-04-25T02:29:18.341248+0000","last_unstale":"2024-04-25T02:29:19.671694+0000","last_undegraded":"2024-04-25T02:29:19.671694+0000","last_fullsized":"2024-04-25T02:29:19.671694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:23.649134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671683+0000","last_change":"2024-04-25T02:29:18.348376+0000","last_active":"2024-04-25T02:29:19.671683+0000","last_peered":"2024-04-25T02:29:19.671683+0000","last_clean":"2024-04-25T02:29:19.671683+0000","last_became_active":"2024-04-25T02:29:18.347730+0000","last_became_peered":"2024-04-25T02:29:18.347730+0000","last_unstale":"2024-04-25T02:29:19.671683+0000","last_undegraded":"2024-04-25T02:29:19.671683+0000","last_fullsized":"2024-04-25T02:29:19.671683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:14.176273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.342602+0000","last_change":"2024-04-25T02:29:18.344161+0000","last_active":"2024-04-25T02:29:19.342602+0000","last_peered":"2024-04-25T02:29:19.342602+0000","last_clean":"2024-04-25T02:29:19.342602+0000","last_became_active":"2024-04-25T02:29:18.343890+0000","last_became_peered":"2024-04-25T02:29:18.343890+0000","last_unstale":"2024-04-25T02:29:19.342602+0000","last_undegraded":"2024-04-25T02:29:19.342602+0000","last_fullsized":"2024-04-25T02:29:19.342602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:13.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.672079+0000","last_change":"2024-04-25T02:29:17.336150+0000","last_active":"2024-04-25T02:29:19.672079+0000","last_peered":"2024-04-25T02:29:19.672079+0000","last_clean":"2024-04-25T02:29:19.672079+0000","last_became_active":"2024-04-25T02:29:17.335858+0000","last_became_peered":"2024-04-25T02:29:17.335858+0000","last_unstale":"2024-04-25T02:29:19.672079+0000","last_undegraded":"2024-04-25T02:29:19.672079+0000","last_fullsized":"2024-04-25T02:29:19.672079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:22.380376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.672072+0000","last_change":"2024-04-25T02:29:18.344188+0000","last_active":"2024-04-25T02:29:19.672072+0000","last_peered":"2024-04-25T02:29:19.672072+0000","last_clean":"2024-04-25T02:29:19.672072+0000","last_became_active":"2024-04-25T02:29:18.343887+0000","last_became_peered":"2024-04-25T02:29:18.343887+0000","last_unstale":"2024-04-25T02:29:19.672072+0000","last_undegraded":"2024-04-25T02:29:19.672072+0000","last_fullsized":"2024-04-25T02:29:19.672072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:18.991459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.342625+0000","last_change":"2024-04-25T02:29:17.338792+0000","last_active":"2024-04-25T02:29:19.342625+0000","last_peered":"2024-04-25T02:29:19.342625+0000","last_clean":"2024-04-25T02:29:19.342625+0000","last_became_active":"2024-04-25T02:29:17.338431+0000","last_became_peered":"2024-04-25T02:29:17.338431+0000","last_unstale":"2024-04-25T02:29:19.342625+0000","last_undegraded":"2024-04-25T02:29:19.342625+0000","last_fullsized":"2024-04-25T02:29:19.342625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:37:20.446428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.344083+0000","last_change":"2024-04-25T02:29:18.349592+0000","last_active":"2024-04-25T02:29:19.344083+0000","last_peered":"2024-04-25T02:29:19.344083+0000","last_clean":"2024-04-25T02:29:19.344083+0000","last_became_active":"2024-04-25T02:29:18.349296+0000","last_became_peered":"2024-04-25T02:29:18.349296+0000","last_unstale":"2024-04-25T02:29:19.344083+0000","last_undegraded":"2024-04-25T02:29:19.344083+0000","last_fullsized":"2024-04-25T02:29:19.344083+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:18.991459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.392795+0000","last_change":"2024-04-25T02:29:17.343354+0000","last_active":"2024-04-25T02:29:19.392795+0000","last_peered":"2024-04-25T02:29:19.392795+0000","last_clean":"2024-04-25T02:29:19.392795+0000","last_became_active":"2024-04-25T02:29:17.343032+0000","last_became_peered":"2024-04-25T02:29:17.343032+0000","last_unstale":"2024-04-25T02:29:19.392795+0000","last_undegraded":"2024-04-25T02:29:19.392795+0000","last_fullsized":"2024-04-25T02:29:19.392795+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:17.984215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.673245+0000","last_change":"2024-04-25T02:29:18.354469+0000","last_active":"2024-04-25T02:29:19.673245+0000","last_peered":"2024-04-25T02:29:19.673245+0000","last_clean":"2024-04-25T02:29:19.673245+0000","last_became_active":"2024-04-25T02:29:18.354133+0000","last_became_peered":"2024-04-25T02:29:18.354133+0000","last_unstale":"2024-04-25T02:29:19.673245+0000","last_undegraded":"2024-04-25T02:29:19.673245+0000","last_fullsized":"2024-04-25T02:29:19.673245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:43.238638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671977+0000","last_change":"2024-04-25T02:29:17.343565+0000","last_active":"2024-04-25T02:29:19.671977+0000","last_peered":"2024-04-25T02:29:19.671977+0000","last_clean":"2024-04-25T02:29:19.671977+0000","last_became_active":"2024-04-25T02:29:17.343267+0000","last_became_peered":"2024-04-25T02:29:17.343267+0000","last_unstale":"2024-04-25T02:29:19.671977+0000","last_undegraded":"2024-04-25T02:29:19.671977+0000","last_fullsized":"2024-04-25T02:29:19.671977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:58.779414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.672043+0000","last_change":"2024-04-25T02:29:18.349899+0000","last_active":"2024-04-25T02:29:19.672043+0000","last_peered":"2024-04-25T02:29:19.672043+0000","last_clean":"2024-04-25T02:29:19.672043+0000","last_became_active":"2024-04-25T02:29:18.349625+0000","last_became_peered":"2024-04-25T02:29:18.349625+0000","last_unstale":"2024-04-25T02:29:19.672043+0000","last_undegraded":"2024-04-25T02:29:19.672043+0000","last_fullsized":"2024-04-25T02:29:19.672043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:28.218463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.344660+0000","last_change":"2024-04-25T02:29:17.345642+0000","last_active":"2024-04-25T02:29:19.344660+0000","last_peered":"2024-04-25T02:29:19.344660+0000","last_clean":"2024-04-25T02:29:19.344660+0000","last_became_active":"2024-04-25T02:29:17.345311+0000","last_became_peered":"2024-04-25T02:29:17.345311+0000","last_unstale":"2024-04-25T02:29:19.344660+0000","last_undegraded":"2024-04-25T02:29:19.344660+0000","last_fullsized":"2024-04-25T02:29:19.344660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:48.636227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.343819+0000","last_change":"2024-04-25T02:29:18.342591+0000","last_active":"2024-04-25T02:29:19.343819+0000","last_peered":"2024-04-25T02:29:19.343819+0000","last_clean":"2024-04-25T02:29:19.343819+0000","last_became_active":"2024-04-25T02:29:18.341689+0000","last_became_peered":"2024-04-25T02:29:18.341689+0000","last_unstale":"2024-04-25T02:29:19.343819+0000","last_undegraded":"2024-04-25T02:29:19.343819+0000","last_fullsized":"2024-04-25T02:29:19.343819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:02:32.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.344293+0000","last_change":"2024-04-25T02:29:17.345509+0000","last_active":"2024-04-25T02:29:19.344293+0000","last_peered":"2024-04-25T02:29:19.344293+0000","last_clean":"2024-04-25T02:29:19.344293+0000","last_became_active":"2024-04-25T02:29:17.345209+0000","last_became_peered":"2024-04-25T02:29:17.345209+0000","last_unstale":"2024-04-25T02:29:19.344293+0000","last_undegraded":"2024-04-25T02:29:19.344293+0000","last_fullsized":"2024-04-25T02:29:19.344293+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:22:26.682356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.343497+0000","last_change":"2024-04-25T02:29:18.334322+0000","last_active":"2024-04-25T02:29:19.343497+0000","last_peered":"2024-04-25T02:29:19.343497+0000","last_clean":"2024-04-25T02:29:19.343497+0000","last_became_active":"2024-04-25T02:29:18.334017+0000","last_became_peered":"2024-04-25T02:29:18.334017+0000","last_unstale":"2024-04-25T02:29:19.343497+0000","last_undegraded":"2024-04-25T02:29:19.343497+0000","last_fullsized":"2024-04-25T02:29:19.343497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:33.371549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.392422+0000","last_change":"2024-04-25T02:29:17.344030+0000","last_active":"2024-04-25T02:29:19.392422+0000","last_peered":"2024-04-25T02:29:19.392422+0000","last_clean":"2024-04-25T02:29:19.392422+0000","last_became_active":"2024-04-25T02:29:17.343766+0000","last_became_peered":"2024-04-25T02:29:17.343766+0000","last_unstale":"2024-04-25T02:29:19.392422+0000","last_undegraded":"2024-04-25T02:29:19.392422+0000","last_fullsized":"2024-04-25T02:29:19.392422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:32.364305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671667+0000","last_change":"2024-04-25T02:29:18.352367+0000","last_active":"2024-04-25T02:29:19.671667+0000","last_peered":"2024-04-25T02:29:19.671667+0000","last_clean":"2024-04-25T02:29:19.671667+0000","last_became_active":"2024-04-25T02:29:18.351998+0000","last_became_peered":"2024-04-25T02:29:18.351998+0000","last_unstale":"2024-04-25T02:29:19.671667+0000","last_undegraded":"2024-04-25T02:29:19.671667+0000","last_fullsized":"2024-04-25T02:29:19.671667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:20.085001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.343434+0000","last_change":"2024-04-25T02:29:17.335287+0000","last_active":"2024-04-25T02:29:19.343434+0000","last_peered":"2024-04-25T02:29:19.343434+0000","last_clean":"2024-04-25T02:29:19.343434+0000","last_became_active":"2024-04-25T02:29:17.334613+0000","last_became_peered":"2024-04-25T02:29:17.334613+0000","last_unstale":"2024-04-25T02:29:19.343434+0000","last_undegraded":"2024-04-25T02:29:19.343434+0000","last_fullsized":"2024-04-25T02:29:19.343434+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:24.711459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.344351+0000","last_change":"2024-04-25T02:29:18.345717+0000","last_active":"2024-04-25T02:29:19.344351+0000","last_peered":"2024-04-25T02:29:19.344351+0000","last_clean":"2024-04-25T02:29:19.344351+0000","last_became_active":"2024-04-25T02:29:18.345430+0000","last_became_peered":"2024-04-25T02:29:18.345430+0000","last_unstale":"2024-04-25T02:29:19.344351+0000","last_undegraded":"2024-04-25T02:29:19.344351+0000","last_fullsized":"2024-04-25T02:29:19.344351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:26.891694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.392910+0000","last_change":"2024-04-25T02:29:17.344786+0000","last_active":"2024-04-25T02:29:19.392910+0000","last_peered":"2024-04-25T02:29:19.392910+0000","last_clean":"2024-04-25T02:29:19.392910+0000","last_became_active":"2024-04-25T02:29:17.344395+0000","last_became_peered":"2024-04-25T02:29:17.344395+0000","last_unstale":"2024-04-25T02:29:19.392910+0000","last_undegraded":"2024-04-25T02:29:19.392910+0000","last_fullsized":"2024-04-25T02:29:19.392910+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:12.515961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.392943+0000","last_change":"2024-04-25T02:29:18.344217+0000","last_active":"2024-04-25T02:29:19.392943+0000","last_peered":"2024-04-25T02:29:19.392943+0000","last_clean":"2024-04-25T02:29:19.392943+0000","last_became_active":"2024-04-25T02:29:18.343885+0000","last_became_peered":"2024-04-25T02:29:18.343885+0000","last_unstale":"2024-04-25T02:29:19.392943+0000","last_undegraded":"2024-04-25T02:29:19.392943+0000","last_fullsized":"2024-04-25T02:29:19.392943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:43.794215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.342713+0000","last_change":"2024-04-25T02:29:17.344529+0000","last_active":"2024-04-25T02:29:19.342713+0000","last_peered":"2024-04-25T02:29:19.342713+0000","last_clean":"2024-04-25T02:29:19.342713+0000","last_became_active":"2024-04-25T02:29:17.344194+0000","last_became_peered":"2024-04-25T02:29:17.344194+0000","last_unstale":"2024-04-25T02:29:19.342713+0000","last_undegraded":"2024-04-25T02:29:19.342713+0000","last_fullsized":"2024-04-25T02:29:19.342713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:03:38.186300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.392860+0000","last_change":"2024-04-25T02:29:18.350354+0000","last_active":"2024-04-25T02:29:19.392860+0000","last_peered":"2024-04-25T02:29:19.392860+0000","last_clean":"2024-04-25T02:29:19.392860+0000","last_became_active":"2024-04-25T02:29:18.350033+0000","last_became_peered":"2024-04-25T02:29:18.350033+0000","last_unstale":"2024-04-25T02:29:19.392860+0000","last_undegraded":"2024-04-25T02:29:19.392860+0000","last_fullsized":"2024-04-25T02:29:19.392860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:26:42.031650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.344615+0000","last_change":"2024-04-25T02:29:17.339319+0000","last_active":"2024-04-25T02:29:19.344615+0000","last_peered":"2024-04-25T02:29:19.344615+0000","last_clean":"2024-04-25T02:29:19.344615+0000","last_became_active":"2024-04-25T02:29:17.339013+0000","last_became_peered":"2024-04-25T02:29:17.339013+0000","last_unstale":"2024-04-25T02:29:19.344615+0000","last_undegraded":"2024-04-25T02:29:19.344615+0000","last_fullsized":"2024-04-25T02:29:19.344615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:24.029388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.344382+0000","last_change":"2024-04-25T02:29:18.345320+0000","last_active":"2024-04-25T02:29:19.344382+0000","last_peered":"2024-04-25T02:29:19.344382+0000","last_clean":"2024-04-25T02:29:19.344382+0000","last_became_active":"2024-04-25T02:29:18.345005+0000","last_became_peered":"2024-04-25T02:29:18.345005+0000","last_unstale":"2024-04-25T02:29:19.344382+0000","last_undegraded":"2024-04-25T02:29:19.344382+0000","last_fullsized":"2024-04-25T02:29:19.344382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:43.238638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.392843+0000","last_change":"2024-04-25T02:29:17.347025+0000","last_active":"2024-04-25T02:29:19.392843+0000","last_peered":"2024-04-25T02:29:19.392843+0000","last_clean":"2024-04-25T02:29:19.392843+0000","last_became_active":"2024-04-25T02:29:17.346724+0000","last_became_peered":"2024-04-25T02:29:17.346724+0000","last_unstale":"2024-04-25T02:29:19.392843+0000","last_undegraded":"2024-04-25T02:29:19.392843+0000","last_fullsized":"2024-04-25T02:29:19.392843+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:13.727317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671928+0000","last_change":"2024-04-25T02:29:18.349195+0000","last_active":"2024-04-25T02:29:19.671928+0000","last_peered":"2024-04-25T02:29:19.671928+0000","last_clean":"2024-04-25T02:29:19.671928+0000","last_became_active":"2024-04-25T02:29:18.348904+0000","last_became_peered":"2024-04-25T02:29:18.348904+0000","last_unstale":"2024-04-25T02:29:19.671928+0000","last_undegraded":"2024-04-25T02:29:19.671928+0000","last_fullsized":"2024-04-25T02:29:19.671928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:50.388712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.344417+0000","last_change":"2024-04-25T02:29:17.333661+0000","last_active":"2024-04-25T02:29:19.344417+0000","last_peered":"2024-04-25T02:29:19.344417+0000","last_clean":"2024-04-25T02:29:19.344417+0000","last_became_active":"2024-04-25T02:29:17.333166+0000","last_became_peered":"2024-04-25T02:29:17.333166+0000","last_unstale":"2024-04-25T02:29:19.344417+0000","last_undegraded":"2024-04-25T02:29:19.344417+0000","last_fullsized":"2024-04-25T02:29:19.344417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:37:20.446428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.392801+0000","last_change":"2024-04-25T02:29:18.351870+0000","last_active":"2024-04-25T02:29:19.392801+0000","last_peered":"2024-04-25T02:29:19.392801+0000","last_clean":"2024-04-25T02:29:19.392801+0000","last_became_active":"2024-04-25T02:29:18.347590+0000","last_became_peered":"2024-04-25T02:29:18.347590+0000","last_unstale":"2024-04-25T02:29:19.392801+0000","last_undegraded":"2024-04-25T02:29:19.392801+0000","last_fullsized":"2024-04-25T02:29:19.392801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:18:37.891123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671891+0000","last_change":"2024-04-25T02:29:17.340109+0000","last_active":"2024-04-25T02:29:19.671891+0000","last_peered":"2024-04-25T02:29:19.671891+0000","last_clean":"2024-04-25T02:29:19.671891+0000","last_became_active":"2024-04-25T02:29:17.339787+0000","last_became_peered":"2024-04-25T02:29:17.339787+0000","last_unstale":"2024-04-25T02:29:19.671891+0000","last_undegraded":"2024-04-25T02:29:19.671891+0000","last_fullsized":"2024-04-25T02:29:19.671891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:24.525150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671885+0000","last_change":"2024-04-25T02:29:18.348361+0000","last_active":"2024-04-25T02:29:19.671885+0000","last_peered":"2024-04-25T02:29:19.671885+0000","last_clean":"2024-04-25T02:29:19.671885+0000","last_became_active":"2024-04-25T02:29:18.347942+0000","last_became_peered":"2024-04-25T02:29:18.347942+0000","last_unstale":"2024-04-25T02:29:19.671885+0000","last_undegraded":"2024-04-25T02:29:19.671885+0000","last_fullsized":"2024-04-25T02:29:19.671885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:43.238638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.392511+0000","last_change":"2024-04-25T02:29:17.344628+0000","last_active":"2024-04-25T02:29:19.392511+0000","last_peered":"2024-04-25T02:29:19.392511+0000","last_clean":"2024-04-25T02:29:19.392511+0000","last_became_active":"2024-04-25T02:29:17.344358+0000","last_became_peered":"2024-04-25T02:29:17.344358+0000","last_unstale":"2024-04-25T02:29:19.392511+0000","last_undegraded":"2024-04-25T02:29:19.392511+0000","last_fullsized":"2024-04-25T02:29:19.392511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:22.641889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671752+0000","last_change":"2024-04-25T02:29:18.344070+0000","last_active":"2024-04-25T02:29:19.671752+0000","last_peered":"2024-04-25T02:29:19.671752+0000","last_clean":"2024-04-25T02:29:19.671752+0000","last_became_active":"2024-04-25T02:29:18.343693+0000","last_became_peered":"2024-04-25T02:29:18.343693+0000","last_unstale":"2024-04-25T02:29:19.671752+0000","last_undegraded":"2024-04-25T02:29:19.671752+0000","last_fullsized":"2024-04-25T02:29:19.671752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:14.734561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.392561+0000","last_change":"2024-04-25T02:29:17.347108+0000","last_active":"2024-04-25T02:29:19.392561+0000","last_peered":"2024-04-25T02:29:19.392561+0000","last_clean":"2024-04-25T02:29:19.392561+0000","last_became_active":"2024-04-25T02:29:17.346804+0000","last_became_peered":"2024-04-25T02:29:17.346804+0000","last_unstale":"2024-04-25T02:29:19.392561+0000","last_undegraded":"2024-04-25T02:29:19.392561+0000","last_fullsized":"2024-04-25T02:29:19.392561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:47.231152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.343976+0000","last_change":"2024-04-25T02:29:18.346263+0000","last_active":"2024-04-25T02:29:19.343976+0000","last_peered":"2024-04-25T02:29:19.343976+0000","last_clean":"2024-04-25T02:29:19.343976+0000","last_became_active":"2024-04-25T02:29:18.345025+0000","last_became_peered":"2024-04-25T02:29:18.345025+0000","last_unstale":"2024-04-25T02:29:19.343976+0000","last_undegraded":"2024-04-25T02:29:19.343976+0000","last_fullsized":"2024-04-25T02:29:19.343976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:14.734561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.672462+0000","last_change":"2024-04-25T02:29:17.344650+0000","last_active":"2024-04-25T02:29:19.672462+0000","last_peered":"2024-04-25T02:29:19.672462+0000","last_clean":"2024-04-25T02:29:19.672462+0000","last_became_active":"2024-04-25T02:29:17.344289+0000","last_became_peered":"2024-04-25T02:29:17.344289+0000","last_unstale":"2024-04-25T02:29:19.672462+0000","last_undegraded":"2024-04-25T02:29:19.672462+0000","last_fullsized":"2024-04-25T02:29:19.672462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:36.286309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.344819+0000","last_change":"2024-04-25T02:29:18.346031+0000","last_active":"2024-04-25T02:29:19.344819+0000","last_peered":"2024-04-25T02:29:19.344819+0000","last_clean":"2024-04-25T02:29:19.344819+0000","last_became_active":"2024-04-25T02:29:18.344184+0000","last_became_peered":"2024-04-25T02:29:18.344184+0000","last_unstale":"2024-04-25T02:29:19.344819+0000","last_undegraded":"2024-04-25T02:29:19.344819+0000","last_fullsized":"2024-04-25T02:29:19.344819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:28.218463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.343978+0000","last_change":"2024-04-25T02:29:17.333575+0000","last_active":"2024-04-25T02:29:19.343978+0000","last_peered":"2024-04-25T02:29:19.343978+0000","last_clean":"2024-04-25T02:29:19.343978+0000","last_became_active":"2024-04-25T02:29:17.333263+0000","last_became_peered":"2024-04-25T02:29:17.333263+0000","last_unstale":"2024-04-25T02:29:19.343978+0000","last_undegraded":"2024-04-25T02:29:19.343978+0000","last_fullsized":"2024-04-25T02:29:19.343978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:17.632711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.672726+0000","last_change":"2024-04-25T02:29:18.355310+0000","last_active":"2024-04-25T02:29:19.672726+0000","last_peered":"2024-04-25T02:29:19.672726+0000","last_clean":"2024-04-25T02:29:19.672726+0000","last_became_active":"2024-04-25T02:29:18.354835+0000","last_became_peered":"2024-04-25T02:29:18.354835+0000","last_unstale":"2024-04-25T02:29:19.672726+0000","last_undegraded":"2024-04-25T02:29:19.672726+0000","last_fullsized":"2024-04-25T02:29:19.672726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:14.176273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.344234+0000","last_change":"2024-04-25T02:29:17.336493+0000","last_active":"2024-04-25T02:29:19.344234+0000","last_peered":"2024-04-25T02:29:19.344234+0000","last_clean":"2024-04-25T02:29:19.344234+0000","last_became_active":"2024-04-25T02:29:17.336162+0000","last_became_peered":"2024-04-25T02:29:17.336162+0000","last_unstale":"2024-04-25T02:29:19.344234+0000","last_undegraded":"2024-04-25T02:29:19.344234+0000","last_fullsized":"2024-04-25T02:29:19.344234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:30.373010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671684+0000","last_change":"2024-04-25T02:29:18.337364+0000","last_active":"2024-04-25T02:29:19.671684+0000","last_peered":"2024-04-25T02:29:19.671684+0000","last_clean":"2024-04-25T02:29:19.671684+0000","last_became_active":"2024-04-25T02:29:18.336958+0000","last_became_peered":"2024-04-25T02:29:18.336958+0000","last_unstale":"2024-04-25T02:29:19.671684+0000","last_undegraded":"2024-04-25T02:29:19.671684+0000","last_fullsized":"2024-04-25T02:29:19.671684+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:49.643471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.344185+0000","last_change":"2024-04-25T02:29:17.345750+0000","last_active":"2024-04-25T02:29:19.344185+0000","last_peered":"2024-04-25T02:29:19.344185+0000","last_clean":"2024-04-25T02:29:19.344185+0000","last_became_active":"2024-04-25T02:29:17.345215+0000","last_became_peered":"2024-04-25T02:29:17.345215+0000","last_unstale":"2024-04-25T02:29:19.344185+0000","last_undegraded":"2024-04-25T02:29:19.344185+0000","last_fullsized":"2024-04-25T02:29:19.344185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:43:25.978582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.673022+0000","last_change":"2024-04-25T02:29:18.344512+0000","last_active":"2024-04-25T02:29:19.673022+0000","last_peered":"2024-04-25T02:29:19.673022+0000","last_clean":"2024-04-25T02:29:19.673022+0000","last_became_active":"2024-04-25T02:29:18.344002+0000","last_became_peered":"2024-04-25T02:29:18.344002+0000","last_unstale":"2024-04-25T02:29:19.673022+0000","last_undegraded":"2024-04-25T02:29:19.673022+0000","last_fullsized":"2024-04-25T02:29:19.673022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:37.293554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.342600+0000","last_change":"2024-04-25T02:29:17.336327+0000","last_active":"2024-04-25T02:29:19.342600+0000","last_peered":"2024-04-25T02:29:19.342600+0000","last_clean":"2024-04-25T02:29:19.342600+0000","last_became_active":"2024-04-25T02:29:17.336061+0000","last_became_peered":"2024-04-25T02:29:17.336061+0000","last_unstale":"2024-04-25T02:29:19.342600+0000","last_undegraded":"2024-04-25T02:29:19.342600+0000","last_fullsized":"2024-04-25T02:29:19.342600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:22.380376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671956+0000","last_change":"2024-04-25T02:29:18.338302+0000","last_active":"2024-04-25T02:29:19.671956+0000","last_peered":"2024-04-25T02:29:19.671956+0000","last_clean":"2024-04-25T02:29:19.671956+0000","last_became_active":"2024-04-25T02:29:18.338039+0000","last_became_peered":"2024-04-25T02:29:18.338039+0000","last_unstale":"2024-04-25T02:29:19.671956+0000","last_undegraded":"2024-04-25T02:29:19.671956+0000","last_fullsized":"2024-04-25T02:29:19.671956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:23.387620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.672486+0000","last_change":"2024-04-25T02:29:17.343462+0000","last_active":"2024-04-25T02:29:19.672486+0000","last_peered":"2024-04-25T02:29:19.672486+0000","last_clean":"2024-04-25T02:29:19.672486+0000","last_became_active":"2024-04-25T02:29:17.343181+0000","last_became_peered":"2024-04-25T02:29:17.343181+0000","last_unstale":"2024-04-25T02:29:19.672486+0000","last_undegraded":"2024-04-25T02:29:19.672486+0000","last_fullsized":"2024-04-25T02:29:19.672486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:52.327814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671662+0000","last_change":"2024-04-25T02:29:18.338928+0000","last_active":"2024-04-25T02:29:19.671662+0000","last_peered":"2024-04-25T02:29:19.671662+0000","last_clean":"2024-04-25T02:29:19.671662+0000","last_became_active":"2024-04-25T02:29:18.338673+0000","last_became_peered":"2024-04-25T02:29:18.338673+0000","last_unstale":"2024-04-25T02:29:19.671662+0000","last_undegraded":"2024-04-25T02:29:19.671662+0000","last_fullsized":"2024-04-25T02:29:19.671662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:25.532394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.343483+0000","last_change":"2024-04-25T02:29:17.335254+0000","last_active":"2024-04-25T02:29:19.343483+0000","last_peered":"2024-04-25T02:29:19.343483+0000","last_clean":"2024-04-25T02:29:19.343483+0000","last_became_active":"2024-04-25T02:29:17.334973+0000","last_became_peered":"2024-04-25T02:29:17.334973+0000","last_unstale":"2024-04-25T02:29:19.343483+0000","last_undegraded":"2024-04-25T02:29:19.343483+0000","last_fullsized":"2024-04-25T02:29:19.343483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:59.526492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671657+0000","last_change":"2024-04-25T02:29:18.347506+0000","last_active":"2024-04-25T02:29:19.671657+0000","last_peered":"2024-04-25T02:29:19.671657+0000","last_clean":"2024-04-25T02:29:19.671657+0000","last_became_active":"2024-04-25T02:29:18.347214+0000","last_became_peered":"2024-04-25T02:29:18.347214+0000","last_unstale":"2024-04-25T02:29:19.671657+0000","last_undegraded":"2024-04-25T02:29:19.671657+0000","last_fullsized":"2024-04-25T02:29:19.671657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:02:32.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.343831+0000","last_change":"2024-04-25T02:29:17.341124+0000","last_active":"2024-04-25T02:29:19.343831+0000","last_peered":"2024-04-25T02:29:19.343831+0000","last_clean":"2024-04-25T02:29:19.343831+0000","last_became_active":"2024-04-25T02:29:17.340870+0000","last_became_peered":"2024-04-25T02:29:17.340870+0000","last_unstale":"2024-04-25T02:29:19.343831+0000","last_undegraded":"2024-04-25T02:29:19.343831+0000","last_fullsized":"2024-04-25T02:29:19.343831+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:36.286309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671786+0000","last_change":"2024-04-25T02:29:18.346689+0000","last_active":"2024-04-25T02:29:19.671786+0000","last_peered":"2024-04-25T02:29:19.671786+0000","last_clean":"2024-04-25T02:29:19.671786+0000","last_became_active":"2024-04-25T02:29:18.346385+0000","last_became_peered":"2024-04-25T02:29:18.346385+0000","last_unstale":"2024-04-25T02:29:19.671786+0000","last_undegraded":"2024-04-25T02:29:19.671786+0000","last_fullsized":"2024-04-25T02:29:19.671786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:37:21.453673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.672556+0000","last_change":"2024-04-25T02:29:17.341566+0000","last_active":"2024-04-25T02:29:19.672556+0000","last_peered":"2024-04-25T02:29:19.672556+0000","last_clean":"2024-04-25T02:29:19.672556+0000","last_became_active":"2024-04-25T02:29:17.341005+0000","last_became_peered":"2024-04-25T02:29:17.341005+0000","last_unstale":"2024-04-25T02:29:19.672556+0000","last_undegraded":"2024-04-25T02:29:19.672556+0000","last_fullsized":"2024-04-25T02:29:19.672556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:24.029388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.344901+0000","last_change":"2024-04-25T02:29:18.346646+0000","last_active":"2024-04-25T02:29:19.344901+0000","last_peered":"2024-04-25T02:29:19.344901+0000","last_clean":"2024-04-25T02:29:19.344901+0000","last_became_active":"2024-04-25T02:29:18.346377+0000","last_became_peered":"2024-04-25T02:29:18.346377+0000","last_unstale":"2024-04-25T02:29:19.344901+0000","last_undegraded":"2024-04-25T02:29:19.344901+0000","last_fullsized":"2024-04-25T02:29:19.344901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:51.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.342784+0000","last_change":"2024-04-25T02:29:17.339450+0000","last_active":"2024-04-25T02:29:19.342784+0000","last_peered":"2024-04-25T02:29:19.342784+0000","last_clean":"2024-04-25T02:29:19.342784+0000","last_became_active":"2024-04-25T02:29:17.339041+0000","last_became_peered":"2024-04-25T02:29:17.339041+0000","last_unstale":"2024-04-25T02:29:19.342784+0000","last_undegraded":"2024-04-25T02:29:19.342784+0000","last_fullsized":"2024-04-25T02:29:19.342784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:52.327814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.342498+0000","last_change":"2024-04-25T02:29:18.343320+0000","last_active":"2024-04-25T02:29:19.342498+0000","last_peered":"2024-04-25T02:29:19.342498+0000","last_clean":"2024-04-25T02:29:19.342498+0000","last_became_active":"2024-04-25T02:29:18.343045+0000","last_became_peered":"2024-04-25T02:29:18.343045+0000","last_unstale":"2024-04-25T02:29:19.342498+0000","last_undegraded":"2024-04-25T02:29:19.342498+0000","last_fullsized":"2024-04-25T02:29:19.342498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:23.649134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.672678+0000","last_change":"2024-04-25T02:29:17.338937+0000","last_active":"2024-04-25T02:29:19.672678+0000","last_peered":"2024-04-25T02:29:19.672678+0000","last_clean":"2024-04-25T02:29:19.672678+0000","last_became_active":"2024-04-25T02:29:17.338636+0000","last_became_peered":"2024-04-25T02:29:17.338636+0000","last_unstale":"2024-04-25T02:29:19.672678+0000","last_undegraded":"2024-04-25T02:29:19.672678+0000","last_fullsized":"2024-04-25T02:29:19.672678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:13.412200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.672512+0000","last_change":"2024-04-25T02:29:18.341511+0000","last_active":"2024-04-25T02:29:19.672512+0000","last_peered":"2024-04-25T02:29:19.672512+0000","last_clean":"2024-04-25T02:29:19.672512+0000","last_became_active":"2024-04-25T02:29:18.341233+0000","last_became_peered":"2024-04-25T02:29:18.341233+0000","last_unstale":"2024-04-25T02:29:19.672512+0000","last_undegraded":"2024-04-25T02:29:19.672512+0000","last_fullsized":"2024-04-25T02:29:19.672512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:30.728990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.342714+0000","last_change":"2024-04-25T02:29:17.335618+0000","last_active":"2024-04-25T02:29:19.342714+0000","last_peered":"2024-04-25T02:29:19.342714+0000","last_clean":"2024-04-25T02:29:19.342714+0000","last_became_active":"2024-04-25T02:29:17.335113+0000","last_became_peered":"2024-04-25T02:29:17.335113+0000","last_unstale":"2024-04-25T02:29:19.342714+0000","last_undegraded":"2024-04-25T02:29:19.342714+0000","last_fullsized":"2024-04-25T02:29:19.342714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:09:24.525150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.342555+0000","last_change":"2024-04-25T02:29:18.343189+0000","last_active":"2024-04-25T02:29:19.342555+0000","last_peered":"2024-04-25T02:29:19.342555+0000","last_clean":"2024-04-25T02:29:19.342555+0000","last_became_active":"2024-04-25T02:29:18.342880+0000","last_became_peered":"2024-04-25T02:29:18.342880+0000","last_unstale":"2024-04-25T02:29:19.342555+0000","last_undegraded":"2024-04-25T02:29:19.342555+0000","last_fullsized":"2024-04-25T02:29:19.342555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:14.734561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671986+0000","last_change":"2024-04-25T02:29:17.342369+0000","last_active":"2024-04-25T02:29:19.671986+0000","last_peered":"2024-04-25T02:29:19.671986+0000","last_clean":"2024-04-25T02:29:19.671986+0000","last_became_active":"2024-04-25T02:29:17.342038+0000","last_became_peered":"2024-04-25T02:29:17.342038+0000","last_unstale":"2024-04-25T02:29:19.671986+0000","last_undegraded":"2024-04-25T02:29:19.671986+0000","last_fullsized":"2024-04-25T02:29:19.671986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:22.380376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.392448+0000","last_change":"2024-04-25T02:29:18.346427+0000","last_active":"2024-04-25T02:29:19.392448+0000","last_peered":"2024-04-25T02:29:19.392448+0000","last_clean":"2024-04-25T02:29:19.392448+0000","last_became_active":"2024-04-25T02:29:18.344252+0000","last_became_peered":"2024-04-25T02:29:18.344252+0000","last_unstale":"2024-04-25T02:29:19.392448+0000","last_undegraded":"2024-04-25T02:29:19.392448+0000","last_fullsized":"2024-04-25T02:29:19.392448+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:04:28.218463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.344576+0000","last_change":"2024-04-25T02:29:17.334132+0000","last_active":"2024-04-25T02:29:19.344576+0000","last_peered":"2024-04-25T02:29:19.344576+0000","last_clean":"2024-04-25T02:29:19.344576+0000","last_became_active":"2024-04-25T02:29:17.333432+0000","last_became_peered":"2024-04-25T02:29:17.333432+0000","last_unstale":"2024-04-25T02:29:19.344576+0000","last_undegraded":"2024-04-25T02:29:19.344576+0000","last_fullsized":"2024-04-25T02:29:19.344576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:12:36.993064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.344573+0000","last_change":"2024-04-25T02:29:18.350496+0000","last_active":"2024-04-25T02:29:19.344573+0000","last_peered":"2024-04-25T02:29:19.344573+0000","last_clean":"2024-04-25T02:29:19.344573+0000","last_became_active":"2024-04-25T02:29:18.350230+0000","last_became_peered":"2024-04-25T02:29:18.350230+0000","last_unstale":"2024-04-25T02:29:19.344573+0000","last_undegraded":"2024-04-25T02:29:19.344573+0000","last_fullsized":"2024-04-25T02:29:19.344573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:20.085001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.392462+0000","last_change":"2024-04-25T02:29:17.345243+0000","last_active":"2024-04-25T02:29:19.392462+0000","last_peered":"2024-04-25T02:29:19.392462+0000","last_clean":"2024-04-25T02:29:19.392462+0000","last_became_active":"2024-04-25T02:29:17.344978+0000","last_became_peered":"2024-04-25T02:29:17.344978+0000","last_unstale":"2024-04-25T02:29:19.392462+0000","last_undegraded":"2024-04-25T02:29:19.392462+0000","last_fullsized":"2024-04-25T02:29:19.392462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:13.412200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671880+0000","last_change":"2024-04-25T02:29:18.346721+0000","last_active":"2024-04-25T02:29:19.671880+0000","last_peered":"2024-04-25T02:29:19.671880+0000","last_clean":"2024-04-25T02:29:19.671880+0000","last_became_active":"2024-04-25T02:29:18.346444+0000","last_became_peered":"2024-04-25T02:29:18.346444+0000","last_unstale":"2024-04-25T02:29:19.671880+0000","last_undegraded":"2024-04-25T02:29:19.671880+0000","last_fullsized":"2024-04-25T02:29:19.671880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:17.313167+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.313167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:26.891694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671809+0000","last_change":"2024-04-25T02:29:17.336098+0000","last_active":"2024-04-25T02:29:19.671809+0000","last_peered":"2024-04-25T02:29:19.671809+0000","last_clean":"2024-04-25T02:29:19.671809+0000","last_became_active":"2024-04-25T02:29:17.335825+0000","last_became_peered":"2024-04-25T02:29:17.335825+0000","last_unstale":"2024-04-25T02:29:19.671809+0000","last_undegraded":"2024-04-25T02:29:19.671809+0000","last_fullsized":"2024-04-25T02:29:19.671809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:16.305922+0000","last_clean_scrub_stamp":"2024-04-25T02:29:16.305922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:03:38.186300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.671432+0000","last_change":"2024-04-25T02:28:15.520345+0000","last_active":"2024-04-25T02:29:19.671432+0000","last_peered":"2024-04-25T02:29:19.671432+0000","last_clean":"2024-04-25T02:29:19.671432+0000","last_became_active":"2024-04-25T02:28:15.519317+0000","last_became_peered":"2024-04-25T02:28:15.519317+0000","last_unstale":"2024-04-25T02:29:19.671432+0000","last_undegraded":"2024-04-25T02:29:19.671432+0000","last_fullsized":"2024-04-25T02:29:19.671432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_clean_scrub_stamp":"2024-04-25T02:28:14.374327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:20.125523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":737066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":146712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":148242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":146678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":148242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":736976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:29:26.116 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T02:29:26.116 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T02:29:26.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.255+0000 7fc40d134640 1 Processor -- start 2024-04-25T02:29:26.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.255+0000 7fc40d134640 1 -- start start 2024-04-25T02:29:26.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.256+0000 7fc40d134640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40806b7f0 0x7fc4080b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.256+0000 7fc40d134640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc40815e830 0x7fc4080b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.256+0000 7fc40d134640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4080b3880 con 0x7fc4080b4310 2024-04-25T02:29:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.256+0000 7fc40d134640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc4080b4760 con 0x7fc40815e830 2024-04-25T02:29:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.256+0000 7fc40d134640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc40815ede0 con 0x7fc40806b7f0 2024-04-25T02:29:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.256+0000 7fc406d9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40806b7f0 0x7fc4080b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.256+0000 7fc40659c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc40815e830 0x7fc4080b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.256+0000 7fc406d9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40806b7f0 0x7fc4080b5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:49102/0 (socket says 172.21.15.67:49102) 2024-04-25T02:29:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.256+0000 7fc40659c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc40815e830 0x7fc4080b3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:55260/0 (socket says 172.21.15.67:55260) 2024-04-25T02:29:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.256+0000 7fc406d9d640 1 -- 172.21.15.67:0/2964702632 learned_addr learned my addr 172.21.15.67:0/2964702632 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.256+0000 7fc40759e640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fc4080b4310 0x7fc408071ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:49078/0 (socket says 172.21.15.67:49078) 2024-04-25T02:29:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.257+0000 7fc406d9d640 1 -- 172.21.15.67:0/2964702632 >> v2:172.21.15.176:3300/0 conn(0x7fc40815e830 msgr2=0x7fc4080b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:26.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.257+0000 7fc406d9d640 1 --2- 172.21.15.67:0/2964702632 >> v2:172.21.15.176:3300/0 conn(0x7fc40815e830 0x7fc4080b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.257+0000 7fc406d9d640 1 -- 172.21.15.67:0/2964702632 >> v1:172.21.15.176:6789/0 conn(0x7fc4080b4310 legacy=0x7fc408071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:26.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.257+0000 7fc406d9d640 1 -- 172.21.15.67:0/2964702632 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40815f0c0 con 0x7fc40806b7f0 2024-04-25T02:29:26.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.257+0000 7fc40659c640 1 --2- 172.21.15.67:0/2964702632 >> v2:172.21.15.176:3300/0 conn(0x7fc40815e830 0x7fc4080b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:26.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.257+0000 7fc406d9d640 1 --2- 172.21.15.67:0/2964702632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40806b7f0 0x7fc4080b5d40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc400009870 tx=0x7fc40002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ee02e9f04ab350f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:26.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.258+0000 7fc405d9b640 1 -- 172.21.15.67:0/2964702632 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc400037070 con 0x7fc40806b7f0 2024-04-25T02:29:26.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.258+0000 7fc405d9b640 1 -- 172.21.15.67:0/2964702632 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc400032440 con 0x7fc40806b7f0 2024-04-25T02:29:26.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.258+0000 7fc405d9b640 1 -- 172.21.15.67:0/2964702632 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc400032810 con 0x7fc40806b7f0 2024-04-25T02:29:26.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.258+0000 7fc40d134640 1 -- 172.21.15.67:0/2964702632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40806b7f0 msgr2=0x7fc4080b5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:26.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.258+0000 7fc40d134640 1 --2- 172.21.15.67:0/2964702632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40806b7f0 0x7fc4080b5d40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc400009870 tx=0x7fc40002a1c0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.258+0000 7fc40d134640 1 -- 172.21.15.67:0/2964702632 shutdown_connections 2024-04-25T02:29:26.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.258+0000 7fc40d134640 1 --2- 172.21.15.67:0/2964702632 >> v2:172.21.15.176:3300/0 conn(0x7fc40815e830 0x7fc4080b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.258+0000 7fc40d134640 1 --2- 172.21.15.67:0/2964702632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40806b7f0 0x7fc4080b5d40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.258+0000 7fc40d134640 1 -- 172.21.15.67:0/2964702632 >> 172.21.15.67:0/2964702632 conn(0x7fc4080b2ad0 msgr2=0x7fc4080b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:26.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.258+0000 7fc40d134640 1 -- 172.21.15.67:0/2964702632 shutdown_connections 2024-04-25T02:29:26.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.258+0000 7fc40d134640 1 -- 172.21.15.67:0/2964702632 wait complete. 2024-04-25T02:29:26.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.260+0000 7fc40d134640 1 Processor -- start 2024-04-25T02:29:26.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.260+0000 7fc40d134640 1 -- start start 2024-04-25T02:29:26.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc40d134640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc40806b7f0 0x7fc408143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:26.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc40d134640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4080b4310 0x7fc4080af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:26.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc40d134640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40815e830 0x7fc4080af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:26.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc40d134640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc4080b6280 con 0x7fc40806b7f0 2024-04-25T02:29:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc40d134640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc40815f680 con 0x7fc4080b4310 2024-04-25T02:29:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc40d134640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc40806f100 con 0x7fc40815e830 2024-04-25T02:29:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc406d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc40806b7f0 0x7fc408143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc406d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc40806b7f0 0x7fc408143f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49388/0 (socket says 172.21.15.67:49388) 2024-04-25T02:29:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc406d9d640 1 -- 172.21.15.67:0/2726995630 learned_addr learned my addr 172.21.15.67:0/2726995630 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc40659c640 1 --2- 172.21.15.67:0/2726995630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4080b4310 0x7fc4080af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc40759e640 1 --2- 172.21.15.67:0/2726995630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40815e830 0x7fc4080af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc406d9d640 1 -- 172.21.15.67:0/2726995630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40815e830 msgr2=0x7fc4080af5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc406d9d640 1 --2- 172.21.15.67:0/2726995630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40815e830 0x7fc4080af5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc406d9d640 1 -- 172.21.15.67:0/2726995630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4080b4310 msgr2=0x7fc4080af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc406d9d640 1 --2- 172.21.15.67:0/2726995630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4080b4310 0x7fc4080af0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc406d9d640 1 -- 172.21.15.67:0/2726995630 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4081f4ea0 con 0x7fc40806b7f0 2024-04-25T02:29:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc406d9d640 1 --2- 172.21.15.67:0/2726995630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc40806b7f0 0x7fc408143f60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc400000c00 tx=0x7fc4000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:26.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc3ff7fe640 1 -- 172.21.15.67:0/2726995630 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc400037040 con 0x7fc40806b7f0 2024-04-25T02:29:26.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc3ff7fe640 1 -- 172.21.15.67:0/2726995630 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc400042070 con 0x7fc40806b7f0 2024-04-25T02:29:26.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc40d134640 1 -- 172.21.15.67:0/2726995630 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4081f40e0 con 0x7fc40806b7f0 2024-04-25T02:29:26.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.261+0000 7fc3ff7fe640 1 -- 172.21.15.67:0/2726995630 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc400030880 con 0x7fc40806b7f0 2024-04-25T02:29:26.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.262+0000 7fc40d134640 1 -- 172.21.15.67:0/2726995630 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4081f46a0 con 0x7fc40806b7f0 2024-04-25T02:29:26.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.262+0000 7fc40d134640 1 -- 172.21.15.67:0/2726995630 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc408069110 con 0x7fc40806b7f0 2024-04-25T02:29:26.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.263+0000 7fc3ff7fe640 1 -- 172.21.15.67:0/2726995630 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc40002ad10 con 0x7fc40806b7f0 2024-04-25T02:29:26.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.263+0000 7fc3ff7fe640 1 --2- 172.21.15.67:0/2726995630 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc3e806be60 0x7fc3e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:26.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.263+0000 7fc3ff7fe640 1 -- 172.21.15.67:0/2726995630 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc4000ab200 con 0x7fc40806b7f0 2024-04-25T02:29:26.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.263+0000 7fc40659c640 1 --2- 172.21.15.67:0/2726995630 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc3e806be60 0x7fc3e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:26.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.264+0000 7fc40659c640 1 --2- 172.21.15.67:0/2726995630 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc3e806be60 0x7fc3e806e320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0009560 tx=0x7fc3f0009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:26.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.268+0000 7fc3ff7fe640 1 -- 172.21.15.67:0/2726995630 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc4000795f0 con 0x7fc40806b7f0 2024-04-25T02:29:26.377 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:29:26.380 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:29:26.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.525+0000 7fc40d134640 1 -- 172.21.15.67:0/2726995630 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc408157e40 con 0x7fc40806b7f0 2024-04-25T02:29:26.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.527+0000 7fc3ff7fe640 1 -- 172.21.15.67:0/2726995630 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7fc40007d8f0 con 0x7fc40806b7f0 2024-04-25T02:29:26.531 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-04-25T02:29:26.531 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCRvylm9w5GARAAYGhC/7jDn/aVYwTEFFwjyg== 2024-04-25T02:29:26.531 INFO:teuthology.orchestra.run.smithi067.stdout: caps mds = "allow" 2024-04-25T02:29:26.531 INFO:teuthology.orchestra.run.smithi067.stdout: caps mon = "allow r" 2024-04-25T02:29:26.531 INFO:teuthology.orchestra.run.smithi067.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T02:29:26.532 INFO:teuthology.orchestra.run.smithi067.stderr:updated caps for client.0 2024-04-25T02:29:26.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.529+0000 7fc40d134640 1 -- 172.21.15.67:0/2726995630 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc3e806be60 msgr2=0x7fc3e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:26.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.529+0000 7fc40d134640 1 --2- 172.21.15.67:0/2726995630 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc3e806be60 0x7fc3e806e320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0009560 tx=0x7fc3f0009190 comp rx=0 tx=0).stop 2024-04-25T02:29:26.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.529+0000 7fc40d134640 1 -- 172.21.15.67:0/2726995630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc40806b7f0 msgr2=0x7fc408143f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:26.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.529+0000 7fc40d134640 1 --2- 172.21.15.67:0/2726995630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc40806b7f0 0x7fc408143f60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc400000c00 tx=0x7fc4000046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.529+0000 7fc40d134640 1 -- 172.21.15.67:0/2726995630 shutdown_connections 2024-04-25T02:29:26.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.529+0000 7fc40d134640 1 --2- 172.21.15.67:0/2726995630 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc3e806be60 0x7fc3e806e320 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.529+0000 7fc40d134640 1 --2- 172.21.15.67:0/2726995630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40815e830 0x7fc4080af5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.529+0000 7fc40d134640 1 --2- 172.21.15.67:0/2726995630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4080b4310 0x7fc4080af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.529+0000 7fc40d134640 1 --2- 172.21.15.67:0/2726995630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc40806b7f0 0x7fc408143f60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.529+0000 7fc40d134640 1 -- 172.21.15.67:0/2726995630 >> 172.21.15.67:0/2726995630 conn(0x7fc4080b2ad0 msgr2=0x7fc4080b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:26.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.529+0000 7fc40d134640 1 -- 172.21.15.67:0/2726995630 shutdown_connections 2024-04-25T02:29:26.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.529+0000 7fc40d134640 1 -- 172.21.15.67:0/2726995630 wait complete. 2024-04-25T02:29:26.547 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:29:26.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.644+0000 7f727209a640 1 Processor -- start 2024-04-25T02:29:26.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.644+0000 7f727209a640 1 -- start start 2024-04-25T02:29:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.645+0000 7f727209a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f726c15e280 0x7f726c06bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.645+0000 7f727209a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f726c06c9b0 con 0x7f726c067200 2024-04-25T02:29:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.645+0000 7f727209a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f726c06bc70 con 0x7f726c15e660 2024-04-25T02:29:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.645+0000 7f727209a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f726c06e990 con 0x7f726c15e280 2024-04-25T02:29:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.645+0000 7f726b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f726c15e280 0x7f726c06bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.645+0000 7f726b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f726c15e280 0x7f726c06bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49392/0 (socket says 172.21.15.67:49392) 2024-04-25T02:29:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.645+0000 7f726b7fe640 1 -- 172.21.15.67:0/362364492 learned_addr learned my addr 172.21.15.67:0/362364492 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.645+0000 7f726bfff640 1 --1- 172.21.15.67:0/362364492 >> v1:172.21.15.67:6789/0 conn(0x7f726c067200 0x7f726c0715e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57544/0 (socket says 172.21.15.67:57544) 2024-04-25T02:29:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.645+0000 7f726b7fe640 1 -- 172.21.15.67:0/362364492 >> v1:172.21.15.176:6789/0 conn(0x7f726c15e660 legacy=0x7f726c06ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.645+0000 7f726b7fe640 1 -- 172.21.15.67:0/362364492 >> v1:172.21.15.67:6789/0 conn(0x7f726c067200 legacy=0x7f726c0715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.645+0000 7f726b7fe640 1 -- 172.21.15.67:0/362364492 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c06e340 con 0x7f726c15e280 2024-04-25T02:29:26.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.646+0000 7f726b7fe640 1 --2- 172.21.15.67:0/362364492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726c15e280 0x7f726c06bf10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f726c0b3230 tx=0x7f726002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ed50f7070b9acb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:26.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.646+0000 7f726a7fc640 1 -- 172.21.15.67:0/362364492 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260037070 con 0x7f726c15e280 2024-04-25T02:29:26.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.646+0000 7f726a7fc640 1 -- 172.21.15.67:0/362364492 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7260032440 con 0x7f726c15e280 2024-04-25T02:29:26.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.646+0000 7f726a7fc640 1 -- 172.21.15.67:0/362364492 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260032810 con 0x7f726c15e280 2024-04-25T02:29:26.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.646+0000 7f727209a640 1 -- 172.21.15.67:0/362364492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726c15e280 msgr2=0x7f726c06bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:26.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.646+0000 7f727209a640 1 --2- 172.21.15.67:0/362364492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726c15e280 0x7f726c06bf10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f726c0b3230 tx=0x7f726002a270 comp rx=0 tx=0).stop 2024-04-25T02:29:26.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.646+0000 7f727209a640 1 -- 172.21.15.67:0/362364492 shutdown_connections 2024-04-25T02:29:26.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.646+0000 7f727209a640 1 --2- 172.21.15.67:0/362364492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726c15e280 0x7f726c06bf10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.646+0000 7f727209a640 1 -- 172.21.15.67:0/362364492 >> 172.21.15.67:0/362364492 conn(0x7f726c0d04f0 msgr2=0x7f726c0d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:26.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.647+0000 7f727209a640 1 -- 172.21.15.67:0/362364492 shutdown_connections 2024-04-25T02:29:26.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.647+0000 7f727209a640 1 -- 172.21.15.67:0/362364492 wait complete. 2024-04-25T02:29:26.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.648+0000 7f727209a640 1 Processor -- start 2024-04-25T02:29:26.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.648+0000 7f727209a640 1 -- start start 2024-04-25T02:29:26.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f727209a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f726c067200 0x7f726c146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f727209a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f726c15e280 0x7f726c155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f727209a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726c15e660 0x7f726c155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f727209a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f726c071cf0 con 0x7f726c15e660 2024-04-25T02:29:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f727209a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f726c06c450 con 0x7f726c067200 2024-04-25T02:29:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f727209a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f726c071e70 con 0x7f726c15e280 2024-04-25T02:29:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f726bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726c15e660 0x7f726c155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f726bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726c15e660 0x7f726c155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49394/0 (socket says 172.21.15.67:49394) 2024-04-25T02:29:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f726bfff640 1 -- 172.21.15.67:0/4094887001 learned_addr learned my addr 172.21.15.67:0/4094887001 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f726b7fe640 1 --2- 172.21.15.67:0/4094887001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f726c067200 0x7f726c146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f726affd640 1 --2- 172.21.15.67:0/4094887001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f726c15e280 0x7f726c155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:26.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f726bfff640 1 -- 172.21.15.67:0/4094887001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f726c15e280 msgr2=0x7f726c155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f726bfff640 1 --2- 172.21.15.67:0/4094887001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f726c15e280 0x7f726c155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f726bfff640 1 -- 172.21.15.67:0/4094887001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f726c067200 msgr2=0x7f726c146000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f726bfff640 1 --2- 172.21.15.67:0/4094887001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f726c067200 0x7f726c146000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f726bfff640 1 -- 172.21.15.67:0/4094887001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c15f6c0 con 0x7f726c15e660 2024-04-25T02:29:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f726bfff640 1 --2- 172.21.15.67:0/4094887001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726c15e660 0x7f726c155950 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f726400c7b0 tx=0x7f726400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f7253fff640 1 -- 172.21.15.67:0/4094887001 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264017070 con 0x7f726c15e660 2024-04-25T02:29:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f7253fff640 1 -- 172.21.15.67:0/4094887001 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f726400a640 con 0x7f726c15e660 2024-04-25T02:29:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f727209a640 1 -- 172.21.15.67:0/4094887001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726c15f9a0 con 0x7f726c15e660 2024-04-25T02:29:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.649+0000 7f7253fff640 1 -- 172.21.15.67:0/4094887001 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726400a9f0 con 0x7f726c15e660 2024-04-25T02:29:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.650+0000 7f727209a640 1 -- 172.21.15.67:0/4094887001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726c15ff60 con 0x7f726c15e660 2024-04-25T02:29:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.651+0000 7f727209a640 1 -- 172.21.15.67:0/4094887001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f726c069110 con 0x7f726c15e660 2024-04-25T02:29:26.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.651+0000 7f7253fff640 1 -- 172.21.15.67:0/4094887001 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f726401a070 con 0x7f726c15e660 2024-04-25T02:29:26.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.651+0000 7f7253fff640 1 --2- 172.21.15.67:0/4094887001 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f725806be30 0x7f725806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:26.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.651+0000 7f7253fff640 1 -- 172.21.15.67:0/4094887001 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f726408a380 con 0x7f726c15e660 2024-04-25T02:29:26.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.652+0000 7f726b7fe640 1 --2- 172.21.15.67:0/4094887001 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f725806be30 0x7f725806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:26.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.652+0000 7f726b7fe640 1 --2- 172.21.15.67:0/4094887001 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f725806be30 0x7f725806e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7260034000 tx=0x7f726002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:26.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.656+0000 7f7253fff640 1 -- 172.21.15.67:0/4094887001 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f72640586f0 con 0x7f726c15e660 2024-04-25T02:29:26.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.875+0000 7f727209a640 1 -- 172.21.15.67:0/4094887001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f726c160130 con 0x7f726c15e660 2024-04-25T02:29:26.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.875+0000 7f7253fff640 1 -- 172.21.15.67:0/4094887001 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5181 (secure 0 0 0) 0x7f726405c9f0 con 0x7f726c15e660 2024-04-25T02:29:26.880 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:26.880 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/101037939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":101037939},{"type":"v1","addr":"172.21.15.176:6837","nonce":101037939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4873,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/958313587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":958313587},{"type":"v1","addr":"172.21.15.176:6836","nonce":958313587}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/2806970849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2806970849},{"type":"v1","addr":"172.21.15.67:6834","nonce":2806970849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:29:17.693906+0000","modified":"2024-04-25T02:29:19.690632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2564564590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":2564564590},{"type":"v1","addr":"172.21.15.67:6835","nonce":2564564590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5085,"qdb_cluster":[5085]},"id":2}]} 2024-04-25T02:29:26.880 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 14 2024-04-25T02:29:26.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.877+0000 7f727209a640 1 -- 172.21.15.67:0/4094887001 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f725806be30 msgr2=0x7f725806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:26.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.877+0000 7f727209a640 1 --2- 172.21.15.67:0/4094887001 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f725806be30 0x7f725806e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7260034000 tx=0x7f726002e000 comp rx=0 tx=0).stop 2024-04-25T02:29:26.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.877+0000 7f727209a640 1 -- 172.21.15.67:0/4094887001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726c15e660 msgr2=0x7f726c155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:26.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.877+0000 7f727209a640 1 --2- 172.21.15.67:0/4094887001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726c15e660 0x7f726c155950 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f726400c7b0 tx=0x7f726400cc70 comp rx=0 tx=0).stop 2024-04-25T02:29:26.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.877+0000 7f727209a640 1 -- 172.21.15.67:0/4094887001 shutdown_connections 2024-04-25T02:29:26.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.877+0000 7f727209a640 1 --2- 172.21.15.67:0/4094887001 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f725806be30 0x7f725806e2f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.877+0000 7f727209a640 1 --2- 172.21.15.67:0/4094887001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726c15e660 0x7f726c155950 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.877+0000 7f727209a640 1 --2- 172.21.15.67:0/4094887001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f726c15e280 0x7f726c155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.877+0000 7f727209a640 1 --2- 172.21.15.67:0/4094887001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f726c067200 0x7f726c146000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:26.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.877+0000 7f727209a640 1 -- 172.21.15.67:0/4094887001 >> 172.21.15.67:0/4094887001 conn(0x7f726c0d04f0 msgr2=0x7f726c0b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:26.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.877+0000 7f727209a640 1 -- 172.21.15.67:0/4094887001 shutdown_connections 2024-04-25T02:29:26.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:26.877+0000 7f727209a640 1 -- 172.21.15.67:0/4094887001 wait complete. 2024-04-25T02:29:27.295 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:29:17.693906+0000', 'modified': '2024-04-25T02:29:19.690632+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5085}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5085': {'gid': 5085, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6835/2564564590', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6833', 'nonce': 2564564590}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 2564564590}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5085, 'qdb_cluster': [5085]} 2024-04-25T02:29:27.295 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:29:27.296 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T02:29:27.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.397+0000 7f82948bd640 1 Processor -- start 2024-04-25T02:29:27.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.397+0000 7f82948bd640 1 -- start start 2024-04-25T02:29:27.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.398+0000 7f82948bd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f829015e630 0x7f82900b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.398+0000 7f82948bd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829009b180 0x7f82900cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.398+0000 7f82948bd640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82900b49e0 con 0x7f82900b3020 2024-04-25T02:29:27.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.398+0000 7f82948bd640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f829006ca00 con 0x7f829015e630 2024-04-25T02:29:27.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.398+0000 7f82948bd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f82900d0a10 con 0x7f829009b180 2024-04-25T02:29:27.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.398+0000 7f828e59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f829015e630 0x7f82900b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.398+0000 7f828dd9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f82900b3020 0x7f829009aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57548/0 (socket says 172.21.15.67:57548) 2024-04-25T02:29:27.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.398+0000 7f828dd9b640 1 -- 172.21.15.67:0/1900197233 learned_addr learned my addr 172.21.15.67:0/1900197233 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:27.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.398+0000 7f828ed9d640 1 --2- 172.21.15.67:0/1900197233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829009b180 0x7f82900cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.398+0000 7f828e59c640 1 -- 172.21.15.67:0/1900197233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829009b180 msgr2=0x7f82900cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:27.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.398+0000 7f828e59c640 1 --2- 172.21.15.67:0/1900197233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829009b180 0x7f82900cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.398+0000 7f828e59c640 1 -- 172.21.15.67:0/1900197233 >> v1:172.21.15.67:6789/0 conn(0x7f82900b3020 legacy=0x7f829009aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:27.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.398+0000 7f828e59c640 1 -- 172.21.15.67:0/1900197233 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82900d0cf0 con 0x7f829015e630 2024-04-25T02:29:27.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.399+0000 7f828e59c640 1 --2- 172.21.15.67:0/1900197233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829015e630 0x7f82900b3490 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f82880097a0 tx=0x7f828802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9721ccdffbd8f8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:27.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.399+0000 7f828d59a640 1 -- 172.21.15.67:0/1900197233 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288037070 con 0x7f829015e630 2024-04-25T02:29:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.399+0000 7f828d59a640 1 -- 172.21.15.67:0/1900197233 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f828802ae50 con 0x7f829015e630 2024-04-25T02:29:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.399+0000 7f828d59a640 1 -- 172.21.15.67:0/1900197233 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288032660 con 0x7f829015e630 2024-04-25T02:29:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.399+0000 7f82948bd640 1 -- 172.21.15.67:0/1900197233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829015e630 msgr2=0x7f82900b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.399+0000 7f82948bd640 1 --2- 172.21.15.67:0/1900197233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829015e630 0x7f82900b3490 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f82880097a0 tx=0x7f828802a100 comp rx=0 tx=0).stop 2024-04-25T02:29:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.400+0000 7f82948bd640 1 -- 172.21.15.67:0/1900197233 shutdown_connections 2024-04-25T02:29:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.400+0000 7f82948bd640 1 --2- 172.21.15.67:0/1900197233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829009b180 0x7f82900cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.400+0000 7f82948bd640 1 --2- 172.21.15.67:0/1900197233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829015e630 0x7f82900b3490 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.400+0000 7f82948bd640 1 -- 172.21.15.67:0/1900197233 >> 172.21.15.67:0/1900197233 conn(0x7f82900b3ae0 msgr2=0x7f82900b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.400+0000 7f82948bd640 1 -- 172.21.15.67:0/1900197233 shutdown_connections 2024-04-25T02:29:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.400+0000 7f82948bd640 1 -- 172.21.15.67:0/1900197233 wait complete. 2024-04-25T02:29:27.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.401+0000 7f82948bd640 1 Processor -- start 2024-04-25T02:29:27.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.401+0000 7f82948bd640 1 -- start start 2024-04-25T02:29:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f82948bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829009b180 0x7f82900c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f82948bd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82900b3020 0x7f8290159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f82948bd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829015e630 0x7f82901596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f82948bd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f82900d1150 con 0x7f829009b180 2024-04-25T02:29:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f82948bd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f82900d0fd0 con 0x7f82900b3020 2024-04-25T02:29:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f82948bd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f829015ea10 con 0x7f829015e630 2024-04-25T02:29:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f828e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829009b180 0x7f82900c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f828e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829009b180 0x7f82900c9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49404/0 (socket says 172.21.15.67:49404) 2024-04-25T02:29:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f828e59c640 1 -- 172.21.15.67:0/302786158 learned_addr learned my addr 172.21.15.67:0/302786158 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f828ed9d640 1 --2- 172.21.15.67:0/302786158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829015e630 0x7f82901596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f828dd9b640 1 --2- 172.21.15.67:0/302786158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82900b3020 0x7f8290159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f828e59c640 1 -- 172.21.15.67:0/302786158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829015e630 msgr2=0x7f82901596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:27.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f828e59c640 1 --2- 172.21.15.67:0/302786158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829015e630 0x7f82901596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f828e59c640 1 -- 172.21.15.67:0/302786158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82900b3020 msgr2=0x7f8290159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:27.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f828e59c640 1 --2- 172.21.15.67:0/302786158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82900b3020 0x7f8290159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f828e59c640 1 -- 172.21.15.67:0/302786158 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82900b6910 con 0x7f829009b180 2024-04-25T02:29:27.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f828dd9b640 1 --2- 172.21.15.67:0/302786158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82900b3020 0x7f8290159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:27.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f828e59c640 1 --2- 172.21.15.67:0/302786158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829009b180 0x7f82900c9310 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8288035040 tx=0x7f82880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:27.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f827effd640 1 -- 172.21.15.67:0/302786158 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288041070 con 0x7f829009b180 2024-04-25T02:29:27.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f827effd640 1 -- 172.21.15.67:0/302786158 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f828803c460 con 0x7f829009b180 2024-04-25T02:29:27.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f82948bd640 1 -- 172.21.15.67:0/302786158 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82900b6bf0 con 0x7f829009b180 2024-04-25T02:29:27.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.402+0000 7f827effd640 1 -- 172.21.15.67:0/302786158 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288037040 con 0x7f829009b180 2024-04-25T02:29:27.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.403+0000 7f82948bd640 1 -- 172.21.15.67:0/302786158 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82900b71b0 con 0x7f829009b180 2024-04-25T02:29:27.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.404+0000 7f827effd640 1 -- 172.21.15.67:0/302786158 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f828803a070 con 0x7f829009b180 2024-04-25T02:29:27.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.405+0000 7f827effd640 1 --2- 172.21.15.67:0/302786158 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f827006be30 0x7f827006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.405+0000 7f827effd640 1 -- 172.21.15.67:0/302786158 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f82880ab180 con 0x7f829009b180 2024-04-25T02:29:27.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.405+0000 7f828dd9b640 1 --2- 172.21.15.67:0/302786158 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f827006be30 0x7f827006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.405+0000 7f828dd9b640 1 --2- 172.21.15.67:0/302786158 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f827006be30 0x7f827006e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f829015d540 tx=0x7f8284009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:27.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.406+0000 7f82975d5740 1 Processor -- start 2024-04-25T02:29:27.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.406+0000 7f82975d5740 1 -- start start 2024-04-25T02:29:27.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f82975d5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae25b60 0x562d5add84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f82975d5740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5ae08c80 0x562d5ae08000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f82975d5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae08540 0x562d5addd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f82975d5740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562d5ad40f00 con 0x562d5ae08c80 2024-04-25T02:29:27.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f82975d5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562d5ace9750 con 0x562d5ae25b60 2024-04-25T02:29:27.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f82975d5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x562d5ad3cec0 con 0x562d5ae08540 2024-04-25T02:29:27.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f828dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5ae08c80 0x562d5ae08000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f828dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5ae08c80 0x562d5ae08000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49424/0 (socket says 172.21.15.67:49424) 2024-04-25T02:29:27.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f828dd9b640 1 -- 172.21.15.67:0/787511343 learned_addr learned my addr 172.21.15.67:0/787511343 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:27.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f828e59c640 1 --2- 172.21.15.67:0/787511343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae25b60 0x562d5add84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f828ed9d640 1 --2- 172.21.15.67:0/787511343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae08540 0x562d5addd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f828dd9b640 1 -- 172.21.15.67:0/787511343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae08540 msgr2=0x562d5addd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:27.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f828dd9b640 1 --2- 172.21.15.67:0/787511343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae08540 0x562d5addd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f828dd9b640 1 -- 172.21.15.67:0/787511343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae25b60 msgr2=0x562d5add84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:27.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f828dd9b640 1 --2- 172.21.15.67:0/787511343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae25b60 0x562d5add84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f828dd9b640 1 -- 172.21.15.67:0/787511343 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d5aa552d0 con 0x562d5ae08c80 2024-04-25T02:29:27.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f828dd9b640 1 --2- 172.21.15.67:0/787511343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5ae08c80 0x562d5ae08000 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f828400eed0 tx=0x7f8284011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77b11bf03aaa79b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:27.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f826ffff640 1 -- 172.21.15.67:0/787511343 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284013630 con 0x562d5ae08c80 2024-04-25T02:29:27.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f826ffff640 1 -- 172.21.15.67:0/787511343 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82840137d0 con 0x562d5ae08c80 2024-04-25T02:29:27.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.407+0000 7f826ffff640 1 -- 172.21.15.67:0/787511343 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284013b80 con 0x562d5ae08c80 2024-04-25T02:29:27.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.408+0000 7f82975d5740 1 -- 172.21.15.67:0/787511343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5ae08c80 msgr2=0x562d5ae08000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:27.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.408+0000 7f82975d5740 1 --2- 172.21.15.67:0/787511343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5ae08c80 0x562d5ae08000 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f828400eed0 tx=0x7f8284011000 comp rx=0 tx=0).stop 2024-04-25T02:29:27.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.408+0000 7f82975d5740 1 -- 172.21.15.67:0/787511343 shutdown_connections 2024-04-25T02:29:27.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.408+0000 7f82975d5740 1 --2- 172.21.15.67:0/787511343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae08540 0x562d5addd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.408+0000 7f82975d5740 1 --2- 172.21.15.67:0/787511343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5ae08c80 0x562d5ae08000 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.408+0000 7f82975d5740 1 --2- 172.21.15.67:0/787511343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae25b60 0x562d5add84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.408+0000 7f82975d5740 1 -- 172.21.15.67:0/787511343 >> 172.21.15.67:0/787511343 conn(0x562d5adda760 msgr2=0x562d5ae23000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:27.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.408+0000 7f82975d5740 1 -- 172.21.15.67:0/787511343 shutdown_connections 2024-04-25T02:29:27.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.408+0000 7f82975d5740 1 -- 172.21.15.67:0/787511343 wait complete. 2024-04-25T02:29:27.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.409+0000 7f82975d5740 1 -- start start 2024-04-25T02:29:27.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.409+0000 7f82975d5740 1 Processor -- start 2024-04-25T02:29:27.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f82975d5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae08c80 0x562d5adf6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f82975d5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae25b60 0x562d5ae0b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f82975d5740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 0x562d5adde1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f82975d5740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562d5addc910 con 0x562d5adddd60 2024-04-25T02:29:27.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f82975d5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562d5acfccf0 con 0x562d5ae08c80 2024-04-25T02:29:27.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f82975d5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x562d5addbd00 con 0x562d5ae25b60 2024-04-25T02:29:27.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f82975d5740 10 client.0 _ll_register_callbacks cb 0x562d5acfc6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:29:27.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f828ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 0x562d5adde1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f828dd9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae25b60 0x562d5ae0b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f828e59c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae08c80 0x562d5adf6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f828ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 0x562d5adde1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49434/0 (socket says 172.21.15.67:49434) 2024-04-25T02:29:27.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f828ed9d640 1 -- 172.21.15.67:0/1606532059 learned_addr learned my addr 172.21.15.67:0/1606532059 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:27.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f828ed9d640 1 -- 172.21.15.67:0/1606532059 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae25b60 msgr2=0x562d5ae0b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:27.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f828ed9d640 1 --2- 172.21.15.67:0/1606532059 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae25b60 0x562d5ae0b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f828ed9d640 1 -- 172.21.15.67:0/1606532059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae08c80 msgr2=0x562d5adf6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:27.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f828ed9d640 1 --2- 172.21.15.67:0/1606532059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae08c80 0x562d5adf6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f828ed9d640 1 -- 172.21.15.67:0/1606532059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d5ab1f6b0 con 0x562d5adddd60 2024-04-25T02:29:27.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f828ed9d640 1 --2- 172.21.15.67:0/1606532059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 0x562d5adde1e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f82800147a0 tx=0x7f8280014c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5aeaadd8619e48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:27.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.410+0000 7f826d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-04-25T02:29:27.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.411+0000 7f826d7fa640 1 -- 172.21.15.67:0/1606532059 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8280022060 con 0x562d5adddd60 2024-04-25T02:29:27.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.411+0000 7f82975d5740 1 -- 172.21.15.67:0/1606532059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82840137d0 con 0x562d5adddd60 2024-04-25T02:29:27.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.411+0000 7f826d7fa640 1 -- 172.21.15.67:0/1606532059 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8280012a40 con 0x562d5adddd60 2024-04-25T02:29:27.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.411+0000 7f826d7fa640 1 -- 172.21.15.67:0/1606532059 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f8280028050 con 0x562d5adddd60 2024-04-25T02:29:27.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.411+0000 7f82975d5740 10 client.5265 fetch_fsmap learned FSMap version 14 2024-04-25T02:29:27.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.411+0000 7f82975d5740 1 -- 172.21.15.67:0/1606532059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562d5ae06810 con 0x562d5adddd60 2024-04-25T02:29:27.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.411+0000 7f826d7fa640 1 -- 172.21.15.67:0/1606532059 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82840137d0 con 0x562d5adddd60 2024-04-25T02:29:27.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.411+0000 7f826d7fa640 1 -- 172.21.15.67:0/1606532059 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 14) ==== 3494+0+0 (secure 0 0 0) 0x7f828002b020 con 0x562d5adddd60 2024-04-25T02:29:27.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.411+0000 7f82975d5740 10 client.5265 fetch_fsmap finished waiting for FSMap version 14 2024-04-25T02:29:27.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.411+0000 7f82975d5740 10 client.5265 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:29:27.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.411+0000 7f82975d5740 20 client.5265 populate_metadata read hostname 'smithi067' 2024-04-25T02:29:27.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.411+0000 7f82975d5740 1 --2- 172.21.15.67:0/1606532059 >> [v2:172.21.15.67:6833/2564564590,v1:172.21.15.67:6835/2564564590] conn(0x562d5ae0a0e0 0x562d5ae40e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.411+0000 7f82975d5740 4 client.5265 mds_command: new command op to 5085 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:29:27.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.411+0000 7f82975d5740 1 -- 172.21.15.67:0/1606532059 --> [v2:172.21.15.67:6833/2564564590,v1:172.21.15.67:6835/2564564590] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d5ad4e440 con 0x562d5ae0a0e0 2024-04-25T02:29:27.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.411+0000 7f828e59c640 1 --2- 172.21.15.67:0/1606532059 >> [v2:172.21.15.67:6833/2564564590,v1:172.21.15.67:6835/2564564590] conn(0x562d5ae0a0e0 0x562d5ae40e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.412+0000 7f826d7fa640 10 client.5265 ms_handle_connect on v2:172.21.15.67:6833/2564564590 2024-04-25T02:29:27.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.412+0000 7f828e59c640 1 --2- 172.21.15.67:0/1606532059 >> [v2:172.21.15.67:6833/2564564590,v1:172.21.15.67:6835/2564564590] conn(0x562d5ae0a0e0 0x562d5ae40e10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=154016e6f03f2b39 server_cookie=3f9f9df111f700df in_seq=0 out_seq=0 2024-04-25T02:29:27.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.412+0000 7f826d7fa640 1 -- 172.21.15.67:0/1606532059 <== mds.0 v2:172.21.15.67:6833/2564564590 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562d5ad4e440 con 0x562d5ae0a0e0 2024-04-25T02:29:27.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.412+0000 7f826d7fa640 10 client.5265 handle_command_reply: tid=0 2024-04-25T02:29:27.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.412+0000 7f82975d5740 1 client.5265 shutdown 2024-04-25T02:29:27.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.412+0000 7f82975d5740 1 -- 172.21.15.67:0/1606532059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 msgr2=0x562d5adde1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:27.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.412+0000 7f82975d5740 1 --2- 172.21.15.67:0/1606532059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 0x562d5adde1e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f82800147a0 tx=0x7f8280014c60 comp rx=0 tx=0).stop 2024-04-25T02:29:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.412+0000 7f82975d5740 1 -- 172.21.15.67:0/1606532059 shutdown_connections 2024-04-25T02:29:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.412+0000 7f82975d5740 1 --2- 172.21.15.67:0/1606532059 >> [v2:172.21.15.67:6833/2564564590,v1:172.21.15.67:6835/2564564590] conn(0x562d5ae0a0e0 0x562d5ae40e10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.412+0000 7f82975d5740 1 --2- 172.21.15.67:0/1606532059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 0x562d5adde1e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.412+0000 7f82975d5740 1 --2- 172.21.15.67:0/1606532059 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae25b60 0x562d5ae0b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.412+0000 7f826d7fa640 0 client.5265 ms_handle_reset on v2:172.21.15.67:6833/2564564590 2024-04-25T02:29:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.412+0000 7f82975d5740 1 --2- 172.21.15.67:0/1606532059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae08c80 0x562d5adf6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.412+0000 7f82975d5740 1 -- 172.21.15.67:0/1606532059 >> 172.21.15.67:0/1606532059 conn(0x562d5ae08540 msgr2=0x562d5ae23890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.413+0000 7f82975d5740 1 -- 172.21.15.67:0/1606532059 shutdown_connections 2024-04-25T02:29:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.413+0000 7f82975d5740 1 -- 172.21.15.67:0/1606532059 wait complete. 2024-04-25T02:29:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.413+0000 7f82975d5740 20 client.5265 trim_cache size 0 max 16384 2024-04-25T02:29:27.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.431+0000 7f82975d5740 1 Processor -- start 2024-04-25T02:29:27.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.431+0000 7f82975d5740 1 -- start start 2024-04-25T02:29:27.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.431+0000 7f82975d5740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 0x562d5adf8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.431+0000 7f82975d5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae08c80 0x562d5ae31640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.431+0000 7f82975d5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae25b60 0x562d5ae31b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.431+0000 7f82975d5740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f82901480d0 con 0x562d5adddd60 2024-04-25T02:29:27.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.431+0000 7f82975d5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f82900cc1c0 con 0x562d5ae08c80 2024-04-25T02:29:27.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.431+0000 7f82975d5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8290147a80 con 0x562d5ae25b60 2024-04-25T02:29:27.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.432+0000 7f828e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 0x562d5adf8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.432+0000 7f828e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 0x562d5adf8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49440/0 (socket says 172.21.15.67:49440) 2024-04-25T02:29:27.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.432+0000 7f828e59c640 1 -- 172.21.15.67:0/1028366835 learned_addr learned my addr 172.21.15.67:0/1028366835 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:27.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.432+0000 7f828ed9d640 1 --2- 172.21.15.67:0/1028366835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae25b60 0x562d5ae31b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.432+0000 7f828dd9b640 1 --2- 172.21.15.67:0/1028366835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae08c80 0x562d5ae31640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.432+0000 7f828e59c640 1 -- 172.21.15.67:0/1028366835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae25b60 msgr2=0x562d5ae31b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:27.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.432+0000 7f828e59c640 1 --2- 172.21.15.67:0/1028366835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae25b60 0x562d5ae31b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.432+0000 7f828e59c640 1 -- 172.21.15.67:0/1028366835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae08c80 msgr2=0x562d5ae31640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:27.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.432+0000 7f828e59c640 1 --2- 172.21.15.67:0/1028366835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae08c80 0x562d5ae31640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.432+0000 7f828e59c640 1 -- 172.21.15.67:0/1028366835 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d5addb8a0 con 0x562d5adddd60 2024-04-25T02:29:27.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.432+0000 7f828e59c640 1 --2- 172.21.15.67:0/1028366835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 0x562d5adf8870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8288045040 tx=0x7f82880a9560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da730317ffd9277 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:27.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.432+0000 7f826f7fe640 1 -- 172.21.15.67:0/1028366835 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828804a040 con 0x562d5adddd60 2024-04-25T02:29:27.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.432+0000 7f826f7fe640 1 -- 172.21.15.67:0/1028366835 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f828802ae50 con 0x562d5adddd60 2024-04-25T02:29:27.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.432+0000 7f826f7fe640 1 -- 172.21.15.67:0/1028366835 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288075ab0 con 0x562d5adddd60 2024-04-25T02:29:27.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.433+0000 7f82975d5740 1 -- 172.21.15.67:0/1028366835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 msgr2=0x562d5adf8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:27.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.433+0000 7f82975d5740 1 --2- 172.21.15.67:0/1028366835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 0x562d5adf8870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8288045040 tx=0x7f82880a9560 comp rx=0 tx=0).stop 2024-04-25T02:29:27.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.433+0000 7f82975d5740 1 -- 172.21.15.67:0/1028366835 shutdown_connections 2024-04-25T02:29:27.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.433+0000 7f82975d5740 1 --2- 172.21.15.67:0/1028366835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae25b60 0x562d5ae31b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.433+0000 7f82975d5740 1 --2- 172.21.15.67:0/1028366835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae08c80 0x562d5ae31640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.433+0000 7f82975d5740 1 --2- 172.21.15.67:0/1028366835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 0x562d5adf8870 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.433+0000 7f82975d5740 1 -- 172.21.15.67:0/1028366835 >> 172.21.15.67:0/1028366835 conn(0x562d5ae08540 msgr2=0x562d5ae0b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:27.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.433+0000 7f82975d5740 1 -- 172.21.15.67:0/1028366835 shutdown_connections 2024-04-25T02:29:27.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.433+0000 7f82975d5740 1 -- 172.21.15.67:0/1028366835 wait complete. 2024-04-25T02:29:27.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.433+0000 7f82975d5740 1 -- start start 2024-04-25T02:29:27.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.434+0000 7f82975d5740 1 Processor -- start 2024-04-25T02:29:27.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.434+0000 7f82975d5740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 0x562d5ae9d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.434+0000 7f82975d5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae08c80 0x562d5ae31640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.434+0000 7f82975d5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae25b60 0x562d5ae31b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.434+0000 7f82975d5740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562d5ae09f60 con 0x562d5adddd60 2024-04-25T02:29:27.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.434+0000 7f82975d5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562d5ae06b50 con 0x562d5ae08c80 2024-04-25T02:29:27.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.434+0000 7f82975d5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x562d5ae0a4f0 con 0x562d5ae25b60 2024-04-25T02:29:27.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f82975d5740 10 client.0 _ll_register_callbacks cb 0x7f82800143b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:29:27.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f828e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 0x562d5ae9d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f828e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 0x562d5ae9d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49442/0 (socket says 172.21.15.67:49442) 2024-04-25T02:29:27.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f828e59c640 1 -- 172.21.15.67:0/822922251 learned_addr learned my addr 172.21.15.67:0/822922251 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:27.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f828ed9d640 1 --2- 172.21.15.67:0/822922251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae25b60 0x562d5ae31b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f828dd9b640 1 --2- 172.21.15.67:0/822922251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae08c80 0x562d5ae31640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f828e59c640 1 -- 172.21.15.67:0/822922251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae25b60 msgr2=0x562d5ae31b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:27.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f828e59c640 1 --2- 172.21.15.67:0/822922251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae25b60 0x562d5ae31b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f828e59c640 1 -- 172.21.15.67:0/822922251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae08c80 msgr2=0x562d5ae31640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:27.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f828e59c640 1 --2- 172.21.15.67:0/822922251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae08c80 0x562d5ae31640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f828e59c640 1 -- 172.21.15.67:0/822922251 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d5ae25070 con 0x562d5adddd60 2024-04-25T02:29:27.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f828e59c640 1 --2- 172.21.15.67:0/822922251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 0x562d5ae9d710 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8288009560 tx=0x7f82880ab040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e925625b864c72f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:27.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f826d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-04-25T02:29:27.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f826d7fa640 1 -- 172.21.15.67:0/822922251 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828804a050 con 0x562d5adddd60 2024-04-25T02:29:27.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f826d7fa640 1 -- 172.21.15.67:0/822922251 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8288081ae0 con 0x562d5adddd60 2024-04-25T02:29:27.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f82975d5740 1 -- 172.21.15.67:0/822922251 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f828802ae50 con 0x562d5adddd60 2024-04-25T02:29:27.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f826d7fa640 1 -- 172.21.15.67:0/822922251 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f8288081d00 con 0x562d5adddd60 2024-04-25T02:29:27.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f82975d5740 10 client.5271 fetch_fsmap learned FSMap version 14 2024-04-25T02:29:27.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f82975d5740 1 -- 172.21.15.67:0/822922251 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562d5ae1de70 con 0x562d5adddd60 2024-04-25T02:29:27.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.435+0000 7f826d7fa640 1 -- 172.21.15.67:0/822922251 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f828802ae50 con 0x562d5adddd60 2024-04-25T02:29:27.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f826d7fa640 1 -- 172.21.15.67:0/822922251 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 14) ==== 3494+0+0 (secure 0 0 0) 0x7f82880a9210 con 0x562d5adddd60 2024-04-25T02:29:27.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f82975d5740 10 client.5271 fetch_fsmap finished waiting for FSMap version 14 2024-04-25T02:29:27.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f82975d5740 10 client.5271 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:29:27.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f82975d5740 20 client.5271 populate_metadata read hostname 'smithi067' 2024-04-25T02:29:27.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f82975d5740 1 --2- 172.21.15.67:0/822922251 >> [v2:172.21.15.67:6833/2564564590,v1:172.21.15.67:6835/2564564590] conn(0x562d5aea0b60 0x562d5ae44e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f82975d5740 4 client.5271 mds_command: new command op to 5085 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:29:27.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f82975d5740 1 -- 172.21.15.67:0/822922251 --> [v2:172.21.15.67:6833/2564564590,v1:172.21.15.67:6835/2564564590] -- command(tid 0: {"prefix": "status"}) -- 0x562d5ad48790 con 0x562d5aea0b60 2024-04-25T02:29:27.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f828dd9b640 1 --2- 172.21.15.67:0/822922251 >> [v2:172.21.15.67:6833/2564564590,v1:172.21.15.67:6835/2564564590] conn(0x562d5aea0b60 0x562d5ae44e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f826d7fa640 10 client.5271 ms_handle_connect on v2:172.21.15.67:6833/2564564590 2024-04-25T02:29:27.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f828dd9b640 1 --2- 172.21.15.67:0/822922251 >> [v2:172.21.15.67:6833/2564564590,v1:172.21.15.67:6835/2564564590] conn(0x562d5aea0b60 0x562d5ae44e30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=137362bb2ae090a8 server_cookie=34d853217912e5b0 in_seq=0 out_seq=0 2024-04-25T02:29:27.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f826d7fa640 1 -- 172.21.15.67:0/822922251 <== mds.0 v2:172.21.15.67:6833/2564564590 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x562d5ad48790 con 0x562d5aea0b60 2024-04-25T02:29:27.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f826d7fa640 10 client.5271 handle_command_reply: tid=0 2024-04-25T02:29:27.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f82975d5740 1 client.5271 shutdown 2024-04-25T02:29:27.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f82975d5740 1 -- 172.21.15.67:0/822922251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 msgr2=0x562d5ae9d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:27.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f82975d5740 1 --2- 172.21.15.67:0/822922251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 0x562d5ae9d710 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8288009560 tx=0x7f82880ab040 comp rx=0 tx=0).stop 2024-04-25T02:29:27.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f82975d5740 1 -- 172.21.15.67:0/822922251 shutdown_connections 2024-04-25T02:29:27.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f82975d5740 1 --2- 172.21.15.67:0/822922251 >> [v2:172.21.15.67:6833/2564564590,v1:172.21.15.67:6835/2564564590] conn(0x562d5aea0b60 0x562d5ae44e30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f82975d5740 1 --2- 172.21.15.67:0/822922251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562d5ae25b60 0x562d5ae31b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f82975d5740 1 --2- 172.21.15.67:0/822922251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562d5ae08c80 0x562d5ae31640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f82975d5740 1 --2- 172.21.15.67:0/822922251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5adddd60 0x562d5ae9d710 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f826d7fa640 0 client.5271 ms_handle_reset on v2:172.21.15.67:6833/2564564590 2024-04-25T02:29:27.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.436+0000 7f82975d5740 1 -- 172.21.15.67:0/822922251 >> 172.21.15.67:0/822922251 conn(0x562d5ae08540 msgr2=0x562d5ae460b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:27.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.437+0000 7f82975d5740 1 -- 172.21.15.67:0/822922251 shutdown_connections 2024-04-25T02:29:27.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.437+0000 7f82975d5740 1 -- 172.21.15.67:0/822922251 wait complete. 2024-04-25T02:29:27.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.437+0000 7f82975d5740 20 client.5271 trim_cache size 0 max 16384 2024-04-25T02:29:27.447 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-25T02:29:27.448 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "84283662-9e10-4d0d-b377-8e43b1f6e3af", 2024-04-25T02:29:27.448 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-04-25T02:29:27.448 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 5085, 2024-04-25T02:29:27.448 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-04-25T02:29:27.448 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-04-25T02:29:27.448 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-04-25T02:29:27.448 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 9.1145929880000001, 2024-04-25T02:29:27.448 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 14, 2024-04-25T02:29:27.448 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 33, 2024-04-25T02:29:27.448 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 33, 2024-04-25T02:29:27.448 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 15.992068547000001 2024-04-25T02:29:27.448 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-25T02:29:27.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.437+0000 7f82948bd640 1 -- 172.21.15.67:0/302786158 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f827006be30 msgr2=0x7f827006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:27.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.437+0000 7f82948bd640 1 --2- 172.21.15.67:0/302786158 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f827006be30 0x7f827006e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f829015d540 tx=0x7f8284009040 comp rx=0 tx=0).stop 2024-04-25T02:29:27.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.437+0000 7f82948bd640 1 -- 172.21.15.67:0/302786158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829009b180 msgr2=0x7f82900c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:27.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.437+0000 7f82948bd640 1 --2- 172.21.15.67:0/302786158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829009b180 0x7f82900c9310 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8288035040 tx=0x7f82880046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.437+0000 7f82948bd640 1 -- 172.21.15.67:0/302786158 shutdown_connections 2024-04-25T02:29:27.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.437+0000 7f82948bd640 1 --2- 172.21.15.67:0/302786158 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f827006be30 0x7f827006e2f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.437+0000 7f82948bd640 1 --2- 172.21.15.67:0/302786158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829015e630 0x7f82901596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.437+0000 7f82948bd640 1 --2- 172.21.15.67:0/302786158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82900b3020 0x7f8290159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.437+0000 7f82948bd640 1 --2- 172.21.15.67:0/302786158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829009b180 0x7f82900c9310 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.437+0000 7f82948bd640 1 -- 172.21.15.67:0/302786158 >> 172.21.15.67:0/302786158 conn(0x7f82900b3ae0 msgr2=0x7f82900b3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:27.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.437+0000 7f82948bd640 1 -- 172.21.15.67:0/302786158 shutdown_connections 2024-04-25T02:29:27.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.437+0000 7f82948bd640 1 -- 172.21.15.67:0/302786158 wait complete. 2024-04-25T02:29:27.452 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:29:27.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.549+0000 7f8a0bd5a640 1 Processor -- start 2024-04-25T02:29:27.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.549+0000 7f8a0bd5a640 1 -- start start 2024-04-25T02:29:27.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.550+0000 7f8a0bd5a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8a040af120 0x7f8a04071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.550+0000 7f8a0bd5a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8a040acda0 0x7f8a0406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.550+0000 7f8a0bd5a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a04160b20 con 0x7f8a0415c230 2024-04-25T02:29:27.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.550+0000 7f8a0bd5a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8a0415c610 con 0x7f8a040af120 2024-04-25T02:29:27.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.550+0000 7f8a0bd5a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8a0415fd60 con 0x7f8a040acda0 2024-04-25T02:29:27.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.550+0000 7f8a09af6640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f8a0415c230 0x7f8a040aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57564/0 (socket says 172.21.15.67:57564) 2024-04-25T02:29:27.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.550+0000 7f8a09af6640 1 -- 172.21.15.67:0/1009739972 learned_addr learned my addr 172.21.15.67:0/1009739972 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:27.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.550+0000 7f8a092f5640 1 --2- 172.21.15.67:0/1009739972 >> v2:172.21.15.67:3300/0 conn(0x7f8a040af120 0x7f8a04071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.550+0000 7f8a0a2f7640 1 --2- 172.21.15.67:0/1009739972 >> v2:172.21.15.176:3300/0 conn(0x7f8a040acda0 0x7f8a0406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.550+0000 7f8a08af4640 1 -- 172.21.15.67:0/1009739972 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1068407856 0 0) 0x7f8a04160b20 con 0x7f8a0415c230 2024-04-25T02:29:27.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.550+0000 7f8a08af4640 1 -- 172.21.15.67:0/1009739972 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89f0003520 con 0x7f8a0415c230 2024-04-25T02:29:27.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.550+0000 7f8a092f5640 1 -- 172.21.15.67:0/1009739972 >> v2:172.21.15.176:3300/0 conn(0x7f8a040acda0 msgr2=0x7f8a0406cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:27.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.550+0000 7f8a092f5640 1 --2- 172.21.15.67:0/1009739972 >> v2:172.21.15.176:3300/0 conn(0x7f8a040acda0 0x7f8a0406cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.550+0000 7f8a092f5640 1 -- 172.21.15.67:0/1009739972 >> v1:172.21.15.67:6789/0 conn(0x7f8a0415c230 legacy=0x7f8a040aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:27.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.550+0000 7f8a092f5640 1 -- 172.21.15.67:0/1009739972 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a04160040 con 0x7f8a040af120 2024-04-25T02:29:27.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.550+0000 7f8a0a2f7640 1 --2- 172.21.15.67:0/1009739972 >> v2:172.21.15.176:3300/0 conn(0x7f8a040acda0 0x7f8a0406cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:27.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.551+0000 7f8a092f5640 1 --2- 172.21.15.67:0/1009739972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a040af120 0x7f8a04071800 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8a04070d80 tx=0x7f89f402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea10f2c8553f27f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:27.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.551+0000 7f8a08af4640 1 -- 172.21.15.67:0/1009739972 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4037070 con 0x7f8a040af120 2024-04-25T02:29:27.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.551+0000 7f8a08af4640 1 -- 172.21.15.67:0/1009739972 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89f4032440 con 0x7f8a040af120 2024-04-25T02:29:27.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.551+0000 7f8a08af4640 1 -- 172.21.15.67:0/1009739972 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4032810 con 0x7f8a040af120 2024-04-25T02:29:27.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.552+0000 7f8a0bd5a640 1 -- 172.21.15.67:0/1009739972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a040af120 msgr2=0x7f8a04071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:27.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.552+0000 7f8a0bd5a640 1 --2- 172.21.15.67:0/1009739972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a040af120 0x7f8a04071800 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8a04070d80 tx=0x7f89f402a1a0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.552+0000 7f8a0bd5a640 1 -- 172.21.15.67:0/1009739972 shutdown_connections 2024-04-25T02:29:27.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.552+0000 7f8a0bd5a640 1 --2- 172.21.15.67:0/1009739972 >> v2:172.21.15.176:3300/0 conn(0x7f8a040acda0 0x7f8a0406cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.552+0000 7f8a0bd5a640 1 --2- 172.21.15.67:0/1009739972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a040af120 0x7f8a04071800 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.552+0000 7f8a0bd5a640 1 -- 172.21.15.67:0/1009739972 >> 172.21.15.67:0/1009739972 conn(0x7f8a040b19c0 msgr2=0x7f8a040b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:27.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.552+0000 7f8a0bd5a640 1 -- 172.21.15.67:0/1009739972 shutdown_connections 2024-04-25T02:29:27.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.552+0000 7f8a0bd5a640 1 -- 172.21.15.67:0/1009739972 wait complete. 2024-04-25T02:29:27.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.553+0000 7f8a0bd5a640 1 Processor -- start 2024-04-25T02:29:27.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.553+0000 7f8a0bd5a640 1 -- start start 2024-04-25T02:29:27.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a0bd5a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a040acda0 0x7f8a04150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a0bd5a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a040af120 0x7f8a0415a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a0bd5a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a0415c230 0x7f8a0415a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a0bd5a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8a040ad1f0 con 0x7f8a040acda0 2024-04-25T02:29:27.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a0bd5a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8a04160600 con 0x7f8a0415c230 2024-04-25T02:29:27.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a0bd5a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8a040ad4d0 con 0x7f8a040af120 2024-04-25T02:29:27.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a09af6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a040acda0 0x7f8a04150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a09af6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a040acda0 0x7f8a04150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49462/0 (socket says 172.21.15.67:49462) 2024-04-25T02:29:27.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a09af6640 1 -- 172.21.15.67:0/1993594498 learned_addr learned my addr 172.21.15.67:0/1993594498 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:27.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a092f5640 1 --2- 172.21.15.67:0/1993594498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a040af120 0x7f8a0415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a0a2f7640 1 --2- 172.21.15.67:0/1993594498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a0415c230 0x7f8a0415a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a09af6640 1 -- 172.21.15.67:0/1993594498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a040af120 msgr2=0x7f8a0415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:27.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a09af6640 1 --2- 172.21.15.67:0/1993594498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a040af120 0x7f8a0415a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a09af6640 1 -- 172.21.15.67:0/1993594498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a0415c230 msgr2=0x7f8a0415a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:27.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a09af6640 1 --2- 172.21.15.67:0/1993594498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a0415c230 0x7f8a0415a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a09af6640 1 -- 172.21.15.67:0/1993594498 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0415d700 con 0x7f8a040acda0 2024-04-25T02:29:27.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a0a2f7640 1 --2- 172.21.15.67:0/1993594498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a0415c230 0x7f8a0415a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:27.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a092f5640 1 --2- 172.21.15.67:0/1993594498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a040af120 0x7f8a0415a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:27.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a09af6640 1 --2- 172.21.15.67:0/1993594498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a040acda0 0x7f8a04150980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000c3c0 tx=0x7f8a0000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:27.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f89fa7fc640 1 -- 172.21.15.67:0/1993594498 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a00017070 con 0x7f8a040acda0 2024-04-25T02:29:27.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f89fa7fc640 1 -- 172.21.15.67:0/1993594498 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a00005ce0 con 0x7f8a040acda0 2024-04-25T02:29:27.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a0bd5a640 1 -- 172.21.15.67:0/1993594498 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a041f5820 con 0x7f8a040acda0 2024-04-25T02:29:27.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f89fa7fc640 1 -- 172.21.15.67:0/1993594498 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a000072f0 con 0x7f8a040acda0 2024-04-25T02:29:27.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.554+0000 7f8a0bd5a640 1 -- 172.21.15.67:0/1993594498 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a041f5de0 con 0x7f8a040acda0 2024-04-25T02:29:27.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.555+0000 7f8a0bd5a640 1 -- 172.21.15.67:0/1993594498 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a04069110 con 0x7f8a040acda0 2024-04-25T02:29:27.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.556+0000 7f89fa7fc640 1 -- 172.21.15.67:0/1993594498 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a0001a070 con 0x7f8a040acda0 2024-04-25T02:29:27.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.556+0000 7f89fa7fc640 1 --2- 172.21.15.67:0/1993594498 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f89e806be30 0x7f89e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:27.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.556+0000 7f89fa7fc640 1 -- 172.21.15.67:0/1993594498 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8a0008a110 con 0x7f8a040acda0 2024-04-25T02:29:27.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.556+0000 7f8a092f5640 1 --2- 172.21.15.67:0/1993594498 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f89e806be30 0x7f89e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:27.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.557+0000 7f8a092f5640 1 --2- 172.21.15.67:0/1993594498 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f89e806be30 0x7f89e806e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f89f4034000 tx=0x7f89f402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:27.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.560+0000 7f89fa7fc640 1 -- 172.21.15.67:0/1993594498 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8a00058b50 con 0x7f8a040acda0 2024-04-25T02:29:27.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.784+0000 7f8a0bd5a640 1 -- 172.21.15.67:0/1993594498 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8a040b15c0 con 0x7f8a040acda0 2024-04-25T02:29:27.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.784+0000 7f89fa7fc640 1 -- 172.21.15.67:0/1993594498 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7f8a00058450 con 0x7f8a040acda0 2024-04-25T02:29:27.789 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:29:27.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.786+0000 7f8a0bd5a640 1 -- 172.21.15.67:0/1993594498 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f89e806be30 msgr2=0x7f89e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:27.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.786+0000 7f8a0bd5a640 1 --2- 172.21.15.67:0/1993594498 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f89e806be30 0x7f89e806e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f89f4034000 tx=0x7f89f402e000 comp rx=0 tx=0).stop 2024-04-25T02:29:27.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.786+0000 7f8a0bd5a640 1 -- 172.21.15.67:0/1993594498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a040acda0 msgr2=0x7f8a04150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:27.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.786+0000 7f8a0bd5a640 1 --2- 172.21.15.67:0/1993594498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a040acda0 0x7f8a04150980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000c3c0 tx=0x7f8a0000c880 comp rx=0 tx=0).stop 2024-04-25T02:29:27.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.786+0000 7f8a0bd5a640 1 -- 172.21.15.67:0/1993594498 shutdown_connections 2024-04-25T02:29:27.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.786+0000 7f8a0bd5a640 1 --2- 172.21.15.67:0/1993594498 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f89e806be30 0x7f89e806e2f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.786+0000 7f8a0bd5a640 1 --2- 172.21.15.67:0/1993594498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a0415c230 0x7f8a0415a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.786+0000 7f8a0bd5a640 1 --2- 172.21.15.67:0/1993594498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a040af120 0x7f8a0415a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.786+0000 7f8a0bd5a640 1 --2- 172.21.15.67:0/1993594498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a040acda0 0x7f8a04150980 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:27.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.786+0000 7f8a0bd5a640 1 -- 172.21.15.67:0/1993594498 >> 172.21.15.67:0/1993594498 conn(0x7f8a040b19c0 msgr2=0x7f8a0406cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:27.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.786+0000 7f8a0bd5a640 1 -- 172.21.15.67:0/1993594498 shutdown_connections 2024-04-25T02:29:27.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:27.786+0000 7f8a0bd5a640 1 -- 172.21.15.67:0/1993594498 wait complete. 2024-04-25T02:29:27.801 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T02:29:27.801 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:29:27.801 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-04-25T02:29:27.801 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:29:27.801 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:29:27.802 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T02:29:27.802 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T02:29:27.802 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:29:27.802 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:29:27.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:27.802 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-04-25T02:29:27.818 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:29:27.818 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:29:27.818 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:29:27.818 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:29:27.818 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-04-25T02:29:27.818 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:29:27.818 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:29:27.818 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-04-25T02:29:27.818 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-04-25T02:29:27.818 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:29:27.818 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-04-25T02:29:27.818 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-04-25T02:29:27.819 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:29:27.819 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-04-25T02:29:27.819 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:29:27.819 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-04-25T02:29:27.819 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:29:27.819 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42695sec preferred_lft 42695sec 2024-04-25T02:29:27.819 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::2c41:8a35:7b1b:25c3/64 scope link noprefixroute 2024-04-25T02:29:27.819 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:29:27.819 INFO:teuthology.orchestra.run.smithi067.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:29:27.819 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4e:35:79:35:3c:7f brd ff:ff:ff:ff:ff:ff 2024-04-25T02:29:27.819 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:29:27.819 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:29:27.819 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::38fc:9dff:fe1d:572b/64 scope link 2024-04-25T02:29:27.819 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:29:27.819 INFO:teuthology.orchestra.run.smithi067.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:29:27.820 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 8a:24:38:07:b0:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:29:27.820 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::8824:38ff:fe07:b0dc/64 scope link 2024-04-25T02:29:27.820 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:29:27.820 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:29:27.820 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 4e:35:79:35:3c:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:29:27.820 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::4c35:79ff:fe35:3c7f/64 scope link 2024-04-25T02:29:27.820 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:29:27.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:27.820 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:29:27.880 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-04-25T02:29:27.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:27.882 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-04-25T02:29:27.939 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-04-25T02:29:27.939 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:29:27.939 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:29:27.939 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:29:27.939 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:29:27.939 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:29:27.939 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-25T02:29:27.939 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:29:27.940 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:29:27.940 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:29:27.940 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-25T02:29:28.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:29:28.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:29:28.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:28.065 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-04-25T02:29:28.080 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T02:29:28.080 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:29:28.080 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:29:28.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:28.080 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-04-25T02:29:28.145 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:29:28.145 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:29:28.201 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:29:28.201 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:29:28.201 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:29:28.255 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:29:28.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:28.255 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:29:28.338 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:29:28.338 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:29:28.338 INFO:teuthology.orchestra.run.smithi067.stdout:invalid new device string format 2024-04-25T02:29:28.347 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:29:28.347 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:29:28.347 INFO:teuthology.orchestra.run.smithi067.stdout:invalid new device string format 2024-04-25T02:29:28.347 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-04-25T02:29:28.347 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:29:28.352 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:29:28.352 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:29:28.352 INFO:teuthology.orchestra.run.smithi067.stdout:invalid new device string format 2024-04-25T02:29:28.352 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-04-25T02:29:28.352 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:29:28.352 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-04-25T02:29:28.352 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.67:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-04-25T02:29:28.352 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=84283662-9e10-4d0d-b377-8e43b1f6e3af" will pass to kernel 2024-04-25T02:29:28.353 INFO:teuthology.orchestra.run.smithi067.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:29:28.353 INFO:teuthology.orchestra.run.smithi067.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:29:28.353 INFO:teuthology.orchestra.run.smithi067.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:29:28.353 INFO:teuthology.orchestra.run.smithi067.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:29:28.353 INFO:teuthology.orchestra.run.smithi067.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:29:28.354 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:29:28.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:28.355 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:29:28.420 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:29:28.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:29:28.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:29:28.521 INFO:teuthology.orchestra.run.smithi067.stdout:client4823 2024-04-25T02:29:28.521 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:29:28.521 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:29:28.537 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:29:28.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.674+0000 7ff120cd4640 1 Processor -- start 2024-04-25T02:29:28.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.674+0000 7ff120cd4640 1 -- start start 2024-04-25T02:29:28.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.675+0000 7ff120cd4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff11c15c230 0x7ff11c071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:28.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.675+0000 7ff120cd4640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff11c0acda0 0x7ff11c0aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:28.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.675+0000 7ff120cd4640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff11c160b20 con 0x7ff11c0aef50 2024-04-25T02:29:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.675+0000 7ff120cd4640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff11c15c610 con 0x7ff11c0acda0 2024-04-25T02:29:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.675+0000 7ff120cd4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff11c0ad200 con 0x7ff11c15c230 2024-04-25T02:29:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.675+0000 7ff119d9b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff11c0acda0 0x7ff11c0aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.675+0000 7ff11a59c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff11c15c230 0x7ff11c071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.675+0000 7ff11ad9d640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7ff11c0aef50 0x7ff11c0722c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:49098/0 (socket says 172.21.15.67:49098) 2024-04-25T02:29:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.676+0000 7ff11ad9d640 1 -- 172.21.15.67:0/1292296841 learned_addr learned my addr 172.21.15.67:0/1292296841 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.676+0000 7ff119d9b640 1 -- 172.21.15.67:0/1292296841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff11c15c230 msgr2=0x7ff11c071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.676+0000 7ff119d9b640 1 --2- 172.21.15.67:0/1292296841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff11c15c230 0x7ff11c071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.676+0000 7ff119d9b640 1 -- 172.21.15.67:0/1292296841 >> v1:172.21.15.176:6789/0 conn(0x7ff11c0aef50 legacy=0x7ff11c0722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.676+0000 7ff119d9b640 1 -- 172.21.15.67:0/1292296841 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c15fd60 con 0x7ff11c0acda0 2024-04-25T02:29:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.676+0000 7ff11a59c640 1 --2- 172.21.15.67:0/1292296841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff11c15c230 0x7ff11c071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.677+0000 7ff119d9b640 1 --2- 172.21.15.67:0/1292296841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff11c0acda0 0x7ff11c0aea10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff1100097a0 tx=0x7ff11002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fef3696bc15294df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.677+0000 7ff11959a640 1 -- 172.21.15.67:0/1292296841 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff110037070 con 0x7ff11c0acda0 2024-04-25T02:29:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.677+0000 7ff11959a640 1 -- 172.21.15.67:0/1292296841 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff110032440 con 0x7ff11c0acda0 2024-04-25T02:29:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.677+0000 7ff11959a640 1 -- 172.21.15.67:0/1292296841 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff110032810 con 0x7ff11c0acda0 2024-04-25T02:29:28.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.677+0000 7ff120cd4640 1 -- 172.21.15.67:0/1292296841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff11c0acda0 msgr2=0x7ff11c0aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:28.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.677+0000 7ff120cd4640 1 --2- 172.21.15.67:0/1292296841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff11c0acda0 0x7ff11c0aea10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff1100097a0 tx=0x7ff11002a180 comp rx=0 tx=0).stop 2024-04-25T02:29:28.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.677+0000 7ff120cd4640 1 -- 172.21.15.67:0/1292296841 shutdown_connections 2024-04-25T02:29:28.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.677+0000 7ff120cd4640 1 --2- 172.21.15.67:0/1292296841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff11c0acda0 0x7ff11c0aea10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:28.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.677+0000 7ff120cd4640 1 --2- 172.21.15.67:0/1292296841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff11c15c230 0x7ff11c071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:28.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.677+0000 7ff120cd4640 1 -- 172.21.15.67:0/1292296841 >> 172.21.15.67:0/1292296841 conn(0x7ff11c0b19c0 msgr2=0x7ff11c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:28.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.677+0000 7ff120cd4640 1 -- 172.21.15.67:0/1292296841 shutdown_connections 2024-04-25T02:29:28.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.678+0000 7ff120cd4640 1 -- 172.21.15.67:0/1292296841 wait complete. 2024-04-25T02:29:28.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.679+0000 7ff120cd4640 1 Processor -- start 2024-04-25T02:29:28.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.679+0000 7ff120cd4640 1 -- start start 2024-04-25T02:29:28.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.679+0000 7ff120cd4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff11c0acda0 0x7ff11c0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:28.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff120cd4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff11c0aef50 0x7ff11c09d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:28.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff120cd4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff11c15c230 0x7ff11c0720b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:28.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff120cd4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c160600 con 0x7ff11c15c230 2024-04-25T02:29:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff120cd4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c160320 con 0x7ff11c0acda0 2024-04-25T02:29:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff120cd4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff11c0af3e0 con 0x7ff11c0aef50 2024-04-25T02:29:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff11ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff11c15c230 0x7ff11c0720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff11ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff11c15c230 0x7ff11c0720b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49478/0 (socket says 172.21.15.67:49478) 2024-04-25T02:29:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff11ad9d640 1 -- 172.21.15.67:0/343217936 learned_addr learned my addr 172.21.15.67:0/343217936 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff11a59c640 1 --2- 172.21.15.67:0/343217936 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff11c0acda0 0x7ff11c0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff119d9b640 1 --2- 172.21.15.67:0/343217936 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff11c0aef50 0x7ff11c09d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff11ad9d640 1 -- 172.21.15.67:0/343217936 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff11c0aef50 msgr2=0x7ff11c09d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff11ad9d640 1 --2- 172.21.15.67:0/343217936 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff11c0aef50 0x7ff11c09d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff11ad9d640 1 -- 172.21.15.67:0/343217936 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff11c0acda0 msgr2=0x7ff11c0cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff11ad9d640 1 --2- 172.21.15.67:0/343217936 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff11c0acda0 0x7ff11c0cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff11ad9d640 1 -- 172.21.15.67:0/343217936 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c0b2e60 con 0x7ff11c15c230 2024-04-25T02:29:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff11a59c640 1 --2- 172.21.15.67:0/343217936 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff11c0acda0 0x7ff11c0cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:28.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff11ad9d640 1 --2- 172.21.15.67:0/343217936 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff11c15c230 0x7ff11c0720b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00ca70 tx=0x7ff10c00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:28.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff10affd640 1 -- 172.21.15.67:0/343217936 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c017070 con 0x7ff11c15c230 2024-04-25T02:29:28.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff10affd640 1 -- 172.21.15.67:0/343217936 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff10c00abd0 con 0x7ff11c15c230 2024-04-25T02:29:28.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff120cd4640 1 -- 172.21.15.67:0/343217936 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff11c0b3140 con 0x7ff11c15c230 2024-04-25T02:29:28.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff10affd640 1 -- 172.21.15.67:0/343217936 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c012400 con 0x7ff11c15c230 2024-04-25T02:29:28.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.680+0000 7ff120cd4640 1 -- 172.21.15.67:0/343217936 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff11c09c0c0 con 0x7ff11c15c230 2024-04-25T02:29:28.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.682+0000 7ff120cd4640 1 -- 172.21.15.67:0/343217936 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff11c069110 con 0x7ff11c15c230 2024-04-25T02:29:28.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.682+0000 7ff10affd640 1 -- 172.21.15.67:0/343217936 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff10c01a070 con 0x7ff11c15c230 2024-04-25T02:29:28.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.682+0000 7ff10affd640 1 --2- 172.21.15.67:0/343217936 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff0fc06be30 0x7ff0fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:28.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.682+0000 7ff10affd640 1 -- 172.21.15.67:0/343217936 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff10c08aa50 con 0x7ff11c15c230 2024-04-25T02:29:28.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.683+0000 7ff11a59c640 1 --2- 172.21.15.67:0/343217936 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff0fc06be30 0x7ff0fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:28.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.683+0000 7ff11a59c640 1 --2- 172.21.15.67:0/343217936 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff0fc06be30 0x7ff0fc06e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff114009a20 tx=0x7ff114008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:28.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.687+0000 7ff10affd640 1 -- 172.21.15.67:0/343217936 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff10c058dc0 con 0x7ff11c15c230 2024-04-25T02:29:28.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.905+0000 7ff120cd4640 1 -- 172.21.15.67:0/343217936 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff11c0cbeb0 con 0x7ff11c15c230 2024-04-25T02:29:28.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.905+0000 7ff10affd640 1 -- 172.21.15.67:0/343217936 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7ff10c05d0c0 con 0x7ff11c15c230 2024-04-25T02:29:28.909 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:29:28.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.908+0000 7ff120cd4640 1 -- 172.21.15.67:0/343217936 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff0fc06be30 msgr2=0x7ff0fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:28.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.908+0000 7ff120cd4640 1 --2- 172.21.15.67:0/343217936 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff0fc06be30 0x7ff0fc06e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff114009a20 tx=0x7ff114008040 comp rx=0 tx=0).stop 2024-04-25T02:29:28.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.908+0000 7ff120cd4640 1 -- 172.21.15.67:0/343217936 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff11c15c230 msgr2=0x7ff11c0720b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:28.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.908+0000 7ff120cd4640 1 --2- 172.21.15.67:0/343217936 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff11c15c230 0x7ff11c0720b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00ca70 tx=0x7ff10c00cf30 comp rx=0 tx=0).stop 2024-04-25T02:29:28.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.908+0000 7ff120cd4640 1 -- 172.21.15.67:0/343217936 shutdown_connections 2024-04-25T02:29:28.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.908+0000 7ff120cd4640 1 --2- 172.21.15.67:0/343217936 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff0fc06be30 0x7ff0fc06e2f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:28.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.908+0000 7ff120cd4640 1 --2- 172.21.15.67:0/343217936 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff11c15c230 0x7ff11c0720b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:28.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.908+0000 7ff120cd4640 1 --2- 172.21.15.67:0/343217936 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff11c0aef50 0x7ff11c09d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:28.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.908+0000 7ff120cd4640 1 --2- 172.21.15.67:0/343217936 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff11c0acda0 0x7ff11c0cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:28.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.908+0000 7ff120cd4640 1 -- 172.21.15.67:0/343217936 >> 172.21.15.67:0/343217936 conn(0x7ff11c0b19c0 msgr2=0x7ff11c0cc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:28.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.908+0000 7ff120cd4640 1 -- 172.21.15.67:0/343217936 shutdown_connections 2024-04-25T02:29:28.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:28.908+0000 7ff120cd4640 1 -- 172.21.15.67:0/343217936 wait complete. 2024-04-25T02:29:28.922 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T02:29:28.922 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:29:28.922 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-04-25T02:29:28.922 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T02:29:28.923 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T02:29:28.923 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T02:29:28.923 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T02:29:28.923 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:29:28.923 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T02:29:28.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:28.923 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-04-25T02:29:28.943 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:29:28.943 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:29:28.943 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:29:28.943 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:29:28.943 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-04-25T02:29:28.943 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:29:28.944 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:29:28.944 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:29:28.944 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-04-25T02:29:28.944 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:29:28.944 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:29:28.944 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-04-25T02:29:28.944 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:29:28.944 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:29:28.944 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:29:28.944 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:29:28.944 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:29:28.944 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42685sec preferred_lft 42685sec 2024-04-25T02:29:28.944 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::f141:2e43:429e:fd86/64 scope link noprefixroute 2024-04-25T02:29:28.945 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:29:28.945 INFO:teuthology.orchestra.run.smithi176.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:29:28.945 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 3a:53:89:77:09:90 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:29:28.945 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:29:28.945 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:29:28.945 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::904b:9cff:fe56:d77b/64 scope link 2024-04-25T02:29:28.945 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:29:28.945 INFO:teuthology.orchestra.run.smithi176.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:29:28.945 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 3a:53:89:77:09:90 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T02:29:28.945 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::3853:89ff:fe77:990/64 scope link 2024-04-25T02:29:28.945 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:29:28.945 INFO:teuthology.orchestra.run.smithi176.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:29:28.945 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 7a:bf:6d:e4:4c:c2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T02:29:28.945 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::78bf:6dff:fee4:4cc2/64 scope link 2024-04-25T02:29:28.946 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:29:28.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:28.946 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:29:29.011 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-04-25T02:29:29.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:29.013 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-04-25T02:29:29.072 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-04-25T02:29:29.073 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:29:29.073 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:29:29.073 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:29:29.073 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:29:29.074 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:29:29.074 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-04-25T02:29:29.074 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:29:29.074 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:29:29.074 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:29:29.074 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-04-25T02:29:29.167 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:29:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:29:29.199 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:29:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:29:29.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:29.206 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-04-25T02:29:29.221 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T02:29:29.221 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T02:29:29.221 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T02:29:29.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:29.221 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-04-25T02:29:29.285 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:29:29.285 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T02:29:29.340 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T02:29:29.340 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:29:29.340 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T02:29:29.396 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:29:29.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:29.396 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T02:29:29.478 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T02:29:29.478 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T02:29:29.478 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-04-25T02:29:29.486 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T02:29:29.486 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T02:29:29.486 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-04-25T02:29:29.486 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-04-25T02:29:29.487 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:29:29.491 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T02:29:29.491 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T02:29:29.491 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-04-25T02:29:29.491 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-04-25T02:29:29.492 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:29:29.492 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.67:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-04-25T02:29:29.492 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.67:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-04-25T02:29:29.492 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=84283662-9e10-4d0d-b377-8e43b1f6e3af" will pass to kernel 2024-04-25T02:29:29.492 INFO:teuthology.orchestra.run.smithi176.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T02:29:29.492 INFO:teuthology.orchestra.run.smithi176.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:29:29.492 INFO:teuthology.orchestra.run.smithi176.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:29:29.492 INFO:teuthology.orchestra.run.smithi176.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:29:29.492 INFO:teuthology.orchestra.run.smithi176.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:29:29.494 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:29:29.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:29.494 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T02:29:29.557 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:29:29.645 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:29:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:29:29.646 INFO:teuthology.orchestra.run.smithi176.stderr:2024-04-25T02:29:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:29:29.652 INFO:teuthology.orchestra.run.smithi176.stdout:client4829 2024-04-25T02:29:29.652 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:29:29.652 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:29:29.668 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-04-25T02:29:29.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.782+0000 7f9da97ab640 1 Processor -- start 2024-04-25T02:29:29.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.783+0000 7f9da97ab640 1 -- start start 2024-04-25T02:29:29.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.783+0000 7f9da97ab640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da415e5a0 0x7f9da40d0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:29.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.783+0000 7f9da97ab640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9da40d1f70 con 0x7f9da40d4cb0 2024-04-25T02:29:29.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.783+0000 7f9da97ab640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9da40d2250 con 0x7f9da40cfdf0 2024-04-25T02:29:29.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.783+0000 7f9da97ab640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9da40b3b20 con 0x7f9da415e5a0 2024-04-25T02:29:29.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.783+0000 7f9da27fc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9da40d4cb0 0x7f9da40b3fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57580/0 (socket says 172.21.15.67:57580) 2024-04-25T02:29:29.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.783+0000 7f9da27fc640 1 -- 172.21.15.67:0/3608491503 learned_addr learned my addr 172.21.15.67:0/3608491503 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:29.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da2ffd640 1 --2- 172.21.15.67:0/3608491503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da415e5a0 0x7f9da40d0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:29.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da1ffb640 1 -- 172.21.15.67:0/3608491503 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 809794272 0 0) 0x7f9da40d1f70 con 0x7f9da40d4cb0 2024-04-25T02:29:29.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da1ffb640 1 -- 172.21.15.67:0/3608491503 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d8c003520 con 0x7f9da40d4cb0 2024-04-25T02:29:29.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da1ffb640 1 -- 172.21.15.67:0/3608491503 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3131338598 0 0) 0x7f9d8c003520 con 0x7f9da40d4cb0 2024-04-25T02:29:29.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da1ffb640 1 -- 172.21.15.67:0/3608491503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da415e5a0 msgr2=0x7f9da40d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:29.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da1ffb640 1 --2- 172.21.15.67:0/3608491503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da415e5a0 0x7f9da40d0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:29.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da1ffb640 1 -- 172.21.15.67:0/3608491503 >> v1:172.21.15.176:6789/0 conn(0x7f9da40cfdf0 legacy=0x7f9da40b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:29.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da1ffb640 1 -- 172.21.15.67:0/3608491503 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da40b37b0 con 0x7f9da40d4cb0 2024-04-25T02:29:29.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da1ffb640 1 -- 172.21.15.67:0/3608491503 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f9d98001670 con 0x7f9da40d4cb0 2024-04-25T02:29:29.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da1ffb640 1 -- 172.21.15.67:0/3608491503 >> v1:172.21.15.67:6789/0 conn(0x7f9da40d4cb0 legacy=0x7f9da40b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:29.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da1ffb640 1 --2- 172.21.15.67:0/3608491503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d8c0039e0 0x7f9d8c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:29.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da1ffb640 1 --2- 172.21.15.67:0/3608491503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da415e5a0 0x7f9d8c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:29.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da1ffb640 1 --2- 172.21.15.67:0/3608491503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d8c004d40 0x7f9d8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:29.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da1ffb640 1 -- 172.21.15.67:0/3608491503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9da40b3b20 con 0x7f9d8c0039e0 2024-04-25T02:29:29.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da1ffb640 1 -- 172.21.15.67:0/3608491503 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8c00bb80 con 0x7f9d8c004d40 2024-04-25T02:29:29.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da1ffb640 1 -- 172.21.15.67:0/3608491503 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9d8c00bd80 con 0x7f9da415e5a0 2024-04-25T02:29:29.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da2ffd640 1 --2- 172.21.15.67:0/3608491503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d8c0039e0 0x7f9d8c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:29.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da27fc640 1 --2- 172.21.15.67:0/3608491503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da415e5a0 0x7f9d8c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:29.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da37fe640 1 --2- 172.21.15.67:0/3608491503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d8c004d40 0x7f9d8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:29.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da2ffd640 1 -- 172.21.15.67:0/3608491503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da415e5a0 msgr2=0x7f9d8c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:29.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.784+0000 7f9da2ffd640 1 --2- 172.21.15.67:0/3608491503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da415e5a0 0x7f9d8c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:29.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.785+0000 7f9da2ffd640 1 -- 172.21.15.67:0/3608491503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d8c004d40 msgr2=0x7f9d8c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:29.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.785+0000 7f9da2ffd640 1 --2- 172.21.15.67:0/3608491503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d8c004d40 0x7f9d8c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:29.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.785+0000 7f9da2ffd640 1 -- 172.21.15.67:0/3608491503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8c003520 con 0x7f9d8c0039e0 2024-04-25T02:29:29.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.785+0000 7f9da2ffd640 1 --2- 172.21.15.67:0/3608491503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d8c0039e0 0x7f9d8c003e00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009ac0 tx=0x7f9d8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753a5e1a410883a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:29.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.785+0000 7f9da1ffb640 1 -- 172.21.15.67:0/3608491503 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c036070 con 0x7f9d8c0039e0 2024-04-25T02:29:29.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.785+0000 7f9da1ffb640 1 -- 172.21.15.67:0/3608491503 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d9c031400 con 0x7f9d8c0039e0 2024-04-25T02:29:29.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.785+0000 7f9da1ffb640 1 -- 172.21.15.67:0/3608491503 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c009690 con 0x7f9d8c0039e0 2024-04-25T02:29:29.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.786+0000 7f9da97ab640 1 -- 172.21.15.67:0/3608491503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d8c0039e0 msgr2=0x7f9d8c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:29.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.786+0000 7f9da97ab640 1 --2- 172.21.15.67:0/3608491503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d8c0039e0 0x7f9d8c003e00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009ac0 tx=0x7f9d8c005830 comp rx=0 tx=0).stop 2024-04-25T02:29:29.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.786+0000 7f9da37fe640 1 -- 172.21.15.67:0/3608491503 reap_dead start 2024-04-25T02:29:29.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.786+0000 7f9da97ab640 1 -- 172.21.15.67:0/3608491503 shutdown_connections 2024-04-25T02:29:29.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.786+0000 7f9da97ab640 1 -- 172.21.15.67:0/3608491503 >> 172.21.15.67:0/3608491503 conn(0x7f9da40d4190 msgr2=0x7f9da40d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:29.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.786+0000 7f9da97ab640 1 -- 172.21.15.67:0/3608491503 shutdown_connections 2024-04-25T02:29:29.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.786+0000 7f9da97ab640 1 -- 172.21.15.67:0/3608491503 wait complete. 2024-04-25T02:29:29.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.787+0000 7f9da97ab640 1 Processor -- start 2024-04-25T02:29:29.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.787+0000 7f9da97ab640 1 -- start start 2024-04-25T02:29:29.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.788+0000 7f9da97ab640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9da4152450 0x7f9da40cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:29.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.788+0000 7f9da97ab640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da40ce480 0x7f9da41f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:29.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.788+0000 7f9da97ab640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9da4152830 0x7f9da415c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:29.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.788+0000 7f9da97ab640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9da415e980 con 0x7f9da4152450 2024-04-25T02:29:29.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.788+0000 7f9da97ab640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9da40d2530 con 0x7f9da4152830 2024-04-25T02:29:29.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.788+0000 7f9da97ab640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9da40b4dd0 con 0x7f9da40ce480 2024-04-25T02:29:29.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.788+0000 7f9da2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9da4152450 0x7f9da40cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:29.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.788+0000 7f9da2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9da4152450 0x7f9da40cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49498/0 (socket says 172.21.15.67:49498) 2024-04-25T02:29:29.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.788+0000 7f9da2ffd640 1 -- 172.21.15.67:0/1179453176 learned_addr learned my addr 172.21.15.67:0/1179453176 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:29.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.788+0000 7f9da27fc640 1 --2- 172.21.15.67:0/1179453176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da40ce480 0x7f9da41f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.788+0000 7f9da37fe640 1 --2- 172.21.15.67:0/1179453176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9da4152830 0x7f9da415c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.789+0000 7f9da2ffd640 1 -- 172.21.15.67:0/1179453176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da40ce480 msgr2=0x7f9da41f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.789+0000 7f9da2ffd640 1 --2- 172.21.15.67:0/1179453176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da40ce480 0x7f9da41f4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.789+0000 7f9da2ffd640 1 -- 172.21.15.67:0/1179453176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9da4152830 msgr2=0x7f9da415c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.789+0000 7f9da2ffd640 1 --2- 172.21.15.67:0/1179453176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9da4152830 0x7f9da415c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.789+0000 7f9da2ffd640 1 -- 172.21.15.67:0/1179453176 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da40b8510 con 0x7f9da4152450 2024-04-25T02:29:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.789+0000 7f9da2ffd640 1 --2- 172.21.15.67:0/1179453176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9da4152450 0x7f9da40cdf40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c034040 tx=0x7f9d9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.789+0000 7f9d8b7fe640 1 -- 172.21.15.67:0/1179453176 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c040020 con 0x7f9da4152450 2024-04-25T02:29:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.789+0000 7f9d8b7fe640 1 -- 172.21.15.67:0/1179453176 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d9c003940 con 0x7f9da4152450 2024-04-25T02:29:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.789+0000 7f9da97ab640 1 -- 172.21.15.67:0/1179453176 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9da40b87f0 con 0x7f9da4152450 2024-04-25T02:29:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.789+0000 7f9d8b7fe640 1 -- 172.21.15.67:0/1179453176 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c036040 con 0x7f9da4152450 2024-04-25T02:29:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.789+0000 7f9da97ab640 1 -- 172.21.15.67:0/1179453176 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9da40b8db0 con 0x7f9da4152450 2024-04-25T02:29:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.790+0000 7f9da97ab640 1 -- 172.21.15.67:0/1179453176 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9da4069110 con 0x7f9da4152450 2024-04-25T02:29:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.791+0000 7f9d8b7fe640 1 -- 172.21.15.67:0/1179453176 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d9c043020 con 0x7f9da4152450 2024-04-25T02:29:29.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.791+0000 7f9d8b7fe640 1 --2- 172.21.15.67:0/1179453176 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9d9006be30 0x7f9d9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:29.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.791+0000 7f9d8b7fe640 1 -- 172.21.15.67:0/1179453176 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f9d9c0aaee0 con 0x7f9da4152450 2024-04-25T02:29:29.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.791+0000 7f9da27fc640 1 --2- 172.21.15.67:0/1179453176 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9d9006be30 0x7f9d9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:29.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.792+0000 7f9da27fc640 1 --2- 172.21.15.67:0/1179453176 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9d9006be30 0x7f9d9006e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9da4152d90 tx=0x7f9d98000fc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:29.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:29.795+0000 7f9d8b7fe640 1 -- 172.21.15.67:0/1179453176 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9d9c04a070 con 0x7f9da4152450 2024-04-25T02:29:30.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.018+0000 7f9da97ab640 1 -- 172.21.15.67:0/1179453176 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f9da40b5a60 con 0x7f9da4152450 2024-04-25T02:29:30.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.375+0000 7f9d8b7fe640 1 -- 172.21.15.67:0/1179453176 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v15) ==== 136+0+0 (secure 0 0 0) 0x7f9d9c079240 con 0x7f9da4152450 2024-04-25T02:29:30.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.378+0000 7f9da97ab640 1 -- 172.21.15.67:0/1179453176 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9d9006be30 msgr2=0x7f9d9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:30.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.378+0000 7f9da97ab640 1 --2- 172.21.15.67:0/1179453176 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9d9006be30 0x7f9d9006e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9da4152d90 tx=0x7f9d98000fc0 comp rx=0 tx=0).stop 2024-04-25T02:29:30.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.378+0000 7f9da97ab640 1 -- 172.21.15.67:0/1179453176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9da4152450 msgr2=0x7f9da40cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:30.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.378+0000 7f9da97ab640 1 --2- 172.21.15.67:0/1179453176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9da4152450 0x7f9da40cdf40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c034040 tx=0x7f9d9c004730 comp rx=0 tx=0).stop 2024-04-25T02:29:30.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.378+0000 7f9da97ab640 1 -- 172.21.15.67:0/1179453176 shutdown_connections 2024-04-25T02:29:30.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.378+0000 7f9da97ab640 1 --2- 172.21.15.67:0/1179453176 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9d9006be30 0x7f9d9006e2f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.378+0000 7f9da97ab640 1 --2- 172.21.15.67:0/1179453176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9da4152830 0x7f9da415c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.378+0000 7f9da97ab640 1 --2- 172.21.15.67:0/1179453176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da40ce480 0x7f9da41f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.378+0000 7f9da97ab640 1 --2- 172.21.15.67:0/1179453176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9da4152450 0x7f9da40cdf40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.378+0000 7f9da97ab640 1 -- 172.21.15.67:0/1179453176 >> 172.21.15.67:0/1179453176 conn(0x7f9da40d4190 msgr2=0x7f9da406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.378+0000 7f9da97ab640 1 -- 172.21.15.67:0/1179453176 shutdown_connections 2024-04-25T02:29:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.378+0000 7f9da97ab640 1 -- 172.21.15.67:0/1179453176 wait complete. 2024-04-25T02:29:30.393 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-04-25T02:29:30.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.493+0000 7f9d291f9640 1 Processor -- start 2024-04-25T02:29:30.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.493+0000 7f9d291f9640 1 -- start start 2024-04-25T02:29:30.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.494+0000 7f9d291f9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9d240b3cd0 0x7f9d24165fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:30.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.494+0000 7f9d291f9640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d2415fa90 con 0x7f9d2415b220 2024-04-25T02:29:30.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.494+0000 7f9d291f9640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d240713d0 con 0x7f9d24070df0 2024-04-25T02:29:30.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.494+0000 7f9d291f9640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9d240aee00 con 0x7f9d240b3cd0 2024-04-25T02:29:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.494+0000 7f9d22d9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9d2415b220 0x7f9d2415ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57588/0 (socket says 172.21.15.67:57588) 2024-04-25T02:29:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.494+0000 7f9d22d9d640 1 -- 172.21.15.67:0/3176913497 learned_addr learned my addr 172.21.15.67:0/3176913497 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.494+0000 7f9d2359e640 1 --2- 172.21.15.67:0/3176913497 >> v2:172.21.15.176:3300/0 conn(0x7f9d240b3cd0 0x7f9d24165fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.494+0000 7f9d2259c640 1 -- 172.21.15.67:0/3176913497 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2229879561 0 0) 0x7f9d2415fa90 con 0x7f9d2415b220 2024-04-25T02:29:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.494+0000 7f9d2259c640 1 -- 172.21.15.67:0/3176913497 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d10003520 con 0x7f9d2415b220 2024-04-25T02:29:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.494+0000 7f9d2259c640 1 -- 172.21.15.67:0/3176913497 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2337018627 0 0) 0x7f9d240713d0 con 0x7f9d24070df0 2024-04-25T02:29:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.494+0000 7f9d2259c640 1 -- 172.21.15.67:0/3176913497 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d2415fa90 con 0x7f9d24070df0 2024-04-25T02:29:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.494+0000 7f9d2359e640 1 -- 172.21.15.67:0/3176913497 >> v1:172.21.15.176:6789/0 conn(0x7f9d24070df0 legacy=0x7f9d2415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.494+0000 7f9d2359e640 1 -- 172.21.15.67:0/3176913497 >> v1:172.21.15.67:6789/0 conn(0x7f9d2415b220 legacy=0x7f9d2415ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.494+0000 7f9d2359e640 1 -- 172.21.15.67:0/3176913497 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d240ae4d0 con 0x7f9d240b3cd0 2024-04-25T02:29:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.495+0000 7f9d2359e640 1 --2- 172.21.15.67:0/3176913497 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d240b3cd0 0x7f9d24165fa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009d90 tx=0x7f9d1c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c38869835376098 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.495+0000 7f9d2259c640 1 -- 172.21.15.67:0/3176913497 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c007740 con 0x7f9d240b3cd0 2024-04-25T02:29:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.495+0000 7f9d2259c640 1 -- 172.21.15.67:0/3176913497 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d1c0078e0 con 0x7f9d240b3cd0 2024-04-25T02:29:30.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.495+0000 7f9d2259c640 1 -- 172.21.15.67:0/3176913497 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c007cb0 con 0x7f9d240b3cd0 2024-04-25T02:29:30.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.496+0000 7f9d291f9640 1 -- 172.21.15.67:0/3176913497 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d240b3cd0 msgr2=0x7f9d24165fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:30.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.496+0000 7f9d291f9640 1 --2- 172.21.15.67:0/3176913497 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d240b3cd0 0x7f9d24165fa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009d90 tx=0x7f9d1c02a6f0 comp rx=0 tx=0).stop 2024-04-25T02:29:30.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.496+0000 7f9d291f9640 1 -- 172.21.15.67:0/3176913497 shutdown_connections 2024-04-25T02:29:30.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.496+0000 7f9d291f9640 1 --2- 172.21.15.67:0/3176913497 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d240b3cd0 0x7f9d24165fa0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:30.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.496+0000 7f9d291f9640 1 -- 172.21.15.67:0/3176913497 >> 172.21.15.67:0/3176913497 conn(0x7f9d240b19c0 msgr2=0x7f9d240b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:30.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.496+0000 7f9d291f9640 1 -- 172.21.15.67:0/3176913497 shutdown_connections 2024-04-25T02:29:30.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.496+0000 7f9d291f9640 1 -- 172.21.15.67:0/3176913497 wait complete. 2024-04-25T02:29:30.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.497+0000 7f9d291f9640 1 Processor -- start 2024-04-25T02:29:30.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.497+0000 7f9d291f9640 1 -- start start 2024-04-25T02:29:30.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.498+0000 7f9d291f9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d24070df0 0x7f9d241496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:30.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.498+0000 7f9d291f9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d240b3cd0 0x7f9d24157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:30.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.498+0000 7f9d291f9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d2415b220 0x7f9d24157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:30.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.498+0000 7f9d291f9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2406eb90 con 0x7f9d2415b220 2024-04-25T02:29:30.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.498+0000 7f9d291f9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9d240aea90 con 0x7f9d240b3cd0 2024-04-25T02:29:30.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.498+0000 7f9d291f9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9d2406ed10 con 0x7f9d24070df0 2024-04-25T02:29:30.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.498+0000 7f9d2359e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d2415b220 0x7f9d24157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:30.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.498+0000 7f9d2359e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d2415b220 0x7f9d24157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49512/0 (socket says 172.21.15.67:49512) 2024-04-25T02:29:30.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.498+0000 7f9d2359e640 1 -- 172.21.15.67:0/4241761430 learned_addr learned my addr 172.21.15.67:0/4241761430 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:30.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.498+0000 7f9d22d9d640 1 --2- 172.21.15.67:0/4241761430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d24070df0 0x7f9d241496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:30.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.498+0000 7f9d1bfff640 1 --2- 172.21.15.67:0/4241761430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d240b3cd0 0x7f9d24157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:30.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.498+0000 7f9d2359e640 1 -- 172.21.15.67:0/4241761430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d24070df0 msgr2=0x7f9d241496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:30.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.498+0000 7f9d2359e640 1 --2- 172.21.15.67:0/4241761430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d24070df0 0x7f9d241496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:30.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.498+0000 7f9d2359e640 1 -- 172.21.15.67:0/4241761430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d240b3cd0 msgr2=0x7f9d24157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:30.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.498+0000 7f9d2359e640 1 --2- 172.21.15.67:0/4241761430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d240b3cd0 0x7f9d24157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:30.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.498+0000 7f9d2359e640 1 -- 172.21.15.67:0/4241761430 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d24149c10 con 0x7f9d2415b220 2024-04-25T02:29:30.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.499+0000 7f9d2359e640 1 --2- 172.21.15.67:0/4241761430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d2415b220 0x7f9d24157d80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009eb0 tx=0x7f9d1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:30.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.499+0000 7f9d1b7fe640 1 -- 172.21.15.67:0/4241761430 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c040070 con 0x7f9d2415b220 2024-04-25T02:29:30.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.499+0000 7f9d1b7fe640 1 -- 172.21.15.67:0/4241761430 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d1c031bc0 con 0x7f9d2415b220 2024-04-25T02:29:30.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.499+0000 7f9d291f9640 1 -- 172.21.15.67:0/4241761430 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2409b9c0 con 0x7f9d2415b220 2024-04-25T02:29:30.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.499+0000 7f9d1b7fe640 1 -- 172.21.15.67:0/4241761430 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c009450 con 0x7f9d2415b220 2024-04-25T02:29:30.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.499+0000 7f9d291f9640 1 -- 172.21.15.67:0/4241761430 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d2409bf80 con 0x7f9d2415b220 2024-04-25T02:29:30.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.500+0000 7f9d291f9640 1 -- 172.21.15.67:0/4241761430 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d24069110 con 0x7f9d2415b220 2024-04-25T02:29:30.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.500+0000 7f9d1b7fe640 1 -- 172.21.15.67:0/4241761430 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d1c039040 con 0x7f9d2415b220 2024-04-25T02:29:30.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.500+0000 7f9d1b7fe640 1 --2- 172.21.15.67:0/4241761430 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9d0406be30 0x7f9d0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:30.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.501+0000 7f9d1b7fe640 1 -- 172.21.15.67:0/4241761430 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f9d1c0ac390 con 0x7f9d2415b220 2024-04-25T02:29:30.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.501+0000 7f9d22d9d640 1 --2- 172.21.15.67:0/4241761430 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9d0406be30 0x7f9d0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:30.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.501+0000 7f9d22d9d640 1 --2- 172.21.15.67:0/4241761430 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9d0406be30 0x7f9d0406e2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9d14000f60 tx=0x7f9d14007d70 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:30.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.505+0000 7f9d1b7fe640 1 -- 172.21.15.67:0/4241761430 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9d1c07a8a0 con 0x7f9d2415b220 2024-04-25T02:29:30.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.714+0000 7f9d291f9640 1 -- 172.21.15.67:0/4241761430 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f9d240b45b0 con 0x7f9d0406be30 2024-04-25T02:29:30.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.716+0000 7f9d1b7fe640 1 -- 172.21.15.67:0/4241761430 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f9d240b45b0 con 0x7f9d0406be30 2024-04-25T02:29:30.719 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-04-25T02:29:30.719 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:30.719 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cephfs" 2024-04-25T02:29:30.719 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:30.719 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-04-25T02:29:30.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.718+0000 7f9d291f9640 1 -- 172.21.15.67:0/4241761430 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9d0406be30 msgr2=0x7f9d0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:30.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.718+0000 7f9d291f9640 1 --2- 172.21.15.67:0/4241761430 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9d0406be30 0x7f9d0406e2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9d14000f60 tx=0x7f9d14007d70 comp rx=0 tx=0).stop 2024-04-25T02:29:30.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.718+0000 7f9d291f9640 1 -- 172.21.15.67:0/4241761430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d2415b220 msgr2=0x7f9d24157d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:30.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.718+0000 7f9d291f9640 1 --2- 172.21.15.67:0/4241761430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d2415b220 0x7f9d24157d80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009eb0 tx=0x7f9d1c004a40 comp rx=0 tx=0).stop 2024-04-25T02:29:30.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.718+0000 7f9d291f9640 1 -- 172.21.15.67:0/4241761430 shutdown_connections 2024-04-25T02:29:30.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.718+0000 7f9d291f9640 1 --2- 172.21.15.67:0/4241761430 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f9d0406be30 0x7f9d0406e2f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:30.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.718+0000 7f9d291f9640 1 --2- 172.21.15.67:0/4241761430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d2415b220 0x7f9d24157d80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:30.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.718+0000 7f9d291f9640 1 --2- 172.21.15.67:0/4241761430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d240b3cd0 0x7f9d24157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:30.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.718+0000 7f9d291f9640 1 --2- 172.21.15.67:0/4241761430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d24070df0 0x7f9d241496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:30.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.718+0000 7f9d291f9640 1 -- 172.21.15.67:0/4241761430 >> 172.21.15.67:0/4241761430 conn(0x7f9d240b19c0 msgr2=0x7f9d240b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:30.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.718+0000 7f9d291f9640 1 -- 172.21.15.67:0/4241761430 shutdown_connections 2024-04-25T02:29:30.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.718+0000 7f9d291f9640 1 -- 172.21.15.67:0/4241761430 wait complete. 2024-04-25T02:29:30.732 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T02:29:30.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.833+0000 7fcceca76640 1 Processor -- start 2024-04-25T02:29:30.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.833+0000 7fcceca76640 1 -- start start 2024-04-25T02:29:30.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.834+0000 7fcceca76640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcce806edf0 0x7fcce815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:30.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.834+0000 7fcceca76640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce80ae8e0 0x7fcce80aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:30.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.834+0000 7fcceca76640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcce806d100 con 0x7fcce8156620 2024-04-25T02:29:30.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.834+0000 7fcceca76640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fcce80acda0 con 0x7fcce806edf0 2024-04-25T02:29:30.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.834+0000 7fcceca76640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcce80af2d0 con 0x7fcce80ae8e0 2024-04-25T02:29:30.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.834+0000 7fcce5d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcce806edf0 0x7fcce815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:30.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.834+0000 7fcce659c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fcce8156620 0x7fcce806dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57590/0 (socket says 172.21.15.67:57590) 2024-04-25T02:29:30.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.834+0000 7fcce5d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcce806edf0 0x7fcce815cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49528/0 (socket says 172.21.15.67:49528) 2024-04-25T02:29:30.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.834+0000 7fcce659c640 1 -- 172.21.15.67:0/3979441447 learned_addr learned my addr 172.21.15.67:0/3979441447 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:30.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.834+0000 7fcce6d9d640 1 --2- 172.21.15.67:0/3979441447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce80ae8e0 0x7fcce80aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:30.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.834+0000 7fcce5d9b640 1 -- 172.21.15.67:0/3979441447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce80ae8e0 msgr2=0x7fcce80aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:30.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.834+0000 7fcce5d9b640 1 --2- 172.21.15.67:0/3979441447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce80ae8e0 0x7fcce80aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:30.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.834+0000 7fcce5d9b640 1 -- 172.21.15.67:0/3979441447 >> v1:172.21.15.67:6789/0 conn(0x7fcce8156620 legacy=0x7fcce806dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:30.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.834+0000 7fcce5d9b640 1 -- 172.21.15.67:0/3979441447 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce80ad060 con 0x7fcce806edf0 2024-04-25T02:29:30.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.834+0000 7fcce559a640 1 -- 172.21.15.67:0/3979441447 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561354852 0 0) 0x7fcce806d100 con 0x7fcce8156620 2024-04-25T02:29:30.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.835+0000 7fcce5d9b640 1 --2- 172.21.15.67:0/3979441447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcce806edf0 0x7fcce815cf70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0097a0 tx=0x7fccdc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480c88ebbdb16713 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:30.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.835+0000 7fcce559a640 1 -- 172.21.15.67:0/3979441447 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc037070 con 0x7fcce806edf0 2024-04-25T02:29:30.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.835+0000 7fcce559a640 1 -- 172.21.15.67:0/3979441447 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccdc02ae50 con 0x7fcce806edf0 2024-04-25T02:29:30.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.835+0000 7fcce559a640 1 -- 172.21.15.67:0/3979441447 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc032660 con 0x7fcce806edf0 2024-04-25T02:29:30.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.836+0000 7fcceca76640 1 -- 172.21.15.67:0/3979441447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcce806edf0 msgr2=0x7fcce815cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:30.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.836+0000 7fcceca76640 1 --2- 172.21.15.67:0/3979441447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcce806edf0 0x7fcce815cf70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0097a0 tx=0x7fccdc02a100 comp rx=0 tx=0).stop 2024-04-25T02:29:30.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.836+0000 7fcceca76640 1 -- 172.21.15.67:0/3979441447 shutdown_connections 2024-04-25T02:29:30.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.836+0000 7fcceca76640 1 --2- 172.21.15.67:0/3979441447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce80ae8e0 0x7fcce80aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:30.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.836+0000 7fcceca76640 1 --2- 172.21.15.67:0/3979441447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcce806edf0 0x7fcce815cf70 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:30.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.836+0000 7fcceca76640 1 -- 172.21.15.67:0/3979441447 >> 172.21.15.67:0/3979441447 conn(0x7fcce80b19c0 msgr2=0x7fcce80b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:30.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.836+0000 7fcceca76640 1 -- 172.21.15.67:0/3979441447 shutdown_connections 2024-04-25T02:29:30.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.836+0000 7fcceca76640 1 -- 172.21.15.67:0/3979441447 wait complete. 2024-04-25T02:29:30.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.837+0000 7fcceca76640 1 Processor -- start 2024-04-25T02:29:30.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.837+0000 7fcceca76640 1 -- start start 2024-04-25T02:29:30.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.838+0000 7fcceca76640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce806edf0 0x7fcce809aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:30.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.838+0000 7fcceca76640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcce80ae8e0 0x7fcce8145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:30.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.838+0000 7fcceca76640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcce8156620 0x7fcce81457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:30.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.838+0000 7fcceca76640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcce80ad340 con 0x7fcce80ae8e0 2024-04-25T02:29:30.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.838+0000 7fcceca76640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcce806d680 con 0x7fcce8156620 2024-04-25T02:29:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.838+0000 7fcceca76640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcce80ad4c0 con 0x7fcce806edf0 2024-04-25T02:29:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.838+0000 7fcce5d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcce80ae8e0 0x7fcce8145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.838+0000 7fcce5d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcce80ae8e0 0x7fcce8145f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49532/0 (socket says 172.21.15.67:49532) 2024-04-25T02:29:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.838+0000 7fcce5d9b640 1 -- 172.21.15.67:0/966127717 learned_addr learned my addr 172.21.15.67:0/966127717 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.838+0000 7fcce659c640 1 --2- 172.21.15.67:0/966127717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce806edf0 0x7fcce809aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.838+0000 7fcce5d9b640 1 -- 172.21.15.67:0/966127717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce806edf0 msgr2=0x7fcce809aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.838+0000 7fcce5d9b640 1 --2- 172.21.15.67:0/966127717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce806edf0 0x7fcce809aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.838+0000 7fcce5d9b640 1 -- 172.21.15.67:0/966127717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcce8156620 msgr2=0x7fcce81457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.838+0000 7fcce6d9d640 1 --2- 172.21.15.67:0/966127717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcce8156620 0x7fcce81457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.838+0000 7fcce5d9b640 1 --2- 172.21.15.67:0/966127717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcce8156620 0x7fcce81457b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.838+0000 7fcce5d9b640 1 -- 172.21.15.67:0/966127717 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce8157f20 con 0x7fcce80ae8e0 2024-04-25T02:29:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.838+0000 7fcce6d9d640 1 --2- 172.21.15.67:0/966127717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcce8156620 0x7fcce81457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:30.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.839+0000 7fcce5d9b640 1 --2- 172.21.15.67:0/966127717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcce80ae8e0 0x7fcce8145f60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fccdc035040 tx=0x7fccdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.839+0000 7fccd6ffd640 1 -- 172.21.15.67:0/966127717 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc041070 con 0x7fcce80ae8e0 2024-04-25T02:29:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.839+0000 7fccd6ffd640 1 -- 172.21.15.67:0/966127717 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccdc03c670 con 0x7fcce80ae8e0 2024-04-25T02:29:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.839+0000 7fccd6ffd640 1 -- 172.21.15.67:0/966127717 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc037040 con 0x7fcce80ae8e0 2024-04-25T02:29:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.839+0000 7fcceca76640 1 -- 172.21.15.67:0/966127717 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce8158200 con 0x7fcce80ae8e0 2024-04-25T02:29:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.839+0000 7fcceca76640 1 -- 172.21.15.67:0/966127717 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce809d5c0 con 0x7fcce80ae8e0 2024-04-25T02:29:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.840+0000 7fcceca76640 1 -- 172.21.15.67:0/966127717 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce8069110 con 0x7fcce80ae8e0 2024-04-25T02:29:30.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.840+0000 7fccd6ffd640 1 -- 172.21.15.67:0/966127717 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fccdc03a070 con 0x7fcce80ae8e0 2024-04-25T02:29:30.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.841+0000 7fccd6ffd640 1 --2- 172.21.15.67:0/966127717 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fccc806be60 0x7fccc806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:30.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.841+0000 7fccd6ffd640 1 -- 172.21.15.67:0/966127717 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fccdc0ab0b0 con 0x7fcce80ae8e0 2024-04-25T02:29:30.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.841+0000 7fcce659c640 1 --2- 172.21.15.67:0/966127717 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fccc806be60 0x7fccc806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:30.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.842+0000 7fcce659c640 1 --2- 172.21.15.67:0/966127717 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fccc806be60 0x7fccc806e320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcce00012e0 tx=0x7fcce0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:30.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:30.845+0000 7fccd6ffd640 1 -- 172.21.15.67:0/966127717 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fccdc079c10 con 0x7fcce80ae8e0 2024-04-25T02:29:31.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.029+0000 7fcceca76640 1 -- 172.21.15.67:0/966127717 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fcce80d0240 con 0x7fcce80ae8e0 2024-04-25T02:29:31.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.029+0000 7fccd6ffd640 1 -- 172.21.15.67:0/966127717 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fccdc079510 con 0x7fcce80ae8e0 2024-04-25T02:29:31.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.031+0000 7fcceca76640 1 -- 172.21.15.67:0/966127717 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fccc806be60 msgr2=0x7fccc806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:31.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.031+0000 7fcceca76640 1 --2- 172.21.15.67:0/966127717 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fccc806be60 0x7fccc806e320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcce00012e0 tx=0x7fcce0009040 comp rx=0 tx=0).stop 2024-04-25T02:29:31.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.031+0000 7fcceca76640 1 -- 172.21.15.67:0/966127717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcce80ae8e0 msgr2=0x7fcce8145f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:31.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.031+0000 7fcceca76640 1 --2- 172.21.15.67:0/966127717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcce80ae8e0 0x7fcce8145f60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fccdc035040 tx=0x7fccdc0046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.031+0000 7fcceca76640 1 -- 172.21.15.67:0/966127717 shutdown_connections 2024-04-25T02:29:31.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.031+0000 7fcceca76640 1 --2- 172.21.15.67:0/966127717 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fccc806be60 0x7fccc806e320 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.031+0000 7fcceca76640 1 --2- 172.21.15.67:0/966127717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcce8156620 0x7fcce81457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.031+0000 7fcceca76640 1 --2- 172.21.15.67:0/966127717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcce80ae8e0 0x7fcce8145f60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.031+0000 7fcceca76640 1 --2- 172.21.15.67:0/966127717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce806edf0 0x7fcce809aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.031+0000 7fcceca76640 1 -- 172.21.15.67:0/966127717 >> 172.21.15.67:0/966127717 conn(0x7fcce80b19c0 msgr2=0x7fcce815c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:31.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.031+0000 7fcceca76640 1 -- 172.21.15.67:0/966127717 shutdown_connections 2024-04-25T02:29:31.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.031+0000 7fcceca76640 1 -- 172.21.15.67:0/966127717 wait complete. 2024-04-25T02:29:31.045 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs subvol_grp17780 2024-04-25T02:29:31.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.146+0000 7fb5b2763640 1 Processor -- start 2024-04-25T02:29:31.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.146+0000 7fb5b2763640 1 -- start start 2024-04-25T02:29:31.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.146+0000 7fb5b2763640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5ac0cf8f0 0x7fb5ac0d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:31.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.146+0000 7fb5b2763640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb5ac06bfb0 0x7fb5ac06c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:31.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.146+0000 7fb5b2763640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5ac0cff80 con 0x7fb5ac15e760 2024-04-25T02:29:31.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.146+0000 7fb5b2763640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb5ac0cfd50 con 0x7fb5ac06bfb0 2024-04-25T02:29:31.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.146+0000 7fb5b2763640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb5ac0d28a0 con 0x7fb5ac0cf8f0 2024-04-25T02:29:31.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.147+0000 7fb5b0d00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb5ac06bfb0 0x7fb5ac06c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:31.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.147+0000 7fb5b0d00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb5ac06bfb0 0x7fb5ac06c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49544/0 (socket says 172.21.15.67:49544) 2024-04-25T02:29:31.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.147+0000 7fb5b0d00640 1 -- 172.21.15.67:0/2406297671 learned_addr learned my addr 172.21.15.67:0/2406297671 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:31.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.147+0000 7fb5ab7fe640 1 --2- 172.21.15.67:0/2406297671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5ac0cf8f0 0x7fb5ac0d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:31.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.147+0000 7fb5b0d00640 1 -- 172.21.15.67:0/2406297671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5ac0cf8f0 msgr2=0x7fb5ac0d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:31.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.147+0000 7fb5b0d00640 1 --2- 172.21.15.67:0/2406297671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5ac0cf8f0 0x7fb5ac0d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.147+0000 7fb5b0d00640 1 -- 172.21.15.67:0/2406297671 >> v1:172.21.15.176:6789/0 conn(0x7fb5ac15e760 legacy=0x7fb5ac0d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:31.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.147+0000 7fb5b0d00640 1 -- 172.21.15.67:0/2406297671 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ac0d2250 con 0x7fb5ac06bfb0 2024-04-25T02:29:31.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.148+0000 7fb5b0d00640 1 --2- 172.21.15.67:0/2406297671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac06bfb0 0x7fb5ac06c440 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009e50 tx=0x7fb5a402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a85fff21cda0bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:31.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.148+0000 7fb5aaffd640 1 -- 172.21.15.67:0/2406297671 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4036070 con 0x7fb5ac06bfb0 2024-04-25T02:29:31.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.148+0000 7fb5aaffd640 1 -- 172.21.15.67:0/2406297671 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5a4031600 con 0x7fb5ac06bfb0 2024-04-25T02:29:31.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.148+0000 7fb5aaffd640 1 -- 172.21.15.67:0/2406297671 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a40319d0 con 0x7fb5ac06bfb0 2024-04-25T02:29:31.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.148+0000 7fb5b2763640 1 -- 172.21.15.67:0/2406297671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac06bfb0 msgr2=0x7fb5ac06c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:31.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.148+0000 7fb5b2763640 1 --2- 172.21.15.67:0/2406297671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac06bfb0 0x7fb5ac06c440 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009e50 tx=0x7fb5a402a710 comp rx=0 tx=0).stop 2024-04-25T02:29:31.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.148+0000 7fb5b2763640 1 -- 172.21.15.67:0/2406297671 shutdown_connections 2024-04-25T02:29:31.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.148+0000 7fb5b2763640 1 --2- 172.21.15.67:0/2406297671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac06bfb0 0x7fb5ac06c440 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.148+0000 7fb5b2763640 1 --2- 172.21.15.67:0/2406297671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5ac0cf8f0 0x7fb5ac0d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.148+0000 7fb5b2763640 1 -- 172.21.15.67:0/2406297671 >> 172.21.15.67:0/2406297671 conn(0x7fb5ac0d41b0 msgr2=0x7fb5ac0d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:31.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.148+0000 7fb5b2763640 1 -- 172.21.15.67:0/2406297671 shutdown_connections 2024-04-25T02:29:31.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.148+0000 7fb5b2763640 1 -- 172.21.15.67:0/2406297671 wait complete. 2024-04-25T02:29:31.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.150+0000 7fb5b2763640 1 Processor -- start 2024-04-25T02:29:31.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.150+0000 7fb5b2763640 1 -- start start 2024-04-25T02:29:31.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.150+0000 7fb5b2763640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac06bfb0 0x7fb5ac0b88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:31.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.150+0000 7fb5b2763640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5ac0cf8f0 0x7fb5ac0cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:31.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.150+0000 7fb5b2763640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5ac15e760 0x7fb5ac0ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:31.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.150+0000 7fb5b2763640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac0d3d40 con 0x7fb5ac06bfb0 2024-04-25T02:29:31.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.150+0000 7fb5b2763640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac0b0e40 con 0x7fb5ac15e760 2024-04-25T02:29:31.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.150+0000 7fb5b2763640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb5ac15eb40 con 0x7fb5ac0cf8f0 2024-04-25T02:29:31.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.151+0000 7fb5abfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac06bfb0 0x7fb5ac0b88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:31.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.151+0000 7fb5abfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac06bfb0 0x7fb5ac0b88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49556/0 (socket says 172.21.15.67:49556) 2024-04-25T02:29:31.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.151+0000 7fb5abfff640 1 -- 172.21.15.67:0/3610896093 learned_addr learned my addr 172.21.15.67:0/3610896093 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:31.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.151+0000 7fb5abfff640 1 -- 172.21.15.67:0/3610896093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5ac0cf8f0 msgr2=0x7fb5ac0cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:31.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.151+0000 7fb5abfff640 1 --2- 172.21.15.67:0/3610896093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5ac0cf8f0 0x7fb5ac0cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.151+0000 7fb5abfff640 1 -- 172.21.15.67:0/3610896093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5ac15e760 msgr2=0x7fb5ac0ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:31.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.151+0000 7fb5abfff640 1 --2- 172.21.15.67:0/3610896093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5ac15e760 0x7fb5ac0ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.151+0000 7fb5abfff640 1 -- 172.21.15.67:0/3610896093 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ac0b7810 con 0x7fb5ac06bfb0 2024-04-25T02:29:31.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.151+0000 7fb5abfff640 1 --2- 172.21.15.67:0/3610896093 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac06bfb0 0x7fb5ac0b88b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00c430 tx=0x7fb59c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:31.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.151+0000 7fb5a8ff9640 1 -- 172.21.15.67:0/3610896093 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0052d0 con 0x7fb5ac06bfb0 2024-04-25T02:29:31.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.151+0000 7fb5a8ff9640 1 -- 172.21.15.67:0/3610896093 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb59c005470 con 0x7fb5ac06bfb0 2024-04-25T02:29:31.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.151+0000 7fb5b2763640 1 -- 172.21.15.67:0/3610896093 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5ac0b7af0 con 0x7fb5ac06bfb0 2024-04-25T02:29:31.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.151+0000 7fb5a8ff9640 1 -- 172.21.15.67:0/3610896093 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c007260 con 0x7fb5ac06bfb0 2024-04-25T02:29:31.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.151+0000 7fb5b2763640 1 -- 172.21.15.67:0/3610896093 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5ac0b80b0 con 0x7fb5ac06bfb0 2024-04-25T02:29:31.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.152+0000 7fb5b2763640 1 -- 172.21.15.67:0/3610896093 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5ac069110 con 0x7fb5ac06bfb0 2024-04-25T02:29:31.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.153+0000 7fb5a8ff9640 1 -- 172.21.15.67:0/3610896093 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb59c007400 con 0x7fb5ac06bfb0 2024-04-25T02:29:31.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.153+0000 7fb5a8ff9640 1 --2- 172.21.15.67:0/3610896093 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb59806be30 0x7fb59806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:31.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.153+0000 7fb5a8ff9640 1 -- 172.21.15.67:0/3610896093 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb59c08a310 con 0x7fb5ac06bfb0 2024-04-25T02:29:31.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.153+0000 7fb5ab7fe640 1 --2- 172.21.15.67:0/3610896093 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb59806be30 0x7fb59806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:31.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.154+0000 7fb5ab7fe640 1 --2- 172.21.15.67:0/3610896093 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb59806be30 0x7fb59806e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0006a90 tx=0x7fb5a0006a20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:31.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.157+0000 7fb5a8ff9640 1 -- 172.21.15.67:0/3610896093 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb59c058d50 con 0x7fb5ac06bfb0 2024-04-25T02:29:31.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.364+0000 7fb5b2763640 1 -- 172.21.15.67:0/3610896093 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "subvol_grp17780", "target": ["mon-mgr", ""]}) -- 0x7fb5ac0ba020 con 0x7fb59806be30 2024-04-25T02:29:31.372 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:29:31.369+0000 7f63a41a6640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:29:31.372 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:29:31.369+0000 7f63a41a6640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:29:31.372 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:29:31.369+0000 7f63a41a6640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:29:31.373 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:29:31.369+0000 7f63a41a6640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:29:31.373 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:29:31.369+0000 7f63a41a6640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:29:31.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.384+0000 7fb5a8ff9640 1 -- 172.21.15.67:0/3610896093 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb5ac0ba020 con 0x7fb59806be30 2024-04-25T02:29:31.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.386+0000 7fb5b2763640 1 -- 172.21.15.67:0/3610896093 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb59806be30 msgr2=0x7fb59806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:31.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.386+0000 7fb5b2763640 1 --2- 172.21.15.67:0/3610896093 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb59806be30 0x7fb59806e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0006a90 tx=0x7fb5a0006a20 comp rx=0 tx=0).stop 2024-04-25T02:29:31.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.386+0000 7fb5b2763640 1 -- 172.21.15.67:0/3610896093 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac06bfb0 msgr2=0x7fb5ac0b88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:31.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.386+0000 7fb5b2763640 1 --2- 172.21.15.67:0/3610896093 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac06bfb0 0x7fb5ac0b88b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00c430 tx=0x7fb59c00c8f0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.386+0000 7fb5b2763640 1 -- 172.21.15.67:0/3610896093 shutdown_connections 2024-04-25T02:29:31.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.386+0000 7fb5b2763640 1 --2- 172.21.15.67:0/3610896093 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb59806be30 0x7fb59806e2f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.386+0000 7fb5b2763640 1 --2- 172.21.15.67:0/3610896093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5ac15e760 0x7fb5ac0ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.386+0000 7fb5b2763640 1 --2- 172.21.15.67:0/3610896093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5ac0cf8f0 0x7fb5ac0cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.386+0000 7fb5b2763640 1 --2- 172.21.15.67:0/3610896093 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac06bfb0 0x7fb5ac0b88b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.386+0000 7fb5b2763640 1 -- 172.21.15.67:0/3610896093 >> 172.21.15.67:0/3610896093 conn(0x7fb5ac0d41b0 msgr2=0x7fb5ac0c9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:31.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.386+0000 7fb5b2763640 1 -- 172.21.15.67:0/3610896093 shutdown_connections 2024-04-25T02:29:31.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.386+0000 7fb5b2763640 1 -- 172.21.15.67:0/3610896093 wait complete. 2024-04-25T02:29:31.400 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol43580 --group_name subvol_grp17780 2024-04-25T02:29:31.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.502+0000 7fc7fb722640 1 Processor -- start 2024-04-25T02:29:31.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.502+0000 7fc7fb722640 1 -- start start 2024-04-25T02:29:31.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.503+0000 7fc7fb722640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc7f40d12b0 0x7fc7f40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:31.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.503+0000 7fc7fb722640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f40d1f70 con 0x7fc7f415e5a0 2024-04-25T02:29:31.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.503+0000 7fc7fb722640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f40d2250 con 0x7fc7f40b4fc0 2024-04-25T02:29:31.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.503+0000 7fc7fb722640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc7f40b3b20 con 0x7fc7f40d12b0 2024-04-25T02:29:31.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.503+0000 7fc7f8cbd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc7f40d12b0 0x7fc7f40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:31.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.503+0000 7fc7f94be640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc7f415e5a0 0x7fc7f40d0ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57602/0 (socket says 172.21.15.67:57602) 2024-04-25T02:29:31.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.503+0000 7fc7f94be640 1 -- 172.21.15.67:0/3098751884 learned_addr learned my addr 172.21.15.67:0/3098751884 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:31.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.504+0000 7fc7f8cbd640 1 -- 172.21.15.67:0/3098751884 >> v1:172.21.15.176:6789/0 conn(0x7fc7f40b4fc0 legacy=0x7fc7f40cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:31.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.504+0000 7fc7f8cbd640 1 -- 172.21.15.67:0/3098751884 >> v1:172.21.15.67:6789/0 conn(0x7fc7f415e5a0 legacy=0x7fc7f40d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:31.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.504+0000 7fc7f8cbd640 1 -- 172.21.15.67:0/3098751884 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f40b37b0 con 0x7fc7f40d12b0 2024-04-25T02:29:31.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.504+0000 7fc7f3fff640 1 -- 172.21.15.67:0/3098751884 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2038009420 0 0) 0x7fc7f40d1f70 con 0x7fc7f415e5a0 2024-04-25T02:29:31.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.504+0000 7fc7f8cbd640 1 --2- 172.21.15.67:0/3098751884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f40d12b0 0x7fc7f40cede0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80097a0 tx=0x7fc7e802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b02b0aa8f2fa453 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:31.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.505+0000 7fc7f3fff640 1 -- 172.21.15.67:0/3098751884 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8037070 con 0x7fc7f40d12b0 2024-04-25T02:29:31.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.505+0000 7fc7f3fff640 1 -- 172.21.15.67:0/3098751884 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e802adc0 con 0x7fc7f40d12b0 2024-04-25T02:29:31.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.505+0000 7fc7f3fff640 1 -- 172.21.15.67:0/3098751884 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8032660 con 0x7fc7f40d12b0 2024-04-25T02:29:31.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.505+0000 7fc7fb722640 1 -- 172.21.15.67:0/3098751884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f40d12b0 msgr2=0x7fc7f40cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:31.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.505+0000 7fc7fb722640 1 --2- 172.21.15.67:0/3098751884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f40d12b0 0x7fc7f40cede0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80097a0 tx=0x7fc7e802a0b0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.505+0000 7fc7fb722640 1 -- 172.21.15.67:0/3098751884 shutdown_connections 2024-04-25T02:29:31.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.505+0000 7fc7fb722640 1 --2- 172.21.15.67:0/3098751884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f40d12b0 0x7fc7f40cede0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.505+0000 7fc7fb722640 1 -- 172.21.15.67:0/3098751884 >> 172.21.15.67:0/3098751884 conn(0x7fc7f40d4190 msgr2=0x7fc7f40d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:31.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.505+0000 7fc7fb722640 1 -- 172.21.15.67:0/3098751884 shutdown_connections 2024-04-25T02:29:31.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.505+0000 7fc7fb722640 1 -- 172.21.15.67:0/3098751884 wait complete. 2024-04-25T02:29:31.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.506+0000 7fc7fb722640 1 Processor -- start 2024-04-25T02:29:31.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.506+0000 7fc7fb722640 1 -- start start 2024-04-25T02:29:31.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.507+0000 7fc7fb722640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7f40b4fc0 0x7fc7f414c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:31.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.507+0000 7fc7fb722640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f40d12b0 0x7fc7f40ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:31.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.507+0000 7fc7fb722640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7f415e5a0 0x7fc7f40b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:31.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.507+0000 7fc7fb722640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f415e980 con 0x7fc7f40d12b0 2024-04-25T02:29:31.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.507+0000 7fc7fb722640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f40d2530 con 0x7fc7f40b4fc0 2024-04-25T02:29:31.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.507+0000 7fc7fb722640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f40d4cb0 con 0x7fc7f415e5a0 2024-04-25T02:29:31.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.507+0000 7fc7f8cbd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f40d12b0 0x7fc7f40ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:31.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.507+0000 7fc7f8cbd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f40d12b0 0x7fc7f40ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49578/0 (socket says 172.21.15.67:49578) 2024-04-25T02:29:31.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.507+0000 7fc7f8cbd640 1 -- 172.21.15.67:0/3592581445 learned_addr learned my addr 172.21.15.67:0/3592581445 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:31.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.507+0000 7fc7f94be640 1 --2- 172.21.15.67:0/3592581445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7f40b4fc0 0x7fc7f414c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:31.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.507+0000 7fc7f9cbf640 1 --2- 172.21.15.67:0/3592581445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7f415e5a0 0x7fc7f40b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:31.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.508+0000 7fc7f8cbd640 1 -- 172.21.15.67:0/3592581445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7f415e5a0 msgr2=0x7fc7f40b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:31.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.508+0000 7fc7f8cbd640 1 --2- 172.21.15.67:0/3592581445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7f415e5a0 0x7fc7f40b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.508+0000 7fc7f8cbd640 1 -- 172.21.15.67:0/3592581445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7f40b4fc0 msgr2=0x7fc7f414c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:31.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.508+0000 7fc7f8cbd640 1 --2- 172.21.15.67:0/3592581445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7f40b4fc0 0x7fc7f414c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.508+0000 7fc7f8cbd640 1 -- 172.21.15.67:0/3592581445 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f40cd3a0 con 0x7fc7f40d12b0 2024-04-25T02:29:31.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.508+0000 7fc7f9cbf640 1 --2- 172.21.15.67:0/3592581445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7f415e5a0 0x7fc7f40b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:31.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.508+0000 7fc7f8cbd640 1 --2- 172.21.15.67:0/3592581445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f40d12b0 0x7fc7f40ccaa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80097a0 tx=0x7fc7e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:31.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.508+0000 7fc7f1ffb640 1 -- 172.21.15.67:0/3592581445 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8041070 con 0x7fc7f40d12b0 2024-04-25T02:29:31.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.508+0000 7fc7f1ffb640 1 -- 172.21.15.67:0/3592581445 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e803c670 con 0x7fc7f40d12b0 2024-04-25T02:29:31.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.508+0000 7fc7fb722640 1 -- 172.21.15.67:0/3592581445 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f40cd680 con 0x7fc7f40d12b0 2024-04-25T02:29:31.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.508+0000 7fc7f1ffb640 1 -- 172.21.15.67:0/3592581445 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8037040 con 0x7fc7f40d12b0 2024-04-25T02:29:31.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.508+0000 7fc7fb722640 1 -- 172.21.15.67:0/3592581445 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f40cdc40 con 0x7fc7f40d12b0 2024-04-25T02:29:31.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.509+0000 7fc7fb722640 1 -- 172.21.15.67:0/3592581445 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f4069110 con 0x7fc7f40d12b0 2024-04-25T02:29:31.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.510+0000 7fc7f1ffb640 1 -- 172.21.15.67:0/3592581445 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc7e8044070 con 0x7fc7f40d12b0 2024-04-25T02:29:31.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.510+0000 7fc7f1ffb640 1 --2- 172.21.15.67:0/3592581445 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc7e006be30 0x7fc7e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:31.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.510+0000 7fc7f1ffb640 1 -- 172.21.15.67:0/3592581445 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc7e80ab610 con 0x7fc7f40d12b0 2024-04-25T02:29:31.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.510+0000 7fc7f94be640 1 --2- 172.21.15.67:0/3592581445 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc7e006be30 0x7fc7e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:31.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.511+0000 7fc7f94be640 1 --2- 172.21.15.67:0/3592581445 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc7e006be30 0x7fc7e006e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec007fd0 tx=0x7fc7ec007de0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:31.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.514+0000 7fc7f1ffb640 1 -- 172.21.15.67:0/3592581445 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc7e8079970 con 0x7fc7f40d12b0 2024-04-25T02:29:31.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.725+0000 7fc7fb722640 1 -- 172.21.15.67:0/3592581445 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol43580", "group_name": "subvol_grp17780", "target": ["mon-mgr", ""]}) -- 0x7fc7f40b5a60 con 0x7fc7e006be30 2024-04-25T02:29:31.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.747+0000 7fc7f1ffb640 1 -- 172.21.15.67:0/3592581445 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc7f40b5a60 con 0x7fc7e006be30 2024-04-25T02:29:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.749+0000 7fc7fb722640 1 -- 172.21.15.67:0/3592581445 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc7e006be30 msgr2=0x7fc7e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.749+0000 7fc7fb722640 1 --2- 172.21.15.67:0/3592581445 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc7e006be30 0x7fc7e006e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec007fd0 tx=0x7fc7ec007de0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.749+0000 7fc7fb722640 1 -- 172.21.15.67:0/3592581445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f40d12b0 msgr2=0x7fc7f40ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.749+0000 7fc7fb722640 1 --2- 172.21.15.67:0/3592581445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f40d12b0 0x7fc7f40ccaa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80097a0 tx=0x7fc7e80046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.749+0000 7fc7fb722640 1 -- 172.21.15.67:0/3592581445 shutdown_connections 2024-04-25T02:29:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.749+0000 7fc7fb722640 1 --2- 172.21.15.67:0/3592581445 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc7e006be30 0x7fc7e006e2f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.749+0000 7fc7fb722640 1 --2- 172.21.15.67:0/3592581445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7f415e5a0 0x7fc7f40b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.749+0000 7fc7fb722640 1 --2- 172.21.15.67:0/3592581445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f40d12b0 0x7fc7f40ccaa0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.749+0000 7fc7fb722640 1 --2- 172.21.15.67:0/3592581445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7f40b4fc0 0x7fc7f414c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.749+0000 7fc7fb722640 1 -- 172.21.15.67:0/3592581445 >> 172.21.15.67:0/3592581445 conn(0x7fc7f40d4190 msgr2=0x7fc7f40cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.750+0000 7fc7fb722640 1 -- 172.21.15.67:0/3592581445 shutdown_connections 2024-04-25T02:29:31.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.750+0000 7fc7fb722640 1 -- 172.21.15.67:0/3592581445 wait complete. 2024-04-25T02:29:31.763 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol18111 --group_name subvol_grp17780 2024-04-25T02:29:31.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.866+0000 7fa3a6534640 1 Processor -- start 2024-04-25T02:29:31.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.866+0000 7fa3a6534640 1 -- start start 2024-04-25T02:29:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.867+0000 7fa3a6534640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa3a00cf100 0x7fa3a00cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.867+0000 7fa3a6534640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a00b4c80 0x7fa3a00acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.867+0000 7fa3a6534640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa3a015fcf0 0x7fa3a01601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.867+0000 7fa3a6534640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa3a015d420 con 0x7fa3a015fcf0 2024-04-25T02:29:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.867+0000 7fa3a6534640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa3a00cfa20 con 0x7fa3a00cf100 2024-04-25T02:29:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.867+0000 7fa3a6534640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a015c810 con 0x7fa3a00b4c80 2024-04-25T02:29:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.867+0000 7fa3a4ad1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa3a015fcf0 0x7fa3a01601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.867+0000 7fa3a4ad1640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa3a015fcf0 0x7fa3a01601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55356/0 (socket says 172.21.15.67:55356) 2024-04-25T02:29:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.867+0000 7fa3a4ad1640 1 -- 172.21.15.67:0/4060263761 learned_addr learned my addr 172.21.15.67:0/4060263761 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.867+0000 7fa39f7fe640 1 --2- 172.21.15.67:0/4060263761 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a00b4c80 0x7fa3a00acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.867+0000 7fa39ffff640 1 --2- 172.21.15.67:0/4060263761 >> v2:172.21.15.176:3300/0 conn(0x7fa3a00cf100 0x7fa3a00cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.867+0000 7fa3a4ad1640 1 -- 172.21.15.67:0/4060263761 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a00b4c80 msgr2=0x7fa3a00acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.867+0000 7fa3a4ad1640 1 --2- 172.21.15.67:0/4060263761 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a00b4c80 0x7fa3a00acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.867+0000 7fa3a4ad1640 1 -- 172.21.15.67:0/4060263761 >> v2:172.21.15.176:3300/0 conn(0x7fa3a00cf100 msgr2=0x7fa3a00cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.867+0000 7fa3a4ad1640 1 --2- 172.21.15.67:0/4060263761 >> v2:172.21.15.176:3300/0 conn(0x7fa3a00cf100 0x7fa3a00cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.867+0000 7fa3a4ad1640 1 -- 172.21.15.67:0/4060263761 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a015caf0 con 0x7fa3a015fcf0 2024-04-25T02:29:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.867+0000 7fa39f7fe640 1 --2- 172.21.15.67:0/4060263761 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a00b4c80 0x7fa3a00acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.867+0000 7fa39ffff640 1 --2- 172.21.15.67:0/4060263761 >> v2:172.21.15.176:3300/0 conn(0x7fa3a00cf100 0x7fa3a00cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.868+0000 7fa3a4ad1640 1 --2- 172.21.15.67:0/4060263761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3a015fcf0 0x7fa3a01601a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa3a006c640 tx=0x7fa39802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11dd6e2d796375a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.868+0000 7fa39effd640 1 -- 172.21.15.67:0/4060263761 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa398036070 con 0x7fa3a015fcf0 2024-04-25T02:29:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.868+0000 7fa39effd640 1 -- 172.21.15.67:0/4060263761 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa398031600 con 0x7fa3a015fcf0 2024-04-25T02:29:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.868+0000 7fa39effd640 1 -- 172.21.15.67:0/4060263761 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3980319d0 con 0x7fa3a015fcf0 2024-04-25T02:29:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.868+0000 7fa3a6534640 1 -- 172.21.15.67:0/4060263761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3a015fcf0 msgr2=0x7fa3a01601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.868+0000 7fa3a6534640 1 --2- 172.21.15.67:0/4060263761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3a015fcf0 0x7fa3a01601a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa3a006c640 tx=0x7fa39802a6a0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.869+0000 7fa3a6534640 1 -- 172.21.15.67:0/4060263761 shutdown_connections 2024-04-25T02:29:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.869+0000 7fa3a6534640 1 --2- 172.21.15.67:0/4060263761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3a015fcf0 0x7fa3a01601a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.869+0000 7fa3a6534640 1 --2- 172.21.15.67:0/4060263761 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a00b4c80 0x7fa3a00acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.869+0000 7fa3a6534640 1 --2- 172.21.15.67:0/4060263761 >> v2:172.21.15.176:3300/0 conn(0x7fa3a00cf100 0x7fa3a00cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.869+0000 7fa3a6534640 1 -- 172.21.15.67:0/4060263761 >> 172.21.15.67:0/4060263761 conn(0x7fa3a00b19c0 msgr2=0x7fa3a00b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.869+0000 7fa3a6534640 1 -- 172.21.15.67:0/4060263761 shutdown_connections 2024-04-25T02:29:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.869+0000 7fa3a6534640 1 -- 172.21.15.67:0/4060263761 wait complete. 2024-04-25T02:29:31.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.870+0000 7fa3a6534640 1 Processor -- start 2024-04-25T02:29:31.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.870+0000 7fa3a6534640 1 -- start start 2024-04-25T02:29:31.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.871+0000 7fa3a6534640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3a00cf100 0x7fa3a00729c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:31.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.871+0000 7fa3a6534640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a015fcf0 0x7fa3a015e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:31.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.871+0000 7fa3a6534640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3a015e940 0x7fa3a00b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:31.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.871+0000 7fa3a6534640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a006cb90 con 0x7fa3a015e940 2024-04-25T02:29:31.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.871+0000 7fa3a6534640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a015d0b0 con 0x7fa3a00cf100 2024-04-25T02:29:31.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.871+0000 7fa3a6534640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a00ad2e0 con 0x7fa3a015fcf0 2024-04-25T02:29:31.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.871+0000 7fa3a4ad1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3a015e940 0x7fa3a00b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:31.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.871+0000 7fa3a4ad1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3a015e940 0x7fa3a00b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55358/0 (socket says 172.21.15.67:55358) 2024-04-25T02:29:31.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.871+0000 7fa3a4ad1640 1 -- 172.21.15.67:0/2180906754 learned_addr learned my addr 172.21.15.67:0/2180906754 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:31.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.871+0000 7fa39f7fe640 1 --2- 172.21.15.67:0/2180906754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a015fcf0 0x7fa3a015e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:31.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.871+0000 7fa39ffff640 1 --2- 172.21.15.67:0/2180906754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3a00cf100 0x7fa3a00729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:31.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.871+0000 7fa3a4ad1640 1 -- 172.21.15.67:0/2180906754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a015fcf0 msgr2=0x7fa3a015e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:31.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.871+0000 7fa3a4ad1640 1 --2- 172.21.15.67:0/2180906754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a015fcf0 0x7fa3a015e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.871+0000 7fa3a4ad1640 1 -- 172.21.15.67:0/2180906754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3a00cf100 msgr2=0x7fa3a00729c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:31.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.871+0000 7fa3a4ad1640 1 --2- 172.21.15.67:0/2180906754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3a00cf100 0x7fa3a00729c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:31.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.871+0000 7fa3a4ad1640 1 -- 172.21.15.67:0/2180906754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a01587a0 con 0x7fa3a015e940 2024-04-25T02:29:31.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.872+0000 7fa3a4ad1640 1 --2- 172.21.15.67:0/2180906754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3a015e940 0x7fa3a00b3830 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa398009f40 tx=0x7fa398004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:31.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.872+0000 7fa39cff9640 1 -- 172.21.15.67:0/2180906754 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa398041020 con 0x7fa3a015e940 2024-04-25T02:29:31.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.872+0000 7fa39cff9640 1 -- 172.21.15.67:0/2180906754 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3980077a0 con 0x7fa3a015e940 2024-04-25T02:29:31.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.872+0000 7fa39cff9640 1 -- 172.21.15.67:0/2180906754 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa398036040 con 0x7fa3a015e940 2024-04-25T02:29:31.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.872+0000 7fa3a6534640 1 -- 172.21.15.67:0/2180906754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a0158a80 con 0x7fa3a015e940 2024-04-25T02:29:31.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.872+0000 7fa3a6534640 1 -- 172.21.15.67:0/2180906754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a0159040 con 0x7fa3a015e940 2024-04-25T02:29:31.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.873+0000 7fa3a6534640 1 -- 172.21.15.67:0/2180906754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a0069110 con 0x7fa3a015e940 2024-04-25T02:29:31.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.873+0000 7fa39cff9640 1 -- 172.21.15.67:0/2180906754 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa398044020 con 0x7fa3a015e940 2024-04-25T02:29:31.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.874+0000 7fa39cff9640 1 --2- 172.21.15.67:0/2180906754 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa38006be60 0x7fa38006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:31.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.874+0000 7fa39cff9640 1 -- 172.21.15.67:0/2180906754 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa3980ab710 con 0x7fa3a015e940 2024-04-25T02:29:31.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.874+0000 7fa39ffff640 1 --2- 172.21.15.67:0/2180906754 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa38006be60 0x7fa38006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:31.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.874+0000 7fa39ffff640 1 --2- 172.21.15.67:0/2180906754 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa38006be60 0x7fa38006e320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa38800ab60 tx=0x7fa388008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:31.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:31.878+0000 7fa39cff9640 1 -- 172.21.15.67:0/2180906754 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa39804b070 con 0x7fa3a015e940 2024-04-25T02:29:32.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.087+0000 7fa3a6534640 1 -- 172.21.15.67:0/2180906754 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol18111", "group_name": "subvol_grp17780", "target": ["mon-mgr", ""]}) -- 0x7fa3a006e810 con 0x7fa38006be60 2024-04-25T02:29:32.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.110+0000 7fa39cff9640 1 -- 172.21.15.67:0/2180906754 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa3a006e810 con 0x7fa38006be60 2024-04-25T02:29:32.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.112+0000 7fa3a6534640 1 -- 172.21.15.67:0/2180906754 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa38006be60 msgr2=0x7fa38006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:32.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.112+0000 7fa3a6534640 1 --2- 172.21.15.67:0/2180906754 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa38006be60 0x7fa38006e320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa38800ab60 tx=0x7fa388008040 comp rx=0 tx=0).stop 2024-04-25T02:29:32.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.112+0000 7fa3a6534640 1 -- 172.21.15.67:0/2180906754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3a015e940 msgr2=0x7fa3a00b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:32.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.112+0000 7fa3a6534640 1 --2- 172.21.15.67:0/2180906754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3a015e940 0x7fa3a00b3830 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa398009f40 tx=0x7fa398004a40 comp rx=0 tx=0).stop 2024-04-25T02:29:32.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.112+0000 7fa3a6534640 1 -- 172.21.15.67:0/2180906754 shutdown_connections 2024-04-25T02:29:32.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.112+0000 7fa3a6534640 1 --2- 172.21.15.67:0/2180906754 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa38006be60 0x7fa38006e320 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.112+0000 7fa3a6534640 1 --2- 172.21.15.67:0/2180906754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3a015e940 0x7fa3a00b3830 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.112+0000 7fa3a6534640 1 --2- 172.21.15.67:0/2180906754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a015fcf0 0x7fa3a015e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.112+0000 7fa3a6534640 1 --2- 172.21.15.67:0/2180906754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3a00cf100 0x7fa3a00729c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.112+0000 7fa3a6534640 1 -- 172.21.15.67:0/2180906754 >> 172.21.15.67:0/2180906754 conn(0x7fa3a00b19c0 msgr2=0x7fa3a0160100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:32.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.112+0000 7fa3a6534640 1 -- 172.21.15.67:0/2180906754 shutdown_connections 2024-04-25T02:29:32.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.112+0000 7fa3a6534640 1 -- 172.21.15.67:0/2180906754 wait complete. 2024-04-25T02:29:32.126 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol72122 --group_name subvol_grp17780 2024-04-25T02:29:32.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.229+0000 7fb0b5729640 1 Processor -- start 2024-04-25T02:29:32.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.229+0000 7fb0b5729640 1 -- start start 2024-04-25T02:29:32.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.230+0000 7fb0b5729640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb0b015e460 0x7fb0b0162d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.230+0000 7fb0b5729640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b00cfe00 0x7fb0b00b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.230+0000 7fb0b5729640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb0b0162160 0x7fb0b01625b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.230+0000 7fb0b5729640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b0162af0 con 0x7fb0b015e460 2024-04-25T02:29:32.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.230+0000 7fb0b5729640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b00b1400 con 0x7fb0b0162160 2024-04-25T02:29:32.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.230+0000 7fb0b5729640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b00b3850 con 0x7fb0b00cfe00 2024-04-25T02:29:32.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.230+0000 7fb0aeffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb0b015e460 0x7fb0b0162d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.230+0000 7fb0aeffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb0b015e460 0x7fb0b0162d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55372/0 (socket says 172.21.15.67:55372) 2024-04-25T02:29:32.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.230+0000 7fb0aeffd640 1 -- 172.21.15.67:0/1261312490 learned_addr learned my addr 172.21.15.67:0/1261312490 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:32.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.230+0000 7fb0aeffd640 1 -- 172.21.15.67:0/1261312490 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b00cfe00 msgr2=0x7fb0b00b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:32.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.230+0000 7fb0aeffd640 1 --2- 172.21.15.67:0/1261312490 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b00cfe00 0x7fb0b00b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.230+0000 7fb0aeffd640 1 -- 172.21.15.67:0/1261312490 >> v2:172.21.15.176:3300/0 conn(0x7fb0b0162160 msgr2=0x7fb0b01625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:32.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.230+0000 7fb0aeffd640 1 --2- 172.21.15.67:0/1261312490 >> v2:172.21.15.176:3300/0 conn(0x7fb0b0162160 0x7fb0b01625b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.230+0000 7fb0aeffd640 1 -- 172.21.15.67:0/1261312490 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b00b1120 con 0x7fb0b015e460 2024-04-25T02:29:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.231+0000 7fb0aeffd640 1 --2- 172.21.15.67:0/1261312490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b015e460 0x7fb0b0162d00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00d1190 tx=0x7fb0a002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b242e7e7c4ba0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.231+0000 7fb0adffb640 1 -- 172.21.15.67:0/1261312490 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0037070 con 0x7fb0b015e460 2024-04-25T02:29:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.231+0000 7fb0adffb640 1 -- 172.21.15.67:0/1261312490 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a0032440 con 0x7fb0b015e460 2024-04-25T02:29:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.231+0000 7fb0adffb640 1 -- 172.21.15.67:0/1261312490 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0032810 con 0x7fb0b015e460 2024-04-25T02:29:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.231+0000 7fb0b5729640 1 -- 172.21.15.67:0/1261312490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b015e460 msgr2=0x7fb0b0162d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.231+0000 7fb0b5729640 1 --2- 172.21.15.67:0/1261312490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b015e460 0x7fb0b0162d00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00d1190 tx=0x7fb0a002a140 comp rx=0 tx=0).stop 2024-04-25T02:29:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.231+0000 7fb0b5729640 1 -- 172.21.15.67:0/1261312490 shutdown_connections 2024-04-25T02:29:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.231+0000 7fb0b5729640 1 --2- 172.21.15.67:0/1261312490 >> v2:172.21.15.176:3300/0 conn(0x7fb0b0162160 0x7fb0b01625b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.231+0000 7fb0b5729640 1 --2- 172.21.15.67:0/1261312490 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b00cfe00 0x7fb0b00b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.231+0000 7fb0b5729640 1 --2- 172.21.15.67:0/1261312490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b015e460 0x7fb0b0162d00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.231+0000 7fb0b5729640 1 -- 172.21.15.67:0/1261312490 >> 172.21.15.67:0/1261312490 conn(0x7fb0b009aa70 msgr2=0x7fb0b009ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.232+0000 7fb0b5729640 1 -- 172.21.15.67:0/1261312490 shutdown_connections 2024-04-25T02:29:32.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.232+0000 7fb0b5729640 1 -- 172.21.15.67:0/1261312490 wait complete. 2024-04-25T02:29:32.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.233+0000 7fb0b5729640 1 Processor -- start 2024-04-25T02:29:32.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.233+0000 7fb0b5729640 1 -- start start 2024-04-25T02:29:32.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0b5729640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b00cfe00 0x7fb0b015faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0b5729640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0b015e460 0x7fb0b0156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0b5729640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b0162160 0x7fb0b00cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0b5729640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b00d0240 con 0x7fb0b0162160 2024-04-25T02:29:32.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0b5729640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b00b3570 con 0x7fb0b015e460 2024-04-25T02:29:32.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0b5729640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b00b2800 con 0x7fb0b00cfe00 2024-04-25T02:29:32.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0af7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b0162160 0x7fb0b00cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0af7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b0162160 0x7fb0b00cb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55376/0 (socket says 172.21.15.67:55376) 2024-04-25T02:29:32.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0af7fe640 1 -- 172.21.15.67:0/2326607591 learned_addr learned my addr 172.21.15.67:0/2326607591 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:32.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0aeffd640 1 --2- 172.21.15.67:0/2326607591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b00cfe00 0x7fb0b015faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0ae7fc640 1 --2- 172.21.15.67:0/2326607591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0b015e460 0x7fb0b0156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0af7fe640 1 -- 172.21.15.67:0/2326607591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b00cfe00 msgr2=0x7fb0b015faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:32.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0af7fe640 1 --2- 172.21.15.67:0/2326607591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b00cfe00 0x7fb0b015faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0af7fe640 1 -- 172.21.15.67:0/2326607591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0b015e460 msgr2=0x7fb0b0156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:32.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0af7fe640 1 --2- 172.21.15.67:0/2326607591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0b015e460 0x7fb0b0156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0af7fe640 1 -- 172.21.15.67:0/2326607591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b00cc420 con 0x7fb0b0162160 2024-04-25T02:29:32.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0aeffd640 1 --2- 172.21.15.67:0/2326607591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b00cfe00 0x7fb0b015faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:32.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0af7fe640 1 --2- 172.21.15.67:0/2326607591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b0162160 0x7fb0b00cb130 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800b970 tx=0x7fb0a800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:32.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0977fe640 1 -- 172.21.15.67:0/2326607591 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8019070 con 0x7fb0b0162160 2024-04-25T02:29:32.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0977fe640 1 -- 172.21.15.67:0/2326607591 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a800cb60 con 0x7fb0b0162160 2024-04-25T02:29:32.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.234+0000 7fb0b5729640 1 -- 172.21.15.67:0/2326607591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b00cbbe0 con 0x7fb0b0162160 2024-04-25T02:29:32.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.235+0000 7fb0977fe640 1 -- 172.21.15.67:0/2326607591 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8014440 con 0x7fb0b0162160 2024-04-25T02:29:32.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.235+0000 7fb0b5729640 1 -- 172.21.15.67:0/2326607591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b00ccd30 con 0x7fb0b0162160 2024-04-25T02:29:32.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.235+0000 7fb0b5729640 1 -- 172.21.15.67:0/2326607591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0b0069110 con 0x7fb0b0162160 2024-04-25T02:29:32.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.236+0000 7fb0977fe640 1 -- 172.21.15.67:0/2326607591 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb0a801c070 con 0x7fb0b0162160 2024-04-25T02:29:32.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.236+0000 7fb0977fe640 1 --2- 172.21.15.67:0/2326607591 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb09c06be60 0x7fb09c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.237+0000 7fb0977fe640 1 -- 172.21.15.67:0/2326607591 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb0a808ab90 con 0x7fb0b0162160 2024-04-25T02:29:32.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.237+0000 7fb0aeffd640 1 --2- 172.21.15.67:0/2326607591 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb09c06be60 0x7fb09c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.237+0000 7fb0aeffd640 1 --2- 172.21.15.67:0/2326607591 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb09c06be60 0x7fb09c06e320 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0034000 tx=0x7fb0a002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:32.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.241+0000 7fb0977fe640 1 -- 172.21.15.67:0/2326607591 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb0b00cbbe0 con 0x7fb0b0162160 2024-04-25T02:29:32.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.386+0000 7fb0977fe640 1 -- 172.21.15.67:0/2326607591 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mgrmap(e 6) ==== 90549+0+0 (secure 0 0 0) 0x7fb0a80554b0 con 0x7fb0b0162160 2024-04-25T02:29:32.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.454+0000 7fb0b5729640 1 -- 172.21.15.67:0/2326607591 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol72122", "group_name": "subvol_grp17780", "target": ["mon-mgr", ""]}) -- 0x7fb0b00b1d40 con 0x7fb09c06be60 2024-04-25T02:29:32.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.480+0000 7fb0977fe640 1 -- 172.21.15.67:0/2326607591 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb0b00b1d40 con 0x7fb09c06be60 2024-04-25T02:29:32.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.482+0000 7fb0b5729640 1 -- 172.21.15.67:0/2326607591 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb09c06be60 msgr2=0x7fb09c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:32.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.482+0000 7fb0b5729640 1 --2- 172.21.15.67:0/2326607591 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb09c06be60 0x7fb09c06e320 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0034000 tx=0x7fb0a002e000 comp rx=0 tx=0).stop 2024-04-25T02:29:32.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.482+0000 7fb0b5729640 1 -- 172.21.15.67:0/2326607591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b0162160 msgr2=0x7fb0b00cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:32.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.482+0000 7fb0b5729640 1 --2- 172.21.15.67:0/2326607591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b0162160 0x7fb0b00cb130 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800b970 tx=0x7fb0a800be30 comp rx=0 tx=0).stop 2024-04-25T02:29:32.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.482+0000 7fb0b5729640 1 -- 172.21.15.67:0/2326607591 shutdown_connections 2024-04-25T02:29:32.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.482+0000 7fb0b5729640 1 --2- 172.21.15.67:0/2326607591 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb09c06be60 0x7fb09c06e320 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.482+0000 7fb0b5729640 1 --2- 172.21.15.67:0/2326607591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b0162160 0x7fb0b00cb130 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.482+0000 7fb0b5729640 1 --2- 172.21.15.67:0/2326607591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0b015e460 0x7fb0b0156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.482+0000 7fb0b5729640 1 --2- 172.21.15.67:0/2326607591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b00cfe00 0x7fb0b015faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.482+0000 7fb0b5729640 1 -- 172.21.15.67:0/2326607591 >> 172.21.15.67:0/2326607591 conn(0x7fb0b009aa70 msgr2=0x7fb0b015da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:32.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.482+0000 7fb0b5729640 1 -- 172.21.15.67:0/2326607591 shutdown_connections 2024-04-25T02:29:32.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.482+0000 7fb0b5729640 1 -- 172.21.15.67:0/2326607591 wait complete. 2024-04-25T02:29:32.496 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol43580 subvol_grp17780 2024-04-25T02:29:32.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.597+0000 7f908cfa2640 1 Processor -- start 2024-04-25T02:29:32.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.597+0000 7f908cfa2640 1 -- start start 2024-04-25T02:29:32.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.598+0000 7f908cfa2640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f908815e5a0 0x7f90880d0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.598+0000 7f908cfa2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90880d4cb0 0x7f90880d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.598+0000 7f908cfa2640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90880b3fb0 0x7f90880b4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.598+0000 7f908cfa2640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f90880b3b20 con 0x7f90880b3fb0 2024-04-25T02:29:32.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.598+0000 7f908cfa2640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f90880d2530 con 0x7f908815e5a0 2024-04-25T02:29:32.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.598+0000 7f908cfa2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f90880d1f70 con 0x7f90880d4cb0 2024-04-25T02:29:32.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.598+0000 7f9086d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90880b3fb0 0x7f90880b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.598+0000 7f9086d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90880b3fb0 0x7f90880b4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55380/0 (socket says 172.21.15.67:55380) 2024-04-25T02:29:32.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.598+0000 7f9086d9d640 1 -- 172.21.15.67:0/1863570054 learned_addr learned my addr 172.21.15.67:0/1863570054 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:32.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.599+0000 7f908659c640 1 --2- 172.21.15.67:0/1863570054 >> v2:172.21.15.176:3300/0 conn(0x7f908815e5a0 0x7f90880d0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.599+0000 7f9085d9b640 1 --2- 172.21.15.67:0/1863570054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90880d4cb0 0x7f90880d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.599+0000 7f9086d9d640 1 -- 172.21.15.67:0/1863570054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90880d4cb0 msgr2=0x7f90880d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:32.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.599+0000 7f9086d9d640 1 --2- 172.21.15.67:0/1863570054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90880d4cb0 0x7f90880d10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.599+0000 7f9086d9d640 1 -- 172.21.15.67:0/1863570054 >> v2:172.21.15.176:3300/0 conn(0x7f908815e5a0 msgr2=0x7f90880d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:32.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.599+0000 7f9086d9d640 1 --2- 172.21.15.67:0/1863570054 >> v2:172.21.15.176:3300/0 conn(0x7f908815e5a0 0x7f90880d0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.599+0000 7f9086d9d640 1 -- 172.21.15.67:0/1863570054 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90880d2250 con 0x7f90880b3fb0 2024-04-25T02:29:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.599+0000 7f9086d9d640 1 --2- 172.21.15.67:0/1863570054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90880b3fb0 0x7f90880b4440 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9088067ed0 tx=0x7f907802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1150b265501b45 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.600+0000 7f908559a640 1 -- 172.21.15.67:0/1863570054 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078037070 con 0x7f90880b3fb0 2024-04-25T02:29:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.600+0000 7f908559a640 1 -- 172.21.15.67:0/1863570054 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f907802ae00 con 0x7f90880b3fb0 2024-04-25T02:29:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.600+0000 7f908559a640 1 -- 172.21.15.67:0/1863570054 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078032660 con 0x7f90880b3fb0 2024-04-25T02:29:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.600+0000 7f908cfa2640 1 -- 172.21.15.67:0/1863570054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90880b3fb0 msgr2=0x7f90880b4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.600+0000 7f908cfa2640 1 --2- 172.21.15.67:0/1863570054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90880b3fb0 0x7f90880b4440 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9088067ed0 tx=0x7f907802a0b0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.600+0000 7f908cfa2640 1 -- 172.21.15.67:0/1863570054 shutdown_connections 2024-04-25T02:29:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.600+0000 7f908cfa2640 1 --2- 172.21.15.67:0/1863570054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90880b3fb0 0x7f90880b4440 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.600+0000 7f908cfa2640 1 --2- 172.21.15.67:0/1863570054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90880d4cb0 0x7f90880d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.600+0000 7f908cfa2640 1 --2- 172.21.15.67:0/1863570054 >> v2:172.21.15.176:3300/0 conn(0x7f908815e5a0 0x7f90880d0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.600+0000 7f908cfa2640 1 -- 172.21.15.67:0/1863570054 >> 172.21.15.67:0/1863570054 conn(0x7f90880d4190 msgr2=0x7f90880d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.600+0000 7f908cfa2640 1 -- 172.21.15.67:0/1863570054 shutdown_connections 2024-04-25T02:29:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.600+0000 7f908cfa2640 1 -- 172.21.15.67:0/1863570054 wait complete. 2024-04-25T02:29:32.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.602+0000 7f908cfa2640 1 Processor -- start 2024-04-25T02:29:32.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.602+0000 7f908cfa2640 1 -- start start 2024-04-25T02:29:32.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.602+0000 7f908cfa2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90880b3fb0 0x7f908814f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.602+0000 7f908cfa2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90880d4cb0 0x7f90881f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.602+0000 7f908cfa2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f908815e5a0 0x7f90880b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.602+0000 7f908cfa2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f908815e980 con 0x7f908815e5a0 2024-04-25T02:29:32.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.602+0000 7f908cfa2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f90880d1a30 con 0x7f90880d4cb0 2024-04-25T02:29:32.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.602+0000 7f908cfa2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f90880b4980 con 0x7f90880b3fb0 2024-04-25T02:29:32.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.602+0000 7f9086d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f908815e5a0 0x7f90880b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.602+0000 7f9086d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f908815e5a0 0x7f90880b1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55384/0 (socket says 172.21.15.67:55384) 2024-04-25T02:29:32.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.602+0000 7f9086d9d640 1 -- 172.21.15.67:0/1185525951 learned_addr learned my addr 172.21.15.67:0/1185525951 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:32.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.603+0000 7f908659c640 1 --2- 172.21.15.67:0/1185525951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90880b3fb0 0x7f908814f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.603+0000 7f9085d9b640 1 --2- 172.21.15.67:0/1185525951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90880d4cb0 0x7f90881f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.603+0000 7f9086d9d640 1 -- 172.21.15.67:0/1185525951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90880b3fb0 msgr2=0x7f908814f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:32.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.603+0000 7f9086d9d640 1 --2- 172.21.15.67:0/1185525951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90880b3fb0 0x7f908814f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.603+0000 7f9086d9d640 1 -- 172.21.15.67:0/1185525951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90880d4cb0 msgr2=0x7f90881f4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:32.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.603+0000 7f9086d9d640 1 --2- 172.21.15.67:0/1185525951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90880d4cb0 0x7f90881f4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.603+0000 7f9086d9d640 1 -- 172.21.15.67:0/1185525951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90881f49f0 con 0x7f908815e5a0 2024-04-25T02:29:32.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.603+0000 7f9086d9d640 1 --2- 172.21.15.67:0/1185525951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f908815e5a0 0x7f90880b1320 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f907802a0f0 tx=0x7f90780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:32.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.603+0000 7f9076ffd640 1 -- 172.21.15.67:0/1185525951 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078042070 con 0x7f908815e5a0 2024-04-25T02:29:32.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.603+0000 7f9076ffd640 1 -- 172.21.15.67:0/1185525951 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f907803e460 con 0x7f908815e5a0 2024-04-25T02:29:32.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.603+0000 7f908cfa2640 1 -- 172.21.15.67:0/1185525951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90881f4cd0 con 0x7f908815e5a0 2024-04-25T02:29:32.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.603+0000 7f9076ffd640 1 -- 172.21.15.67:0/1185525951 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078037040 con 0x7f908815e5a0 2024-04-25T02:29:32.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.603+0000 7f908cfa2640 1 -- 172.21.15.67:0/1185525951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90881f4570 con 0x7f908815e5a0 2024-04-25T02:29:32.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.604+0000 7f908cfa2640 1 -- 172.21.15.67:0/1185525951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90881f51f0 con 0x7f908815e5a0 2024-04-25T02:29:32.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.605+0000 7f9076ffd640 1 -- 172.21.15.67:0/1185525951 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 6) ==== 90549+0+0 (secure 0 0 0) 0x7f907803a040 con 0x7f908815e5a0 2024-04-25T02:29:32.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.605+0000 7f9076ffd640 1 --2- 172.21.15.67:0/1185525951 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f906806bec0 0x7f906806e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.605+0000 7f9076ffd640 1 -- 172.21.15.67:0/1185525951 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f90780ab240 con 0x7f908815e5a0 2024-04-25T02:29:32.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.605+0000 7f908659c640 1 --2- 172.21.15.67:0/1185525951 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f906806bec0 0x7f906806e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.606+0000 7f908659c640 1 --2- 172.21.15.67:0/1185525951 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f906806bec0 0x7f906806e380 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f90800073f0 tx=0x7f908000b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:32.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.610+0000 7f9076ffd640 1 -- 172.21.15.67:0/1185525951 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9078079d20 con 0x7f908815e5a0 2024-04-25T02:29:32.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.825+0000 7f908cfa2640 1 -- 172.21.15.67:0/1185525951 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol43580", "group_name": "subvol_grp17780", "target": ["mon-mgr", ""]}) -- 0x7f9088069110 con 0x7f906806bec0 2024-04-25T02:29:32.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.836+0000 7f9076ffd640 1 -- 172.21.15.67:0/1185525951 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9088069110 con 0x7f906806bec0 2024-04-25T02:29:32.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.838+0000 7f908cfa2640 1 -- 172.21.15.67:0/1185525951 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f906806bec0 msgr2=0x7f906806e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:32.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.838+0000 7f908cfa2640 1 --2- 172.21.15.67:0/1185525951 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f906806bec0 0x7f906806e380 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f90800073f0 tx=0x7f908000b040 comp rx=0 tx=0).stop 2024-04-25T02:29:32.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.838+0000 7f908cfa2640 1 -- 172.21.15.67:0/1185525951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f908815e5a0 msgr2=0x7f90880b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:32.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.838+0000 7f908cfa2640 1 --2- 172.21.15.67:0/1185525951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f908815e5a0 0x7f90880b1320 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f907802a0f0 tx=0x7f90780046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.838+0000 7f908cfa2640 1 -- 172.21.15.67:0/1185525951 shutdown_connections 2024-04-25T02:29:32.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.838+0000 7f908cfa2640 1 --2- 172.21.15.67:0/1185525951 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f906806bec0 0x7f906806e380 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.838+0000 7f908cfa2640 1 --2- 172.21.15.67:0/1185525951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f908815e5a0 0x7f90880b1320 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.838+0000 7f908cfa2640 1 --2- 172.21.15.67:0/1185525951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90880d4cb0 0x7f90881f4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.838+0000 7f908cfa2640 1 --2- 172.21.15.67:0/1185525951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90880b3fb0 0x7f908814f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.838+0000 7f908cfa2640 1 -- 172.21.15.67:0/1185525951 >> 172.21.15.67:0/1185525951 conn(0x7f90880d4190 msgr2=0x7f90880b2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:32.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.838+0000 7f908cfa2640 1 -- 172.21.15.67:0/1185525951 shutdown_connections 2024-04-25T02:29:32.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.838+0000 7f908cfa2640 1 -- 172.21.15.67:0/1185525951 wait complete. 2024-04-25T02:29:32.843 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:29:32.839+0000 7f63a71ac640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:29:32.843 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:29:32.839+0000 7f63a71ac640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:29:32.843 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:29:32.839+0000 7f63a71ac640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:29:32.843 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:29:32.839+0000 7f63a71ac640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:29:32.843 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:29:32.839+0000 7f63a71ac640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:29:32.853 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol18111 subvol_grp17780 2024-04-25T02:29:32.856 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:29:32.852+0000 7f63a59a9640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:29:32.856 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:29:32.852+0000 7f63a59a9640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:29:32.856 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:29:32.853+0000 7f63a59a9640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:29:32.856 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:29:32.853+0000 7f63a59a9640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:29:32.856 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-04-25T02:29:32.853+0000 7f63a59a9640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:29:32.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.956+0000 7f987515a640 1 Processor -- start 2024-04-25T02:29:32.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.956+0000 7f987515a640 1 -- start start 2024-04-25T02:29:32.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.957+0000 7f987515a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f98700b4020 0x7f987006c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.957+0000 7f987515a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f987006c6a0 0x7f987006d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.957+0000 7f987515a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f987006dc00 0x7f98700b4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.957+0000 7f987515a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f987006bcd0 con 0x7f987006dc00 2024-04-25T02:29:32.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.957+0000 7f987515a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f987006b0c0 con 0x7f98700b4020 2024-04-25T02:29:32.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.957+0000 7f987515a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f987006b3a0 con 0x7f987006c6a0 2024-04-25T02:29:32.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.957+0000 7f986f59e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f987006dc00 0x7f98700b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.957+0000 7f986f59e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f987006dc00 0x7f98700b4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55398/0 (socket says 172.21.15.67:55398) 2024-04-25T02:29:32.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.957+0000 7f986f59e640 1 -- 172.21.15.67:0/1599988377 learned_addr learned my addr 172.21.15.67:0/1599988377 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:32.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.957+0000 7f986e59c640 1 --2- 172.21.15.67:0/1599988377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f987006c6a0 0x7f987006d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.957+0000 7f986ed9d640 1 --2- 172.21.15.67:0/1599988377 >> v2:172.21.15.176:3300/0 conn(0x7f98700b4020 0x7f987006c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.957+0000 7f986f59e640 1 -- 172.21.15.67:0/1599988377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f987006c6a0 msgr2=0x7f987006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:32.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.957+0000 7f986f59e640 1 --2- 172.21.15.67:0/1599988377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f987006c6a0 0x7f987006d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.957+0000 7f986f59e640 1 -- 172.21.15.67:0/1599988377 >> v2:172.21.15.176:3300/0 conn(0x7f98700b4020 msgr2=0x7f987006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:32.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.957+0000 7f986f59e640 1 --2- 172.21.15.67:0/1599988377 >> v2:172.21.15.176:3300/0 conn(0x7f98700b4020 0x7f987006c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.957+0000 7f986f59e640 1 -- 172.21.15.67:0/1599988377 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987006b680 con 0x7f987006dc00 2024-04-25T02:29:32.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.957+0000 7f986ed9d640 1 --2- 172.21.15.67:0/1599988377 >> v2:172.21.15.176:3300/0 conn(0x7f98700b4020 0x7f987006c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:32.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.958+0000 7f986f59e640 1 --2- 172.21.15.67:0/1599988377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987006dc00 0x7f98700b4400 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f98700d12e0 tx=0x7f986002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31514f18dcfb5e1d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:32.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.958+0000 7f986dd9b640 1 -- 172.21.15.67:0/1599988377 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9860037070 con 0x7f987006dc00 2024-04-25T02:29:32.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.958+0000 7f986dd9b640 1 -- 172.21.15.67:0/1599988377 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9860032440 con 0x7f987006dc00 2024-04-25T02:29:32.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.958+0000 7f986dd9b640 1 -- 172.21.15.67:0/1599988377 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9860032810 con 0x7f987006dc00 2024-04-25T02:29:32.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.959+0000 7f987515a640 1 -- 172.21.15.67:0/1599988377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987006dc00 msgr2=0x7f98700b4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:32.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.959+0000 7f987515a640 1 --2- 172.21.15.67:0/1599988377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987006dc00 0x7f98700b4400 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f98700d12e0 tx=0x7f986002a270 comp rx=0 tx=0).stop 2024-04-25T02:29:32.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.959+0000 7f987515a640 1 -- 172.21.15.67:0/1599988377 shutdown_connections 2024-04-25T02:29:32.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.959+0000 7f987515a640 1 --2- 172.21.15.67:0/1599988377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987006dc00 0x7f98700b4400 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.959+0000 7f987515a640 1 --2- 172.21.15.67:0/1599988377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f987006c6a0 0x7f987006d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.959+0000 7f987515a640 1 --2- 172.21.15.67:0/1599988377 >> v2:172.21.15.176:3300/0 conn(0x7f98700b4020 0x7f987006c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.959+0000 7f987515a640 1 -- 172.21.15.67:0/1599988377 >> 172.21.15.67:0/1599988377 conn(0x7f98700d04b0 msgr2=0x7f98700d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:32.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.959+0000 7f987515a640 1 -- 172.21.15.67:0/1599988377 shutdown_connections 2024-04-25T02:29:32.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.959+0000 7f987515a640 1 -- 172.21.15.67:0/1599988377 wait complete. 2024-04-25T02:29:32.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.960+0000 7f987515a640 1 Processor -- start 2024-04-25T02:29:32.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.960+0000 7f987515a640 1 -- start start 2024-04-25T02:29:32.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.961+0000 7f987515a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987006c6a0 0x7f98701599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.961+0000 7f987515a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f987006dc00 0x7f987014f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.961+0000 7f987515a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98700b4020 0x7f98700cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.961+0000 7f987515a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f98700adc10 con 0x7f987006c6a0 2024-04-25T02:29:32.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.961+0000 7f987515a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f98700ada90 con 0x7f98700b4020 2024-04-25T02:29:32.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.961+0000 7f987515a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f98700b4940 con 0x7f987006dc00 2024-04-25T02:29:32.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.961+0000 7f986ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987006c6a0 0x7f98701599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.961+0000 7f986ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987006c6a0 0x7f98701599b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55404/0 (socket says 172.21.15.67:55404) 2024-04-25T02:29:32.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.961+0000 7f986ed9d640 1 -- 172.21.15.67:0/1192583718 learned_addr learned my addr 172.21.15.67:0/1192583718 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:32.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.961+0000 7f986e59c640 1 --2- 172.21.15.67:0/1192583718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f987006dc00 0x7f987014f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.961+0000 7f986f59e640 1 --2- 172.21.15.67:0/1192583718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98700b4020 0x7f98700cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.961+0000 7f986ed9d640 1 -- 172.21.15.67:0/1192583718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f987006dc00 msgr2=0x7f987014f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:32.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.961+0000 7f986ed9d640 1 --2- 172.21.15.67:0/1192583718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f987006dc00 0x7f987014f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.961+0000 7f986ed9d640 1 -- 172.21.15.67:0/1192583718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98700b4020 msgr2=0x7f98700cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:32.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.961+0000 7f986ed9d640 1 --2- 172.21.15.67:0/1192583718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98700b4020 0x7f98700cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:32.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.961+0000 7f986ed9d640 1 -- 172.21.15.67:0/1192583718 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9870158910 con 0x7f987006c6a0 2024-04-25T02:29:32.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.962+0000 7f986ed9d640 1 --2- 172.21.15.67:0/1192583718 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987006c6a0 0x7f98701599b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f986800d7d0 tx=0x7f986800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:32.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.962+0000 7f98577fe640 1 -- 172.21.15.67:0/1192583718 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868004030 con 0x7f987006c6a0 2024-04-25T02:29:32.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.962+0000 7f98577fe640 1 -- 172.21.15.67:0/1192583718 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98680041d0 con 0x7f987006c6a0 2024-04-25T02:29:32.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.962+0000 7f987515a640 1 -- 172.21.15.67:0/1192583718 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9870158bf0 con 0x7f987006c6a0 2024-04-25T02:29:32.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.962+0000 7f98577fe640 1 -- 172.21.15.67:0/1192583718 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98680096a0 con 0x7f987006c6a0 2024-04-25T02:29:32.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.962+0000 7f987515a640 1 -- 172.21.15.67:0/1192583718 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98701591b0 con 0x7f987006c6a0 2024-04-25T02:29:32.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.963+0000 7f987515a640 1 -- 172.21.15.67:0/1192583718 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9870069110 con 0x7f987006c6a0 2024-04-25T02:29:32.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.963+0000 7f98577fe640 1 -- 172.21.15.67:0/1192583718 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 6) ==== 90549+0+0 (secure 0 0 0) 0x7f9868009840 con 0x7f987006c6a0 2024-04-25T02:29:32.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.964+0000 7f98577fe640 1 --2- 172.21.15.67:0/1192583718 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f985c06bef0 0x7f985c06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:32.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.964+0000 7f98577fe640 1 -- 172.21.15.67:0/1192583718 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f986808b130 con 0x7f987006c6a0 2024-04-25T02:29:32.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.964+0000 7f986e59c640 1 --2- 172.21.15.67:0/1192583718 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f985c06bef0 0x7f985c06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:32.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.964+0000 7f986e59c640 1 --2- 172.21.15.67:0/1192583718 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f985c06bef0 0x7f985c06e3b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f987015e110 tx=0x7f986400d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:32.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:32.968+0000 7f98577fe640 1 -- 172.21.15.67:0/1192583718 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9868059b00 con 0x7f987006c6a0 2024-04-25T02:29:33.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:33.178+0000 7f987515a640 1 -- 172.21.15.67:0/1192583718 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol18111", "group_name": "subvol_grp17780", "target": ["mon-mgr", ""]}) -- 0x7f9870161ad0 con 0x7f985c06bef0 2024-04-25T02:29:34.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:34.393+0000 7f98577fe640 1 -- 172.21.15.67:0/1192583718 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f9868055a70 con 0x7f987006c6a0 2024-04-25T02:29:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.466+0000 7f98577fe640 1 -- 172.21.15.67:0/1192583718 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9870161ad0 con 0x7f985c06bef0 2024-04-25T02:29:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.469+0000 7f987515a640 1 -- 172.21.15.67:0/1192583718 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f985c06bef0 msgr2=0x7f985c06e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.469+0000 7f987515a640 1 --2- 172.21.15.67:0/1192583718 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f985c06bef0 0x7f985c06e3b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f987015e110 tx=0x7f986400d040 comp rx=0 tx=0).stop 2024-04-25T02:29:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.469+0000 7f987515a640 1 -- 172.21.15.67:0/1192583718 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987006c6a0 msgr2=0x7f98701599b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.469+0000 7f987515a640 1 --2- 172.21.15.67:0/1192583718 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987006c6a0 0x7f98701599b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f986800d7d0 tx=0x7f986800dc90 comp rx=0 tx=0).stop 2024-04-25T02:29:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.469+0000 7f987515a640 1 -- 172.21.15.67:0/1192583718 shutdown_connections 2024-04-25T02:29:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.469+0000 7f987515a640 1 --2- 172.21.15.67:0/1192583718 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f985c06bef0 0x7f985c06e3b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.469+0000 7f987515a640 1 --2- 172.21.15.67:0/1192583718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98700b4020 0x7f98700cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.469+0000 7f987515a640 1 --2- 172.21.15.67:0/1192583718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f987006dc00 0x7f987014f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.469+0000 7f987515a640 1 --2- 172.21.15.67:0/1192583718 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f987006c6a0 0x7f98701599b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.469+0000 7f987515a640 1 -- 172.21.15.67:0/1192583718 >> 172.21.15.67:0/1192583718 conn(0x7f98700d04b0 msgr2=0x7f9870157e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:36.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.469+0000 7f987515a640 1 -- 172.21.15.67:0/1192583718 shutdown_connections 2024-04-25T02:29:36.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.469+0000 7f987515a640 1 -- 172.21.15.67:0/1192583718 wait complete. 2024-04-25T02:29:36.486 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol72122 subvol_grp17780 2024-04-25T02:29:36.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.594+0000 7f5737f09640 1 Processor -- start 2024-04-25T02:29:36.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.594+0000 7f5737f09640 1 -- start start 2024-04-25T02:29:36.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.595+0000 7f5737f09640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f573015a9b0 0x7f5730070e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.595+0000 7f5737f09640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57300b2dc0 0x7f5730072890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.595+0000 7f5737f09640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57300717f0 con 0x7f5730071350 2024-04-25T02:29:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.595+0000 7f5737f09640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5730072400 con 0x7f573015a9b0 2024-04-25T02:29:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.595+0000 7f5737f09640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5730071ad0 con 0x7f57300b2dc0 2024-04-25T02:29:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.595+0000 7f5735ca5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f573015a9b0 0x7f5730070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.595+0000 7f57364a6640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5730071350 0x7f57300b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57510/0 (socket says 172.21.15.67:57510) 2024-04-25T02:29:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.595+0000 7f57364a6640 1 -- 172.21.15.67:0/615033747 learned_addr learned my addr 172.21.15.67:0/615033747 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.595+0000 7f5735ca5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f573015a9b0 0x7f5730070e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55408/0 (socket says 172.21.15.67:55408) 2024-04-25T02:29:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.595+0000 7f57354a4640 1 --2- 172.21.15.67:0/615033747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57300b2dc0 0x7f5730072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.595+0000 7f5735ca5640 1 -- 172.21.15.67:0/615033747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57300b2dc0 msgr2=0x7f5730072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.595+0000 7f5735ca5640 1 --2- 172.21.15.67:0/615033747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57300b2dc0 0x7f5730072890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.595+0000 7f5735ca5640 1 -- 172.21.15.67:0/615033747 >> v1:172.21.15.67:6789/0 conn(0x7f5730071350 legacy=0x7f57300b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.595+0000 7f5735ca5640 1 -- 172.21.15.67:0/615033747 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5730071db0 con 0x7f573015a9b0 2024-04-25T02:29:36.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.595+0000 7f5734ca3640 1 -- 172.21.15.67:0/615033747 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3245117896 0 0) 0x7f57300717f0 con 0x7f5730071350 2024-04-25T02:29:36.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.596+0000 7f5735ca5640 1 --2- 172.21.15.67:0/615033747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f573015a9b0 0x7f5730070e10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f572c0097a0 tx=0x7f572c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43abe90c07f3cd7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:36.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.596+0000 7f5734ca3640 1 -- 172.21.15.67:0/615033747 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c037070 con 0x7f573015a9b0 2024-04-25T02:29:36.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.596+0000 7f5734ca3640 1 -- 172.21.15.67:0/615033747 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f572c032440 con 0x7f573015a9b0 2024-04-25T02:29:36.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.596+0000 7f5734ca3640 1 -- 172.21.15.67:0/615033747 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c032810 con 0x7f573015a9b0 2024-04-25T02:29:36.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.597+0000 7f5737f09640 1 -- 172.21.15.67:0/615033747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f573015a9b0 msgr2=0x7f5730070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:36.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.597+0000 7f5737f09640 1 --2- 172.21.15.67:0/615033747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f573015a9b0 0x7f5730070e10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f572c0097a0 tx=0x7f572c02a180 comp rx=0 tx=0).stop 2024-04-25T02:29:36.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.597+0000 7f5737f09640 1 -- 172.21.15.67:0/615033747 shutdown_connections 2024-04-25T02:29:36.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.597+0000 7f5737f09640 1 --2- 172.21.15.67:0/615033747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57300b2dc0 0x7f5730072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.597+0000 7f5737f09640 1 --2- 172.21.15.67:0/615033747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f573015a9b0 0x7f5730070e10 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.597+0000 7f5737f09640 1 -- 172.21.15.67:0/615033747 >> 172.21.15.67:0/615033747 conn(0x7f57300b19c0 msgr2=0x7f57300b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:36.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.597+0000 7f5737f09640 1 -- 172.21.15.67:0/615033747 shutdown_connections 2024-04-25T02:29:36.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.597+0000 7f5737f09640 1 -- 172.21.15.67:0/615033747 wait complete. 2024-04-25T02:29:36.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.598+0000 7f5737f09640 1 Processor -- start 2024-04-25T02:29:36.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.598+0000 7f5737f09640 1 -- start start 2024-04-25T02:29:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.599+0000 7f5737f09640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5730071350 0x7f57300cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.599+0000 7f5737f09640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57300b2dc0 0x7f57301476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.599+0000 7f5737f09640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f573015a9b0 0x7f573015d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.599+0000 7f5737f09640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f57300b3fd0 con 0x7f5730071350 2024-04-25T02:29:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.599+0000 7f5737f09640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f57300b3e50 con 0x7f57300b2dc0 2024-04-25T02:29:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.599+0000 7f5737f09640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5730072dd0 con 0x7f573015a9b0 2024-04-25T02:29:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.599+0000 7f5735ca5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5730071350 0x7f57300cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.599+0000 7f5735ca5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5730071350 0x7f57300cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55422/0 (socket says 172.21.15.67:55422) 2024-04-25T02:29:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.599+0000 7f5735ca5640 1 -- 172.21.15.67:0/3832671925 learned_addr learned my addr 172.21.15.67:0/3832671925 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.599+0000 7f57364a6640 1 --2- 172.21.15.67:0/3832671925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f573015a9b0 0x7f573015d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.599+0000 7f57354a4640 1 --2- 172.21.15.67:0/3832671925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57300b2dc0 0x7f57301476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.599+0000 7f5735ca5640 1 -- 172.21.15.67:0/3832671925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f573015a9b0 msgr2=0x7f573015d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.599+0000 7f5735ca5640 1 --2- 172.21.15.67:0/3832671925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f573015a9b0 0x7f573015d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.599+0000 7f5735ca5640 1 -- 172.21.15.67:0/3832671925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57300b2dc0 msgr2=0x7f57301476f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.599+0000 7f5735ca5640 1 --2- 172.21.15.67:0/3832671925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57300b2dc0 0x7f57301476f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.599+0000 7f5735ca5640 1 -- 172.21.15.67:0/3832671925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57300ccbe0 con 0x7f5730071350 2024-04-25T02:29:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.599+0000 7f5735ca5640 1 --2- 172.21.15.67:0/3832671925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5730071350 0x7f57300cc600 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f572c035040 tx=0x7f572c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.600+0000 7f57267fc640 1 -- 172.21.15.67:0/3832671925 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c037040 con 0x7f5730071350 2024-04-25T02:29:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.600+0000 7f57267fc640 1 -- 172.21.15.67:0/3832671925 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f572c030770 con 0x7f5730071350 2024-04-25T02:29:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.600+0000 7f5737f09640 1 -- 172.21.15.67:0/3832671925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57300ccec0 con 0x7f5730071350 2024-04-25T02:29:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.600+0000 7f57267fc640 1 -- 172.21.15.67:0/3832671925 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c030b40 con 0x7f5730071350 2024-04-25T02:29:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.600+0000 7f5737f09640 1 -- 172.21.15.67:0/3832671925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57300cd480 con 0x7f5730071350 2024-04-25T02:29:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.601+0000 7f5737f09640 1 -- 172.21.15.67:0/3832671925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5730069110 con 0x7f5730071350 2024-04-25T02:29:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.601+0000 7f57267fc640 1 -- 172.21.15.67:0/3832671925 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f572c044020 con 0x7f5730071350 2024-04-25T02:29:36.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.601+0000 7f57267fc640 1 --2- 172.21.15.67:0/3832671925 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f571406bfe0 0x7f571406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:36.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.602+0000 7f57267fc640 1 -- 172.21.15.67:0/3832671925 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f572c0ab6b0 con 0x7f5730071350 2024-04-25T02:29:36.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.602+0000 7f57354a4640 1 --2- 172.21.15.67:0/3832671925 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f571406bfe0 0x7f571406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:36.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.602+0000 7f57354a4640 1 --2- 172.21.15.67:0/3832671925 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f571406bfe0 0x7f571406e4a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f57300ad410 tx=0x7f5720008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:36.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.606+0000 7f57267fc640 1 -- 172.21.15.67:0/3832671925 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f572c032e20 con 0x7f5730071350 2024-04-25T02:29:36.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.814+0000 7f5737f09640 1 -- 172.21.15.67:0/3832671925 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol72122", "group_name": "subvol_grp17780", "target": ["mon-mgr", ""]}) -- 0x7f5730147c30 con 0x7f571406bfe0 2024-04-25T02:29:36.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.831+0000 7f57267fc640 1 -- 172.21.15.67:0/3832671925 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5730147c30 con 0x7f571406bfe0 2024-04-25T02:29:36.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.833+0000 7f5737f09640 1 -- 172.21.15.67:0/3832671925 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f571406bfe0 msgr2=0x7f571406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:36.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.833+0000 7f5737f09640 1 --2- 172.21.15.67:0/3832671925 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f571406bfe0 0x7f571406e4a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f57300ad410 tx=0x7f5720008040 comp rx=0 tx=0).stop 2024-04-25T02:29:36.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.833+0000 7f5737f09640 1 -- 172.21.15.67:0/3832671925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5730071350 msgr2=0x7f57300cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:36.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.833+0000 7f5737f09640 1 --2- 172.21.15.67:0/3832671925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5730071350 0x7f57300cc600 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f572c035040 tx=0x7f572c0046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.833+0000 7f5737f09640 1 -- 172.21.15.67:0/3832671925 shutdown_connections 2024-04-25T02:29:36.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.833+0000 7f5737f09640 1 --2- 172.21.15.67:0/3832671925 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f571406bfe0 0x7f571406e4a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.833+0000 7f5737f09640 1 --2- 172.21.15.67:0/3832671925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f573015a9b0 0x7f573015d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.833+0000 7f5737f09640 1 --2- 172.21.15.67:0/3832671925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57300b2dc0 0x7f57301476f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.833+0000 7f5737f09640 1 --2- 172.21.15.67:0/3832671925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5730071350 0x7f57300cc600 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.833+0000 7f5737f09640 1 -- 172.21.15.67:0/3832671925 >> 172.21.15.67:0/3832671925 conn(0x7f57300b19c0 msgr2=0x7f57300ae920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:36.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.833+0000 7f5737f09640 1 -- 172.21.15.67:0/3832671925 shutdown_connections 2024-04-25T02:29:36.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.833+0000 7f5737f09640 1 -- 172.21.15.67:0/3832671925 wait complete. 2024-04-25T02:29:36.849 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp17780 2024-04-25T02:29:36.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.950+0000 7fa8f1916640 1 Processor -- start 2024-04-25T02:29:36.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.950+0000 7fa8f1916640 1 -- start start 2024-04-25T02:29:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.951+0000 7fa8f1916640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa8ec158750 0x7fa8ec06c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.951+0000 7fa8f1916640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa8ec15e6c0 0x7fa8ec06c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.951+0000 7fa8f1916640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8ec15ec30 con 0x7fa8ec0ad8e0 2024-04-25T02:29:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.951+0000 7fa8f1916640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa8ec15ef10 con 0x7fa8ec15e6c0 2024-04-25T02:29:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.951+0000 7fa8f1916640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa8ec15f1f0 con 0x7fa8ec158750 2024-04-25T02:29:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.951+0000 7fa8ea7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa8ec15e6c0 0x7fa8ec06c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.951+0000 7fa8ea7fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa8ec15e6c0 0x7fa8ec06c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55430/0 (socket says 172.21.15.67:55430) 2024-04-25T02:29:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.951+0000 7fa8ea7fc640 1 -- 172.21.15.67:0/3052856852 learned_addr learned my addr 172.21.15.67:0/3052856852 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.951+0000 7fa8eaffd640 1 --2- 172.21.15.67:0/3052856852 >> v2:172.21.15.176:3300/0 conn(0x7fa8ec158750 0x7fa8ec06c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.951+0000 7fa8ea7fc640 1 -- 172.21.15.67:0/3052856852 >> v2:172.21.15.176:3300/0 conn(0x7fa8ec158750 msgr2=0x7fa8ec06c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.951+0000 7fa8ea7fc640 1 --2- 172.21.15.67:0/3052856852 >> v2:172.21.15.176:3300/0 conn(0x7fa8ec158750 0x7fa8ec06c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.951+0000 7fa8ea7fc640 1 -- 172.21.15.67:0/3052856852 >> v1:172.21.15.176:6789/0 conn(0x7fa8ec0ad8e0 legacy=0x7fa8ec161cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.951+0000 7fa8ea7fc640 1 -- 172.21.15.67:0/3052856852 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec15f4d0 con 0x7fa8ec15e6c0 2024-04-25T02:29:36.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.951+0000 7fa8eaffd640 1 --2- 172.21.15.67:0/3052856852 >> v2:172.21.15.176:3300/0 conn(0x7fa8ec158750 0x7fa8ec06c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:36.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.952+0000 7fa8ea7fc640 1 --2- 172.21.15.67:0/3052856852 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8ec15e6c0 0x7fa8ec06c610 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec071240 tx=0x7fa8d402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7485b3121949b8f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:36.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.952+0000 7fa8e9ffb640 1 -- 172.21.15.67:0/3052856852 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4037070 con 0x7fa8ec15e6c0 2024-04-25T02:29:36.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.952+0000 7fa8e9ffb640 1 -- 172.21.15.67:0/3052856852 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d4032440 con 0x7fa8ec15e6c0 2024-04-25T02:29:36.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.952+0000 7fa8e9ffb640 1 -- 172.21.15.67:0/3052856852 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4032810 con 0x7fa8ec15e6c0 2024-04-25T02:29:36.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.953+0000 7fa8f1916640 1 -- 172.21.15.67:0/3052856852 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8ec15e6c0 msgr2=0x7fa8ec06c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:36.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.953+0000 7fa8f1916640 1 --2- 172.21.15.67:0/3052856852 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8ec15e6c0 0x7fa8ec06c610 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec071240 tx=0x7fa8d402a2c0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.953+0000 7fa8f1916640 1 -- 172.21.15.67:0/3052856852 shutdown_connections 2024-04-25T02:29:36.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.953+0000 7fa8f1916640 1 --2- 172.21.15.67:0/3052856852 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8ec15e6c0 0x7fa8ec06c610 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.953+0000 7fa8f1916640 1 --2- 172.21.15.67:0/3052856852 >> v2:172.21.15.176:3300/0 conn(0x7fa8ec158750 0x7fa8ec06c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.953+0000 7fa8f1916640 1 -- 172.21.15.67:0/3052856852 >> 172.21.15.67:0/3052856852 conn(0x7fa8ec0715c0 msgr2=0x7fa8ec0719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:36.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.953+0000 7fa8f1916640 1 -- 172.21.15.67:0/3052856852 shutdown_connections 2024-04-25T02:29:36.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.953+0000 7fa8f1916640 1 -- 172.21.15.67:0/3052856852 wait complete. 2024-04-25T02:29:36.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.954+0000 7fa8f1916640 1 Processor -- start 2024-04-25T02:29:36.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.954+0000 7fa8f1916640 1 -- start start 2024-04-25T02:29:36.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.955+0000 7fa8f1916640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8ec0ad8e0 0x7fa8ec155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:36.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.955+0000 7fa8f1916640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8ec158750 0x7fa8ec14e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:36.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.955+0000 7fa8f1916640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8ec15e6c0 0x7fa8ec156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:36.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.955+0000 7fa8f1916640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec0723b0 con 0x7fa8ec158750 2024-04-25T02:29:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.955+0000 7fa8f1916640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec072230 con 0x7fa8ec15e6c0 2024-04-25T02:29:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.955+0000 7fa8f1916640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ec0b4820 con 0x7fa8ec0ad8e0 2024-04-25T02:29:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.955+0000 7fa8ea7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8ec158750 0x7fa8ec14e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.955+0000 7fa8ea7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8ec158750 0x7fa8ec14e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55432/0 (socket says 172.21.15.67:55432) 2024-04-25T02:29:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.955+0000 7fa8ea7fc640 1 -- 172.21.15.67:0/2994476849 learned_addr learned my addr 172.21.15.67:0/2994476849 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.955+0000 7fa8eaffd640 1 --2- 172.21.15.67:0/2994476849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8ec0ad8e0 0x7fa8ec155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.955+0000 7fa8eb7fe640 1 --2- 172.21.15.67:0/2994476849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8ec15e6c0 0x7fa8ec156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.955+0000 7fa8ea7fc640 1 -- 172.21.15.67:0/2994476849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8ec0ad8e0 msgr2=0x7fa8ec155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.955+0000 7fa8ea7fc640 1 --2- 172.21.15.67:0/2994476849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8ec0ad8e0 0x7fa8ec155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.955+0000 7fa8ea7fc640 1 -- 172.21.15.67:0/2994476849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8ec15e6c0 msgr2=0x7fa8ec156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.955+0000 7fa8ea7fc640 1 --2- 172.21.15.67:0/2994476849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8ec15e6c0 0x7fa8ec156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.955+0000 7fa8ea7fc640 1 -- 172.21.15.67:0/2994476849 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec14f530 con 0x7fa8ec158750 2024-04-25T02:29:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.956+0000 7fa8ea7fc640 1 --2- 172.21.15.67:0/2994476849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8ec158750 0x7fa8ec14e240 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa8d402a300 tx=0x7fa8d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.956+0000 7fa8e3fff640 1 -- 172.21.15.67:0/2994476849 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4037040 con 0x7fa8ec158750 2024-04-25T02:29:36.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.956+0000 7fa8e3fff640 1 -- 172.21.15.67:0/2994476849 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d4042070 con 0x7fa8ec158750 2024-04-25T02:29:36.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.956+0000 7fa8e3fff640 1 -- 172.21.15.67:0/2994476849 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4030bb0 con 0x7fa8ec158750 2024-04-25T02:29:36.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.956+0000 7fa8f1916640 1 -- 172.21.15.67:0/2994476849 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8ec14f810 con 0x7fa8ec158750 2024-04-25T02:29:36.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.956+0000 7fa8f1916640 1 -- 172.21.15.67:0/2994476849 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8ec14fdd0 con 0x7fa8ec158750 2024-04-25T02:29:36.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.957+0000 7fa8f1916640 1 -- 172.21.15.67:0/2994476849 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8ec0b3460 con 0x7fa8ec158750 2024-04-25T02:29:36.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.957+0000 7fa8e3fff640 1 -- 172.21.15.67:0/2994476849 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fa8d4047460 con 0x7fa8ec158750 2024-04-25T02:29:36.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.958+0000 7fa8e3fff640 1 --2- 172.21.15.67:0/2994476849 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa8cc06bfe0 0x7fa8cc06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:36.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.958+0000 7fa8e3fff640 1 -- 172.21.15.67:0/2994476849 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa8d40abe40 con 0x7fa8ec158750 2024-04-25T02:29:36.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.958+0000 7fa8eaffd640 1 --2- 172.21.15.67:0/2994476849 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa8cc06bfe0 0x7fa8cc06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:36.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.958+0000 7fa8eaffd640 1 --2- 172.21.15.67:0/2994476849 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa8cc06bfe0 0x7fa8cc06e4a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc0075b0 tx=0x7fa8dc007540 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:36.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:36.962+0000 7fa8e3fff640 1 -- 172.21.15.67:0/2994476849 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa8ec0b3460 con 0x7fa8ec158750 2024-04-25T02:29:37.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.174+0000 7fa8f1916640 1 -- 172.21.15.67:0/2994476849 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp17780", "target": ["mon-mgr", ""]}) -- 0x7fa8ec069110 con 0x7fa8cc06bfe0 2024-04-25T02:29:37.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.180+0000 7fa8e3fff640 1 -- 172.21.15.67:0/2994476849 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa8ec069110 con 0x7fa8cc06bfe0 2024-04-25T02:29:37.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.182+0000 7fa8f1916640 1 -- 172.21.15.67:0/2994476849 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa8cc06bfe0 msgr2=0x7fa8cc06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:37.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.182+0000 7fa8f1916640 1 --2- 172.21.15.67:0/2994476849 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa8cc06bfe0 0x7fa8cc06e4a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc0075b0 tx=0x7fa8dc007540 comp rx=0 tx=0).stop 2024-04-25T02:29:37.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.182+0000 7fa8f1916640 1 -- 172.21.15.67:0/2994476849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8ec158750 msgr2=0x7fa8ec14e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:37.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.182+0000 7fa8f1916640 1 --2- 172.21.15.67:0/2994476849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8ec158750 0x7fa8ec14e240 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa8d402a300 tx=0x7fa8d40046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.182+0000 7fa8f1916640 1 -- 172.21.15.67:0/2994476849 shutdown_connections 2024-04-25T02:29:37.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.182+0000 7fa8f1916640 1 --2- 172.21.15.67:0/2994476849 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa8cc06bfe0 0x7fa8cc06e4a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.182+0000 7fa8f1916640 1 --2- 172.21.15.67:0/2994476849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8ec15e6c0 0x7fa8ec156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.182+0000 7fa8f1916640 1 --2- 172.21.15.67:0/2994476849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8ec158750 0x7fa8ec14e240 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.182+0000 7fa8f1916640 1 --2- 172.21.15.67:0/2994476849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8ec0ad8e0 0x7fa8ec155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.182+0000 7fa8f1916640 1 -- 172.21.15.67:0/2994476849 >> 172.21.15.67:0/2994476849 conn(0x7fa8ec0715c0 msgr2=0x7fa8ec160550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:37.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.183+0000 7fa8f1916640 1 -- 172.21.15.67:0/2994476849 shutdown_connections 2024-04-25T02:29:37.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.183+0000 7fa8f1916640 1 -- 172.21.15.67:0/2994476849 wait complete. 2024-04-25T02:29:37.197 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-04-25T02:29:37.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:29:37.250 INFO:teuthology.orchestra.run.smithi067.stdout:2 2024-04-25T02:29:37.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:29:37.256 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T02:29:37.257 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:29:37.306 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:29:37.349 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T02:29:37.349 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:29:37.349 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:29:37.349 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:29:37.365 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:29:37.365 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:29:37.420 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:29:37.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.558+0000 7fa299bb7640 1 Processor -- start 2024-04-25T02:29:37.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.559+0000 7fa299bb7640 1 -- start start 2024-04-25T02:29:37.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.559+0000 7fa299bb7640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa29415b220 0x7fa294070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:37.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.559+0000 7fa299bb7640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2940713d0 con 0x7fa29415ec70 2024-04-25T02:29:37.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.559+0000 7fa299bb7640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2940ae4d0 con 0x7fa29415f800 2024-04-25T02:29:37.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.559+0000 7fa299bb7640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa2940aee00 con 0x7fa29415b220 2024-04-25T02:29:37.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.559+0000 7fa292ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa29415ec70 0x7fa29415f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57526/0 (socket says 172.21.15.67:57526) 2024-04-25T02:29:37.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.559+0000 7fa292ffd640 1 -- 172.21.15.67:0/729038760 learned_addr learned my addr 172.21.15.67:0/729038760 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:37.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa2927fc640 1 -- 172.21.15.67:0/729038760 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3951577625 0 0) 0x7fa2940713d0 con 0x7fa29415ec70 2024-04-25T02:29:37.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa2937fe640 1 --2- 172.21.15.67:0/729038760 >> v2:172.21.15.176:3300/0 conn(0x7fa29415b220 0x7fa294070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:37.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa2927fc640 1 -- 172.21.15.67:0/729038760 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa27c005730 con 0x7fa29415ec70 2024-04-25T02:29:37.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa2927fc640 1 -- 172.21.15.67:0/729038760 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2432325002 0 0) 0x7fa27c005730 con 0x7fa29415ec70 2024-04-25T02:29:37.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa2927fc640 1 -- 172.21.15.67:0/729038760 >> v2:172.21.15.176:3300/0 conn(0x7fa29415b220 msgr2=0x7fa294070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:37.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa2927fc640 1 --2- 172.21.15.67:0/729038760 >> v2:172.21.15.176:3300/0 conn(0x7fa29415b220 0x7fa294070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa2927fc640 1 -- 172.21.15.67:0/729038760 >> v1:172.21.15.176:6789/0 conn(0x7fa29415f800 legacy=0x7fa2940b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:37.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa2927fc640 1 -- 172.21.15.67:0/729038760 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2940ae7b0 con 0x7fa29415ec70 2024-04-25T02:29:37.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa2927fc640 1 -- 172.21.15.67:0/729038760 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7fa288001670 con 0x7fa29415ec70 2024-04-25T02:29:37.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa2927fc640 1 -- 172.21.15.67:0/729038760 >> v1:172.21.15.67:6789/0 conn(0x7fa29415ec70 legacy=0x7fa29415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:37.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa2927fc640 1 --2- 172.21.15.67:0/729038760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa27c005bc0 0x7fa27c005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:37.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa2927fc640 1 --2- 172.21.15.67:0/729038760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa27c006a10 0x7fa27c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:37.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa2927fc640 1 --2- 172.21.15.67:0/729038760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa27c0073d0 0x7fa27c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:37.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa2927fc640 1 -- 172.21.15.67:0/729038760 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa2940aee00 con 0x7fa27c0073d0 2024-04-25T02:29:37.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa2927fc640 1 -- 172.21.15.67:0/729038760 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c00e270 con 0x7fa27c006a10 2024-04-25T02:29:37.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa2927fc640 1 -- 172.21.15.67:0/729038760 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa27c00e470 con 0x7fa27c005bc0 2024-04-25T02:29:37.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa293fff640 1 --2- 172.21.15.67:0/729038760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa27c0073d0 0x7fa27c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:37.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa2937fe640 1 --2- 172.21.15.67:0/729038760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa27c005bc0 0x7fa27c005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:37.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa292ffd640 1 --2- 172.21.15.67:0/729038760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa27c006a10 0x7fa27c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:37.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa293fff640 1 -- 172.21.15.67:0/729038760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa27c005bc0 msgr2=0x7fa27c005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:37.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa293fff640 1 --2- 172.21.15.67:0/729038760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa27c005bc0 0x7fa27c005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa293fff640 1 -- 172.21.15.67:0/729038760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa27c006a10 msgr2=0x7fa27c006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:37.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.560+0000 7fa293fff640 1 --2- 172.21.15.67:0/729038760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa27c006a10 0x7fa27c006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.561+0000 7fa293fff640 1 -- 172.21.15.67:0/729038760 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27c005730 con 0x7fa27c0073d0 2024-04-25T02:29:37.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.561+0000 7fa293fff640 1 -- 172.21.15.67:0/729038760 reap_dead start 2024-04-25T02:29:37.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.561+0000 7fa293fff640 1 --2- 172.21.15.67:0/729038760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa27c0073d0 0x7fa27c00dbd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa28c001e20 tx=0x7fa27c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa1603666e26248 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:37.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.561+0000 7fa2927fc640 1 -- 172.21.15.67:0/729038760 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c001a70 con 0x7fa27c0073d0 2024-04-25T02:29:37.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.561+0000 7fa2927fc640 1 -- 172.21.15.67:0/729038760 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa28c02ae40 con 0x7fa27c0073d0 2024-04-25T02:29:37.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.561+0000 7fa2927fc640 1 -- 172.21.15.67:0/729038760 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c003b90 con 0x7fa27c0073d0 2024-04-25T02:29:37.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.562+0000 7fa299bb7640 1 -- 172.21.15.67:0/729038760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa27c0073d0 msgr2=0x7fa27c00dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:37.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.562+0000 7fa299bb7640 1 --2- 172.21.15.67:0/729038760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa27c0073d0 0x7fa27c00dbd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa28c001e20 tx=0x7fa27c007a40 comp rx=0 tx=0).stop 2024-04-25T02:29:37.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.562+0000 7fa299bb7640 1 -- 172.21.15.67:0/729038760 shutdown_connections 2024-04-25T02:29:37.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.562+0000 7fa299bb7640 1 --2- 172.21.15.67:0/729038760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa27c0073d0 0x7fa27c00dbd0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.562+0000 7fa299bb7640 1 -- 172.21.15.67:0/729038760 >> 172.21.15.67:0/729038760 conn(0x7fa2940b19c0 msgr2=0x7fa2940b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:37.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.562+0000 7fa299bb7640 1 -- 172.21.15.67:0/729038760 shutdown_connections 2024-04-25T02:29:37.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.562+0000 7fa299bb7640 1 -- 172.21.15.67:0/729038760 wait complete. 2024-04-25T02:29:37.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.563+0000 7fa299bb7640 1 Processor -- start 2024-04-25T02:29:37.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.563+0000 7fa299bb7640 1 -- start start 2024-04-25T02:29:37.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.564+0000 7fa299bb7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa27c0073d0 0x7fa294152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:37.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.564+0000 7fa299bb7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa294151390 0x7fa2940b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:37.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.564+0000 7fa299bb7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2941517f0 0x7fa2940b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:37.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.564+0000 7fa299bb7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa29406ed10 con 0x7fa2941517f0 2024-04-25T02:29:37.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.564+0000 7fa299bb7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa29406eb90 con 0x7fa294151390 2024-04-25T02:29:37.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.564+0000 7fa299bb7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa294070df0 con 0x7fa27c0073d0 2024-04-25T02:29:37.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.564+0000 7fa293fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2941517f0 0x7fa2940b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:37.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.564+0000 7fa293fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2941517f0 0x7fa2940b0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55446/0 (socket says 172.21.15.67:55446) 2024-04-25T02:29:37.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.564+0000 7fa293fff640 1 -- 172.21.15.67:0/2930114512 learned_addr learned my addr 172.21.15.67:0/2930114512 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:37.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.564+0000 7fa2937fe640 1 --2- 172.21.15.67:0/2930114512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa27c0073d0 0x7fa294152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:37.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.564+0000 7fa292ffd640 1 --2- 172.21.15.67:0/2930114512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa294151390 0x7fa2940b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:37.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.564+0000 7fa293fff640 1 -- 172.21.15.67:0/2930114512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa27c0073d0 msgr2=0x7fa294152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:37.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.564+0000 7fa293fff640 1 --2- 172.21.15.67:0/2930114512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa27c0073d0 0x7fa294152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.564+0000 7fa293fff640 1 -- 172.21.15.67:0/2930114512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa294151390 msgr2=0x7fa2940b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:37.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.564+0000 7fa293fff640 1 --2- 172.21.15.67:0/2930114512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa294151390 0x7fa2940b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.564+0000 7fa293fff640 1 -- 172.21.15.67:0/2930114512 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29415b850 con 0x7fa2941517f0 2024-04-25T02:29:37.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.564+0000 7fa2937fe640 1 --2- 172.21.15.67:0/2930114512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa27c0073d0 0x7fa294152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:37.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.565+0000 7fa293fff640 1 --2- 172.21.15.67:0/2930114512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2941517f0 0x7fa2940b0f50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa28c02a8f0 tx=0x7fa28c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:37.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.565+0000 7fa27bfff640 1 -- 172.21.15.67:0/2930114512 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c007db0 con 0x7fa2941517f0 2024-04-25T02:29:37.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.565+0000 7fa27bfff640 1 -- 172.21.15.67:0/2930114512 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa28c02ac40 con 0x7fa2941517f0 2024-04-25T02:29:37.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.565+0000 7fa27bfff640 1 -- 172.21.15.67:0/2930114512 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c005790 con 0x7fa2941517f0 2024-04-25T02:29:37.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.565+0000 7fa299bb7640 1 -- 172.21.15.67:0/2930114512 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa29415bb30 con 0x7fa2941517f0 2024-04-25T02:29:37.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.565+0000 7fa299bb7640 1 -- 172.21.15.67:0/2930114512 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa29409c430 con 0x7fa2941517f0 2024-04-25T02:29:37.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.566+0000 7fa299bb7640 1 -- 172.21.15.67:0/2930114512 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa294069110 con 0x7fa2941517f0 2024-04-25T02:29:37.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.566+0000 7fa27bfff640 1 -- 172.21.15.67:0/2930114512 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fa28c032440 con 0x7fa2941517f0 2024-04-25T02:29:37.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.567+0000 7fa27bfff640 1 --2- 172.21.15.67:0/2930114512 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa28006bfe0 0x7fa28006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:37.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.567+0000 7fa27bfff640 1 -- 172.21.15.67:0/2930114512 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa28c0aa300 con 0x7fa2941517f0 2024-04-25T02:29:37.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.567+0000 7fa2937fe640 1 --2- 172.21.15.67:0/2930114512 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa28006bfe0 0x7fa28006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:37.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.567+0000 7fa2937fe640 1 --2- 172.21.15.67:0/2930114512 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa28006bfe0 0x7fa28006e4a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa284009a40 tx=0x7fa284008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:37.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.571+0000 7fa27bfff640 1 -- 172.21.15.67:0/2930114512 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa28c078490 con 0x7fa2941517f0 2024-04-25T02:29:37.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.758+0000 7fa299bb7640 1 -- 172.21.15.67:0/2930114512 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa294072470 con 0x7fa2941517f0 2024-04-25T02:29:37.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.759+0000 7fa27bfff640 1 -- 172.21.15.67:0/2930114512 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16645 (secure 0 0 0) 0x7fa28c07c790 con 0x7fa2941517f0 2024-04-25T02:29:37.762 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:37.762 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":33,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:29:19.335566+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:29:16.301169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T02:29:16.663379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:29:37.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.761+0000 7fa299bb7640 1 -- 172.21.15.67:0/2930114512 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa28006bfe0 msgr2=0x7fa28006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:37.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.761+0000 7fa299bb7640 1 --2- 172.21.15.67:0/2930114512 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa28006bfe0 0x7fa28006e4a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa284009a40 tx=0x7fa284008040 comp rx=0 tx=0).stop 2024-04-25T02:29:37.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.761+0000 7fa299bb7640 1 -- 172.21.15.67:0/2930114512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2941517f0 msgr2=0x7fa2940b0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:37.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.761+0000 7fa299bb7640 1 --2- 172.21.15.67:0/2930114512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2941517f0 0x7fa2940b0f50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa28c02a8f0 tx=0x7fa28c0014a0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.761+0000 7fa299bb7640 1 -- 172.21.15.67:0/2930114512 shutdown_connections 2024-04-25T02:29:37.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.761+0000 7fa299bb7640 1 --2- 172.21.15.67:0/2930114512 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa28006bfe0 0x7fa28006e4a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.761+0000 7fa299bb7640 1 --2- 172.21.15.67:0/2930114512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2941517f0 0x7fa2940b0f50 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.761+0000 7fa299bb7640 1 --2- 172.21.15.67:0/2930114512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa294151390 0x7fa2940b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.761+0000 7fa299bb7640 1 --2- 172.21.15.67:0/2930114512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa27c0073d0 0x7fa294152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.761+0000 7fa299bb7640 1 -- 172.21.15.67:0/2930114512 >> 172.21.15.67:0/2930114512 conn(0x7fa2940b19c0 msgr2=0x7fa294159350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:37.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.761+0000 7fa299bb7640 1 -- 172.21.15.67:0/2930114512 shutdown_connections 2024-04-25T02:29:37.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.761+0000 7fa299bb7640 1 -- 172.21.15.67:0/2930114512 wait complete. 2024-04-25T02:29:37.775 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:29:16.301169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:29:16.663379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:29:37.776 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:29:37.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.876+0000 7fb233589640 1 Processor -- start 2024-04-25T02:29:37.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.876+0000 7fb233589640 1 -- start start 2024-04-25T02:29:37.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.877+0000 7fb233589640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb22c0b2cc0 0x7fb22c09db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:37.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.877+0000 7fb233589640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22c0ad820 con 0x7fb22c06ec40 2024-04-25T02:29:37.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.877+0000 7fb233589640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22c0b3260 con 0x7fb22c15b090 2024-04-25T02:29:37.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.877+0000 7fb233589640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb22c0b3540 con 0x7fb22c0b2cc0 2024-04-25T02:29:37.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.877+0000 7fb231b26640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb22c0b2cc0 0x7fb22c09db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:37.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.877+0000 7fb230b24640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb22c06ec40 0x7fb22c0add00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57540/0 (socket says 172.21.15.67:57540) 2024-04-25T02:29:37.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.877+0000 7fb230b24640 1 -- 172.21.15.67:0/3295146776 learned_addr learned my addr 172.21.15.67:0/3295146776 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:37.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.878+0000 7fb231b26640 1 -- 172.21.15.67:0/3295146776 >> v1:172.21.15.176:6789/0 conn(0x7fb22c15b090 legacy=0x7fb22c06e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:37.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.878+0000 7fb231b26640 1 -- 172.21.15.67:0/3295146776 >> v1:172.21.15.67:6789/0 conn(0x7fb22c06ec40 legacy=0x7fb22c0add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:37.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.878+0000 7fb22bfff640 1 -- 172.21.15.67:0/3295146776 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186998139 0 0) 0x7fb22c0ad820 con 0x7fb22c06ec40 2024-04-25T02:29:37.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.878+0000 7fb231b26640 1 -- 172.21.15.67:0/3295146776 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22c0b3820 con 0x7fb22c0b2cc0 2024-04-25T02:29:37.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.878+0000 7fb231b26640 1 --2- 172.21.15.67:0/3295146776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c0b2cc0 0x7fb22c09db30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009d90 tx=0x7fb21c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f0f0fdaefb1db9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.879+0000 7fb22bfff640 1 -- 172.21.15.67:0/3295146776 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c007740 con 0x7fb22c0b2cc0 2024-04-25T02:29:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.879+0000 7fb22bfff640 1 -- 172.21.15.67:0/3295146776 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb21c0078e0 con 0x7fb22c0b2cc0 2024-04-25T02:29:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.879+0000 7fb22bfff640 1 -- 172.21.15.67:0/3295146776 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c007cb0 con 0x7fb22c0b2cc0 2024-04-25T02:29:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.879+0000 7fb233589640 1 -- 172.21.15.67:0/3295146776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c0b2cc0 msgr2=0x7fb22c09db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.879+0000 7fb233589640 1 --2- 172.21.15.67:0/3295146776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c0b2cc0 0x7fb22c09db30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009d90 tx=0x7fb21c02a6f0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.879+0000 7fb233589640 1 -- 172.21.15.67:0/3295146776 shutdown_connections 2024-04-25T02:29:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.879+0000 7fb233589640 1 --2- 172.21.15.67:0/3295146776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c0b2cc0 0x7fb22c09db30 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.879+0000 7fb233589640 1 -- 172.21.15.67:0/3295146776 >> 172.21.15.67:0/3295146776 conn(0x7fb22c0b19c0 msgr2=0x7fb22c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.879+0000 7fb233589640 1 -- 172.21.15.67:0/3295146776 shutdown_connections 2024-04-25T02:29:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.879+0000 7fb233589640 1 -- 172.21.15.67:0/3295146776 wait complete. 2024-04-25T02:29:37.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.880+0000 7fb233589640 1 Processor -- start 2024-04-25T02:29:37.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.880+0000 7fb233589640 1 -- start start 2024-04-25T02:29:37.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.881+0000 7fb233589640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb22c06ec40 0x7fb22c145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:37.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.881+0000 7fb233589640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c0b2cc0 0x7fb22c153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:37.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.881+0000 7fb233589640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb22c15b090 0x7fb22c14e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:37.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.881+0000 7fb233589640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c15b470 con 0x7fb22c0b2cc0 2024-04-25T02:29:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.881+0000 7fb233589640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c0b4f70 con 0x7fb22c06ec40 2024-04-25T02:29:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.881+0000 7fb233589640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb22c070e10 con 0x7fb22c15b090 2024-04-25T02:29:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.881+0000 7fb230b24640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c0b2cc0 0x7fb22c153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.881+0000 7fb230b24640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c0b2cc0 0x7fb22c153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55466/0 (socket says 172.21.15.67:55466) 2024-04-25T02:29:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.881+0000 7fb230b24640 1 -- 172.21.15.67:0/1025383527 learned_addr learned my addr 172.21.15.67:0/1025383527 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.881+0000 7fb231b26640 1 --2- 172.21.15.67:0/1025383527 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb22c15b090 0x7fb22c14e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.881+0000 7fb231325640 1 --2- 172.21.15.67:0/1025383527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb22c06ec40 0x7fb22c145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.881+0000 7fb230b24640 1 -- 172.21.15.67:0/1025383527 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb22c15b090 msgr2=0x7fb22c14e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.881+0000 7fb230b24640 1 --2- 172.21.15.67:0/1025383527 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb22c15b090 0x7fb22c14e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.881+0000 7fb230b24640 1 -- 172.21.15.67:0/1025383527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb22c06ec40 msgr2=0x7fb22c145610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.882+0000 7fb230b24640 1 --2- 172.21.15.67:0/1025383527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb22c06ec40 0x7fb22c145610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.882+0000 7fb230b24640 1 -- 172.21.15.67:0/1025383527 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22c15c0d0 con 0x7fb22c0b2cc0 2024-04-25T02:29:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.882+0000 7fb231325640 1 --2- 172.21.15.67:0/1025383527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb22c06ec40 0x7fb22c145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:37.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.882+0000 7fb231b26640 1 --2- 172.21.15.67:0/1025383527 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb22c15b090 0x7fb22c14e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:37.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.882+0000 7fb230b24640 1 --2- 172.21.15.67:0/1025383527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c0b2cc0 0x7fb22c153f20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb22000c4a0 tx=0x7fb22000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:37.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.882+0000 7fb229ffb640 1 -- 172.21.15.67:0/1025383527 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220018070 con 0x7fb22c0b2cc0 2024-04-25T02:29:37.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.882+0000 7fb229ffb640 1 -- 172.21.15.67:0/1025383527 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2200074e0 con 0x7fb22c0b2cc0 2024-04-25T02:29:37.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.882+0000 7fb229ffb640 1 -- 172.21.15.67:0/1025383527 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220004a20 con 0x7fb22c0b2cc0 2024-04-25T02:29:37.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.882+0000 7fb233589640 1 -- 172.21.15.67:0/1025383527 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb22c15c370 con 0x7fb22c0b2cc0 2024-04-25T02:29:37.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.882+0000 7fb233589640 1 -- 172.21.15.67:0/1025383527 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb22c1f1fc0 con 0x7fb22c0b2cc0 2024-04-25T02:29:37.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.883+0000 7fb233589640 1 -- 172.21.15.67:0/1025383527 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb22c154940 con 0x7fb22c0b2cc0 2024-04-25T02:29:37.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.884+0000 7fb229ffb640 1 -- 172.21.15.67:0/1025383527 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fb22001b070 con 0x7fb22c0b2cc0 2024-04-25T02:29:37.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.884+0000 7fb229ffb640 1 --2- 172.21.15.67:0/1025383527 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb21806bfe0 0x7fb21806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:37.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.884+0000 7fb229ffb640 1 -- 172.21.15.67:0/1025383527 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb22008a3e0 con 0x7fb22c0b2cc0 2024-04-25T02:29:37.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.884+0000 7fb231325640 1 --2- 172.21.15.67:0/1025383527 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb21806bfe0 0x7fb21806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:37.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.885+0000 7fb231325640 1 --2- 172.21.15.67:0/1025383527 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb21806bfe0 0x7fb21806e4a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb224007fd0 tx=0x7fb224009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:37.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:37.889+0000 7fb229ffb640 1 -- 172.21.15.67:0/1025383527 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb220058ba0 con 0x7fb22c0b2cc0 2024-04-25T02:29:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.069+0000 7fb233589640 1 -- 172.21.15.67:0/1025383527 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb22c06cdd0 con 0x7fb22c0b2cc0 2024-04-25T02:29:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.069+0000 7fb229ffb640 1 -- 172.21.15.67:0/1025383527 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7fb2200584a0 con 0x7fb22c0b2cc0 2024-04-25T02:29:38.072 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:29:38.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.071+0000 7fb233589640 1 -- 172.21.15.67:0/1025383527 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb21806bfe0 msgr2=0x7fb21806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.071+0000 7fb233589640 1 --2- 172.21.15.67:0/1025383527 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb21806bfe0 0x7fb21806e4a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb224007fd0 tx=0x7fb224009040 comp rx=0 tx=0).stop 2024-04-25T02:29:38.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.071+0000 7fb233589640 1 -- 172.21.15.67:0/1025383527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c0b2cc0 msgr2=0x7fb22c153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.071+0000 7fb233589640 1 --2- 172.21.15.67:0/1025383527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c0b2cc0 0x7fb22c153f20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb22000c4a0 tx=0x7fb22000c960 comp rx=0 tx=0).stop 2024-04-25T02:29:38.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.071+0000 7fb233589640 1 -- 172.21.15.67:0/1025383527 shutdown_connections 2024-04-25T02:29:38.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.071+0000 7fb233589640 1 --2- 172.21.15.67:0/1025383527 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb21806bfe0 0x7fb21806e4a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.071+0000 7fb233589640 1 --2- 172.21.15.67:0/1025383527 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb22c15b090 0x7fb22c14e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.071+0000 7fb233589640 1 --2- 172.21.15.67:0/1025383527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c0b2cc0 0x7fb22c153f20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.071+0000 7fb233589640 1 --2- 172.21.15.67:0/1025383527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb22c06ec40 0x7fb22c145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.071+0000 7fb233589640 1 -- 172.21.15.67:0/1025383527 >> 172.21.15.67:0/1025383527 conn(0x7fb22c0b19c0 msgr2=0x7fb22c0ae030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:38.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.071+0000 7fb233589640 1 -- 172.21.15.67:0/1025383527 shutdown_connections 2024-04-25T02:29:38.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.071+0000 7fb233589640 1 -- 172.21.15.67:0/1025383527 wait complete. 2024-04-25T02:29:38.085 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:29:38.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.186+0000 7ff3603d5640 1 Processor -- start 2024-04-25T02:29:38.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.186+0000 7ff3603d5640 1 -- start start 2024-04-25T02:29:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.187+0000 7ff3603d5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff35806c7e0 0x7ff3580b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.187+0000 7ff3603d5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff35815ec30 con 0x7ff35815e6c0 2024-04-25T02:29:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.187+0000 7ff3603d5640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff35815ef10 con 0x7ff358158750 2024-04-25T02:29:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.187+0000 7ff3603d5640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff35815f1f0 con 0x7ff35806c7e0 2024-04-25T02:29:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.187+0000 7ff35e972640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff35815e6c0 0x7ff3580b3d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57556/0 (socket says 172.21.15.67:57556) 2024-04-25T02:29:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.187+0000 7ff35e972640 1 -- 172.21.15.67:0/4135411625 learned_addr learned my addr 172.21.15.67:0/4135411625 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35d16f640 1 -- 172.21.15.67:0/4135411625 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 429910860 0 0) 0x7ff35815ec30 con 0x7ff35815e6c0 2024-04-25T02:29:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35d16f640 1 -- 172.21.15.67:0/4135411625 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff340003520 con 0x7ff35815e6c0 2024-04-25T02:29:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35d970640 1 --2- 172.21.15.67:0/4135411625 >> v2:172.21.15.176:3300/0 conn(0x7ff35806c7e0 0x7ff3580b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35d16f640 1 -- 172.21.15.67:0/4135411625 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4126574533 0 0) 0x7ff340003520 con 0x7ff35815e6c0 2024-04-25T02:29:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35d16f640 1 -- 172.21.15.67:0/4135411625 >> v2:172.21.15.176:3300/0 conn(0x7ff35806c7e0 msgr2=0x7ff3580b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35d16f640 1 --2- 172.21.15.67:0/4135411625 >> v2:172.21.15.176:3300/0 conn(0x7ff35806c7e0 0x7ff3580b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35d16f640 1 -- 172.21.15.67:0/4135411625 >> v1:172.21.15.176:6789/0 conn(0x7ff358158750 legacy=0x7ff35806c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35d16f640 1 -- 172.21.15.67:0/4135411625 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35815f4d0 con 0x7ff35815e6c0 2024-04-25T02:29:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35d16f640 1 -- 172.21.15.67:0/4135411625 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7ff350001670 con 0x7ff35815e6c0 2024-04-25T02:29:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35d16f640 1 -- 172.21.15.67:0/4135411625 >> v1:172.21.15.67:6789/0 conn(0x7ff35815e6c0 legacy=0x7ff3580b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35d16f640 1 --2- 172.21.15.67:0/4135411625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3400039b0 0x7ff340003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35d16f640 1 --2- 172.21.15.67:0/4135411625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff340004800 0x7ff340004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35d16f640 1 --2- 172.21.15.67:0/4135411625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3400051c0 0x7ff34000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35d16f640 1 -- 172.21.15.67:0/4135411625 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff35815f1f0 con 0x7ff3400051c0 2024-04-25T02:29:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35d16f640 1 -- 172.21.15.67:0/4135411625 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff34000c070 con 0x7ff340004800 2024-04-25T02:29:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35d16f640 1 -- 172.21.15.67:0/4135411625 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff34000c270 con 0x7ff3400039b0 2024-04-25T02:29:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35e972640 1 --2- 172.21.15.67:0/4135411625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3400051c0 0x7ff34000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35e171640 1 --2- 172.21.15.67:0/4135411625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3400039b0 0x7ff340003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35d970640 1 --2- 172.21.15.67:0/4135411625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff340004800 0x7ff340004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35e972640 1 -- 172.21.15.67:0/4135411625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3400039b0 msgr2=0x7ff340003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35e972640 1 --2- 172.21.15.67:0/4135411625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3400039b0 0x7ff340003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35e972640 1 -- 172.21.15.67:0/4135411625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff340004800 msgr2=0x7ff340004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35e972640 1 --2- 172.21.15.67:0/4135411625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff340004800 0x7ff340004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.188+0000 7ff35e972640 1 -- 172.21.15.67:0/4135411625 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff340003520 con 0x7ff3400051c0 2024-04-25T02:29:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.189+0000 7ff35e972640 1 -- 172.21.15.67:0/4135411625 reap_dead start 2024-04-25T02:29:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.189+0000 7ff35e972640 1 --2- 172.21.15.67:0/4135411625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3400051c0 0x7ff34000b9c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff35000c240 tx=0x7ff340005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50e81dce2a8b9db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.189+0000 7ff35d16f640 1 -- 172.21.15.67:0/4135411625 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff350007cf0 con 0x7ff3400051c0 2024-04-25T02:29:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.189+0000 7ff35d16f640 1 -- 172.21.15.67:0/4135411625 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3500058d0 con 0x7ff3400051c0 2024-04-25T02:29:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.189+0000 7ff35d16f640 1 -- 172.21.15.67:0/4135411625 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff350005ce0 con 0x7ff3400051c0 2024-04-25T02:29:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.190+0000 7ff3603d5640 1 -- 172.21.15.67:0/4135411625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3400051c0 msgr2=0x7ff34000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.190+0000 7ff3603d5640 1 --2- 172.21.15.67:0/4135411625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3400051c0 0x7ff34000b9c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff35000c240 tx=0x7ff340005830 comp rx=0 tx=0).stop 2024-04-25T02:29:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.190+0000 7ff3603d5640 1 -- 172.21.15.67:0/4135411625 shutdown_connections 2024-04-25T02:29:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.190+0000 7ff3603d5640 1 --2- 172.21.15.67:0/4135411625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3400051c0 0x7ff34000b9c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.190+0000 7ff3603d5640 1 -- 172.21.15.67:0/4135411625 >> 172.21.15.67:0/4135411625 conn(0x7ff3580715c0 msgr2=0x7ff3580719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:38.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.190+0000 7ff3603d5640 1 -- 172.21.15.67:0/4135411625 shutdown_connections 2024-04-25T02:29:38.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.190+0000 7ff3603d5640 1 -- 172.21.15.67:0/4135411625 wait complete. 2024-04-25T02:29:38.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.191+0000 7ff3603d5640 1 Processor -- start 2024-04-25T02:29:38.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.191+0000 7ff3603d5640 1 -- start start 2024-04-25T02:29:38.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff3603d5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3400051c0 0x7ff358152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff3603d5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff358152850 0x7ff358141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff3603d5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff358141cb0 0x7ff358142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff3603d5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff3580723b0 con 0x7ff3400051c0 2024-04-25T02:29:38.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff3603d5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff358072230 con 0x7ff358141cb0 2024-04-25T02:29:38.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff3603d5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff3580ad8e0 con 0x7ff358152850 2024-04-25T02:29:38.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff35e171640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3400051c0 0x7ff358152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff35e171640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3400051c0 0x7ff358152310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55490/0 (socket says 172.21.15.67:55490) 2024-04-25T02:29:38.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff35e171640 1 -- 172.21.15.67:0/47053416 learned_addr learned my addr 172.21.15.67:0/47053416 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:38.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff35d970640 1 --2- 172.21.15.67:0/47053416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff358152850 0x7ff358141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff35e972640 1 --2- 172.21.15.67:0/47053416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff358141cb0 0x7ff358142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff35e171640 1 -- 172.21.15.67:0/47053416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff358152850 msgr2=0x7ff358141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff35e171640 1 --2- 172.21.15.67:0/47053416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff358152850 0x7ff358141770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff35e171640 1 -- 172.21.15.67:0/47053416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff358141cb0 msgr2=0x7ff358142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff35e171640 1 --2- 172.21.15.67:0/47053416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff358141cb0 0x7ff358142130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff35e171640 1 -- 172.21.15.67:0/47053416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff358152cd0 con 0x7ff3400051c0 2024-04-25T02:29:38.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff35d970640 1 --2- 172.21.15.67:0/47053416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff358152850 0x7ff358141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:38.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff35e972640 1 --2- 172.21.15.67:0/47053416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff358141cb0 0x7ff358142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff35e171640 1 --2- 172.21.15.67:0/47053416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3400051c0 0x7ff358152310 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff34800f990 tx=0x7ff34800fe50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff356ffd640 1 -- 172.21.15.67:0/47053416 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348003b80 con 0x7ff3400051c0 2024-04-25T02:29:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff356ffd640 1 -- 172.21.15.67:0/47053416 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff348018070 con 0x7ff3400051c0 2024-04-25T02:29:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff3603d5640 1 -- 172.21.15.67:0/47053416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff358142670 con 0x7ff3400051c0 2024-04-25T02:29:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff356ffd640 1 -- 172.21.15.67:0/47053416 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34800d7d0 con 0x7ff3400051c0 2024-04-25T02:29:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.192+0000 7ff3603d5640 1 -- 172.21.15.67:0/47053416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff358153240 con 0x7ff3400051c0 2024-04-25T02:29:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.193+0000 7ff3603d5640 1 -- 172.21.15.67:0/47053416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff358068960 con 0x7ff3400051c0 2024-04-25T02:29:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.194+0000 7ff356ffd640 1 -- 172.21.15.67:0/47053416 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7ff34800d970 con 0x7ff3400051c0 2024-04-25T02:29:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.194+0000 7ff356ffd640 1 --2- 172.21.15.67:0/47053416 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff34406bfe0 0x7ff34406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.194+0000 7ff356ffd640 1 -- 172.21.15.67:0/47053416 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff34808b300 con 0x7ff3400051c0 2024-04-25T02:29:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.194+0000 7ff35d970640 1 --2- 172.21.15.67:0/47053416 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff34406bfe0 0x7ff34406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.195+0000 7ff35d970640 1 --2- 172.21.15.67:0/47053416 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff34406bfe0 0x7ff34406e4a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff34c0093d0 tx=0x7ff34c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.199+0000 7ff356ffd640 1 -- 172.21.15.67:0/47053416 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff358068960 con 0x7ff3400051c0 2024-04-25T02:29:38.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.383+0000 7ff3603d5640 1 -- 172.21.15.67:0/47053416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff3580aef90 con 0x7ff3400051c0 2024-04-25T02:29:38.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.383+0000 7ff356ffd640 1 -- 172.21.15.67:0/47053416 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7ff34801a310 con 0x7ff3400051c0 2024-04-25T02:29:38.386 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-25T02:29:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.385+0000 7ff3603d5640 1 -- 172.21.15.67:0/47053416 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff34406bfe0 msgr2=0x7ff34406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.385+0000 7ff3603d5640 1 --2- 172.21.15.67:0/47053416 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff34406bfe0 0x7ff34406e4a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff34c0093d0 tx=0x7ff34c008040 comp rx=0 tx=0).stop 2024-04-25T02:29:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.385+0000 7ff3603d5640 1 -- 172.21.15.67:0/47053416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3400051c0 msgr2=0x7ff358152310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.385+0000 7ff3603d5640 1 --2- 172.21.15.67:0/47053416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3400051c0 0x7ff358152310 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff34800f990 tx=0x7ff34800fe50 comp rx=0 tx=0).stop 2024-04-25T02:29:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.385+0000 7ff3603d5640 1 -- 172.21.15.67:0/47053416 shutdown_connections 2024-04-25T02:29:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.385+0000 7ff3603d5640 1 --2- 172.21.15.67:0/47053416 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff34406bfe0 0x7ff34406e4a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.385+0000 7ff3603d5640 1 --2- 172.21.15.67:0/47053416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff358141cb0 0x7ff358142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.385+0000 7ff3603d5640 1 --2- 172.21.15.67:0/47053416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff358152850 0x7ff358141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.385+0000 7ff3603d5640 1 --2- 172.21.15.67:0/47053416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3400051c0 0x7ff358152310 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.385+0000 7ff3603d5640 1 -- 172.21.15.67:0/47053416 >> 172.21.15.67:0/47053416 conn(0x7ff3580715c0 msgr2=0x7ff3580b4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.385+0000 7ff3603d5640 1 -- 172.21.15.67:0/47053416 shutdown_connections 2024-04-25T02:29:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.385+0000 7ff3603d5640 1 -- 172.21.15.67:0/47053416 wait complete. 2024-04-25T02:29:38.399 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:29:38.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.500+0000 7ff0a1322640 1 Processor -- start 2024-04-25T02:29:38.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.500+0000 7ff0a1322640 1 -- start start 2024-04-25T02:29:38.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.501+0000 7ff0a1322640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff09c15e760 0x7ff09c0cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.501+0000 7ff0a1322640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c0cff80 con 0x7ff09c0d1470 2024-04-25T02:29:38.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.501+0000 7ff0a1322640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c0d2250 con 0x7ff09c0d0900 2024-04-25T02:29:38.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.501+0000 7ff0a1322640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff09c0d28a0 con 0x7ff09c15e760 2024-04-25T02:29:38.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.501+0000 7ff09affd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff09c15e760 0x7ff09c0cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.501+0000 7ff09b7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff09c0d1470 0x7ff09c06bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57562/0 (socket says 172.21.15.67:57562) 2024-04-25T02:29:38.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.502+0000 7ff09b7fe640 1 -- 172.21.15.67:0/2821544722 learned_addr learned my addr 172.21.15.67:0/2821544722 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:38.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.502+0000 7ff09affd640 1 -- 172.21.15.67:0/2821544722 >> v1:172.21.15.176:6789/0 conn(0x7ff09c0d0900 legacy=0x7ff09c0d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:38.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.502+0000 7ff09affd640 1 -- 172.21.15.67:0/2821544722 >> v1:172.21.15.67:6789/0 conn(0x7ff09c0d1470 legacy=0x7ff09c06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.502+0000 7ff099ffb640 1 -- 172.21.15.67:0/2821544722 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2832885466 0 0) 0x7ff09c0cff80 con 0x7ff09c0d1470 2024-04-25T02:29:38.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.502+0000 7ff09affd640 1 -- 172.21.15.67:0/2821544722 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c0d2530 con 0x7ff09c15e760 2024-04-25T02:29:38.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.502+0000 7ff09affd640 1 --2- 172.21.15.67:0/2821544722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff09c15e760 0x7ff09c0cf8f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff0940097a0 tx=0x7ff09402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3c9e8b4caa082d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:38.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.503+0000 7ff099ffb640 1 -- 172.21.15.67:0/2821544722 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff094037070 con 0x7ff09c15e760 2024-04-25T02:29:38.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.503+0000 7ff099ffb640 1 -- 172.21.15.67:0/2821544722 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff094032440 con 0x7ff09c15e760 2024-04-25T02:29:38.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.503+0000 7ff099ffb640 1 -- 172.21.15.67:0/2821544722 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff094032810 con 0x7ff09c15e760 2024-04-25T02:29:38.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.503+0000 7ff0a1322640 1 -- 172.21.15.67:0/2821544722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff09c15e760 msgr2=0x7ff09c0cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.503+0000 7ff0a1322640 1 --2- 172.21.15.67:0/2821544722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff09c15e760 0x7ff09c0cf8f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff0940097a0 tx=0x7ff09402a1e0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.503+0000 7ff0a1322640 1 -- 172.21.15.67:0/2821544722 shutdown_connections 2024-04-25T02:29:38.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.503+0000 7ff0a1322640 1 --2- 172.21.15.67:0/2821544722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff09c15e760 0x7ff09c0cf8f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.503+0000 7ff0a1322640 1 -- 172.21.15.67:0/2821544722 >> 172.21.15.67:0/2821544722 conn(0x7ff09c0d41b0 msgr2=0x7ff09c0d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:38.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.503+0000 7ff0a1322640 1 -- 172.21.15.67:0/2821544722 shutdown_connections 2024-04-25T02:29:38.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.503+0000 7ff0a1322640 1 -- 172.21.15.67:0/2821544722 wait complete. 2024-04-25T02:29:38.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.505+0000 7ff0a1322640 1 Processor -- start 2024-04-25T02:29:38.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.505+0000 7ff0a1322640 1 -- start start 2024-04-25T02:29:38.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.505+0000 7ff0a1322640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff09c0d0900 0x7ff09c14e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.505+0000 7ff0a1322640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff09c0d1470 0x7ff09c1f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.505+0000 7ff0a1322640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff09c15e760 0x7ff09c0c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.505+0000 7ff0a1322640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c15eb40 con 0x7ff09c0d0900 2024-04-25T02:29:38.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.505+0000 7ff0a1322640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c0d3d40 con 0x7ff09c0d1470 2024-04-25T02:29:38.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.505+0000 7ff0a1322640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff09c15ecc0 con 0x7ff09c15e760 2024-04-25T02:29:38.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.505+0000 7ff09affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff09c0d0900 0x7ff09c14e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.505+0000 7ff09affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff09c0d0900 0x7ff09c14e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55508/0 (socket says 172.21.15.67:55508) 2024-04-25T02:29:38.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.505+0000 7ff09affd640 1 -- 172.21.15.67:0/678788829 learned_addr learned my addr 172.21.15.67:0/678788829 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:38.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.506+0000 7ff09b7fe640 1 --2- 172.21.15.67:0/678788829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff09c15e760 0x7ff09c0c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.506+0000 7ff09a7fc640 1 --2- 172.21.15.67:0/678788829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff09c0d1470 0x7ff09c1f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.506+0000 7ff09affd640 1 -- 172.21.15.67:0/678788829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff09c15e760 msgr2=0x7ff09c0c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.506+0000 7ff09affd640 1 --2- 172.21.15.67:0/678788829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff09c15e760 0x7ff09c0c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.506+0000 7ff09affd640 1 -- 172.21.15.67:0/678788829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff09c0d1470 msgr2=0x7ff09c1f7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.506+0000 7ff09affd640 1 --2- 172.21.15.67:0/678788829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff09c0d1470 0x7ff09c1f7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.506+0000 7ff09affd640 1 -- 172.21.15.67:0/678788829 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c14f0e0 con 0x7ff09c0d0900 2024-04-25T02:29:38.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.506+0000 7ff09affd640 1 --2- 172.21.15.67:0/678788829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff09c0d0900 0x7ff09c14e860 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff0940098c0 tx=0x7ff0940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:38.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.506+0000 7ff0837fe640 1 -- 172.21.15.67:0/678788829 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff094041070 con 0x7ff09c0d0900 2024-04-25T02:29:38.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.506+0000 7ff0837fe640 1 -- 172.21.15.67:0/678788829 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff09403c870 con 0x7ff09c0d0900 2024-04-25T02:29:38.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.506+0000 7ff0a1322640 1 -- 172.21.15.67:0/678788829 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09c14f3c0 con 0x7ff09c0d0900 2024-04-25T02:29:38.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.506+0000 7ff0837fe640 1 -- 172.21.15.67:0/678788829 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff094037040 con 0x7ff09c0d0900 2024-04-25T02:29:38.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.506+0000 7ff0a1322640 1 -- 172.21.15.67:0/678788829 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff09c14f980 con 0x7ff09c0d0900 2024-04-25T02:29:38.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.507+0000 7ff0a1322640 1 -- 172.21.15.67:0/678788829 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff09c069110 con 0x7ff09c0d0900 2024-04-25T02:29:38.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.508+0000 7ff0837fe640 1 -- 172.21.15.67:0/678788829 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7ff094044070 con 0x7ff09c0d0900 2024-04-25T02:29:38.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.508+0000 7ff0837fe640 1 --2- 172.21.15.67:0/678788829 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff08806bfe0 0x7ff08806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.508+0000 7ff0837fe640 1 -- 172.21.15.67:0/678788829 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff0940abbe0 con 0x7ff09c0d0900 2024-04-25T02:29:38.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.508+0000 7ff09a7fc640 1 --2- 172.21.15.67:0/678788829 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff08806bfe0 0x7ff08806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.509+0000 7ff09a7fc640 1 --2- 172.21.15.67:0/678788829 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff08806bfe0 0x7ff08806e4a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0b8780 tx=0x7ff090007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:38.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.512+0000 7ff0837fe640 1 -- 172.21.15.67:0/678788829 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff094079e00 con 0x7ff09c0d0900 2024-04-25T02:29:38.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.696+0000 7ff0a1322640 1 -- 172.21.15.67:0/678788829 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff09c0b14b0 con 0x7ff09c0d0900 2024-04-25T02:29:38.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.696+0000 7ff0837fe640 1 -- 172.21.15.67:0/678788829 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7ff09407e100 con 0x7ff09c0d0900 2024-04-25T02:29:38.700 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-25T02:29:38.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.698+0000 7ff0a1322640 1 -- 172.21.15.67:0/678788829 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff08806bfe0 msgr2=0x7ff08806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.698+0000 7ff0a1322640 1 --2- 172.21.15.67:0/678788829 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff08806bfe0 0x7ff08806e4a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0b8780 tx=0x7ff090007e30 comp rx=0 tx=0).stop 2024-04-25T02:29:38.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.698+0000 7ff0a1322640 1 -- 172.21.15.67:0/678788829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff09c0d0900 msgr2=0x7ff09c14e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.698+0000 7ff0a1322640 1 --2- 172.21.15.67:0/678788829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff09c0d0900 0x7ff09c14e860 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff0940098c0 tx=0x7ff0940046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.698+0000 7ff0a1322640 1 -- 172.21.15.67:0/678788829 shutdown_connections 2024-04-25T02:29:38.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.698+0000 7ff0a1322640 1 --2- 172.21.15.67:0/678788829 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff08806bfe0 0x7ff08806e4a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.698+0000 7ff0a1322640 1 --2- 172.21.15.67:0/678788829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff09c15e760 0x7ff09c0c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.698+0000 7ff0a1322640 1 --2- 172.21.15.67:0/678788829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff09c0d1470 0x7ff09c1f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.698+0000 7ff0a1322640 1 --2- 172.21.15.67:0/678788829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff09c0d0900 0x7ff09c14e860 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.698+0000 7ff0a1322640 1 -- 172.21.15.67:0/678788829 >> 172.21.15.67:0/678788829 conn(0x7ff09c0d41b0 msgr2=0x7ff09c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:38.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.699+0000 7ff0a1322640 1 -- 172.21.15.67:0/678788829 shutdown_connections 2024-04-25T02:29:38.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.699+0000 7ff0a1322640 1 -- 172.21.15.67:0/678788829 wait complete. 2024-04-25T02:29:38.712 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:29:38.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.811+0000 7fe28b8d2640 1 Processor -- start 2024-04-25T02:29:38.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.811+0000 7fe28b8d2640 1 -- start start 2024-04-25T02:29:38.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.812+0000 7fe28b8d2640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe28415e630 0x7fe2840b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.812+0000 7fe28b8d2640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe28409b180 0x7fe2840cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.812+0000 7fe28b8d2640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2840b49e0 con 0x7fe2840b3020 2024-04-25T02:29:38.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.812+0000 7fe28b8d2640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe28406ca00 con 0x7fe28409b180 2024-04-25T02:29:38.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.812+0000 7fe28b8d2640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe2840d0a10 con 0x7fe28415e630 2024-04-25T02:29:38.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.812+0000 7fe289e6f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe28409b180 0x7fe2840cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.812+0000 7fe288e6d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe2840b3020 0x7fe28409aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57572/0 (socket says 172.21.15.67:57572) 2024-04-25T02:29:38.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.812+0000 7fe288e6d640 1 -- 172.21.15.67:0/678254517 learned_addr learned my addr 172.21.15.67:0/678254517 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:38.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.812+0000 7fe28966e640 1 --2- 172.21.15.67:0/678254517 >> v2:172.21.15.176:3300/0 conn(0x7fe28415e630 0x7fe2840b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.812+0000 7fe289e6f640 1 -- 172.21.15.67:0/678254517 >> v2:172.21.15.176:3300/0 conn(0x7fe28415e630 msgr2=0x7fe2840b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:38.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.812+0000 7fe289e6f640 1 --2- 172.21.15.67:0/678254517 >> v2:172.21.15.176:3300/0 conn(0x7fe28415e630 0x7fe2840b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.812+0000 7fe289e6f640 1 -- 172.21.15.67:0/678254517 >> v1:172.21.15.67:6789/0 conn(0x7fe2840b3020 legacy=0x7fe28409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.812+0000 7fe27bfff640 1 -- 172.21.15.67:0/678254517 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1393242060 0 0) 0x7fe2840b49e0 con 0x7fe2840b3020 2024-04-25T02:29:38.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.812+0000 7fe289e6f640 1 -- 172.21.15.67:0/678254517 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2840d0cf0 con 0x7fe28409b180 2024-04-25T02:29:38.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.813+0000 7fe289e6f640 1 --2- 172.21.15.67:0/678254517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe28409b180 0x7fe2840cc620 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe28406ea00 tx=0x7fe27c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fa74a5121679c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:38.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.813+0000 7fe27bfff640 1 -- 172.21.15.67:0/678254517 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c007740 con 0x7fe28409b180 2024-04-25T02:29:38.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.813+0000 7fe27bfff640 1 -- 172.21.15.67:0/678254517 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe27c0078e0 con 0x7fe28409b180 2024-04-25T02:29:38.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.813+0000 7fe27bfff640 1 -- 172.21.15.67:0/678254517 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c007cb0 con 0x7fe28409b180 2024-04-25T02:29:38.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.814+0000 7fe28b8d2640 1 -- 172.21.15.67:0/678254517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe28409b180 msgr2=0x7fe2840cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.814+0000 7fe28b8d2640 1 --2- 172.21.15.67:0/678254517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe28409b180 0x7fe2840cc620 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe28406ea00 tx=0x7fe27c02a5f0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.814+0000 7fe28b8d2640 1 -- 172.21.15.67:0/678254517 shutdown_connections 2024-04-25T02:29:38.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.814+0000 7fe28b8d2640 1 --2- 172.21.15.67:0/678254517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe28409b180 0x7fe2840cc620 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.814+0000 7fe28b8d2640 1 --2- 172.21.15.67:0/678254517 >> v2:172.21.15.176:3300/0 conn(0x7fe28415e630 0x7fe2840b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.814+0000 7fe28b8d2640 1 -- 172.21.15.67:0/678254517 >> 172.21.15.67:0/678254517 conn(0x7fe2840b3ae0 msgr2=0x7fe2840b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:38.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.814+0000 7fe28b8d2640 1 -- 172.21.15.67:0/678254517 shutdown_connections 2024-04-25T02:29:38.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.814+0000 7fe28b8d2640 1 -- 172.21.15.67:0/678254517 wait complete. 2024-04-25T02:29:38.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.815+0000 7fe28b8d2640 1 Processor -- start 2024-04-25T02:29:38.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.815+0000 7fe28b8d2640 1 -- start start 2024-04-25T02:29:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe28b8d2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe28409b180 0x7fe2840cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe28b8d2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2840b3020 0x7fe284145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe28b8d2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe28415e630 0x7fe2841f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe28b8d2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe2840d1150 con 0x7fe28409b180 2024-04-25T02:29:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe28b8d2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe2840d0fd0 con 0x7fe28415e630 2024-04-25T02:29:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe28b8d2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe28415ea10 con 0x7fe2840b3020 2024-04-25T02:29:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe28966e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe28409b180 0x7fe2840cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe28966e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe28409b180 0x7fe2840cb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55528/0 (socket says 172.21.15.67:55528) 2024-04-25T02:29:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe28966e640 1 -- 172.21.15.67:0/1332683216 learned_addr learned my addr 172.21.15.67:0/1332683216 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe288e6d640 1 --2- 172.21.15.67:0/1332683216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2840b3020 0x7fe284145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe289e6f640 1 --2- 172.21.15.67:0/1332683216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe28415e630 0x7fe2841f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe28966e640 1 -- 172.21.15.67:0/1332683216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2840b3020 msgr2=0x7fe284145cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe28966e640 1 --2- 172.21.15.67:0/1332683216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2840b3020 0x7fe284145cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe28966e640 1 -- 172.21.15.67:0/1332683216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe28415e630 msgr2=0x7fe2841f72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:38.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe28966e640 1 --2- 172.21.15.67:0/1332683216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe28415e630 0x7fe2841f72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:38.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe28966e640 1 -- 172.21.15.67:0/1332683216 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2840c9720 con 0x7fe28409b180 2024-04-25T02:29:38.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe288e6d640 1 --2- 172.21.15.67:0/1332683216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2840b3020 0x7fe284145cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:38.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe28966e640 1 --2- 172.21.15.67:0/1332683216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe28409b180 0x7fe2840cb910 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe28000d5f0 tx=0x7fe28000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:38.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.816+0000 7fe279ffb640 1 -- 172.21.15.67:0/1332683216 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2800125f0 con 0x7fe28409b180 2024-04-25T02:29:38.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.817+0000 7fe279ffb640 1 -- 172.21.15.67:0/1332683216 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe280019070 con 0x7fe28409b180 2024-04-25T02:29:38.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.817+0000 7fe28b8d2640 1 -- 172.21.15.67:0/1332683216 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2840cbe50 con 0x7fe28409b180 2024-04-25T02:29:38.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.817+0000 7fe279ffb640 1 -- 172.21.15.67:0/1332683216 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2800129d0 con 0x7fe28409b180 2024-04-25T02:29:38.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.817+0000 7fe28b8d2640 1 -- 172.21.15.67:0/1332683216 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2840c9440 con 0x7fe28409b180 2024-04-25T02:29:38.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.818+0000 7fe28b8d2640 1 -- 172.21.15.67:0/1332683216 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe284069110 con 0x7fe28409b180 2024-04-25T02:29:38.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.818+0000 7fe279ffb640 1 -- 172.21.15.67:0/1332683216 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fe280012b70 con 0x7fe28409b180 2024-04-25T02:29:38.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.819+0000 7fe279ffb640 1 --2- 172.21.15.67:0/1332683216 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe26806bfe0 0x7fe26806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:38.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.819+0000 7fe279ffb640 1 -- 172.21.15.67:0/1332683216 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe28008b580 con 0x7fe28409b180 2024-04-25T02:29:38.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.819+0000 7fe288e6d640 1 --2- 172.21.15.67:0/1332683216 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe26806bfe0 0x7fe26806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:38.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.819+0000 7fe288e6d640 1 --2- 172.21.15.67:0/1332683216 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe26806bfe0 0x7fe26806e4a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe2840b4140 tx=0x7fe274009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:38.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:38.823+0000 7fe279ffb640 1 -- 172.21.15.67:0/1332683216 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe280059cb0 con 0x7fe28409b180 2024-04-25T02:29:39.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.021+0000 7fe28b8d2640 1 -- 172.21.15.67:0/1332683216 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe2840cc2e0 con 0x7fe28409b180 2024-04-25T02:29:39.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.022+0000 7fe279ffb640 1 -- 172.21.15.67:0/1332683216 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7fe2800595b0 con 0x7fe28409b180 2024-04-25T02:29:39.025 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-04-25T02:29:39.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.024+0000 7fe28b8d2640 1 -- 172.21.15.67:0/1332683216 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe26806bfe0 msgr2=0x7fe26806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:39.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.024+0000 7fe28b8d2640 1 --2- 172.21.15.67:0/1332683216 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe26806bfe0 0x7fe26806e4a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe2840b4140 tx=0x7fe274009040 comp rx=0 tx=0).stop 2024-04-25T02:29:39.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.024+0000 7fe28b8d2640 1 -- 172.21.15.67:0/1332683216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe28409b180 msgr2=0x7fe2840cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:39.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.024+0000 7fe28b8d2640 1 --2- 172.21.15.67:0/1332683216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe28409b180 0x7fe2840cb910 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe28000d5f0 tx=0x7fe28000dab0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.024+0000 7fe28b8d2640 1 -- 172.21.15.67:0/1332683216 shutdown_connections 2024-04-25T02:29:39.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.024+0000 7fe28b8d2640 1 --2- 172.21.15.67:0/1332683216 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe26806bfe0 0x7fe26806e4a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.024+0000 7fe28b8d2640 1 --2- 172.21.15.67:0/1332683216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe28415e630 0x7fe2841f72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.024+0000 7fe28b8d2640 1 --2- 172.21.15.67:0/1332683216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2840b3020 0x7fe284145cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.024+0000 7fe28b8d2640 1 --2- 172.21.15.67:0/1332683216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe28409b180 0x7fe2840cb910 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.024+0000 7fe28b8d2640 1 -- 172.21.15.67:0/1332683216 >> 172.21.15.67:0/1332683216 conn(0x7fe2840b3ae0 msgr2=0x7fe28409aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:39.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.024+0000 7fe28b8d2640 1 -- 172.21.15.67:0/1332683216 shutdown_connections 2024-04-25T02:29:39.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.024+0000 7fe28b8d2640 1 -- 172.21.15.67:0/1332683216 wait complete. 2024-04-25T02:29:39.037 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:29:39.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:39.038 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:29:39.065 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-04-25T02:29:39.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:39.065 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:29:39.121 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:29:39.122 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:29:39.122 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:29:39.140 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:29:39.141 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:29:39.199 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:29:39.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.296+0000 7f34b9bf9640 1 Processor -- start 2024-04-25T02:29:39.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.296+0000 7f34b9bf9640 1 -- start start 2024-04-25T02:29:39.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b9bf9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34b4070df0 0x7f34b415f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b9bf9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f34b40b2cc0 0x7f34b40b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b9bf9640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b40713d0 con 0x7f34b415b220 2024-04-25T02:29:39.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b9bf9640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f34b40aee00 con 0x7f34b40b2cc0 2024-04-25T02:29:39.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b9bf9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f34b40ae4d0 con 0x7f34b4070df0 2024-04-25T02:29:39.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b37fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f34b415b220 0x7f34b415ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57574/0 (socket says 172.21.15.67:57574) 2024-04-25T02:29:39.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b37fe640 1 -- 172.21.15.67:0/2487840789 learned_addr learned my addr 172.21.15.67:0/2487840789 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:39.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b27fc640 1 -- 172.21.15.67:0/2487840789 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 924062065 0 0) 0x7f34b40713d0 con 0x7f34b415b220 2024-04-25T02:29:39.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b27fc640 1 -- 172.21.15.67:0/2487840789 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f349c003520 con 0x7f34b415b220 2024-04-25T02:29:39.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b2ffd640 1 --2- 172.21.15.67:0/2487840789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34b4070df0 0x7f34b415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b3fff640 1 --2- 172.21.15.67:0/2487840789 >> v2:172.21.15.176:3300/0 conn(0x7f34b40b2cc0 0x7f34b40b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b27fc640 1 -- 172.21.15.67:0/2487840789 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 561740468 0 0) 0x7f349c003520 con 0x7f34b415b220 2024-04-25T02:29:39.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b27fc640 1 -- 172.21.15.67:0/2487840789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34b4070df0 msgr2=0x7f34b415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:39.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b27fc640 1 --2- 172.21.15.67:0/2487840789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34b4070df0 0x7f34b415f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b27fc640 1 -- 172.21.15.67:0/2487840789 >> v2:172.21.15.176:3300/0 conn(0x7f34b40b2cc0 msgr2=0x7f34b40b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:39.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b27fc640 1 --2- 172.21.15.67:0/2487840789 >> v2:172.21.15.176:3300/0 conn(0x7f34b40b2cc0 0x7f34b40b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b27fc640 1 -- 172.21.15.67:0/2487840789 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b40ae7b0 con 0x7f34b415b220 2024-04-25T02:29:39.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b27fc640 1 -- 172.21.15.67:0/2487840789 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f34a4001670 con 0x7f34b415b220 2024-04-25T02:29:39.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.297+0000 7f34b27fc640 1 -- 172.21.15.67:0/2487840789 >> v1:172.21.15.67:6789/0 conn(0x7f34b415b220 legacy=0x7f34b415ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:39.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.298+0000 7f34b27fc640 1 --2- 172.21.15.67:0/2487840789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f349c0039b0 0x7f349c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.298+0000 7f34b27fc640 1 --2- 172.21.15.67:0/2487840789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f349c004800 0x7f349c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.298+0000 7f34b27fc640 1 --2- 172.21.15.67:0/2487840789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34b4070df0 0x7f349c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.298+0000 7f34b27fc640 1 -- 172.21.15.67:0/2487840789 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f34b40aee00 con 0x7f349c004800 2024-04-25T02:29:39.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.298+0000 7f34b27fc640 1 -- 172.21.15.67:0/2487840789 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f34b40ae4d0 con 0x7f349c0039b0 2024-04-25T02:29:39.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.298+0000 7f34b27fc640 1 -- 172.21.15.67:0/2487840789 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f349c00ba10 con 0x7f34b4070df0 2024-04-25T02:29:39.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.298+0000 7f34b2ffd640 1 --2- 172.21.15.67:0/2487840789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f349c004800 0x7f349c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.298+0000 7f34b3fff640 1 --2- 172.21.15.67:0/2487840789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34b4070df0 0x7f349c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.298+0000 7f34b37fe640 1 --2- 172.21.15.67:0/2487840789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f349c0039b0 0x7f349c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.298+0000 7f34b2ffd640 1 -- 172.21.15.67:0/2487840789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34b4070df0 msgr2=0x7f349c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:39.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.298+0000 7f34b2ffd640 1 --2- 172.21.15.67:0/2487840789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34b4070df0 0x7f349c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.298+0000 7f34b2ffd640 1 -- 172.21.15.67:0/2487840789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f349c0039b0 msgr2=0x7f349c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:39.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.298+0000 7f34b2ffd640 1 --2- 172.21.15.67:0/2487840789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f349c0039b0 0x7f349c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.298+0000 7f34b2ffd640 1 -- 172.21.15.67:0/2487840789 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349c003520 con 0x7f349c004800 2024-04-25T02:29:39.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.299+0000 7f34b2ffd640 1 --2- 172.21.15.67:0/2487840789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f349c004800 0x7f349c004c80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009ac0 tx=0x7f349c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762a21a9b76b463 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:39.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.299+0000 7f34b27fc640 1 -- 172.21.15.67:0/2487840789 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a8036070 con 0x7f349c004800 2024-04-25T02:29:39.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.299+0000 7f34b27fc640 1 -- 172.21.15.67:0/2487840789 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34a8031400 con 0x7f349c004800 2024-04-25T02:29:39.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.299+0000 7f34b27fc640 1 -- 172.21.15.67:0/2487840789 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a8009690 con 0x7f349c004800 2024-04-25T02:29:39.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.299+0000 7f34b9bf9640 1 -- 172.21.15.67:0/2487840789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f349c004800 msgr2=0x7f349c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:39.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.299+0000 7f34b9bf9640 1 --2- 172.21.15.67:0/2487840789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f349c004800 0x7f349c004c80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009ac0 tx=0x7f349c005830 comp rx=0 tx=0).stop 2024-04-25T02:29:39.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.299+0000 7f34b3fff640 1 -- 172.21.15.67:0/2487840789 reap_dead start 2024-04-25T02:29:39.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.299+0000 7f34b9bf9640 1 -- 172.21.15.67:0/2487840789 shutdown_connections 2024-04-25T02:29:39.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.299+0000 7f34b9bf9640 1 -- 172.21.15.67:0/2487840789 >> 172.21.15.67:0/2487840789 conn(0x7f34b40b19c0 msgr2=0x7f34b40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:39.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.299+0000 7f34b9bf9640 1 -- 172.21.15.67:0/2487840789 shutdown_connections 2024-04-25T02:29:39.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.299+0000 7f34b9bf9640 1 -- 172.21.15.67:0/2487840789 wait complete. 2024-04-25T02:29:39.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.301+0000 7f34b9bf9640 1 Processor -- start 2024-04-25T02:29:39.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.301+0000 7f34b9bf9640 1 -- start start 2024-04-25T02:29:39.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b9bf9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f349c004800 0x7f34b414eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b9bf9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34b415c010 0x7f34b409aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b9bf9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34b409afb0 0x7f34b40afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b9bf9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f34b406ed10 con 0x7f34b409afb0 2024-04-25T02:29:39.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b9bf9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f34b406eb90 con 0x7f349c004800 2024-04-25T02:29:39.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b9bf9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f34b415f380 con 0x7f34b415c010 2024-04-25T02:29:39.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34b409afb0 0x7f34b40afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34b409afb0 0x7f34b40afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55550/0 (socket says 172.21.15.67:55550) 2024-04-25T02:29:39.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b3fff640 1 -- 172.21.15.67:0/4069491967 learned_addr learned my addr 172.21.15.67:0/4069491967 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:39.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b2ffd640 1 --2- 172.21.15.67:0/4069491967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34b415c010 0x7f34b409aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b37fe640 1 --2- 172.21.15.67:0/4069491967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f349c004800 0x7f34b414eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b3fff640 1 -- 172.21.15.67:0/4069491967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34b415c010 msgr2=0x7f34b409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:39.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b3fff640 1 --2- 172.21.15.67:0/4069491967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34b415c010 0x7f34b409aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b3fff640 1 -- 172.21.15.67:0/4069491967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f349c004800 msgr2=0x7f34b414eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:39.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b3fff640 1 --2- 172.21.15.67:0/4069491967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f349c004800 0x7f34b414eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b3fff640 1 -- 172.21.15.67:0/4069491967 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b415c9f0 con 0x7f34b409afb0 2024-04-25T02:29:39.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b2ffd640 1 --2- 172.21.15.67:0/4069491967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34b415c010 0x7f34b409aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:39.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b37fe640 1 --2- 172.21.15.67:0/4069491967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f349c004800 0x7f34b414eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:39.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b3fff640 1 --2- 172.21.15.67:0/4069491967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34b409afb0 0x7f34b40afc10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f34b40ad690 tx=0x7f34ac007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:39.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f349bfff640 1 -- 172.21.15.67:0/4069491967 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac0046a0 con 0x7f34b409afb0 2024-04-25T02:29:39.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f349bfff640 1 -- 172.21.15.67:0/4069491967 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ac01a070 con 0x7f34b409afb0 2024-04-25T02:29:39.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b9bf9640 1 -- 172.21.15.67:0/4069491967 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b4150390 con 0x7f34b409afb0 2024-04-25T02:29:39.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f349bfff640 1 -- 172.21.15.67:0/4069491967 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac015660 con 0x7f34b409afb0 2024-04-25T02:29:39.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.302+0000 7f34b9bf9640 1 -- 172.21.15.67:0/4069491967 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b4150950 con 0x7f34b409afb0 2024-04-25T02:29:39.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.303+0000 7f34b9bf9640 1 -- 172.21.15.67:0/4069491967 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b4069110 con 0x7f34b409afb0 2024-04-25T02:29:39.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.304+0000 7f349bfff640 1 -- 172.21.15.67:0/4069491967 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f34ac015800 con 0x7f34b409afb0 2024-04-25T02:29:39.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.304+0000 7f349bfff640 1 --2- 172.21.15.67:0/4069491967 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f34a006bfe0 0x7f34a006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.304+0000 7f349bfff640 1 -- 172.21.15.67:0/4069491967 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f34ac08b890 con 0x7f34b409afb0 2024-04-25T02:29:39.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.305+0000 7f34b37fe640 1 --2- 172.21.15.67:0/4069491967 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f34a006bfe0 0x7f34a006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.305+0000 7f34b37fe640 1 --2- 172.21.15.67:0/4069491967 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f34a006bfe0 0x7f34a006e4a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f34a4000fb0 tx=0x7f34a4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:39.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.309+0000 7f349bfff640 1 -- 172.21.15.67:0/4069491967 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f34ac024020 con 0x7f34b409afb0 2024-04-25T02:29:39.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.500+0000 7f34b9bf9640 1 -- 172.21.15.67:0/4069491967 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f34b406e610 con 0x7f34b409afb0 2024-04-25T02:29:39.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.501+0000 7f349bfff640 1 -- 172.21.15.67:0/4069491967 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16645 (secure 0 0 0) 0x7f34ac05a050 con 0x7f34b409afb0 2024-04-25T02:29:39.504 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:39.504 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":33,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:29:19.335566+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:29:16.301169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T02:29:16.663379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:29:39.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.503+0000 7f34b9bf9640 1 -- 172.21.15.67:0/4069491967 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f34a006bfe0 msgr2=0x7f34a006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:39.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.503+0000 7f34b9bf9640 1 --2- 172.21.15.67:0/4069491967 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f34a006bfe0 0x7f34a006e4a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f34a4000fb0 tx=0x7f34a4009040 comp rx=0 tx=0).stop 2024-04-25T02:29:39.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.503+0000 7f34b9bf9640 1 -- 172.21.15.67:0/4069491967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34b409afb0 msgr2=0x7f34b40afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:39.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.503+0000 7f34b9bf9640 1 --2- 172.21.15.67:0/4069491967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34b409afb0 0x7f34b40afc10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f34b40ad690 tx=0x7f34ac007700 comp rx=0 tx=0).stop 2024-04-25T02:29:39.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.503+0000 7f34b9bf9640 1 -- 172.21.15.67:0/4069491967 shutdown_connections 2024-04-25T02:29:39.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.503+0000 7f34b9bf9640 1 --2- 172.21.15.67:0/4069491967 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f34a006bfe0 0x7f34a006e4a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.503+0000 7f34b9bf9640 1 --2- 172.21.15.67:0/4069491967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34b409afb0 0x7f34b40afc10 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.503+0000 7f34b9bf9640 1 --2- 172.21.15.67:0/4069491967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34b415c010 0x7f34b409aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.503+0000 7f34b9bf9640 1 --2- 172.21.15.67:0/4069491967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f349c004800 0x7f34b414eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.503+0000 7f34b9bf9640 1 -- 172.21.15.67:0/4069491967 >> 172.21.15.67:0/4069491967 conn(0x7f34b40b19c0 msgr2=0x7f34b40ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:39.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.503+0000 7f34b9bf9640 1 -- 172.21.15.67:0/4069491967 shutdown_connections 2024-04-25T02:29:39.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.503+0000 7f34b9bf9640 1 -- 172.21.15.67:0/4069491967 wait complete. 2024-04-25T02:29:39.517 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:29:16.301169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:29:16.663379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:29:39.518 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:29:39.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.619+0000 7f3e1996a640 1 Processor -- start 2024-04-25T02:29:39.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.619+0000 7f3e1996a640 1 -- start start 2024-04-25T02:29:39.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.620+0000 7f3e1996a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3e1415e760 0x7f3e140cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.620+0000 7f3e1996a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e140cff80 con 0x7f3e140d0900 2024-04-25T02:29:39.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.620+0000 7f3e1996a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e140d2250 con 0x7f3e140d1470 2024-04-25T02:29:39.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.620+0000 7f3e1996a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3e140d28a0 con 0x7f3e1415e760 2024-04-25T02:29:39.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.620+0000 7f3e127fc640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3e140d0900 0x7f3e140d0d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57592/0 (socket says 172.21.15.67:57592) 2024-04-25T02:29:39.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.620+0000 7f3e127fc640 1 -- 172.21.15.67:0/2631529832 learned_addr learned my addr 172.21.15.67:0/2631529832 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:39.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.620+0000 7f3e12ffd640 1 --2- 172.21.15.67:0/2631529832 >> v2:172.21.15.176:3300/0 conn(0x7f3e1415e760 0x7f3e140cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.621+0000 7f3e11ffb640 1 -- 172.21.15.67:0/2631529832 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1897420760 0 0) 0x7f3e140cff80 con 0x7f3e140d0900 2024-04-25T02:29:39.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.621+0000 7f3e11ffb640 1 -- 172.21.15.67:0/2631529832 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e00003520 con 0x7f3e140d0900 2024-04-25T02:29:39.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.621+0000 7f3e12ffd640 1 -- 172.21.15.67:0/2631529832 >> v1:172.21.15.176:6789/0 conn(0x7f3e140d1470 legacy=0x7f3e1406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:39.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.621+0000 7f3e11ffb640 1 -- 172.21.15.67:0/2631529832 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 355009596 0 0) 0x7f3e00003520 con 0x7f3e140d0900 2024-04-25T02:29:39.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.621+0000 7f3e12ffd640 1 -- 172.21.15.67:0/2631529832 >> v1:172.21.15.67:6789/0 conn(0x7f3e140d0900 legacy=0x7f3e140d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:39.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.621+0000 7f3e12ffd640 1 -- 172.21.15.67:0/2631529832 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e140d2530 con 0x7f3e1415e760 2024-04-25T02:29:39.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.622+0000 7f3e12ffd640 1 --2- 172.21.15.67:0/2631529832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e1415e760 0x7f3e140cf8f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0097a0 tx=0x7f3e0c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de44b7046987a948 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:39.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.622+0000 7f3e11ffb640 1 -- 172.21.15.67:0/2631529832 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c037070 con 0x7f3e1415e760 2024-04-25T02:29:39.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.622+0000 7f3e11ffb640 1 -- 172.21.15.67:0/2631529832 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e0c02ac50 con 0x7f3e1415e760 2024-04-25T02:29:39.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.622+0000 7f3e11ffb640 1 -- 172.21.15.67:0/2631529832 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc001670 con 0x7f3e1415e760 2024-04-25T02:29:39.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.622+0000 7f3e1996a640 1 -- 172.21.15.67:0/2631529832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e1415e760 msgr2=0x7f3e140cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:39.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.622+0000 7f3e1996a640 1 --2- 172.21.15.67:0/2631529832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e1415e760 0x7f3e140cf8f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0097a0 tx=0x7f3e0c02a1c0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.622+0000 7f3e1996a640 1 -- 172.21.15.67:0/2631529832 shutdown_connections 2024-04-25T02:29:39.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.622+0000 7f3e1996a640 1 --2- 172.21.15.67:0/2631529832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e1415e760 0x7f3e140cf8f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.622+0000 7f3e1996a640 1 -- 172.21.15.67:0/2631529832 >> 172.21.15.67:0/2631529832 conn(0x7f3e140d41b0 msgr2=0x7f3e140d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:39.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.622+0000 7f3e1996a640 1 -- 172.21.15.67:0/2631529832 shutdown_connections 2024-04-25T02:29:39.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.622+0000 7f3e1996a640 1 -- 172.21.15.67:0/2631529832 wait complete. 2024-04-25T02:29:39.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.624+0000 7f3e1996a640 1 Processor -- start 2024-04-25T02:29:39.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.624+0000 7f3e1996a640 1 -- start start 2024-04-25T02:29:39.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.624+0000 7f3e1996a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e140d0900 0x7f3e14156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.624+0000 7f3e1996a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e140d1470 0x7f3e140b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.624+0000 7f3e1996a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e1415e760 0x7f3e1415a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.624+0000 7f3e1996a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1415eb40 con 0x7f3e140d1470 2024-04-25T02:29:39.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.624+0000 7f3e1996a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3e140d3d40 con 0x7f3e1415e760 2024-04-25T02:29:39.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.624+0000 7f3e1996a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1415ecc0 con 0x7f3e140d0900 2024-04-25T02:29:39.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.625+0000 7f3e127fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e140d1470 0x7f3e140b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.625+0000 7f3e127fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e140d1470 0x7f3e140b7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55560/0 (socket says 172.21.15.67:55560) 2024-04-25T02:29:39.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.625+0000 7f3e127fc640 1 -- 172.21.15.67:0/2234606482 learned_addr learned my addr 172.21.15.67:0/2234606482 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:39.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.625+0000 7f3e12ffd640 1 --2- 172.21.15.67:0/2234606482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e140d0900 0x7f3e14156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.625+0000 7f3e137fe640 1 --2- 172.21.15.67:0/2234606482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e1415e760 0x7f3e1415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.625+0000 7f3e127fc640 1 -- 172.21.15.67:0/2234606482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e140d0900 msgr2=0x7f3e14156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:39.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.625+0000 7f3e127fc640 1 --2- 172.21.15.67:0/2234606482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e140d0900 0x7f3e14156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.625+0000 7f3e127fc640 1 -- 172.21.15.67:0/2234606482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e1415e760 msgr2=0x7f3e1415a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:39.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.625+0000 7f3e127fc640 1 --2- 172.21.15.67:0/2234606482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e1415e760 0x7f3e1415a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.625+0000 7f3e127fc640 1 -- 172.21.15.67:0/2234606482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e14159150 con 0x7f3e140d1470 2024-04-25T02:29:39.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.625+0000 7f3e127fc640 1 --2- 172.21.15.67:0/2234606482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e140d1470 0x7f3e140b7f30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00c750 tx=0x7f3dfc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:39.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.625+0000 7f3e0bfff640 1 -- 172.21.15.67:0/2234606482 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc017070 con 0x7f3e140d1470 2024-04-25T02:29:39.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.625+0000 7f3e0bfff640 1 -- 172.21.15.67:0/2234606482 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dfc005ad0 con 0x7f3e140d1470 2024-04-25T02:29:39.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.625+0000 7f3e1996a640 1 -- 172.21.15.67:0/2234606482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e14156f40 con 0x7f3e140d1470 2024-04-25T02:29:39.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.625+0000 7f3e0bfff640 1 -- 172.21.15.67:0/2234606482 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc007070 con 0x7f3e140d1470 2024-04-25T02:29:39.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.625+0000 7f3e1996a640 1 -- 172.21.15.67:0/2234606482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e141596a0 con 0x7f3e140d1470 2024-04-25T02:29:39.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.626+0000 7f3e1996a640 1 -- 172.21.15.67:0/2234606482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e14069110 con 0x7f3e140d1470 2024-04-25T02:29:39.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.627+0000 7f3e0bfff640 1 -- 172.21.15.67:0/2234606482 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f3dfc01a070 con 0x7f3e140d1470 2024-04-25T02:29:39.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.627+0000 7f3e0bfff640 1 --2- 172.21.15.67:0/2234606482 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3df406bfe0 0x7f3df406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.628+0000 7f3e0bfff640 1 -- 172.21.15.67:0/2234606482 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f3dfc08a4b0 con 0x7f3e140d1470 2024-04-25T02:29:39.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.628+0000 7f3e12ffd640 1 --2- 172.21.15.67:0/2234606482 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3df406bfe0 0x7f3df406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.628+0000 7f3e12ffd640 1 --2- 172.21.15.67:0/2234606482 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3df406bfe0 0x7f3df406e4a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c034000 tx=0x7f3e0c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:39.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.632+0000 7f3e0bfff640 1 -- 172.21.15.67:0/2234606482 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3dfc0586d0 con 0x7f3e140d1470 2024-04-25T02:29:39.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.812+0000 7f3e1996a640 1 -- 172.21.15.67:0/2234606482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3e1415f500 con 0x7f3e140d1470 2024-04-25T02:29:39.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.812+0000 7f3e0bfff640 1 -- 172.21.15.67:0/2234606482 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7f3dfc05c9d0 con 0x7f3e140d1470 2024-04-25T02:29:39.815 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:29:39.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.814+0000 7f3e1996a640 1 -- 172.21.15.67:0/2234606482 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3df406bfe0 msgr2=0x7f3df406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:39.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.814+0000 7f3e1996a640 1 --2- 172.21.15.67:0/2234606482 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3df406bfe0 0x7f3df406e4a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c034000 tx=0x7f3e0c02e000 comp rx=0 tx=0).stop 2024-04-25T02:29:39.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.814+0000 7f3e1996a640 1 -- 172.21.15.67:0/2234606482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e140d1470 msgr2=0x7f3e140b7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:39.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.814+0000 7f3e1996a640 1 --2- 172.21.15.67:0/2234606482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e140d1470 0x7f3e140b7f30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00c750 tx=0x7f3dfc00cc10 comp rx=0 tx=0).stop 2024-04-25T02:29:39.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.814+0000 7f3e1996a640 1 -- 172.21.15.67:0/2234606482 shutdown_connections 2024-04-25T02:29:39.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.814+0000 7f3e1996a640 1 --2- 172.21.15.67:0/2234606482 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3df406bfe0 0x7f3df406e4a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.814+0000 7f3e1996a640 1 --2- 172.21.15.67:0/2234606482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e1415e760 0x7f3e1415a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.814+0000 7f3e1996a640 1 --2- 172.21.15.67:0/2234606482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e140d1470 0x7f3e140b7f30 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.814+0000 7f3e1996a640 1 --2- 172.21.15.67:0/2234606482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e140d0900 0x7f3e14156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.814+0000 7f3e1996a640 1 -- 172.21.15.67:0/2234606482 >> 172.21.15.67:0/2234606482 conn(0x7f3e140d41b0 msgr2=0x7f3e140d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:39.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.814+0000 7f3e1996a640 1 -- 172.21.15.67:0/2234606482 shutdown_connections 2024-04-25T02:29:39.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.814+0000 7f3e1996a640 1 -- 172.21.15.67:0/2234606482 wait complete. 2024-04-25T02:29:39.828 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:29:39.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.929+0000 7ff066fe7640 1 Processor -- start 2024-04-25T02:29:39.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.929+0000 7ff066fe7640 1 -- start start 2024-04-25T02:29:39.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.930+0000 7ff066fe7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff06015b090 0x7ff06009db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.930+0000 7ff066fe7640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff06006ec40 0x7ff0600add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.930+0000 7ff066fe7640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0600ad820 con 0x7ff0600b2cc0 2024-04-25T02:29:39.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.930+0000 7ff066fe7640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff0600b3260 con 0x7ff06006ec40 2024-04-25T02:29:39.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.930+0000 7ff066fe7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff0600b3540 con 0x7ff06015b090 2024-04-25T02:29:39.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.930+0000 7ff065584640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff06006ec40 0x7ff0600add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.930+0000 7ff065584640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff06006ec40 0x7ff0600add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55566/0 (socket says 172.21.15.67:55566) 2024-04-25T02:29:39.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.930+0000 7ff065584640 1 -- 172.21.15.67:0/399662182 learned_addr learned my addr 172.21.15.67:0/399662182 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:39.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.930+0000 7ff064d83640 1 --2- 172.21.15.67:0/399662182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff06015b090 0x7ff06009db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.931+0000 7ff065584640 1 -- 172.21.15.67:0/399662182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff06015b090 msgr2=0x7ff06009db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:39.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.931+0000 7ff065584640 1 --2- 172.21.15.67:0/399662182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff06015b090 0x7ff06009db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.931+0000 7ff065584640 1 -- 172.21.15.67:0/399662182 >> v1:172.21.15.176:6789/0 conn(0x7ff0600b2cc0 legacy=0x7ff06006e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:39.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.931+0000 7ff065584640 1 -- 172.21.15.67:0/399662182 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0600b3820 con 0x7ff06006ec40 2024-04-25T02:29:39.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.931+0000 7ff065584640 1 --2- 172.21.15.67:0/399662182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff06006ec40 0x7ff0600add00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff058009e50 tx=0x7ff05802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35532a98f8d75539 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:39.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.931+0000 7ff05f7fe640 1 -- 172.21.15.67:0/399662182 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058036070 con 0x7ff06006ec40 2024-04-25T02:29:39.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.931+0000 7ff05f7fe640 1 -- 172.21.15.67:0/399662182 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff058031600 con 0x7ff06006ec40 2024-04-25T02:29:39.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.931+0000 7ff05f7fe640 1 -- 172.21.15.67:0/399662182 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0580319d0 con 0x7ff06006ec40 2024-04-25T02:29:39.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.932+0000 7ff066fe7640 1 -- 172.21.15.67:0/399662182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff06006ec40 msgr2=0x7ff0600add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:39.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.932+0000 7ff066fe7640 1 --2- 172.21.15.67:0/399662182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff06006ec40 0x7ff0600add00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff058009e50 tx=0x7ff05802a6c0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.932+0000 7ff066fe7640 1 -- 172.21.15.67:0/399662182 shutdown_connections 2024-04-25T02:29:39.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.932+0000 7ff066fe7640 1 --2- 172.21.15.67:0/399662182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff06006ec40 0x7ff0600add00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.932+0000 7ff066fe7640 1 --2- 172.21.15.67:0/399662182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff06015b090 0x7ff06009db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.932+0000 7ff066fe7640 1 -- 172.21.15.67:0/399662182 >> 172.21.15.67:0/399662182 conn(0x7ff0600b19c0 msgr2=0x7ff0600b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:39.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.932+0000 7ff066fe7640 1 -- 172.21.15.67:0/399662182 shutdown_connections 2024-04-25T02:29:39.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.932+0000 7ff066fe7640 1 -- 172.21.15.67:0/399662182 wait complete. 2024-04-25T02:29:39.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.933+0000 7ff066fe7640 1 Processor -- start 2024-04-25T02:29:39.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.933+0000 7ff066fe7640 1 -- start start 2024-04-25T02:29:39.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.934+0000 7ff066fe7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff06006ec40 0x7ff06014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.934+0000 7ff066fe7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0600b2cc0 0x7ff06014f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.934+0000 7ff066fe7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff06015b090 0x7ff06014ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.934+0000 7ff066fe7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff06015b470 con 0x7ff06006ec40 2024-04-25T02:29:39.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.934+0000 7ff066fe7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff0600b4f70 con 0x7ff0600b2cc0 2024-04-25T02:29:39.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.934+0000 7ff066fe7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff060070e10 con 0x7ff06015b090 2024-04-25T02:29:39.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.934+0000 7ff064d83640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff06006ec40 0x7ff06014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.934+0000 7ff064d83640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff06006ec40 0x7ff06014df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55578/0 (socket says 172.21.15.67:55578) 2024-04-25T02:29:39.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.934+0000 7ff064d83640 1 -- 172.21.15.67:0/93790678 learned_addr learned my addr 172.21.15.67:0/93790678 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:39.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.935+0000 7ff065584640 1 --2- 172.21.15.67:0/93790678 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff06015b090 0x7ff06014ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.935+0000 7ff064d83640 1 -- 172.21.15.67:0/93790678 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff06015b090 msgr2=0x7ff06014ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:39.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.935+0000 7ff064d83640 1 --2- 172.21.15.67:0/93790678 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff06015b090 0x7ff06014ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.935+0000 7ff064d83640 1 -- 172.21.15.67:0/93790678 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0600b2cc0 msgr2=0x7ff06014f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:39.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.935+0000 7ff05ffff640 1 --2- 172.21.15.67:0/93790678 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0600b2cc0 0x7ff06014f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.935+0000 7ff064d83640 1 --2- 172.21.15.67:0/93790678 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0600b2cc0 0x7ff06014f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:39.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.935+0000 7ff064d83640 1 -- 172.21.15.67:0/93790678 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0600b03e0 con 0x7ff06006ec40 2024-04-25T02:29:39.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.935+0000 7ff064d83640 1 --2- 172.21.15.67:0/93790678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff06006ec40 0x7ff06014df60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff05000d5f0 tx=0x7ff05000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:39.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.935+0000 7ff05d7fa640 1 -- 172.21.15.67:0/93790678 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0500125f0 con 0x7ff06006ec40 2024-04-25T02:29:39.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.935+0000 7ff05d7fa640 1 -- 172.21.15.67:0/93790678 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff050019070 con 0x7ff06006ec40 2024-04-25T02:29:39.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.935+0000 7ff066fe7640 1 -- 172.21.15.67:0/93790678 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0600b06c0 con 0x7ff06006ec40 2024-04-25T02:29:39.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.935+0000 7ff05d7fa640 1 -- 172.21.15.67:0/93790678 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0500129d0 con 0x7ff06006ec40 2024-04-25T02:29:39.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.935+0000 7ff066fe7640 1 -- 172.21.15.67:0/93790678 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0600b11a0 con 0x7ff06006ec40 2024-04-25T02:29:39.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.936+0000 7ff066fe7640 1 -- 172.21.15.67:0/93790678 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff060069110 con 0x7ff06006ec40 2024-04-25T02:29:39.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.936+0000 7ff05d7fa640 1 -- 172.21.15.67:0/93790678 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7ff050012b70 con 0x7ff06006ec40 2024-04-25T02:29:39.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.937+0000 7ff05d7fa640 1 --2- 172.21.15.67:0/93790678 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff04c06bfe0 0x7ff04c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:39.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.937+0000 7ff05d7fa640 1 -- 172.21.15.67:0/93790678 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff05008b580 con 0x7ff06006ec40 2024-04-25T02:29:39.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.937+0000 7ff05ffff640 1 --2- 172.21.15.67:0/93790678 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff04c06bfe0 0x7ff04c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:39.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.938+0000 7ff05ffff640 1 --2- 172.21.15.67:0/93790678 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff04c06bfe0 0x7ff04c06e4a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff054003d90 tx=0x7ff054009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:39.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:39.941+0000 7ff05d7fa640 1 -- 172.21.15.67:0/93790678 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff050059cb0 con 0x7ff06006ec40 2024-04-25T02:29:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.122+0000 7ff066fe7640 1 -- 172.21.15.67:0/93790678 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff06006cdd0 con 0x7ff06006ec40 2024-04-25T02:29:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.122+0000 7ff05d7fa640 1 -- 172.21.15.67:0/93790678 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7ff0500595b0 con 0x7ff06006ec40 2024-04-25T02:29:40.125 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-25T02:29:40.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.124+0000 7ff066fe7640 1 -- 172.21.15.67:0/93790678 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff04c06bfe0 msgr2=0x7ff04c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.124+0000 7ff066fe7640 1 --2- 172.21.15.67:0/93790678 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff04c06bfe0 0x7ff04c06e4a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff054003d90 tx=0x7ff054009040 comp rx=0 tx=0).stop 2024-04-25T02:29:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.124+0000 7ff066fe7640 1 -- 172.21.15.67:0/93790678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff06006ec40 msgr2=0x7ff06014df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.124+0000 7ff066fe7640 1 --2- 172.21.15.67:0/93790678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff06006ec40 0x7ff06014df60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff05000d5f0 tx=0x7ff05000dab0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.124+0000 7ff066fe7640 1 -- 172.21.15.67:0/93790678 shutdown_connections 2024-04-25T02:29:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.124+0000 7ff066fe7640 1 --2- 172.21.15.67:0/93790678 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff04c06bfe0 0x7ff04c06e4a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.124+0000 7ff066fe7640 1 --2- 172.21.15.67:0/93790678 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff06015b090 0x7ff06014ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.124+0000 7ff066fe7640 1 --2- 172.21.15.67:0/93790678 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0600b2cc0 0x7ff06014f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.124+0000 7ff066fe7640 1 --2- 172.21.15.67:0/93790678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff06006ec40 0x7ff06014df60 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.124+0000 7ff066fe7640 1 -- 172.21.15.67:0/93790678 >> 172.21.15.67:0/93790678 conn(0x7ff0600b19c0 msgr2=0x7ff06006e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.124+0000 7ff066fe7640 1 -- 172.21.15.67:0/93790678 shutdown_connections 2024-04-25T02:29:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.124+0000 7ff066fe7640 1 -- 172.21.15.67:0/93790678 wait complete. 2024-04-25T02:29:40.138 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:29:40.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.239+0000 7f0b5e14c640 1 Processor -- start 2024-04-25T02:29:40.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.239+0000 7f0b5e14c640 1 -- start start 2024-04-25T02:29:40.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.240+0000 7f0b5e14c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0b5815b090 0x7f0b5809db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.240+0000 7f0b5e14c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b580b2cc0 0x7f0b5806e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.240+0000 7f0b5e14c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0b5806ea70 0x7f0b5815ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.240+0000 7f0b5e14c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0b580ad820 con 0x7f0b5815b090 2024-04-25T02:29:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.240+0000 7f0b5e14c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f0b580b3260 con 0x7f0b5806ea70 2024-04-25T02:29:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.240+0000 7f0b5e14c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0b580b3540 con 0x7f0b580b2cc0 2024-04-25T02:29:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.240+0000 7f0b577fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0b5815b090 0x7f0b5809db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.240+0000 7f0b577fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0b5815b090 0x7f0b5809db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55590/0 (socket says 172.21.15.67:55590) 2024-04-25T02:29:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.240+0000 7f0b577fe640 1 -- 172.21.15.67:0/2950336123 learned_addr learned my addr 172.21.15.67:0/2950336123 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.240+0000 7f0b56ffd640 1 --2- 172.21.15.67:0/2950336123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b580b2cc0 0x7f0b5806e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.240+0000 7f0b57fff640 1 --2- 172.21.15.67:0/2950336123 >> v2:172.21.15.176:3300/0 conn(0x7f0b5806ea70 0x7f0b5815ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.240+0000 7f0b577fe640 1 -- 172.21.15.67:0/2950336123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b580b2cc0 msgr2=0x7f0b5806e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.240+0000 7f0b577fe640 1 --2- 172.21.15.67:0/2950336123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b580b2cc0 0x7f0b5806e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.240+0000 7f0b577fe640 1 -- 172.21.15.67:0/2950336123 >> v2:172.21.15.176:3300/0 conn(0x7f0b5806ea70 msgr2=0x7f0b5815ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.240+0000 7f0b577fe640 1 --2- 172.21.15.67:0/2950336123 >> v2:172.21.15.176:3300/0 conn(0x7f0b5806ea70 0x7f0b5815ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.240+0000 7f0b577fe640 1 -- 172.21.15.67:0/2950336123 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b580b3820 con 0x7f0b5815b090 2024-04-25T02:29:40.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.241+0000 7f0b577fe640 1 --2- 172.21.15.67:0/2950336123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b5815b090 0x7f0b5809db30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0b5815fca0 tx=0x7f0b4802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfd4712bc991a22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:40.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.241+0000 7f0b567fc640 1 -- 172.21.15.67:0/2950336123 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b48036070 con 0x7f0b5815b090 2024-04-25T02:29:40.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.241+0000 7f0b567fc640 1 -- 172.21.15.67:0/2950336123 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b48031600 con 0x7f0b5815b090 2024-04-25T02:29:40.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.241+0000 7f0b567fc640 1 -- 172.21.15.67:0/2950336123 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b480319d0 con 0x7f0b5815b090 2024-04-25T02:29:40.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.242+0000 7f0b5e14c640 1 -- 172.21.15.67:0/2950336123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b5815b090 msgr2=0x7f0b5809db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:40.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.242+0000 7f0b5e14c640 1 --2- 172.21.15.67:0/2950336123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b5815b090 0x7f0b5809db30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0b5815fca0 tx=0x7f0b4802a6a0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.242+0000 7f0b5e14c640 1 -- 172.21.15.67:0/2950336123 shutdown_connections 2024-04-25T02:29:40.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.242+0000 7f0b5e14c640 1 --2- 172.21.15.67:0/2950336123 >> v2:172.21.15.176:3300/0 conn(0x7f0b5806ea70 0x7f0b5815ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.242+0000 7f0b5e14c640 1 --2- 172.21.15.67:0/2950336123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b580b2cc0 0x7f0b5806e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.242+0000 7f0b5e14c640 1 --2- 172.21.15.67:0/2950336123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b5815b090 0x7f0b5809db30 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.242+0000 7f0b5e14c640 1 -- 172.21.15.67:0/2950336123 >> 172.21.15.67:0/2950336123 conn(0x7f0b580b19c0 msgr2=0x7f0b580b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:40.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.242+0000 7f0b5e14c640 1 -- 172.21.15.67:0/2950336123 shutdown_connections 2024-04-25T02:29:40.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.242+0000 7f0b5e14c640 1 -- 172.21.15.67:0/2950336123 wait complete. 2024-04-25T02:29:40.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.243+0000 7f0b5e14c640 1 Processor -- start 2024-04-25T02:29:40.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.243+0000 7f0b5e14c640 1 -- start start 2024-04-25T02:29:40.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.244+0000 7f0b5e14c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b5806ea70 0x7f0b5815cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.244+0000 7f0b5e14c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b580b2cc0 0x7f0b58153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.244+0000 7f0b5e14c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b5815b090 0x7f0b58155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.244+0000 7f0b5e14c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5815b470 con 0x7f0b5815b090 2024-04-25T02:29:40.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.244+0000 7f0b5e14c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0b580b4f70 con 0x7f0b580b2cc0 2024-04-25T02:29:40.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.244+0000 7f0b5e14c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0b58070e10 con 0x7f0b5806ea70 2024-04-25T02:29:40.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.244+0000 7f0b57fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b5815b090 0x7f0b58155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.244+0000 7f0b57fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b5815b090 0x7f0b58155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55592/0 (socket says 172.21.15.67:55592) 2024-04-25T02:29:40.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.244+0000 7f0b57fff640 1 -- 172.21.15.67:0/1103426332 learned_addr learned my addr 172.21.15.67:0/1103426332 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:40.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.244+0000 7f0b56ffd640 1 --2- 172.21.15.67:0/1103426332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b580b2cc0 0x7f0b58153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.244+0000 7f0b57fff640 1 -- 172.21.15.67:0/1103426332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b5806ea70 msgr2=0x7f0b5815cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:40.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.244+0000 7f0b57fff640 1 --2- 172.21.15.67:0/1103426332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b5806ea70 0x7f0b5815cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.244+0000 7f0b57fff640 1 -- 172.21.15.67:0/1103426332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b580b2cc0 msgr2=0x7f0b58153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:40.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.244+0000 7f0b57fff640 1 --2- 172.21.15.67:0/1103426332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b580b2cc0 0x7f0b58153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.244+0000 7f0b57fff640 1 -- 172.21.15.67:0/1103426332 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5815bb70 con 0x7f0b5815b090 2024-04-25T02:29:40.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.245+0000 7f0b57fff640 1 --2- 172.21.15.67:0/1103426332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b5815b090 0x7f0b58155bf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000d5d0 tx=0x7f0b5000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:40.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.245+0000 7f0b4ffff640 1 -- 172.21.15.67:0/1103426332 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50018020 con 0x7f0b5815b090 2024-04-25T02:29:40.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.245+0000 7f0b4ffff640 1 -- 172.21.15.67:0/1103426332 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b50014620 con 0x7f0b5815b090 2024-04-25T02:29:40.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.245+0000 7f0b5e14c640 1 -- 172.21.15.67:0/1103426332 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5815c100 con 0x7f0b5815b090 2024-04-25T02:29:40.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.245+0000 7f0b4ffff640 1 -- 172.21.15.67:0/1103426332 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b500149f0 con 0x7f0b5815b090 2024-04-25T02:29:40.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.245+0000 7f0b5e14c640 1 -- 172.21.15.67:0/1103426332 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b5815c6c0 con 0x7f0b5815b090 2024-04-25T02:29:40.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.246+0000 7f0b5e14c640 1 -- 172.21.15.67:0/1103426332 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b58069110 con 0x7f0b5815b090 2024-04-25T02:29:40.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.246+0000 7f0b4ffff640 1 -- 172.21.15.67:0/1103426332 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f0b5001b020 con 0x7f0b5815b090 2024-04-25T02:29:40.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.247+0000 7f0b4ffff640 1 --2- 172.21.15.67:0/1103426332 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f0b3806bfe0 0x7f0b3806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.247+0000 7f0b4ffff640 1 -- 172.21.15.67:0/1103426332 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f0b5008b580 con 0x7f0b5815b090 2024-04-25T02:29:40.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.247+0000 7f0b577fe640 1 --2- 172.21.15.67:0/1103426332 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f0b3806bfe0 0x7f0b3806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.247+0000 7f0b577fe640 1 --2- 172.21.15.67:0/1103426332 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f0b3806bfe0 0x7f0b3806e4a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0b48033000 tx=0x7f0b4802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:40.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.251+0000 7f0b4ffff640 1 -- 172.21.15.67:0/1103426332 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0b50022020 con 0x7f0b5815b090 2024-04-25T02:29:40.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.435+0000 7f0b5e14c640 1 -- 172.21.15.67:0/1103426332 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0b5815c890 con 0x7f0b5815b090 2024-04-25T02:29:40.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.436+0000 7f0b4ffff640 1 -- 172.21.15.67:0/1103426332 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7f0b50059d40 con 0x7f0b5815b090 2024-04-25T02:29:40.441 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-25T02:29:40.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.437+0000 7f0b5e14c640 1 -- 172.21.15.67:0/1103426332 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f0b3806bfe0 msgr2=0x7f0b3806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:40.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.437+0000 7f0b5e14c640 1 --2- 172.21.15.67:0/1103426332 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f0b3806bfe0 0x7f0b3806e4a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0b48033000 tx=0x7f0b4802e000 comp rx=0 tx=0).stop 2024-04-25T02:29:40.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.437+0000 7f0b5e14c640 1 -- 172.21.15.67:0/1103426332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b5815b090 msgr2=0x7f0b58155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:40.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.437+0000 7f0b5e14c640 1 --2- 172.21.15.67:0/1103426332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b5815b090 0x7f0b58155bf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000d5d0 tx=0x7f0b5000da90 comp rx=0 tx=0).stop 2024-04-25T02:29:40.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.438+0000 7f0b5e14c640 1 -- 172.21.15.67:0/1103426332 shutdown_connections 2024-04-25T02:29:40.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.438+0000 7f0b5e14c640 1 --2- 172.21.15.67:0/1103426332 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f0b3806bfe0 0x7f0b3806e4a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.438+0000 7f0b5e14c640 1 --2- 172.21.15.67:0/1103426332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b5815b090 0x7f0b58155bf0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.438+0000 7f0b5e14c640 1 --2- 172.21.15.67:0/1103426332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b580b2cc0 0x7f0b58153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.438+0000 7f0b5e14c640 1 --2- 172.21.15.67:0/1103426332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b5806ea70 0x7f0b5815cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.438+0000 7f0b5e14c640 1 -- 172.21.15.67:0/1103426332 >> 172.21.15.67:0/1103426332 conn(0x7f0b580b19c0 msgr2=0x7f0b580723b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:40.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.438+0000 7f0b5e14c640 1 -- 172.21.15.67:0/1103426332 shutdown_connections 2024-04-25T02:29:40.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.438+0000 7f0b5e14c640 1 -- 172.21.15.67:0/1103426332 wait complete. 2024-04-25T02:29:40.452 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:29:40.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.551+0000 7f1259600640 1 Processor -- start 2024-04-25T02:29:40.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.551+0000 7f1259600640 1 -- start start 2024-04-25T02:29:40.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.552+0000 7f1259600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f12540cdcb0 0x7f125406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.552+0000 7f1259600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12540b4790 con 0x7f125415e430 2024-04-25T02:29:40.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.552+0000 7f1259600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12540cefd0 con 0x7f125406d2f0 2024-04-25T02:29:40.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.552+0000 7f1259600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f12540cf290 con 0x7f12540cdcb0 2024-04-25T02:29:40.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.552+0000 7f1252ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f125415e430 0x7f125406cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57600/0 (socket says 172.21.15.67:57600) 2024-04-25T02:29:40.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.552+0000 7f1252ffd640 1 -- 172.21.15.67:0/1878546570 learned_addr learned my addr 172.21.15.67:0/1878546570 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:40.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.552+0000 7f12537fe640 1 --2- 172.21.15.67:0/1878546570 >> v2:172.21.15.176:3300/0 conn(0x7f12540cdcb0 0x7f125406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f1251ffb640 1 -- 172.21.15.67:0/1878546570 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1039232583 0 0) 0x7f12540b4790 con 0x7f125415e430 2024-04-25T02:29:40.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f1251ffb640 1 -- 172.21.15.67:0/1878546570 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1240003520 con 0x7f125415e430 2024-04-25T02:29:40.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f1251ffb640 1 -- 172.21.15.67:0/1878546570 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1200452371 0 0) 0x7f12540cefd0 con 0x7f125406d2f0 2024-04-25T02:29:40.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f1251ffb640 1 -- 172.21.15.67:0/1878546570 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12540b4790 con 0x7f125406d2f0 2024-04-25T02:29:40.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f1251ffb640 1 -- 172.21.15.67:0/1878546570 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2838038825 0 0) 0x7f1240003520 con 0x7f125415e430 2024-04-25T02:29:40.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f1251ffb640 1 -- 172.21.15.67:0/1878546570 >> v2:172.21.15.176:3300/0 conn(0x7f12540cdcb0 msgr2=0x7f125406fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:40.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f1251ffb640 1 --2- 172.21.15.67:0/1878546570 >> v2:172.21.15.176:3300/0 conn(0x7f12540cdcb0 0x7f125406fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f1251ffb640 1 -- 172.21.15.67:0/1878546570 >> v1:172.21.15.176:6789/0 conn(0x7f125406d2f0 legacy=0x7f125406f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:40.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f1251ffb640 1 -- 172.21.15.67:0/1878546570 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12540b44b0 con 0x7f125415e430 2024-04-25T02:29:40.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f1251ffb640 1 -- 172.21.15.67:0/1878546570 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f123c001670 con 0x7f125415e430 2024-04-25T02:29:40.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f12537fe640 1 --2- 172.21.15.67:0/1878546570 >> v2:172.21.15.176:3300/0 conn(0x7f12540cdcb0 0x7f125406fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:40.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f1251ffb640 1 -- 172.21.15.67:0/1878546570 >> v1:172.21.15.67:6789/0 conn(0x7f125415e430 legacy=0x7f125406cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:40.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f1251ffb640 1 --2- 172.21.15.67:0/1878546570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1240003b40 0x7f1240003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f1251ffb640 1 --2- 172.21.15.67:0/1878546570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1240004800 0x7f1240004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f1251ffb640 1 --2- 172.21.15.67:0/1878546570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12400051c0 0x7f124000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f1251ffb640 1 -- 172.21.15.67:0/1878546570 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f12540cf290 con 0x7f12400051c0 2024-04-25T02:29:40.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f1251ffb640 1 -- 172.21.15.67:0/1878546570 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f124000c0f0 con 0x7f1240003b40 2024-04-25T02:29:40.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f1251ffb640 1 -- 172.21.15.67:0/1878546570 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f124000c2f0 con 0x7f1240004800 2024-04-25T02:29:40.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f12537fe640 1 --2- 172.21.15.67:0/1878546570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12400051c0 0x7f124000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f1252ffd640 1 --2- 172.21.15.67:0/1878546570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1240003b40 0x7f1240003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f12527fc640 1 --2- 172.21.15.67:0/1878546570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1240004800 0x7f1240004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f12537fe640 1 -- 172.21.15.67:0/1878546570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1240004800 msgr2=0x7f1240004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:40.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f12537fe640 1 --2- 172.21.15.67:0/1878546570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1240004800 0x7f1240004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f12537fe640 1 -- 172.21.15.67:0/1878546570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1240003b40 msgr2=0x7f1240003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:40.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f12537fe640 1 --2- 172.21.15.67:0/1878546570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1240003b40 0x7f1240003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.553+0000 7f12537fe640 1 -- 172.21.15.67:0/1878546570 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1240003520 con 0x7f12400051c0 2024-04-25T02:29:40.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.554+0000 7f12537fe640 1 -- 172.21.15.67:0/1878546570 reap_dead start 2024-04-25T02:29:40.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.554+0000 7f12537fe640 1 --2- 172.21.15.67:0/1878546570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12400051c0 0x7f124000b9c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f124c00e350 tx=0x7f1240005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce720a52085863c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:40.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.554+0000 7f1251ffb640 1 -- 172.21.15.67:0/1878546570 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124c009de0 con 0x7f12400051c0 2024-04-25T02:29:40.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.554+0000 7f1251ffb640 1 -- 172.21.15.67:0/1878546570 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f124c003bd0 con 0x7f12400051c0 2024-04-25T02:29:40.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.554+0000 7f1251ffb640 1 -- 172.21.15.67:0/1878546570 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124c004020 con 0x7f12400051c0 2024-04-25T02:29:40.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.555+0000 7f1259600640 1 -- 172.21.15.67:0/1878546570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12400051c0 msgr2=0x7f124000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:40.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.555+0000 7f1259600640 1 --2- 172.21.15.67:0/1878546570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12400051c0 0x7f124000b9c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f124c00e350 tx=0x7f1240005830 comp rx=0 tx=0).stop 2024-04-25T02:29:40.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.555+0000 7f1259600640 1 -- 172.21.15.67:0/1878546570 shutdown_connections 2024-04-25T02:29:40.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.555+0000 7f1259600640 1 --2- 172.21.15.67:0/1878546570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12400051c0 0x7f124000b9c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.555+0000 7f1259600640 1 -- 172.21.15.67:0/1878546570 >> 172.21.15.67:0/1878546570 conn(0x7f12540b38f0 msgr2=0x7f12540b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:40.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.555+0000 7f1259600640 1 -- 172.21.15.67:0/1878546570 shutdown_connections 2024-04-25T02:29:40.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.555+0000 7f1259600640 1 -- 172.21.15.67:0/1878546570 wait complete. 2024-04-25T02:29:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.556+0000 7f1259600640 1 Processor -- start 2024-04-25T02:29:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.556+0000 7f1259600640 1 -- start start 2024-04-25T02:29:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.557+0000 7f1259600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12400051c0 0x7f1254157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.557+0000 7f1259600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12540b0460 0x7f12540c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.557+0000 7f1259600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12540c9b20 0x7f125415b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.557+0000 7f1259600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f125406c3e0 con 0x7f12400051c0 2024-04-25T02:29:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.557+0000 7f1259600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f12540cc780 con 0x7f12540b0460 2024-04-25T02:29:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.557+0000 7f1259600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f125406c560 con 0x7f12540c9b20 2024-04-25T02:29:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.557+0000 7f1252ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12400051c0 0x7f1254157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.557+0000 7f1252ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12400051c0 0x7f1254157df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55608/0 (socket says 172.21.15.67:55608) 2024-04-25T02:29:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.557+0000 7f1252ffd640 1 -- 172.21.15.67:0/2134571453 learned_addr learned my addr 172.21.15.67:0/2134571453 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.558+0000 7f12527fc640 1 --2- 172.21.15.67:0/2134571453 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12540b0460 0x7f12540c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.558+0000 7f12537fe640 1 --2- 172.21.15.67:0/2134571453 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12540c9b20 0x7f125415b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.558+0000 7f1252ffd640 1 -- 172.21.15.67:0/2134571453 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12540c9b20 msgr2=0x7f125415b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.558+0000 7f1252ffd640 1 --2- 172.21.15.67:0/2134571453 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12540c9b20 0x7f125415b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.558+0000 7f1252ffd640 1 -- 172.21.15.67:0/2134571453 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12540b0460 msgr2=0x7f12540c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.558+0000 7f1252ffd640 1 --2- 172.21.15.67:0/2134571453 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12540b0460 0x7f12540c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.558+0000 7f1252ffd640 1 -- 172.21.15.67:0/2134571453 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12540af3c0 con 0x7f12400051c0 2024-04-25T02:29:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.558+0000 7f1252ffd640 1 --2- 172.21.15.67:0/2134571453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12400051c0 0x7f1254157df0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f123c004eb0 tx=0x7f123c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.558+0000 7f124b7fe640 1 -- 172.21.15.67:0/2134571453 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c01a070 con 0x7f12400051c0 2024-04-25T02:29:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.558+0000 7f124b7fe640 1 -- 172.21.15.67:0/2134571453 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f123c00f750 con 0x7f12400051c0 2024-04-25T02:29:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.558+0000 7f124b7fe640 1 -- 172.21.15.67:0/2134571453 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c00fb40 con 0x7f12400051c0 2024-04-25T02:29:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.558+0000 7f1259600640 1 -- 172.21.15.67:0/2134571453 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12540af6a0 con 0x7f12400051c0 2024-04-25T02:29:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.558+0000 7f1259600640 1 -- 172.21.15.67:0/2134571453 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12540afc60 con 0x7f12400051c0 2024-04-25T02:29:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.559+0000 7f1259600640 1 -- 172.21.15.67:0/2134571453 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1254075750 con 0x7f12400051c0 2024-04-25T02:29:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.559+0000 7f124b7fe640 1 -- 172.21.15.67:0/2134571453 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f123c00fce0 con 0x7f12400051c0 2024-04-25T02:29:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.560+0000 7f124b7fe640 1 --2- 172.21.15.67:0/2134571453 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f123406bfe0 0x7f123406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.560+0000 7f124b7fe640 1 -- 172.21.15.67:0/2134571453 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f123c08aa00 con 0x7f12400051c0 2024-04-25T02:29:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.560+0000 7f12527fc640 1 --2- 172.21.15.67:0/2134571453 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f123406bfe0 0x7f123406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.561+0000 7f12527fc640 1 --2- 172.21.15.67:0/2134571453 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f123406bfe0 0x7f123406e4a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1244007fd0 tx=0x7f1244009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.564+0000 7f124b7fe640 1 -- 172.21.15.67:0/2134571453 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f123c059130 con 0x7f12400051c0 2024-04-25T02:29:40.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.760+0000 7f1259600640 1 -- 172.21.15.67:0/2134571453 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f12540cefd0 con 0x7f12400051c0 2024-04-25T02:29:40.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.760+0000 7f124b7fe640 1 -- 172.21.15.67:0/2134571453 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7f123c058a30 con 0x7f12400051c0 2024-04-25T02:29:40.763 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-04-25T02:29:40.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.762+0000 7f1259600640 1 -- 172.21.15.67:0/2134571453 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f123406bfe0 msgr2=0x7f123406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.762+0000 7f1259600640 1 --2- 172.21.15.67:0/2134571453 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f123406bfe0 0x7f123406e4a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1244007fd0 tx=0x7f1244009040 comp rx=0 tx=0).stop 2024-04-25T02:29:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.762+0000 7f1259600640 1 -- 172.21.15.67:0/2134571453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12400051c0 msgr2=0x7f1254157df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.762+0000 7f1259600640 1 --2- 172.21.15.67:0/2134571453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12400051c0 0x7f1254157df0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f123c004eb0 tx=0x7f123c007430 comp rx=0 tx=0).stop 2024-04-25T02:29:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.762+0000 7f1259600640 1 -- 172.21.15.67:0/2134571453 shutdown_connections 2024-04-25T02:29:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.762+0000 7f1259600640 1 --2- 172.21.15.67:0/2134571453 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f123406bfe0 0x7f123406e4a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.762+0000 7f1259600640 1 --2- 172.21.15.67:0/2134571453 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12540c9b20 0x7f125415b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.762+0000 7f1259600640 1 --2- 172.21.15.67:0/2134571453 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12540b0460 0x7f12540c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.762+0000 7f1259600640 1 --2- 172.21.15.67:0/2134571453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12400051c0 0x7f1254157df0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.762+0000 7f1259600640 1 -- 172.21.15.67:0/2134571453 >> 172.21.15.67:0/2134571453 conn(0x7f12540b38f0 msgr2=0x7f12540d0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.762+0000 7f1259600640 1 -- 172.21.15.67:0/2134571453 shutdown_connections 2024-04-25T02:29:40.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:40.762+0000 7f1259600640 1 -- 172.21.15.67:0/2134571453 wait complete. 2024-04-25T02:29:40.776 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T02:29:40.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:40.776 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-25T02:29:40.809 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-04-25T02:29:40.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:40.810 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T02:29:40.867 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:29:40.867 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:29:40.867 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:29:40.883 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056113,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19720 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248848k,nr_inodes=812212,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:29:40.883 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:29:40.883 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:29:40.883 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:29:40.925 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056111,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20664 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248848k,nr_inodes=812212,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:29:40.925 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:29:41.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.022+0000 7f938ea64640 1 Processor -- start 2024-04-25T02:29:41.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.022+0000 7f938ea64640 1 -- start start 2024-04-25T02:29:41.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.023+0000 7f938ea64640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f938815e280 0x7f938806bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.023+0000 7f938ea64640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938815e660 0x7f938806ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.023+0000 7f938ea64640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9388067200 0x7f93880715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.023+0000 7f938ea64640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f938806e990 con 0x7f9388067200 2024-04-25T02:29:41.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.023+0000 7f938ea64640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f938806c9b0 con 0x7f938815e280 2024-04-25T02:29:41.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.023+0000 7f938ea64640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f938806bc70 con 0x7f938815e660 2024-04-25T02:29:41.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.023+0000 7f938d001640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9388067200 0x7f93880715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.023+0000 7f938d001640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9388067200 0x7f93880715e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55612/0 (socket says 172.21.15.67:55612) 2024-04-25T02:29:41.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.023+0000 7f938d001640 1 -- 172.21.15.67:0/2916553810 learned_addr learned my addr 172.21.15.67:0/2916553810 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:41.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.024+0000 7f9387fff640 1 --2- 172.21.15.67:0/2916553810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938815e660 0x7f938806ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.024+0000 7f938c800640 1 --2- 172.21.15.67:0/2916553810 >> v2:172.21.15.176:3300/0 conn(0x7f938815e280 0x7f938806bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.024+0000 7f938d001640 1 -- 172.21.15.67:0/2916553810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938815e660 msgr2=0x7f938806ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:41.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.024+0000 7f938d001640 1 --2- 172.21.15.67:0/2916553810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938815e660 0x7f938806ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.024+0000 7f938d001640 1 -- 172.21.15.67:0/2916553810 >> v2:172.21.15.176:3300/0 conn(0x7f938815e280 msgr2=0x7f938806bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:41.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.024+0000 7f938d001640 1 --2- 172.21.15.67:0/2916553810 >> v2:172.21.15.176:3300/0 conn(0x7f938815e280 0x7f938806bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.024+0000 7f938d001640 1 -- 172.21.15.67:0/2916553810 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938806e340 con 0x7f9388067200 2024-04-25T02:29:41.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.024+0000 7f938d001640 1 --2- 172.21.15.67:0/2916553810 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9388067200 0x7f93880715e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f93880b3230 tx=0x7f938002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27aa7527b16ed53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:41.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.025+0000 7f93877fe640 1 -- 172.21.15.67:0/2916553810 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9380036070 con 0x7f9388067200 2024-04-25T02:29:41.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.025+0000 7f93877fe640 1 -- 172.21.15.67:0/2916553810 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9380031600 con 0x7f9388067200 2024-04-25T02:29:41.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.025+0000 7f93877fe640 1 -- 172.21.15.67:0/2916553810 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93800319d0 con 0x7f9388067200 2024-04-25T02:29:41.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.025+0000 7f938ea64640 1 -- 172.21.15.67:0/2916553810 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9388067200 msgr2=0x7f93880715e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.025+0000 7f938ea64640 1 --2- 172.21.15.67:0/2916553810 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9388067200 0x7f93880715e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f93880b3230 tx=0x7f938002a6a0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.025+0000 7f938ea64640 1 -- 172.21.15.67:0/2916553810 shutdown_connections 2024-04-25T02:29:41.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.025+0000 7f938ea64640 1 --2- 172.21.15.67:0/2916553810 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9388067200 0x7f93880715e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.025+0000 7f938ea64640 1 --2- 172.21.15.67:0/2916553810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938815e660 0x7f938806ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.025+0000 7f938ea64640 1 --2- 172.21.15.67:0/2916553810 >> v2:172.21.15.176:3300/0 conn(0x7f938815e280 0x7f938806bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.025+0000 7f938ea64640 1 -- 172.21.15.67:0/2916553810 >> 172.21.15.67:0/2916553810 conn(0x7f93880d04f0 msgr2=0x7f93880d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:41.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.025+0000 7f938ea64640 1 -- 172.21.15.67:0/2916553810 shutdown_connections 2024-04-25T02:29:41.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.025+0000 7f938ea64640 1 -- 172.21.15.67:0/2916553810 wait complete. 2024-04-25T02:29:41.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.026+0000 7f938ea64640 1 Processor -- start 2024-04-25T02:29:41.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.026+0000 7f938ea64640 1 -- start start 2024-04-25T02:29:41.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.027+0000 7f938ea64640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9388067200 0x7f938815a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.027+0000 7f938ea64640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f938815e280 0x7f938815f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.027+0000 7f938ea64640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938815e660 0x7f9388158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.027+0000 7f938ea64640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f938806f360 con 0x7f9388067200 2024-04-25T02:29:41.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.027+0000 7f938ea64640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f938806c450 con 0x7f938815e280 2024-04-25T02:29:41.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.027+0000 7f938ea64640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f938806f4e0 con 0x7f938815e660 2024-04-25T02:29:41.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.027+0000 7f938c800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9388067200 0x7f938815a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.027+0000 7f938c800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9388067200 0x7f938815a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55622/0 (socket says 172.21.15.67:55622) 2024-04-25T02:29:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.027+0000 7f938c800640 1 -- 172.21.15.67:0/1558487325 learned_addr learned my addr 172.21.15.67:0/1558487325 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.028+0000 7f938d001640 1 --2- 172.21.15.67:0/1558487325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938815e660 0x7f9388158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.028+0000 7f9387fff640 1 --2- 172.21.15.67:0/1558487325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f938815e280 0x7f938815f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.028+0000 7f938c800640 1 -- 172.21.15.67:0/1558487325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938815e660 msgr2=0x7f9388158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.028+0000 7f938c800640 1 --2- 172.21.15.67:0/1558487325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938815e660 0x7f9388158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.028+0000 7f938c800640 1 -- 172.21.15.67:0/1558487325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f938815e280 msgr2=0x7f938815f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.028+0000 7f938c800640 1 --2- 172.21.15.67:0/1558487325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f938815e280 0x7f938815f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.028+0000 7f938c800640 1 -- 172.21.15.67:0/1558487325 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938815fea0 con 0x7f9388067200 2024-04-25T02:29:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.028+0000 7f938c800640 1 --2- 172.21.15.67:0/1558487325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9388067200 0x7f938815a8b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f937c00d800 tx=0x7f937c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.028+0000 7f93857fa640 1 -- 172.21.15.67:0/1558487325 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937c018020 con 0x7f9388067200 2024-04-25T02:29:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.028+0000 7f93857fa640 1 -- 172.21.15.67:0/1558487325 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f937c0096a0 con 0x7f9388067200 2024-04-25T02:29:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.028+0000 7f93857fa640 1 -- 172.21.15.67:0/1558487325 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937c009a70 con 0x7f9388067200 2024-04-25T02:29:41.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.028+0000 7f938ea64640 1 -- 172.21.15.67:0/1558487325 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9388160180 con 0x7f9388067200 2024-04-25T02:29:41.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.028+0000 7f938ea64640 1 -- 172.21.15.67:0/1558487325 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f938815adf0 con 0x7f9388067200 2024-04-25T02:29:41.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.029+0000 7f938ea64640 1 -- 172.21.15.67:0/1558487325 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9388069110 con 0x7f9388067200 2024-04-25T02:29:41.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.030+0000 7f93857fa640 1 -- 172.21.15.67:0/1558487325 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f937c01b020 con 0x7f9388067200 2024-04-25T02:29:41.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.030+0000 7f93857fa640 1 --2- 172.21.15.67:0/1558487325 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f936c06bfe0 0x7f936c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.030+0000 7f93857fa640 1 -- 172.21.15.67:0/1558487325 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f937c08b1c0 con 0x7f9388067200 2024-04-25T02:29:41.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.030+0000 7f9387fff640 1 --2- 172.21.15.67:0/1558487325 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f936c06bfe0 0x7f936c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.031+0000 7f9387fff640 1 --2- 172.21.15.67:0/1558487325 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f936c06bfe0 0x7f936c06e4a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f938815b990 tx=0x7f9374008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:41.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.034+0000 7f93857fa640 1 -- 172.21.15.67:0/1558487325 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f937c022030 con 0x7f9388067200 2024-04-25T02:29:41.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.261+0000 7f938ea64640 1 -- 172.21.15.67:0/1558487325 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9388066fe0 con 0x7f9388067200 2024-04-25T02:29:41.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.261+0000 7f93857fa640 1 -- 172.21.15.67:0/1558487325 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5181 (secure 0 0 0) 0x7f937c059330 con 0x7f9388067200 2024-04-25T02:29:41.264 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:41.265 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/101037939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":101037939},{"type":"v1","addr":"172.21.15.176:6837","nonce":101037939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4873,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/958313587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":958313587},{"type":"v1","addr":"172.21.15.176:6836","nonce":958313587}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/2806970849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2806970849},{"type":"v1","addr":"172.21.15.67:6834","nonce":2806970849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:29:17.693906+0000","modified":"2024-04-25T02:29:19.690632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2564564590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":2564564590},{"type":"v1","addr":"172.21.15.67:6835","nonce":2564564590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5085,"qdb_cluster":[5085]},"id":2}]} 2024-04-25T02:29:41.265 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 15 2024-04-25T02:29:41.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.263+0000 7f938ea64640 1 -- 172.21.15.67:0/1558487325 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f936c06bfe0 msgr2=0x7f936c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.263+0000 7f938ea64640 1 --2- 172.21.15.67:0/1558487325 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f936c06bfe0 0x7f936c06e4a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f938815b990 tx=0x7f9374008040 comp rx=0 tx=0).stop 2024-04-25T02:29:41.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.263+0000 7f938ea64640 1 -- 172.21.15.67:0/1558487325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9388067200 msgr2=0x7f938815a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.263+0000 7f938ea64640 1 --2- 172.21.15.67:0/1558487325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9388067200 0x7f938815a8b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f937c00d800 tx=0x7f937c00dcc0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.264+0000 7f938ea64640 1 -- 172.21.15.67:0/1558487325 shutdown_connections 2024-04-25T02:29:41.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.264+0000 7f938ea64640 1 --2- 172.21.15.67:0/1558487325 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f936c06bfe0 0x7f936c06e4a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.264+0000 7f938ea64640 1 --2- 172.21.15.67:0/1558487325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f938815e660 0x7f9388158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.264+0000 7f938ea64640 1 --2- 172.21.15.67:0/1558487325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f938815e280 0x7f938815f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.264+0000 7f938ea64640 1 --2- 172.21.15.67:0/1558487325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9388067200 0x7f938815a8b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.264+0000 7f938ea64640 1 -- 172.21.15.67:0/1558487325 >> 172.21.15.67:0/1558487325 conn(0x7f93880d04f0 msgr2=0x7f93880b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:41.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.264+0000 7f938ea64640 1 -- 172.21.15.67:0/1558487325 shutdown_connections 2024-04-25T02:29:41.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.264+0000 7f938ea64640 1 -- 172.21.15.67:0/1558487325 wait complete. 2024-04-25T02:29:41.278 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:29:41.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.376+0000 7fa9b23c1640 1 Processor -- start 2024-04-25T02:29:41.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.376+0000 7fa9b23c1640 1 -- start start 2024-04-25T02:29:41.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.377+0000 7fa9b23c1640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa9ac0cf3d0 0x7fa9ac0d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.377+0000 7fa9b23c1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9ac0d2cc0 con 0x7fa9ac15e5f0 2024-04-25T02:29:41.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.377+0000 7fa9b23c1640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9ac0d2fa0 con 0x7fa9ac15e210 2024-04-25T02:29:41.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.377+0000 7fa9b23c1640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa9ac06c6f0 con 0x7fa9ac0cf3d0 2024-04-25T02:29:41.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.377+0000 7fa9ab7fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa9ac15e5f0 0x7fa9ac0cecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57606/0 (socket says 172.21.15.67:57606) 2024-04-25T02:29:41.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.377+0000 7fa9ab7fe640 1 -- 172.21.15.67:0/886866403 learned_addr learned my addr 172.21.15.67:0/886866403 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:41.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.377+0000 7fa9b095e640 1 --2- 172.21.15.67:0/886866403 >> v2:172.21.15.176:3300/0 conn(0x7fa9ac0cf3d0 0x7fa9ac0d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9aaffd640 1 -- 172.21.15.67:0/886866403 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 19473896 0 0) 0x7fa9ac0d2cc0 con 0x7fa9ac15e5f0 2024-04-25T02:29:41.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9aaffd640 1 -- 172.21.15.67:0/886866403 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa994003520 con 0x7fa9ac15e5f0 2024-04-25T02:29:41.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9aaffd640 1 -- 172.21.15.67:0/886866403 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 654516161 0 0) 0x7fa994003520 con 0x7fa9ac15e5f0 2024-04-25T02:29:41.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9aaffd640 1 -- 172.21.15.67:0/886866403 >> v2:172.21.15.176:3300/0 conn(0x7fa9ac0cf3d0 msgr2=0x7fa9ac0d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:41.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9aaffd640 1 --2- 172.21.15.67:0/886866403 >> v2:172.21.15.176:3300/0 conn(0x7fa9ac0cf3d0 0x7fa9ac0d3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9aaffd640 1 -- 172.21.15.67:0/886866403 >> v1:172.21.15.176:6789/0 conn(0x7fa9ac15e210 legacy=0x7fa9ac06cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9aaffd640 1 -- 172.21.15.67:0/886866403 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ac06c0a0 con 0x7fa9ac15e5f0 2024-04-25T02:29:41.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9aaffd640 1 -- 172.21.15.67:0/886866403 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7fa9a0001670 con 0x7fa9ac15e5f0 2024-04-25T02:29:41.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9aaffd640 1 -- 172.21.15.67:0/886866403 >> v1:172.21.15.67:6789/0 conn(0x7fa9ac15e5f0 legacy=0x7fa9ac0cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9aaffd640 1 --2- 172.21.15.67:0/886866403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9940039b0 0x7fa994003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9aaffd640 1 --2- 172.21.15.67:0/886866403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9940043b0 0x7fa994004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9aaffd640 1 --2- 172.21.15.67:0/886866403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa994005120 0x7fa99400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9aaffd640 1 -- 172.21.15.67:0/886866403 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ac06c6f0 con 0x7fa9940039b0 2024-04-25T02:29:41.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9aaffd640 1 -- 172.21.15.67:0/886866403 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa99400c060 con 0x7fa9940043b0 2024-04-25T02:29:41.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9aaffd640 1 -- 172.21.15.67:0/886866403 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa99400c260 con 0x7fa994005120 2024-04-25T02:29:41.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9abfff640 1 --2- 172.21.15.67:0/886866403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9940039b0 0x7fa994003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9ab7fe640 1 --2- 172.21.15.67:0/886866403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9940043b0 0x7fa994004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9b095e640 1 --2- 172.21.15.67:0/886866403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa994005120 0x7fa99400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9abfff640 1 -- 172.21.15.67:0/886866403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa994005120 msgr2=0x7fa99400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:41.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9abfff640 1 --2- 172.21.15.67:0/886866403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa994005120 0x7fa99400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9abfff640 1 -- 172.21.15.67:0/886866403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9940043b0 msgr2=0x7fa994004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:41.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9abfff640 1 --2- 172.21.15.67:0/886866403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9940043b0 0x7fa994004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9abfff640 1 -- 172.21.15.67:0/886866403 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa994003520 con 0x7fa9940039b0 2024-04-25T02:29:41.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.378+0000 7fa9b095e640 1 -- 172.21.15.67:0/886866403 reap_dead start 2024-04-25T02:29:41.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.379+0000 7fa9abfff640 1 --2- 172.21.15.67:0/886866403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9940039b0 0x7fa994003d90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa99c001910 tx=0x7fa994005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f44464039ebd47 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:41.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.379+0000 7fa9aaffd640 1 -- 172.21.15.67:0/886866403 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c037070 con 0x7fa9940039b0 2024-04-25T02:29:41.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.379+0000 7fa9aaffd640 1 -- 172.21.15.67:0/886866403 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa99c02ac40 con 0x7fa9940039b0 2024-04-25T02:29:41.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.379+0000 7fa9aaffd640 1 -- 172.21.15.67:0/886866403 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c0014e0 con 0x7fa9940039b0 2024-04-25T02:29:41.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.380+0000 7fa9b23c1640 1 -- 172.21.15.67:0/886866403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9940039b0 msgr2=0x7fa994003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.380+0000 7fa9b23c1640 1 --2- 172.21.15.67:0/886866403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9940039b0 0x7fa994003d90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa99c001910 tx=0x7fa994005830 comp rx=0 tx=0).stop 2024-04-25T02:29:41.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.380+0000 7fa9b23c1640 1 -- 172.21.15.67:0/886866403 shutdown_connections 2024-04-25T02:29:41.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.380+0000 7fa9b23c1640 1 --2- 172.21.15.67:0/886866403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9940039b0 0x7fa994003d90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.380+0000 7fa9b23c1640 1 -- 172.21.15.67:0/886866403 >> 172.21.15.67:0/886866403 conn(0x7fa9ac08dbb0 msgr2=0x7fa9ac09d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:41.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.380+0000 7fa9b23c1640 1 -- 172.21.15.67:0/886866403 shutdown_connections 2024-04-25T02:29:41.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.380+0000 7fa9b23c1640 1 -- 172.21.15.67:0/886866403 wait complete. 2024-04-25T02:29:41.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.381+0000 7fa9b23c1640 1 Processor -- start 2024-04-25T02:29:41.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.381+0000 7fa9b23c1640 1 -- start start 2024-04-25T02:29:41.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.382+0000 7fa9b23c1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9940039b0 0x7fa9ac0cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.382+0000 7fa9b23c1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9ac0cbed0 0x7fa9ac1536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.382+0000 7fa9b23c1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9ac0cc530 0x7fa9ac0d0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.382+0000 7fa9b23c1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ac0cee40 con 0x7fa9940039b0 2024-04-25T02:29:41.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.382+0000 7fa9b23c1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ac0cecc0 con 0x7fa9ac0cbed0 2024-04-25T02:29:41.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.382+0000 7fa9b23c1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa9ac0cefc0 con 0x7fa9ac0cc530 2024-04-25T02:29:41.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.382+0000 7fa9abfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9940039b0 0x7fa9ac0cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.382+0000 7fa9abfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9940039b0 0x7fa9ac0cdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55644/0 (socket says 172.21.15.67:55644) 2024-04-25T02:29:41.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.382+0000 7fa9abfff640 1 -- 172.21.15.67:0/4066320271 learned_addr learned my addr 172.21.15.67:0/4066320271 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:41.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.382+0000 7fa9b095e640 1 --2- 172.21.15.67:0/4066320271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9ac0cc530 0x7fa9ac0d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.382+0000 7fa9ab7fe640 1 --2- 172.21.15.67:0/4066320271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9ac0cbed0 0x7fa9ac1536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.382+0000 7fa9abfff640 1 -- 172.21.15.67:0/4066320271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9ac0cc530 msgr2=0x7fa9ac0d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.382+0000 7fa9abfff640 1 --2- 172.21.15.67:0/4066320271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9ac0cc530 0x7fa9ac0d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.382+0000 7fa9abfff640 1 -- 172.21.15.67:0/4066320271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9ac0cbed0 msgr2=0x7fa9ac1536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.382+0000 7fa9abfff640 1 --2- 172.21.15.67:0/4066320271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9ac0cbed0 0x7fa9ac1536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.382+0000 7fa9abfff640 1 -- 172.21.15.67:0/4066320271 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ac153bf0 con 0x7fa9940039b0 2024-04-25T02:29:41.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.383+0000 7fa9abfff640 1 --2- 172.21.15.67:0/4066320271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9940039b0 0x7fa9ac0cdf70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa99c035040 tx=0x7fa99c0012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:41.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.383+0000 7fa9a8ff9640 1 -- 172.21.15.67:0/4066320271 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c037050 con 0x7fa9940039b0 2024-04-25T02:29:41.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.383+0000 7fa9a8ff9640 1 -- 172.21.15.67:0/4066320271 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa99c043070 con 0x7fa9940039b0 2024-04-25T02:29:41.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.383+0000 7fa9b23c1640 1 -- 172.21.15.67:0/4066320271 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9ac0cced0 con 0x7fa9940039b0 2024-04-25T02:29:41.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.383+0000 7fa9a8ff9640 1 -- 172.21.15.67:0/4066320271 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c007490 con 0x7fa9940039b0 2024-04-25T02:29:41.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.383+0000 7fa9b23c1640 1 -- 172.21.15.67:0/4066320271 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9ac0cd490 con 0x7fa9940039b0 2024-04-25T02:29:41.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.384+0000 7fa9b23c1640 1 -- 172.21.15.67:0/4066320271 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9ac069110 con 0x7fa9940039b0 2024-04-25T02:29:41.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.384+0000 7fa9a8ff9640 1 -- 172.21.15.67:0/4066320271 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fa99c048460 con 0x7fa9940039b0 2024-04-25T02:29:41.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.385+0000 7fa9a8ff9640 1 --2- 172.21.15.67:0/4066320271 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa99806c010 0x7fa99806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.385+0000 7fa9a8ff9640 1 -- 172.21.15.67:0/4066320271 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa99c0ab610 con 0x7fa9940039b0 2024-04-25T02:29:41.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.385+0000 7fa9ab7fe640 1 --2- 172.21.15.67:0/4066320271 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa99806c010 0x7fa99806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.386+0000 7fa9ab7fe640 1 --2- 172.21.15.67:0/4066320271 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa99806c010 0x7fa99806e4d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00011e0 tx=0x7fa9a0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:41.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.389+0000 7fa9a8ff9640 1 -- 172.21.15.67:0/4066320271 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa99c04d020 con 0x7fa9940039b0 2024-04-25T02:29:41.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.576+0000 7fa9b23c1640 1 -- 172.21.15.67:0/4066320271 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa9ac06be80 con 0x7fa9940039b0 2024-04-25T02:29:41.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.577+0000 7fa9a8ff9640 1 -- 172.21.15.67:0/4066320271 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16645 (secure 0 0 0) 0x7fa9ac153bf0 con 0x7fa9940039b0 2024-04-25T02:29:41.580 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:41.580 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":33,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:29:19.335566+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:29:16.301169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T02:29:16.663379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:29:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.579+0000 7fa9b23c1640 1 -- 172.21.15.67:0/4066320271 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa99806c010 msgr2=0x7fa99806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.579+0000 7fa9b23c1640 1 --2- 172.21.15.67:0/4066320271 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa99806c010 0x7fa99806e4d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00011e0 tx=0x7fa9a0009040 comp rx=0 tx=0).stop 2024-04-25T02:29:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.579+0000 7fa9b23c1640 1 -- 172.21.15.67:0/4066320271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9940039b0 msgr2=0x7fa9ac0cdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.579+0000 7fa9b23c1640 1 --2- 172.21.15.67:0/4066320271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9940039b0 0x7fa9ac0cdf70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa99c035040 tx=0x7fa99c0012b0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.579+0000 7fa9b23c1640 1 -- 172.21.15.67:0/4066320271 shutdown_connections 2024-04-25T02:29:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.579+0000 7fa9b23c1640 1 --2- 172.21.15.67:0/4066320271 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fa99806c010 0x7fa99806e4d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.579+0000 7fa9b23c1640 1 --2- 172.21.15.67:0/4066320271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9ac0cc530 0x7fa9ac0d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.579+0000 7fa9b23c1640 1 --2- 172.21.15.67:0/4066320271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9ac0cbed0 0x7fa9ac1536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.579+0000 7fa9b23c1640 1 --2- 172.21.15.67:0/4066320271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9940039b0 0x7fa9ac0cdf70 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.579+0000 7fa9b23c1640 1 -- 172.21.15.67:0/4066320271 >> 172.21.15.67:0/4066320271 conn(0x7fa9ac08dbb0 msgr2=0x7fa9ac1612f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:41.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.580+0000 7fa9b23c1640 1 -- 172.21.15.67:0/4066320271 shutdown_connections 2024-04-25T02:29:41.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.580+0000 7fa9b23c1640 1 -- 172.21.15.67:0/4066320271 wait complete. 2024-04-25T02:29:41.594 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:29:16.301169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:29:16.663379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:29:41.594 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:29:41.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.694+0000 7fc54b09e640 1 Processor -- start 2024-04-25T02:29:41.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.694+0000 7fc54b09e640 1 -- start start 2024-04-25T02:29:41.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.695+0000 7fc54b09e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc5440d0a00 0x7fc54406b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.695+0000 7fc54b09e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5440cd1d0 0x7fc5440cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.695+0000 7fc54b09e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5440cd630 con 0x7fc5440cf920 2024-04-25T02:29:41.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.695+0000 7fc54b09e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc54406c040 con 0x7fc5440d0a00 2024-04-25T02:29:41.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.695+0000 7fc54b09e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc5440cef50 con 0x7fc5440cd1d0 2024-04-25T02:29:41.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.695+0000 7fc548e3a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc5440d0a00 0x7fc54406b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.695+0000 7fc543fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5440cd1d0 0x7fc5440cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.695+0000 7fc54963b640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fc5440cf920 0x7fc544071e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:51426/0 (socket says 172.21.15.67:51426) 2024-04-25T02:29:41.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.695+0000 7fc54963b640 1 -- 172.21.15.67:0/158544081 learned_addr learned my addr 172.21.15.67:0/158544081 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:41.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.695+0000 7fc548e3a640 1 --2- 172.21.15.67:0/158544081 >> v2:172.21.15.176:3300/0 conn(0x7fc5440d0a00 0x7fc54406b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.67:36420/0 (socket says 172.21.15.67:36420) 2024-04-25T02:29:41.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.695+0000 7fc543fff640 1 --2- 172.21.15.67:0/158544081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5440cd1d0 0x7fc5440cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:32874/0 (socket says 172.21.15.67:32874) 2024-04-25T02:29:41.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.696+0000 7fc5437fe640 1 -- 172.21.15.67:0/158544081 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2010007160 0 0) 0x7fc5440cd630 con 0x7fc5440cf920 2024-04-25T02:29:41.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.696+0000 7fc5437fe640 1 -- 172.21.15.67:0/158544081 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc52c003520 con 0x7fc5440cf920 2024-04-25T02:29:41.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.696+0000 7fc548e3a640 1 -- 172.21.15.67:0/158544081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5440cd1d0 msgr2=0x7fc5440cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:41.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.696+0000 7fc548e3a640 1 --2- 172.21.15.67:0/158544081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5440cd1d0 0x7fc5440cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.696+0000 7fc548e3a640 1 -- 172.21.15.67:0/158544081 >> v1:172.21.15.176:6789/0 conn(0x7fc5440cf920 legacy=0x7fc544071e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.696+0000 7fc548e3a640 1 -- 172.21.15.67:0/158544081 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54406b7a0 con 0x7fc5440d0a00 2024-04-25T02:29:41.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.696+0000 7fc543fff640 1 --2- 172.21.15.67:0/158544081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5440cd1d0 0x7fc5440cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:41.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.697+0000 7fc548e3a640 1 --2- 172.21.15.67:0/158544081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5440d0a00 0x7fc54406b0c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc5340097a0 tx=0x7fc53402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2346050d06d3c43d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:41.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.697+0000 7fc5437fe640 1 -- 172.21.15.67:0/158544081 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc534037070 con 0x7fc5440d0a00 2024-04-25T02:29:41.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.697+0000 7fc5437fe640 1 -- 172.21.15.67:0/158544081 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc534032440 con 0x7fc5440d0a00 2024-04-25T02:29:41.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.697+0000 7fc5437fe640 1 -- 172.21.15.67:0/158544081 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5340327f0 con 0x7fc5440d0a00 2024-04-25T02:29:41.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.697+0000 7fc54b09e640 1 -- 172.21.15.67:0/158544081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5440d0a00 msgr2=0x7fc54406b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.697+0000 7fc54b09e640 1 --2- 172.21.15.67:0/158544081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5440d0a00 0x7fc54406b0c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc5340097a0 tx=0x7fc53402a180 comp rx=0 tx=0).stop 2024-04-25T02:29:41.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.697+0000 7fc54b09e640 1 -- 172.21.15.67:0/158544081 shutdown_connections 2024-04-25T02:29:41.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.697+0000 7fc54b09e640 1 --2- 172.21.15.67:0/158544081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5440cd1d0 0x7fc5440cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.697+0000 7fc54b09e640 1 --2- 172.21.15.67:0/158544081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5440d0a00 0x7fc54406b0c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.697+0000 7fc54b09e640 1 -- 172.21.15.67:0/158544081 >> 172.21.15.67:0/158544081 conn(0x7fc5440d0e20 msgr2=0x7fc5440d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:41.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.697+0000 7fc54b09e640 1 -- 172.21.15.67:0/158544081 shutdown_connections 2024-04-25T02:29:41.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.697+0000 7fc54b09e640 1 -- 172.21.15.67:0/158544081 wait complete. 2024-04-25T02:29:41.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.699+0000 7fc54b09e640 1 Processor -- start 2024-04-25T02:29:41.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.699+0000 7fc54b09e640 1 -- start start 2024-04-25T02:29:41.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc54b09e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5440cd1d0 0x7fc54414daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc54b09e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5440cf920 0x7fc54414d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc54b09e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5440d0a00 0x7fc5440b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc54b09e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc544072580 con 0x7fc5440d0a00 2024-04-25T02:29:41.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc54b09e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc54406bd60 con 0x7fc5440cf920 2024-04-25T02:29:41.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc54b09e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc544072700 con 0x7fc5440cd1d0 2024-04-25T02:29:41.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc54963b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5440d0a00 0x7fc5440b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc54963b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5440d0a00 0x7fc5440b44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58566/0 (socket says 172.21.15.67:58566) 2024-04-25T02:29:41.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc54963b640 1 -- 172.21.15.67:0/1396970596 learned_addr learned my addr 172.21.15.67:0/1396970596 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:41.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc543fff640 1 --2- 172.21.15.67:0/1396970596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5440cf920 0x7fc54414d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc548e3a640 1 --2- 172.21.15.67:0/1396970596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5440cd1d0 0x7fc54414daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc54963b640 1 -- 172.21.15.67:0/1396970596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5440cd1d0 msgr2=0x7fc54414daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc54963b640 1 --2- 172.21.15.67:0/1396970596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5440cd1d0 0x7fc54414daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc54963b640 1 -- 172.21.15.67:0/1396970596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5440cf920 msgr2=0x7fc54414d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc54963b640 1 --2- 172.21.15.67:0/1396970596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5440cf920 0x7fc54414d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc54963b640 1 -- 172.21.15.67:0/1396970596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5440c8000 con 0x7fc5440d0a00 2024-04-25T02:29:41.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc54963b640 1 --2- 172.21.15.67:0/1396970596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5440d0a00 0x7fc5440b44f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00cb70 tx=0x7fc53c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:41.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc5417fa640 1 -- 172.21.15.67:0/1396970596 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c017070 con 0x7fc5440d0a00 2024-04-25T02:29:41.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc54b09e640 1 -- 172.21.15.67:0/1396970596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5440c82e0 con 0x7fc5440d0a00 2024-04-25T02:29:41.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc5417fa640 1 -- 172.21.15.67:0/1396970596 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53c00ad40 con 0x7fc5440d0a00 2024-04-25T02:29:41.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc5417fa640 1 -- 172.21.15.67:0/1396970596 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c012620 con 0x7fc5440d0a00 2024-04-25T02:29:41.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.700+0000 7fc54b09e640 1 -- 172.21.15.67:0/1396970596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5440c88a0 con 0x7fc5440d0a00 2024-04-25T02:29:41.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.701+0000 7fc54b09e640 1 -- 172.21.15.67:0/1396970596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc544067e40 con 0x7fc5440d0a00 2024-04-25T02:29:41.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.702+0000 7fc5417fa640 1 -- 172.21.15.67:0/1396970596 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fc53c01a070 con 0x7fc5440d0a00 2024-04-25T02:29:41.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.702+0000 7fc5417fa640 1 --2- 172.21.15.67:0/1396970596 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc53006bfe0 0x7fc53006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:41.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.702+0000 7fc5417fa640 1 -- 172.21.15.67:0/1396970596 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc53c08af40 con 0x7fc5440d0a00 2024-04-25T02:29:41.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.703+0000 7fc548e3a640 1 --2- 172.21.15.67:0/1396970596 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc53006bfe0 0x7fc53006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:41.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.703+0000 7fc548e3a640 1 --2- 172.21.15.67:0/1396970596 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc53006bfe0 0x7fc53006e4a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc534034000 tx=0x7fc53402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:41.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.706+0000 7fc5417fa640 1 -- 172.21.15.67:0/1396970596 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc53c058fa0 con 0x7fc5440d0a00 2024-04-25T02:29:41.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.889+0000 7fc54b09e640 1 -- 172.21.15.67:0/1396970596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc544069110 con 0x7fc5440d0a00 2024-04-25T02:29:41.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.889+0000 7fc5417fa640 1 -- 172.21.15.67:0/1396970596 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7fc53c05d2a0 con 0x7fc5440d0a00 2024-04-25T02:29:41.893 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:29:41.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.891+0000 7fc54b09e640 1 -- 172.21.15.67:0/1396970596 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc53006bfe0 msgr2=0x7fc53006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.891+0000 7fc54b09e640 1 --2- 172.21.15.67:0/1396970596 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc53006bfe0 0x7fc53006e4a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc534034000 tx=0x7fc53402e000 comp rx=0 tx=0).stop 2024-04-25T02:29:41.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.891+0000 7fc54b09e640 1 -- 172.21.15.67:0/1396970596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5440d0a00 msgr2=0x7fc5440b44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.891+0000 7fc54b09e640 1 --2- 172.21.15.67:0/1396970596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5440d0a00 0x7fc5440b44f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00cb70 tx=0x7fc53c00a430 comp rx=0 tx=0).stop 2024-04-25T02:29:41.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.891+0000 7fc54b09e640 1 -- 172.21.15.67:0/1396970596 shutdown_connections 2024-04-25T02:29:41.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.891+0000 7fc54b09e640 1 --2- 172.21.15.67:0/1396970596 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc53006bfe0 0x7fc53006e4a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.891+0000 7fc54b09e640 1 --2- 172.21.15.67:0/1396970596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5440d0a00 0x7fc5440b44f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.891+0000 7fc54b09e640 1 --2- 172.21.15.67:0/1396970596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5440cf920 0x7fc54414d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.891+0000 7fc54b09e640 1 --2- 172.21.15.67:0/1396970596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5440cd1d0 0x7fc54414daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.891+0000 7fc54b09e640 1 -- 172.21.15.67:0/1396970596 >> 172.21.15.67:0/1396970596 conn(0x7fc5440d0e20 msgr2=0x7fc5440b2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:41.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.891+0000 7fc54b09e640 1 -- 172.21.15.67:0/1396970596 shutdown_connections 2024-04-25T02:29:41.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:41.891+0000 7fc54b09e640 1 -- 172.21.15.67:0/1396970596 wait complete. 2024-04-25T02:29:41.905 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:29:42.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.005+0000 7f1e88e9a640 1 Processor -- start 2024-04-25T02:29:42.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.006+0000 7f1e88e9a640 1 -- start start 2024-04-25T02:29:42.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.006+0000 7f1e88e9a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e84156620 0x7f1e8415cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.006+0000 7f1e88e9a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1e8406edf0 0x7f1e8406dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.006+0000 7f1e88e9a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1e840ae8e0 0x7f1e840aed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.006+0000 7f1e88e9a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1e8406d100 con 0x7f1e8406edf0 2024-04-25T02:29:42.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.006+0000 7f1e88e9a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1e840acda0 con 0x7f1e840ae8e0 2024-04-25T02:29:42.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.006+0000 7f1e88e9a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1e840ad060 con 0x7f1e84156620 2024-04-25T02:29:42.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.007+0000 7f1e81d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1e8406edf0 0x7f1e8406dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.007+0000 7f1e81d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1e8406edf0 0x7f1e8406dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58568/0 (socket says 172.21.15.67:58568) 2024-04-25T02:29:42.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.007+0000 7f1e81d9b640 1 -- 172.21.15.67:0/2590334669 learned_addr learned my addr 172.21.15.67:0/2590334669 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:42.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.007+0000 7f1e81d9b640 1 -- 172.21.15.67:0/2590334669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e84156620 msgr2=0x7f1e8415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:42.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.007+0000 7f1e81d9b640 1 --2- 172.21.15.67:0/2590334669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e84156620 0x7f1e8415cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.007+0000 7f1e81d9b640 1 -- 172.21.15.67:0/2590334669 >> v2:172.21.15.176:3300/0 conn(0x7f1e840ae8e0 msgr2=0x7f1e840aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:42.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.007+0000 7f1e81d9b640 1 --2- 172.21.15.67:0/2590334669 >> v2:172.21.15.176:3300/0 conn(0x7f1e840ae8e0 0x7f1e840aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.007+0000 7f1e81d9b640 1 -- 172.21.15.67:0/2590334669 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e8406d3a0 con 0x7f1e8406edf0 2024-04-25T02:29:42.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.008+0000 7f1e81d9b640 1 --2- 172.21.15.67:0/2590334669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e8406edf0 0x7f1e8406dba0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1e840b2690 tx=0x7f1e7402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685ccc5ea769221c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:42.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.008+0000 7f1e8159a640 1 -- 172.21.15.67:0/2590334669 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e74037070 con 0x7f1e8406edf0 2024-04-25T02:29:42.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.008+0000 7f1e8159a640 1 -- 172.21.15.67:0/2590334669 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e74032440 con 0x7f1e8406edf0 2024-04-25T02:29:42.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.008+0000 7f1e8159a640 1 -- 172.21.15.67:0/2590334669 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e74032810 con 0x7f1e8406edf0 2024-04-25T02:29:42.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.008+0000 7f1e88e9a640 1 -- 172.21.15.67:0/2590334669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e8406edf0 msgr2=0x7f1e8406dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.008+0000 7f1e88e9a640 1 --2- 172.21.15.67:0/2590334669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e8406edf0 0x7f1e8406dba0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1e840b2690 tx=0x7f1e7402a1e0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.008+0000 7f1e88e9a640 1 -- 172.21.15.67:0/2590334669 shutdown_connections 2024-04-25T02:29:42.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.008+0000 7f1e88e9a640 1 --2- 172.21.15.67:0/2590334669 >> v2:172.21.15.176:3300/0 conn(0x7f1e840ae8e0 0x7f1e840aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.008+0000 7f1e88e9a640 1 --2- 172.21.15.67:0/2590334669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e8406edf0 0x7f1e8406dba0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.008+0000 7f1e88e9a640 1 --2- 172.21.15.67:0/2590334669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e84156620 0x7f1e8415cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.008+0000 7f1e88e9a640 1 -- 172.21.15.67:0/2590334669 >> 172.21.15.67:0/2590334669 conn(0x7f1e840b19c0 msgr2=0x7f1e840b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:42.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.008+0000 7f1e88e9a640 1 -- 172.21.15.67:0/2590334669 shutdown_connections 2024-04-25T02:29:42.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.008+0000 7f1e88e9a640 1 -- 172.21.15.67:0/2590334669 wait complete. 2024-04-25T02:29:42.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.010+0000 7f1e88e9a640 1 Processor -- start 2024-04-25T02:29:42.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.010+0000 7f1e88e9a640 1 -- start start 2024-04-25T02:29:42.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.010+0000 7f1e88e9a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e8406edf0 0x7f1e8414b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.010+0000 7f1e88e9a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e840ae8e0 0x7f1e8415c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.010+0000 7f1e88e9a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e84156620 0x7f1e8415cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.010+0000 7f1e88e9a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1e8406e0e0 con 0x7f1e840ae8e0 2024-04-25T02:29:42.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.010+0000 7f1e88e9a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1e840af2b0 con 0x7f1e8406edf0 2024-04-25T02:29:42.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.010+0000 7f1e88e9a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1e840ad340 con 0x7f1e84156620 2024-04-25T02:29:42.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.011+0000 7f1e81d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e840ae8e0 0x7f1e8415c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.011+0000 7f1e81d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e840ae8e0 0x7f1e8415c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58574/0 (socket says 172.21.15.67:58574) 2024-04-25T02:29:42.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.011+0000 7f1e81d9b640 1 -- 172.21.15.67:0/3402119280 learned_addr learned my addr 172.21.15.67:0/3402119280 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:42.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.011+0000 7f1e82d9d640 1 --2- 172.21.15.67:0/3402119280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e84156620 0x7f1e8415cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.011+0000 7f1e8259c640 1 --2- 172.21.15.67:0/3402119280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e8406edf0 0x7f1e8414b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.011+0000 7f1e81d9b640 1 -- 172.21.15.67:0/3402119280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e84156620 msgr2=0x7f1e8415cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.011+0000 7f1e81d9b640 1 --2- 172.21.15.67:0/3402119280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e84156620 0x7f1e8415cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.011+0000 7f1e81d9b640 1 -- 172.21.15.67:0/3402119280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e8406edf0 msgr2=0x7f1e8414b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.011+0000 7f1e81d9b640 1 --2- 172.21.15.67:0/3402119280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e8406edf0 0x7f1e8414b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.011+0000 7f1e81d9b640 1 -- 172.21.15.67:0/3402119280 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e8415ea60 con 0x7f1e840ae8e0 2024-04-25T02:29:42.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.011+0000 7f1e82d9d640 1 --2- 172.21.15.67:0/3402119280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e84156620 0x7f1e8415cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:42.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.011+0000 7f1e8259c640 1 --2- 172.21.15.67:0/3402119280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e8406edf0 0x7f1e8414b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:42.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.011+0000 7f1e81d9b640 1 --2- 172.21.15.67:0/3402119280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e840ae8e0 0x7f1e8415c630 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1e74000c00 tx=0x7f1e740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:42.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.011+0000 7f1e72ffd640 1 -- 172.21.15.67:0/3402119280 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e74041070 con 0x7f1e840ae8e0 2024-04-25T02:29:42.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.011+0000 7f1e72ffd640 1 -- 172.21.15.67:0/3402119280 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e7403c870 con 0x7f1e840ae8e0 2024-04-25T02:29:42.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.011+0000 7f1e72ffd640 1 -- 172.21.15.67:0/3402119280 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e74037040 con 0x7f1e840ae8e0 2024-04-25T02:29:42.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.011+0000 7f1e88e9a640 1 -- 172.21.15.67:0/3402119280 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e841f2680 con 0x7f1e840ae8e0 2024-04-25T02:29:42.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.011+0000 7f1e88e9a640 1 -- 172.21.15.67:0/3402119280 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e84157870 con 0x7f1e840ae8e0 2024-04-25T02:29:42.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.012+0000 7f1e88e9a640 1 -- 172.21.15.67:0/3402119280 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e84069110 con 0x7f1e840ae8e0 2024-04-25T02:29:42.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.013+0000 7f1e72ffd640 1 -- 172.21.15.67:0/3402119280 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f1e74044070 con 0x7f1e840ae8e0 2024-04-25T02:29:42.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.013+0000 7f1e72ffd640 1 --2- 172.21.15.67:0/3402119280 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f1e6406bfe0 0x7f1e6406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.013+0000 7f1e72ffd640 1 -- 172.21.15.67:0/3402119280 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1e740abe60 con 0x7f1e840ae8e0 2024-04-25T02:29:42.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.013+0000 7f1e8259c640 1 --2- 172.21.15.67:0/3402119280 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f1e6406bfe0 0x7f1e6406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.014+0000 7f1e8259c640 1 --2- 172.21.15.67:0/3402119280 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f1e6406bfe0 0x7f1e6406e4a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1e78006fd0 tx=0x7f1e78008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:42.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.017+0000 7f1e72ffd640 1 -- 172.21.15.67:0/3402119280 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1e7407a740 con 0x7f1e840ae8e0 2024-04-25T02:29:42.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.199+0000 7f1e88e9a640 1 -- 172.21.15.67:0/3402119280 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1e84072070 con 0x7f1e840ae8e0 2024-04-25T02:29:42.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.200+0000 7f1e72ffd640 1 -- 172.21.15.67:0/3402119280 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7f1e7407a040 con 0x7f1e840ae8e0 2024-04-25T02:29:42.203 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-25T02:29:42.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.202+0000 7f1e88e9a640 1 -- 172.21.15.67:0/3402119280 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f1e6406bfe0 msgr2=0x7f1e6406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.202+0000 7f1e88e9a640 1 --2- 172.21.15.67:0/3402119280 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f1e6406bfe0 0x7f1e6406e4a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1e78006fd0 tx=0x7f1e78008040 comp rx=0 tx=0).stop 2024-04-25T02:29:42.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.202+0000 7f1e88e9a640 1 -- 172.21.15.67:0/3402119280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e840ae8e0 msgr2=0x7f1e8415c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.202+0000 7f1e88e9a640 1 --2- 172.21.15.67:0/3402119280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e840ae8e0 0x7f1e8415c630 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1e74000c00 tx=0x7f1e740046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.202+0000 7f1e88e9a640 1 -- 172.21.15.67:0/3402119280 shutdown_connections 2024-04-25T02:29:42.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.202+0000 7f1e88e9a640 1 --2- 172.21.15.67:0/3402119280 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f1e6406bfe0 0x7f1e6406e4a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.202+0000 7f1e88e9a640 1 --2- 172.21.15.67:0/3402119280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e84156620 0x7f1e8415cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.202+0000 7f1e88e9a640 1 --2- 172.21.15.67:0/3402119280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e840ae8e0 0x7f1e8415c630 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.202+0000 7f1e88e9a640 1 --2- 172.21.15.67:0/3402119280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e8406edf0 0x7f1e8414b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.202+0000 7f1e88e9a640 1 -- 172.21.15.67:0/3402119280 >> 172.21.15.67:0/3402119280 conn(0x7f1e840b19c0 msgr2=0x7f1e84072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:42.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.202+0000 7f1e88e9a640 1 -- 172.21.15.67:0/3402119280 shutdown_connections 2024-04-25T02:29:42.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.202+0000 7f1e88e9a640 1 -- 172.21.15.67:0/3402119280 wait complete. 2024-04-25T02:29:42.216 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:29:42.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.316+0000 7f23dc19d640 1 Processor -- start 2024-04-25T02:29:42.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.317+0000 7f23dc19d640 1 -- start start 2024-04-25T02:29:42.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.317+0000 7f23dc19d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f23d415b090 0x7f23d409db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.317+0000 7f23dc19d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d40b2cc0 0x7f23d406e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.317+0000 7f23dc19d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f23d406ea70 0x7f23d415ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.317+0000 7f23dc19d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f23d40ad820 con 0x7f23d406ea70 2024-04-25T02:29:42.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.317+0000 7f23dc19d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f23d40b3260 con 0x7f23d415b090 2024-04-25T02:29:42.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.317+0000 7f23dc19d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f23d40b3540 con 0x7f23d40b2cc0 2024-04-25T02:29:42.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.318+0000 7f23da73a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f23d406ea70 0x7f23d415ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.318+0000 7f23da73a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f23d406ea70 0x7f23d415ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58580/0 (socket says 172.21.15.67:58580) 2024-04-25T02:29:42.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.318+0000 7f23da73a640 1 -- 172.21.15.67:0/4193517517 learned_addr learned my addr 172.21.15.67:0/4193517517 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:42.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.318+0000 7f23d9738640 1 --2- 172.21.15.67:0/4193517517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d40b2cc0 0x7f23d406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.318+0000 7f23d9f39640 1 --2- 172.21.15.67:0/4193517517 >> v2:172.21.15.176:3300/0 conn(0x7f23d415b090 0x7f23d409db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.318+0000 7f23da73a640 1 -- 172.21.15.67:0/4193517517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d40b2cc0 msgr2=0x7f23d406e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:42.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.318+0000 7f23da73a640 1 --2- 172.21.15.67:0/4193517517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d40b2cc0 0x7f23d406e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.318+0000 7f23da73a640 1 -- 172.21.15.67:0/4193517517 >> v2:172.21.15.176:3300/0 conn(0x7f23d415b090 msgr2=0x7f23d409db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:42.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.318+0000 7f23da73a640 1 --2- 172.21.15.67:0/4193517517 >> v2:172.21.15.176:3300/0 conn(0x7f23d415b090 0x7f23d409db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.318+0000 7f23da73a640 1 -- 172.21.15.67:0/4193517517 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d40b3820 con 0x7f23d406ea70 2024-04-25T02:29:42.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.319+0000 7f23da73a640 1 --2- 172.21.15.67:0/4193517517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d406ea70 0x7f23d415ec00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f23d40709b0 tx=0x7f23cc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd872599f1517c1d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:42.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.319+0000 7f23d8f37640 1 -- 172.21.15.67:0/4193517517 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc037070 con 0x7f23d406ea70 2024-04-25T02:29:42.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.319+0000 7f23d8f37640 1 -- 172.21.15.67:0/4193517517 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23cc032440 con 0x7f23d406ea70 2024-04-25T02:29:42.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.319+0000 7f23d8f37640 1 -- 172.21.15.67:0/4193517517 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc032810 con 0x7f23d406ea70 2024-04-25T02:29:42.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.319+0000 7f23dc19d640 1 -- 172.21.15.67:0/4193517517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d406ea70 msgr2=0x7f23d415ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.319+0000 7f23dc19d640 1 --2- 172.21.15.67:0/4193517517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d406ea70 0x7f23d415ec00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f23d40709b0 tx=0x7f23cc02a1e0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.319+0000 7f23dc19d640 1 -- 172.21.15.67:0/4193517517 shutdown_connections 2024-04-25T02:29:42.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.319+0000 7f23dc19d640 1 --2- 172.21.15.67:0/4193517517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d406ea70 0x7f23d415ec00 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.319+0000 7f23dc19d640 1 --2- 172.21.15.67:0/4193517517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d40b2cc0 0x7f23d406e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.319+0000 7f23dc19d640 1 --2- 172.21.15.67:0/4193517517 >> v2:172.21.15.176:3300/0 conn(0x7f23d415b090 0x7f23d409db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.319+0000 7f23dc19d640 1 -- 172.21.15.67:0/4193517517 >> 172.21.15.67:0/4193517517 conn(0x7f23d40b19c0 msgr2=0x7f23d40b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:42.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.319+0000 7f23dc19d640 1 -- 172.21.15.67:0/4193517517 shutdown_connections 2024-04-25T02:29:42.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.319+0000 7f23dc19d640 1 -- 172.21.15.67:0/4193517517 wait complete. 2024-04-25T02:29:42.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.321+0000 7f23dc19d640 1 Processor -- start 2024-04-25T02:29:42.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.321+0000 7f23dc19d640 1 -- start start 2024-04-25T02:29:42.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.321+0000 7f23dc19d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d406ea70 0x7f23d4159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.321+0000 7f23dc19d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23d40b2cc0 0x7f23d41460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.321+0000 7f23dc19d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d415b090 0x7f23d41487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.321+0000 7f23dc19d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f23d415b470 con 0x7f23d406ea70 2024-04-25T02:29:42.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.321+0000 7f23dc19d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f23d40b4f70 con 0x7f23d40b2cc0 2024-04-25T02:29:42.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.321+0000 7f23dc19d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f23d4070e10 con 0x7f23d415b090 2024-04-25T02:29:42.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.321+0000 7f23d9f39640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d406ea70 0x7f23d4159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.321+0000 7f23d9f39640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d406ea70 0x7f23d4159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58590/0 (socket says 172.21.15.67:58590) 2024-04-25T02:29:42.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.321+0000 7f23d9f39640 1 -- 172.21.15.67:0/1113380416 learned_addr learned my addr 172.21.15.67:0/1113380416 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:42.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.322+0000 7f23da73a640 1 --2- 172.21.15.67:0/1113380416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d415b090 0x7f23d41487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.322+0000 7f23d9738640 1 --2- 172.21.15.67:0/1113380416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23d40b2cc0 0x7f23d41460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.322+0000 7f23d9f39640 1 -- 172.21.15.67:0/1113380416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d415b090 msgr2=0x7f23d41487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.322+0000 7f23d9f39640 1 --2- 172.21.15.67:0/1113380416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d415b090 0x7f23d41487c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.322+0000 7f23d9f39640 1 -- 172.21.15.67:0/1113380416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23d40b2cc0 msgr2=0x7f23d41460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.322+0000 7f23d9f39640 1 --2- 172.21.15.67:0/1113380416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23d40b2cc0 0x7f23d41460d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.322+0000 7f23d9f39640 1 -- 172.21.15.67:0/1113380416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d409aa70 con 0x7f23d406ea70 2024-04-25T02:29:42.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.322+0000 7f23da73a640 1 --2- 172.21.15.67:0/1113380416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d415b090 0x7f23d41487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:42.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.322+0000 7f23d9f39640 1 --2- 172.21.15.67:0/1113380416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d406ea70 0x7f23d4159a80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f23c4007f20 tx=0x7f23c400e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:42.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.322+0000 7f23d27fc640 1 -- 172.21.15.67:0/1113380416 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4014620 con 0x7f23d406ea70 2024-04-25T02:29:42.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.322+0000 7f23d27fc640 1 -- 172.21.15.67:0/1113380416 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c4019070 con 0x7f23d406ea70 2024-04-25T02:29:42.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.322+0000 7f23dc19d640 1 -- 172.21.15.67:0/1113380416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d409ad50 con 0x7f23d406ea70 2024-04-25T02:29:42.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.322+0000 7f23d27fc640 1 -- 172.21.15.67:0/1113380416 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4014a00 con 0x7f23d406ea70 2024-04-25T02:29:42.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.322+0000 7f23dc19d640 1 -- 172.21.15.67:0/1113380416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d4159280 con 0x7f23d406ea70 2024-04-25T02:29:42.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.323+0000 7f23dc19d640 1 -- 172.21.15.67:0/1113380416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d4069110 con 0x7f23d406ea70 2024-04-25T02:29:42.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.324+0000 7f23d27fc640 1 -- 172.21.15.67:0/1113380416 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f23c4014ba0 con 0x7f23d406ea70 2024-04-25T02:29:42.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.324+0000 7f23d27fc640 1 --2- 172.21.15.67:0/1113380416 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f23c006c010 0x7f23c006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.324+0000 7f23d27fc640 1 -- 172.21.15.67:0/1113380416 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f23c408bac0 con 0x7f23d406ea70 2024-04-25T02:29:42.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.324+0000 7f23d9738640 1 --2- 172.21.15.67:0/1113380416 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f23c006c010 0x7f23c006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.325+0000 7f23d9738640 1 --2- 172.21.15.67:0/1113380416 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f23c006c010 0x7f23c006e4d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f23d406ef00 tx=0x7f23c8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:42.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.328+0000 7f23d27fc640 1 -- 172.21.15.67:0/1113380416 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f23c405a160 con 0x7f23d406ea70 2024-04-25T02:29:42.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.514+0000 7f23dc19d640 1 -- 172.21.15.67:0/1113380416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f23d406cdd0 con 0x7f23d406ea70 2024-04-25T02:29:42.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.514+0000 7f23d27fc640 1 -- 172.21.15.67:0/1113380416 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7f23c4059a60 con 0x7f23d406ea70 2024-04-25T02:29:42.517 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-25T02:29:42.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.516+0000 7f23dc19d640 1 -- 172.21.15.67:0/1113380416 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f23c006c010 msgr2=0x7f23c006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.516+0000 7f23dc19d640 1 --2- 172.21.15.67:0/1113380416 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f23c006c010 0x7f23c006e4d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f23d406ef00 tx=0x7f23c8008040 comp rx=0 tx=0).stop 2024-04-25T02:29:42.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.516+0000 7f23dc19d640 1 -- 172.21.15.67:0/1113380416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d406ea70 msgr2=0x7f23d4159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.516+0000 7f23dc19d640 1 --2- 172.21.15.67:0/1113380416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d406ea70 0x7f23d4159a80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f23c4007f20 tx=0x7f23c400e570 comp rx=0 tx=0).stop 2024-04-25T02:29:42.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.516+0000 7f23dc19d640 1 -- 172.21.15.67:0/1113380416 shutdown_connections 2024-04-25T02:29:42.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.516+0000 7f23dc19d640 1 --2- 172.21.15.67:0/1113380416 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f23c006c010 0x7f23c006e4d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.516+0000 7f23dc19d640 1 --2- 172.21.15.67:0/1113380416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d415b090 0x7f23d41487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.516+0000 7f23dc19d640 1 --2- 172.21.15.67:0/1113380416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23d40b2cc0 0x7f23d41460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.516+0000 7f23dc19d640 1 --2- 172.21.15.67:0/1113380416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23d406ea70 0x7f23d4159a80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.516+0000 7f23dc19d640 1 -- 172.21.15.67:0/1113380416 >> 172.21.15.67:0/1113380416 conn(0x7f23d40b19c0 msgr2=0x7f23d40adb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:42.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.516+0000 7f23dc19d640 1 -- 172.21.15.67:0/1113380416 shutdown_connections 2024-04-25T02:29:42.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.516+0000 7f23dc19d640 1 -- 172.21.15.67:0/1113380416 wait complete. 2024-04-25T02:29:42.530 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:29:42.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.628+0000 7ff4dfc7b640 1 Processor -- start 2024-04-25T02:29:42.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.628+0000 7ff4dfc7b640 1 -- start start 2024-04-25T02:29:42.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.629+0000 7ff4dfc7b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff4d815e210 0x7ff4d806cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.629+0000 7ff4dfc7b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4d815e5f0 0x7ff4d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.629+0000 7ff4dfc7b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff4d80cecc0 0x7ff4d80cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.629+0000 7ff4dfc7b640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff4d806c6f0 con 0x7ff4d815e210 2024-04-25T02:29:42.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.629+0000 7ff4dfc7b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff4d80d2cc0 con 0x7ff4d80cecc0 2024-04-25T02:29:42.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.629+0000 7ff4dfc7b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff4d80d2fa0 con 0x7ff4d815e5f0 2024-04-25T02:29:42.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.629+0000 7ff4dda17640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff4d815e210 0x7ff4d806cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.629+0000 7ff4dda17640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff4d815e210 0x7ff4d806cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58600/0 (socket says 172.21.15.67:58600) 2024-04-25T02:29:42.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.629+0000 7ff4dda17640 1 -- 172.21.15.67:0/4243571795 learned_addr learned my addr 172.21.15.67:0/4243571795 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:42.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.629+0000 7ff4dd216640 1 --2- 172.21.15.67:0/4243571795 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4d815e5f0 0x7ff4d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.629+0000 7ff4de218640 1 --2- 172.21.15.67:0/4243571795 >> v2:172.21.15.176:3300/0 conn(0x7ff4d80cecc0 0x7ff4d80cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.630+0000 7ff4dda17640 1 -- 172.21.15.67:0/4243571795 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4d815e5f0 msgr2=0x7ff4d806d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:42.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.630+0000 7ff4dda17640 1 --2- 172.21.15.67:0/4243571795 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4d815e5f0 0x7ff4d806d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.630+0000 7ff4dda17640 1 -- 172.21.15.67:0/4243571795 >> v2:172.21.15.176:3300/0 conn(0x7ff4d80cecc0 msgr2=0x7ff4d80cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:42.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.630+0000 7ff4dda17640 1 --2- 172.21.15.67:0/4243571795 >> v2:172.21.15.176:3300/0 conn(0x7ff4d80cecc0 0x7ff4d80cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.630+0000 7ff4dda17640 1 -- 172.21.15.67:0/4243571795 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d806c0a0 con 0x7ff4d815e210 2024-04-25T02:29:42.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.630+0000 7ff4de218640 1 --2- 172.21.15.67:0/4243571795 >> v2:172.21.15.176:3300/0 conn(0x7ff4d80cecc0 0x7ff4d80cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:42.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.630+0000 7ff4dda17640 1 --2- 172.21.15.67:0/4243571795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4d815e210 0x7ff4d806cb80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff4d808e0d0 tx=0x7ff4d402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d71caca3dacab14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:42.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.630+0000 7ff4dca15640 1 -- 172.21.15.67:0/4243571795 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4037070 con 0x7ff4d815e210 2024-04-25T02:29:42.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.630+0000 7ff4dca15640 1 -- 172.21.15.67:0/4243571795 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4d4032440 con 0x7ff4d815e210 2024-04-25T02:29:42.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.630+0000 7ff4dca15640 1 -- 172.21.15.67:0/4243571795 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4032810 con 0x7ff4d815e210 2024-04-25T02:29:42.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.631+0000 7ff4dfc7b640 1 -- 172.21.15.67:0/4243571795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4d815e210 msgr2=0x7ff4d806cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.631+0000 7ff4dfc7b640 1 --2- 172.21.15.67:0/4243571795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4d815e210 0x7ff4d806cb80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff4d808e0d0 tx=0x7ff4d402a1e0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.631+0000 7ff4dfc7b640 1 -- 172.21.15.67:0/4243571795 shutdown_connections 2024-04-25T02:29:42.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.631+0000 7ff4dfc7b640 1 --2- 172.21.15.67:0/4243571795 >> v2:172.21.15.176:3300/0 conn(0x7ff4d80cecc0 0x7ff4d80cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.631+0000 7ff4dfc7b640 1 --2- 172.21.15.67:0/4243571795 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4d815e5f0 0x7ff4d806d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.631+0000 7ff4dfc7b640 1 --2- 172.21.15.67:0/4243571795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4d815e210 0x7ff4d806cb80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.631+0000 7ff4dfc7b640 1 -- 172.21.15.67:0/4243571795 >> 172.21.15.67:0/4243571795 conn(0x7ff4d808dbb0 msgr2=0x7ff4d809d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:42.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.631+0000 7ff4dfc7b640 1 -- 172.21.15.67:0/4243571795 shutdown_connections 2024-04-25T02:29:42.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.631+0000 7ff4dfc7b640 1 -- 172.21.15.67:0/4243571795 wait complete. 2024-04-25T02:29:42.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.632+0000 7ff4dfc7b640 1 Processor -- start 2024-04-25T02:29:42.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.632+0000 7ff4dfc7b640 1 -- start start 2024-04-25T02:29:42.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.633+0000 7ff4dfc7b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4d80cecc0 0x7ff4d80d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.633+0000 7ff4dfc7b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4d815e210 0x7ff4d81573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.633+0000 7ff4dfc7b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4d815e5f0 0x7ff4d81578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.633+0000 7ff4dfc7b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d80d3fe0 con 0x7ff4d815e210 2024-04-25T02:29:42.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.633+0000 7ff4dfc7b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d80d3e60 con 0x7ff4d80cecc0 2024-04-25T02:29:42.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.633+0000 7ff4dfc7b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff4d80d4160 con 0x7ff4d815e5f0 2024-04-25T02:29:42.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.633+0000 7ff4dd216640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4d815e210 0x7ff4d81573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.633+0000 7ff4dd216640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4d815e210 0x7ff4d81573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58610/0 (socket says 172.21.15.67:58610) 2024-04-25T02:29:42.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.633+0000 7ff4dd216640 1 -- 172.21.15.67:0/229935266 learned_addr learned my addr 172.21.15.67:0/229935266 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:42.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.633+0000 7ff4de218640 1 --2- 172.21.15.67:0/229935266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4d815e5f0 0x7ff4d81578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.633+0000 7ff4dda17640 1 --2- 172.21.15.67:0/229935266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4d80cecc0 0x7ff4d80d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.633+0000 7ff4dd216640 1 -- 172.21.15.67:0/229935266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4d815e5f0 msgr2=0x7ff4d81578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.633+0000 7ff4dd216640 1 --2- 172.21.15.67:0/229935266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4d815e5f0 0x7ff4d81578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.633+0000 7ff4dd216640 1 -- 172.21.15.67:0/229935266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4d80cecc0 msgr2=0x7ff4d80d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.633+0000 7ff4dd216640 1 --2- 172.21.15.67:0/229935266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4d80cecc0 0x7ff4d80d03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.633+0000 7ff4dd216640 1 -- 172.21.15.67:0/229935266 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d80cbfe0 con 0x7ff4d815e210 2024-04-25T02:29:42.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.633+0000 7ff4de218640 1 --2- 172.21.15.67:0/229935266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4d815e5f0 0x7ff4d81578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:42.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.634+0000 7ff4dd216640 1 --2- 172.21.15.67:0/229935266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4d815e210 0x7ff4d81573a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800d5c0 tx=0x7ff4c800da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:42.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.634+0000 7ff4ce7fc640 1 -- 172.21.15.67:0/229935266 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80125f0 con 0x7ff4d815e210 2024-04-25T02:29:42.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.634+0000 7ff4ce7fc640 1 -- 172.21.15.67:0/229935266 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c8019070 con 0x7ff4d815e210 2024-04-25T02:29:42.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.634+0000 7ff4dfc7b640 1 -- 172.21.15.67:0/229935266 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d815a5d0 con 0x7ff4d815e210 2024-04-25T02:29:42.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.634+0000 7ff4ce7fc640 1 -- 172.21.15.67:0/229935266 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80129d0 con 0x7ff4d815e210 2024-04-25T02:29:42.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.634+0000 7ff4dfc7b640 1 -- 172.21.15.67:0/229935266 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d815ab90 con 0x7ff4d815e210 2024-04-25T02:29:42.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.635+0000 7ff4dfc7b640 1 -- 172.21.15.67:0/229935266 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4d80d4f70 con 0x7ff4d815e210 2024-04-25T02:29:42.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.635+0000 7ff4ce7fc640 1 -- 172.21.15.67:0/229935266 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7ff4c8012b70 con 0x7ff4d815e210 2024-04-25T02:29:42.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.636+0000 7ff4ce7fc640 1 --2- 172.21.15.67:0/229935266 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff4bc06bfe0 0x7ff4bc06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.636+0000 7ff4ce7fc640 1 -- 172.21.15.67:0/229935266 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff4c808b4e0 con 0x7ff4d815e210 2024-04-25T02:29:42.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.636+0000 7ff4dda17640 1 --2- 172.21.15.67:0/229935266 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff4bc06bfe0 0x7ff4bc06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.637+0000 7ff4dda17640 1 --2- 172.21.15.67:0/229935266 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff4bc06bfe0 0x7ff4bc06e4a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4034000 tx=0x7ff4d402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:42.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.640+0000 7ff4ce7fc640 1 -- 172.21.15.67:0/229935266 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff4d80d4f70 con 0x7ff4d815e210 2024-04-25T02:29:42.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.862+0000 7ff4dfc7b640 1 -- 172.21.15.67:0/229935266 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4d8069110 con 0x7ff4d815e210 2024-04-25T02:29:42.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.862+0000 7ff4ce7fc640 1 -- 172.21.15.67:0/229935266 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5181 (secure 0 0 0) 0x7ff4c8059ca0 con 0x7ff4d815e210 2024-04-25T02:29:42.866 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:42.866 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/101037939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":101037939},{"type":"v1","addr":"172.21.15.176:6837","nonce":101037939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4873,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/958313587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":958313587},{"type":"v1","addr":"172.21.15.176:6836","nonce":958313587}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/2806970849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2806970849},{"type":"v1","addr":"172.21.15.67:6834","nonce":2806970849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:29:17.693906+0000","modified":"2024-04-25T02:29:19.690632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2564564590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":2564564590},{"type":"v1","addr":"172.21.15.67:6835","nonce":2564564590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5085,"qdb_cluster":[5085]},"id":2}]} 2024-04-25T02:29:42.866 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 15 2024-04-25T02:29:42.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.865+0000 7ff4dfc7b640 1 -- 172.21.15.67:0/229935266 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff4bc06bfe0 msgr2=0x7ff4bc06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.865+0000 7ff4dfc7b640 1 --2- 172.21.15.67:0/229935266 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff4bc06bfe0 0x7ff4bc06e4a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4034000 tx=0x7ff4d402e000 comp rx=0 tx=0).stop 2024-04-25T02:29:42.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.865+0000 7ff4dfc7b640 1 -- 172.21.15.67:0/229935266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4d815e210 msgr2=0x7ff4d81573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.865+0000 7ff4dfc7b640 1 --2- 172.21.15.67:0/229935266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4d815e210 0x7ff4d81573a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800d5c0 tx=0x7ff4c800da80 comp rx=0 tx=0).stop 2024-04-25T02:29:42.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.865+0000 7ff4dfc7b640 1 -- 172.21.15.67:0/229935266 shutdown_connections 2024-04-25T02:29:42.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.865+0000 7ff4dfc7b640 1 --2- 172.21.15.67:0/229935266 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff4bc06bfe0 0x7ff4bc06e4a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.865+0000 7ff4dfc7b640 1 --2- 172.21.15.67:0/229935266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4d815e5f0 0x7ff4d81578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.865+0000 7ff4dfc7b640 1 --2- 172.21.15.67:0/229935266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4d815e210 0x7ff4d81573a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.865+0000 7ff4dfc7b640 1 --2- 172.21.15.67:0/229935266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4d80cecc0 0x7ff4d80d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.865+0000 7ff4dfc7b640 1 -- 172.21.15.67:0/229935266 >> 172.21.15.67:0/229935266 conn(0x7ff4d808dbb0 msgr2=0x7ff4d815f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:42.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.865+0000 7ff4dfc7b640 1 -- 172.21.15.67:0/229935266 shutdown_connections 2024-04-25T02:29:42.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.865+0000 7ff4dfc7b640 1 -- 172.21.15.67:0/229935266 wait complete. 2024-04-25T02:29:42.879 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:29:42.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.976+0000 7fbac8f1d640 1 Processor -- start 2024-04-25T02:29:42.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.976+0000 7fbac8f1d640 1 -- start start 2024-04-25T02:29:42.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.977+0000 7fbac8f1d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbac415a6f0 0x7fbac40b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.977+0000 7fbac8f1d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbac40b4b70 0x7fbac40ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.977+0000 7fbac8f1d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbac40b33c0 con 0x7fbac406e7a0 2024-04-25T02:29:42.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.977+0000 7fbac8f1d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fbac40b3fd0 con 0x7fbac40b4b70 2024-04-25T02:29:42.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.977+0000 7fbac8f1d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbac40b36a0 con 0x7fbac415a6f0 2024-04-25T02:29:42.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.977+0000 7fbac1d9b640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fbac406e7a0 0x7fbac40b4460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:51438/0 (socket says 172.21.15.67:51438) 2024-04-25T02:29:42.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.977+0000 7fbac1d9b640 1 -- 172.21.15.67:0/3543581969 learned_addr learned my addr 172.21.15.67:0/3543581969 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:42.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.977+0000 7fbac259c640 1 --2- 172.21.15.67:0/3543581969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbac415a6f0 0x7fbac40b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.977+0000 7fbac2d9d640 1 --2- 172.21.15.67:0/3543581969 >> v2:172.21.15.176:3300/0 conn(0x7fbac40b4b70 0x7fbac40ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.977+0000 7fbac159a640 1 -- 172.21.15.67:0/3543581969 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2260944481 0 0) 0x7fbac40b33c0 con 0x7fbac406e7a0 2024-04-25T02:29:42.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac159a640 1 -- 172.21.15.67:0/3543581969 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaac003520 con 0x7fbac406e7a0 2024-04-25T02:29:42.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac159a640 1 -- 172.21.15.67:0/3543581969 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2682967688 0 0) 0x7fbaac003520 con 0x7fbac406e7a0 2024-04-25T02:29:42.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac159a640 1 -- 172.21.15.67:0/3543581969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbac415a6f0 msgr2=0x7fbac40b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:42.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac159a640 1 --2- 172.21.15.67:0/3543581969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbac415a6f0 0x7fbac40b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac159a640 1 -- 172.21.15.67:0/3543581969 >> v2:172.21.15.176:3300/0 conn(0x7fbac40b4b70 msgr2=0x7fbac40ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac159a640 1 --2- 172.21.15.67:0/3543581969 >> v2:172.21.15.176:3300/0 conn(0x7fbac40b4b70 0x7fbac40ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac159a640 1 -- 172.21.15.67:0/3543581969 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac40b3980 con 0x7fbac406e7a0 2024-04-25T02:29:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac159a640 1 -- 172.21.15.67:0/3543581969 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7fbab8001670 con 0x7fbac406e7a0 2024-04-25T02:29:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac159a640 1 -- 172.21.15.67:0/3543581969 >> v1:172.21.15.176:6789/0 conn(0x7fbac406e7a0 legacy=0x7fbac40b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac159a640 1 --2- 172.21.15.67:0/3543581969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbac415a6f0 0x7fbaac0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac159a640 1 --2- 172.21.15.67:0/3543581969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaac003f30 0x7fbaac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac159a640 1 --2- 172.21.15.67:0/3543581969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbaac004d40 0x7fbaac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac159a640 1 -- 172.21.15.67:0/3543581969 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbac40b3fd0 con 0x7fbaac003f30 2024-04-25T02:29:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac159a640 1 -- 172.21.15.67:0/3543581969 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbac40b36a0 con 0x7fbaac004d40 2024-04-25T02:29:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac159a640 1 -- 172.21.15.67:0/3543581969 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbaac00b9c0 con 0x7fbac415a6f0 2024-04-25T02:29:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac1d9b640 1 --2- 172.21.15.67:0/3543581969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaac003f30 0x7fbaac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac259c640 1 --2- 172.21.15.67:0/3543581969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbac415a6f0 0x7fbaac0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac2d9d640 1 --2- 172.21.15.67:0/3543581969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbaac004d40 0x7fbaac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac1d9b640 1 -- 172.21.15.67:0/3543581969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbac415a6f0 msgr2=0x7fbaac0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac1d9b640 1 --2- 172.21.15.67:0/3543581969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbac415a6f0 0x7fbaac0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac1d9b640 1 -- 172.21.15.67:0/3543581969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbaac004d40 msgr2=0x7fbaac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac1d9b640 1 --2- 172.21.15.67:0/3543581969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbaac004d40 0x7fbaac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.978+0000 7fbac1d9b640 1 -- 172.21.15.67:0/3543581969 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaac003520 con 0x7fbaac003f30 2024-04-25T02:29:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.979+0000 7fbac1d9b640 1 --2- 172.21.15.67:0/3543581969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaac003f30 0x7fbaac004800 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbab800c290 tx=0x7fbaac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1721f2910f1afa5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.979+0000 7fbac159a640 1 -- 172.21.15.67:0/3543581969 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab8007d50 con 0x7fbaac003f30 2024-04-25T02:29:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.979+0000 7fbac159a640 1 -- 172.21.15.67:0/3543581969 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbab802e070 con 0x7fbaac003f30 2024-04-25T02:29:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.979+0000 7fbac159a640 1 -- 172.21.15.67:0/3543581969 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab8005d90 con 0x7fbaac003f30 2024-04-25T02:29:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.980+0000 7fbac8f1d640 1 -- 172.21.15.67:0/3543581969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaac003f30 msgr2=0x7fbaac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.980+0000 7fbac8f1d640 1 --2- 172.21.15.67:0/3543581969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaac003f30 0x7fbaac004800 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbab800c290 tx=0x7fbaac005830 comp rx=0 tx=0).stop 2024-04-25T02:29:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.980+0000 7fbac2d9d640 1 -- 172.21.15.67:0/3543581969 reap_dead start 2024-04-25T02:29:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.980+0000 7fbac8f1d640 1 -- 172.21.15.67:0/3543581969 shutdown_connections 2024-04-25T02:29:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.980+0000 7fbac8f1d640 1 -- 172.21.15.67:0/3543581969 >> 172.21.15.67:0/3543581969 conn(0x7fbac40b19c0 msgr2=0x7fbac40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.980+0000 7fbac8f1d640 1 -- 172.21.15.67:0/3543581969 shutdown_connections 2024-04-25T02:29:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.980+0000 7fbac8f1d640 1 -- 172.21.15.67:0/3543581969 wait complete. 2024-04-25T02:29:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.981+0000 7fbac8f1d640 1 Processor -- start 2024-04-25T02:29:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.981+0000 7fbac8f1d640 1 -- start start 2024-04-25T02:29:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.982+0000 7fbac8f1d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaac003f30 0x7fbac409ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.982+0000 7fbac8f1d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbac4151780 0x7fbac414d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.982+0000 7fbac8f1d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbac4153300 0x7fbac4153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.982+0000 7fbac8f1d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbac415aad0 con 0x7fbaac003f30 2024-04-25T02:29:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.982+0000 7fbac8f1d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbac406ec00 con 0x7fbac4153300 2024-04-25T02:29:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.982+0000 7fbac8f1d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbac40ad5c0 con 0x7fbac4151780 2024-04-25T02:29:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.982+0000 7fbac259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaac003f30 0x7fbac409ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.982+0000 7fbac259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaac003f30 0x7fbac409ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58620/0 (socket says 172.21.15.67:58620) 2024-04-25T02:29:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.982+0000 7fbac259c640 1 -- 172.21.15.67:0/260957910 learned_addr learned my addr 172.21.15.67:0/260957910 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.982+0000 7fbac259c640 1 -- 172.21.15.67:0/260957910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbac4151780 msgr2=0x7fbac414d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.982+0000 7fbac259c640 1 --2- 172.21.15.67:0/260957910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbac4151780 0x7fbac414d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.982+0000 7fbac259c640 1 -- 172.21.15.67:0/260957910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbac4153300 msgr2=0x7fbac4153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.982+0000 7fbac259c640 1 --2- 172.21.15.67:0/260957910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbac4153300 0x7fbac4153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.982+0000 7fbac259c640 1 -- 172.21.15.67:0/260957910 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac4151c00 con 0x7fbaac003f30 2024-04-25T02:29:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.983+0000 7fbac259c640 1 --2- 172.21.15.67:0/260957910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaac003f30 0x7fbac409ce10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbab40119d0 tx=0x7fbab4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.983+0000 7fbab2ffd640 1 -- 172.21.15.67:0/260957910 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab400fa70 con 0x7fbaac003f30 2024-04-25T02:29:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.983+0000 7fbab2ffd640 1 -- 172.21.15.67:0/260957910 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbab400fc10 con 0x7fbaac003f30 2024-04-25T02:29:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.983+0000 7fbab2ffd640 1 -- 172.21.15.67:0/260957910 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab4014440 con 0x7fbaac003f30 2024-04-25T02:29:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.983+0000 7fbac8f1d640 1 -- 172.21.15.67:0/260957910 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac414de90 con 0x7fbaac003f30 2024-04-25T02:29:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.983+0000 7fbac8f1d640 1 -- 172.21.15.67:0/260957910 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac4152160 con 0x7fbaac003f30 2024-04-25T02:29:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.984+0000 7fbac8f1d640 1 -- 172.21.15.67:0/260957910 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbac4069110 con 0x7fbaac003f30 2024-04-25T02:29:42.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.984+0000 7fbab2ffd640 1 -- 172.21.15.67:0/260957910 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fbab4012040 con 0x7fbaac003f30 2024-04-25T02:29:42.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.985+0000 7fbab2ffd640 1 --2- 172.21.15.67:0/260957910 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbaa406c010 0x7fbaa406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:42.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.985+0000 7fbab2ffd640 1 -- 172.21.15.67:0/260957910 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fbab408b5a0 con 0x7fbaac003f30 2024-04-25T02:29:42.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.985+0000 7fbac1d9b640 1 --2- 172.21.15.67:0/260957910 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbaa406c010 0x7fbaa406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:42.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.986+0000 7fbac1d9b640 1 --2- 172.21.15.67:0/260957910 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbaa406c010 0x7fbaa406e4d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbab8033000 tx=0x7fbab8007000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:42.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:42.989+0000 7fbab2ffd640 1 -- 172.21.15.67:0/260957910 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbac4151c00 con 0x7fbaac003f30 2024-04-25T02:29:43.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.170+0000 7fbac8f1d640 1 -- 172.21.15.67:0/260957910 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbac406e150 con 0x7fbaac003f30 2024-04-25T02:29:43.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.171+0000 7fbab2ffd640 1 -- 172.21.15.67:0/260957910 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16645 (secure 0 0 0) 0x7fbab4088120 con 0x7fbaac003f30 2024-04-25T02:29:43.175 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:43.175 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":33,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:29:19.335566+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:29:16.301169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T02:29:16.663379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:29:43.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.173+0000 7fbac8f1d640 1 -- 172.21.15.67:0/260957910 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbaa406c010 msgr2=0x7fbaa406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:43.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.173+0000 7fbac8f1d640 1 --2- 172.21.15.67:0/260957910 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbaa406c010 0x7fbaa406e4d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbab8033000 tx=0x7fbab8007000 comp rx=0 tx=0).stop 2024-04-25T02:29:43.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.173+0000 7fbac8f1d640 1 -- 172.21.15.67:0/260957910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaac003f30 msgr2=0x7fbac409ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:43.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.173+0000 7fbac8f1d640 1 --2- 172.21.15.67:0/260957910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaac003f30 0x7fbac409ce10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbab40119d0 tx=0x7fbab4011e90 comp rx=0 tx=0).stop 2024-04-25T02:29:43.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.173+0000 7fbac8f1d640 1 -- 172.21.15.67:0/260957910 shutdown_connections 2024-04-25T02:29:43.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.173+0000 7fbac8f1d640 1 --2- 172.21.15.67:0/260957910 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbaa406c010 0x7fbaa406e4d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.173+0000 7fbac8f1d640 1 --2- 172.21.15.67:0/260957910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbac4153300 0x7fbac4153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.173+0000 7fbac8f1d640 1 --2- 172.21.15.67:0/260957910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbac4151780 0x7fbac414d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.173+0000 7fbac8f1d640 1 --2- 172.21.15.67:0/260957910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbaac003f30 0x7fbac409ce10 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.173+0000 7fbac8f1d640 1 -- 172.21.15.67:0/260957910 >> 172.21.15.67:0/260957910 conn(0x7fbac40b19c0 msgr2=0x7fbac40b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:43.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.174+0000 7fbac8f1d640 1 -- 172.21.15.67:0/260957910 shutdown_connections 2024-04-25T02:29:43.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.174+0000 7fbac8f1d640 1 -- 172.21.15.67:0/260957910 wait complete. 2024-04-25T02:29:43.188 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T02:29:43.188 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:29:43.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.286+0000 7ff9de732640 1 Processor -- start 2024-04-25T02:29:43.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.286+0000 7ff9de732640 1 -- start start 2024-04-25T02:29:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.287+0000 7ff9de732640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9d81619d0 0x7ff9d80d1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.287+0000 7ff9de732640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff9d80b3b30 0x7ff9d80d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.287+0000 7ff9de732640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9d80d24f0 con 0x7ff9d80d2cf0 2024-04-25T02:29:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.287+0000 7ff9de732640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff9d80d0b30 con 0x7ff9d80b3b30 2024-04-25T02:29:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.287+0000 7ff9de732640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff9d80d0e10 con 0x7ff9d81619d0 2024-04-25T02:29:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.287+0000 7ff9d77fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff9d80b3b30 0x7ff9d80d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.287+0000 7ff9d77fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff9d80b3b30 0x7ff9d80d27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58630/0 (socket says 172.21.15.67:58630) 2024-04-25T02:29:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.287+0000 7ff9d77fe640 1 -- 172.21.15.67:0/3446043283 learned_addr learned my addr 172.21.15.67:0/3446043283 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.288+0000 7ff9d7fff640 1 --2- 172.21.15.67:0/3446043283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9d81619d0 0x7ff9d80d1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.288+0000 7ff9d77fe640 1 -- 172.21.15.67:0/3446043283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9d81619d0 msgr2=0x7ff9d80d1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:43.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.288+0000 7ff9d77fe640 1 --2- 172.21.15.67:0/3446043283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9d81619d0 0x7ff9d80d1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.288+0000 7ff9d77fe640 1 -- 172.21.15.67:0/3446043283 >> v1:172.21.15.176:6789/0 conn(0x7ff9d80d2cf0 legacy=0x7ff9d81620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:43.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.288+0000 7ff9d77fe640 1 -- 172.21.15.67:0/3446043283 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d80d10f0 con 0x7ff9d80b3b30 2024-04-25T02:29:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.288+0000 7ff9d77fe640 1 --2- 172.21.15.67:0/3446043283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d80b3b30 0x7ff9d80d27b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009870 tx=0x7ff9c802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119c9cb1bb74b52c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.289+0000 7ff9d6ffd640 1 -- 172.21.15.67:0/3446043283 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8037070 con 0x7ff9d80b3b30 2024-04-25T02:29:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.289+0000 7ff9d6ffd640 1 -- 172.21.15.67:0/3446043283 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c8032440 con 0x7ff9d80b3b30 2024-04-25T02:29:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.289+0000 7ff9d6ffd640 1 -- 172.21.15.67:0/3446043283 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8032810 con 0x7ff9d80b3b30 2024-04-25T02:29:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.289+0000 7ff9de732640 1 -- 172.21.15.67:0/3446043283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d80b3b30 msgr2=0x7ff9d80d27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.289+0000 7ff9de732640 1 --2- 172.21.15.67:0/3446043283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d80b3b30 0x7ff9d80d27b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009870 tx=0x7ff9c802a210 comp rx=0 tx=0).stop 2024-04-25T02:29:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.289+0000 7ff9de732640 1 -- 172.21.15.67:0/3446043283 shutdown_connections 2024-04-25T02:29:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.289+0000 7ff9de732640 1 --2- 172.21.15.67:0/3446043283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d80b3b30 0x7ff9d80d27b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.289+0000 7ff9de732640 1 --2- 172.21.15.67:0/3446043283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9d81619d0 0x7ff9d80d1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.289+0000 7ff9de732640 1 -- 172.21.15.67:0/3446043283 >> 172.21.15.67:0/3446043283 conn(0x7ff9d809d4b0 msgr2=0x7ff9d80d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:43.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.289+0000 7ff9de732640 1 -- 172.21.15.67:0/3446043283 shutdown_connections 2024-04-25T02:29:43.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.289+0000 7ff9de732640 1 -- 172.21.15.67:0/3446043283 wait complete. 2024-04-25T02:29:43.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.290+0000 7ff9de732640 1 Processor -- start 2024-04-25T02:29:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.291+0000 7ff9de732640 1 -- start start 2024-04-25T02:29:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.291+0000 7ff9de732640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9d80b3b30 0x7ff9d80b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.291+0000 7ff9de732640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d80d2cf0 0x7ff9d815a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.291+0000 7ff9de732640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9d81619d0 0x7ff9d80c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.291+0000 7ff9de732640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d8161db0 con 0x7ff9d80d2cf0 2024-04-25T02:29:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.291+0000 7ff9de732640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d80cece0 con 0x7ff9d80b3b30 2024-04-25T02:29:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.291+0000 7ff9de732640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff9d80d0800 con 0x7ff9d81619d0 2024-04-25T02:29:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.291+0000 7ff9d77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d80d2cf0 0x7ff9d815a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.291+0000 7ff9d77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d80d2cf0 0x7ff9d815a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58644/0 (socket says 172.21.15.67:58644) 2024-04-25T02:29:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.291+0000 7ff9d77fe640 1 -- 172.21.15.67:0/1922348949 learned_addr learned my addr 172.21.15.67:0/1922348949 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.291+0000 7ff9d7fff640 1 --2- 172.21.15.67:0/1922348949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9d80b3b30 0x7ff9d80b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.292+0000 7ff9dcccf640 1 --2- 172.21.15.67:0/1922348949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9d81619d0 0x7ff9d80c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.292+0000 7ff9d77fe640 1 -- 172.21.15.67:0/1922348949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9d81619d0 msgr2=0x7ff9d80c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.292+0000 7ff9d77fe640 1 --2- 172.21.15.67:0/1922348949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9d81619d0 0x7ff9d80c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.292+0000 7ff9d77fe640 1 -- 172.21.15.67:0/1922348949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9d80b3b30 msgr2=0x7ff9d80b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.292+0000 7ff9d77fe640 1 --2- 172.21.15.67:0/1922348949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9d80b3b30 0x7ff9d80b5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.292+0000 7ff9d77fe640 1 -- 172.21.15.67:0/1922348949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d80ccb40 con 0x7ff9d80d2cf0 2024-04-25T02:29:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.292+0000 7ff9d7fff640 1 --2- 172.21.15.67:0/1922348949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9d80b3b30 0x7ff9d80b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.292+0000 7ff9d77fe640 1 --2- 172.21.15.67:0/1922348949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d80d2cf0 0x7ff9d815a840 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8000c00 tx=0x7ff9c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.292+0000 7ff9d4ff9640 1 -- 172.21.15.67:0/1922348949 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8037040 con 0x7ff9d80d2cf0 2024-04-25T02:29:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.292+0000 7ff9d4ff9640 1 -- 172.21.15.67:0/1922348949 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c8042070 con 0x7ff9d80d2cf0 2024-04-25T02:29:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.292+0000 7ff9de732640 1 -- 172.21.15.67:0/1922348949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d80c9060 con 0x7ff9d80d2cf0 2024-04-25T02:29:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.292+0000 7ff9d4ff9640 1 -- 172.21.15.67:0/1922348949 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8030bd0 con 0x7ff9d80d2cf0 2024-04-25T02:29:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.292+0000 7ff9de732640 1 -- 172.21.15.67:0/1922348949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d80b6200 con 0x7ff9d80d2cf0 2024-04-25T02:29:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.293+0000 7ff9de732640 1 -- 172.21.15.67:0/1922348949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9d8069110 con 0x7ff9d80d2cf0 2024-04-25T02:29:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.293+0000 7ff9d4ff9640 1 -- 172.21.15.67:0/1922348949 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7ff9c8047460 con 0x7ff9d80d2cf0 2024-04-25T02:29:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.294+0000 7ff9d4ff9640 1 --2- 172.21.15.67:0/1922348949 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff9c406bfe0 0x7ff9c406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.294+0000 7ff9d4ff9640 1 -- 172.21.15.67:0/1922348949 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff9c80abdb0 con 0x7ff9d80d2cf0 2024-04-25T02:29:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.294+0000 7ff9d7fff640 1 --2- 172.21.15.67:0/1922348949 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff9c406bfe0 0x7ff9c406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:43.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.295+0000 7ff9d7fff640 1 --2- 172.21.15.67:0/1922348949 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff9c406bfe0 0x7ff9c406e4a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00a9d0 tx=0x7ff9cc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:43.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.298+0000 7ff9d4ff9640 1 -- 172.21.15.67:0/1922348949 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff9c8045360 con 0x7ff9d80d2cf0 2024-04-25T02:29:43.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.522+0000 7ff9de732640 1 -- 172.21.15.67:0/1922348949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9d80d1780 con 0x7ff9d80d2cf0 2024-04-25T02:29:43.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.522+0000 7ff9d4ff9640 1 -- 172.21.15.67:0/1922348949 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5181 (secure 0 0 0) 0x7ff9c807a4e0 con 0x7ff9d80d2cf0 2024-04-25T02:29:43.526 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:43.526 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/101037939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":101037939},{"type":"v1","addr":"172.21.15.176:6837","nonce":101037939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4873,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/958313587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":958313587},{"type":"v1","addr":"172.21.15.176:6836","nonce":958313587}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/2806970849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2806970849},{"type":"v1","addr":"172.21.15.67:6834","nonce":2806970849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:29:17.693906+0000","modified":"2024-04-25T02:29:19.690632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2564564590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":2564564590},{"type":"v1","addr":"172.21.15.67:6835","nonce":2564564590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5085,"qdb_cluster":[5085]},"id":2}]} 2024-04-25T02:29:43.526 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 15 2024-04-25T02:29:43.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.524+0000 7ff9de732640 1 -- 172.21.15.67:0/1922348949 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff9c406bfe0 msgr2=0x7ff9c406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:43.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.524+0000 7ff9de732640 1 --2- 172.21.15.67:0/1922348949 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff9c406bfe0 0x7ff9c406e4a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00a9d0 tx=0x7ff9cc008040 comp rx=0 tx=0).stop 2024-04-25T02:29:43.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.524+0000 7ff9de732640 1 -- 172.21.15.67:0/1922348949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d80d2cf0 msgr2=0x7ff9d815a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:43.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.524+0000 7ff9de732640 1 --2- 172.21.15.67:0/1922348949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d80d2cf0 0x7ff9d815a840 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8000c00 tx=0x7ff9c80046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.524+0000 7ff9de732640 1 -- 172.21.15.67:0/1922348949 shutdown_connections 2024-04-25T02:29:43.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.524+0000 7ff9de732640 1 --2- 172.21.15.67:0/1922348949 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff9c406bfe0 0x7ff9c406e4a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.524+0000 7ff9de732640 1 --2- 172.21.15.67:0/1922348949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9d81619d0 0x7ff9d80c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.524+0000 7ff9de732640 1 --2- 172.21.15.67:0/1922348949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d80d2cf0 0x7ff9d815a840 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.524+0000 7ff9de732640 1 --2- 172.21.15.67:0/1922348949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9d80b3b30 0x7ff9d80b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.524+0000 7ff9de732640 1 -- 172.21.15.67:0/1922348949 >> 172.21.15.67:0/1922348949 conn(0x7ff9d809d4b0 msgr2=0x7ff9d815efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:43.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.525+0000 7ff9de732640 1 -- 172.21.15.67:0/1922348949 shutdown_connections 2024-04-25T02:29:43.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.525+0000 7ff9de732640 1 -- 172.21.15.67:0/1922348949 wait complete. 2024-04-25T02:29:43.539 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:29:43.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.636+0000 7fc97e29a640 1 Processor -- start 2024-04-25T02:29:43.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.636+0000 7fc97e29a640 1 -- start start 2024-04-25T02:29:43.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.637+0000 7fc97e29a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc97815c230 0x7fc978071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.637+0000 7fc97e29a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc9780acda0 0x7fc9780aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.637+0000 7fc97e29a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc9780aef50 0x7fc9780722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.637+0000 7fc97e29a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc97815c610 con 0x7fc9780aef50 2024-04-25T02:29:43.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.637+0000 7fc97e29a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc978160b20 con 0x7fc9780acda0 2024-04-25T02:29:43.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.637+0000 7fc97e29a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc9780ad200 con 0x7fc97815c230 2024-04-25T02:29:43.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.637+0000 7fc97c837640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc9780aef50 0x7fc9780722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:43.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.637+0000 7fc97c837640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc9780aef50 0x7fc9780722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58652/0 (socket says 172.21.15.67:58652) 2024-04-25T02:29:43.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.637+0000 7fc97c837640 1 -- 172.21.15.67:0/1136177469 learned_addr learned my addr 172.21.15.67:0/1136177469 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:43.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.637+0000 7fc9777fe640 1 --2- 172.21.15.67:0/1136177469 >> v2:172.21.15.176:3300/0 conn(0x7fc9780acda0 0x7fc9780aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:43.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.637+0000 7fc977fff640 1 --2- 172.21.15.67:0/1136177469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc97815c230 0x7fc978071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:43.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.637+0000 7fc97c837640 1 -- 172.21.15.67:0/1136177469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc97815c230 msgr2=0x7fc978071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:43.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.637+0000 7fc97c837640 1 --2- 172.21.15.67:0/1136177469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc97815c230 0x7fc978071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.637+0000 7fc97c837640 1 -- 172.21.15.67:0/1136177469 >> v2:172.21.15.176:3300/0 conn(0x7fc9780acda0 msgr2=0x7fc9780aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:43.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.637+0000 7fc97c837640 1 --2- 172.21.15.67:0/1136177469 >> v2:172.21.15.176:3300/0 conn(0x7fc9780acda0 0x7fc9780aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.637+0000 7fc97c837640 1 -- 172.21.15.67:0/1136177469 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97815fd60 con 0x7fc9780aef50 2024-04-25T02:29:43.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.638+0000 7fc97c837640 1 --2- 172.21.15.67:0/1136177469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9780aef50 0x7fc9780722c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc9780b5190 tx=0x7fc97002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688908dad7261221 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:43.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.638+0000 7fc976ffd640 1 -- 172.21.15.67:0/1136177469 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970036070 con 0x7fc9780aef50 2024-04-25T02:29:43.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.638+0000 7fc976ffd640 1 -- 172.21.15.67:0/1136177469 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc970031600 con 0x7fc9780aef50 2024-04-25T02:29:43.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.638+0000 7fc976ffd640 1 -- 172.21.15.67:0/1136177469 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9700319d0 con 0x7fc9780aef50 2024-04-25T02:29:43.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.639+0000 7fc97e29a640 1 -- 172.21.15.67:0/1136177469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9780aef50 msgr2=0x7fc9780722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:43.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.639+0000 7fc97e29a640 1 --2- 172.21.15.67:0/1136177469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9780aef50 0x7fc9780722c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc9780b5190 tx=0x7fc97002a6a0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.639+0000 7fc97e29a640 1 -- 172.21.15.67:0/1136177469 shutdown_connections 2024-04-25T02:29:43.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.639+0000 7fc97e29a640 1 --2- 172.21.15.67:0/1136177469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9780aef50 0x7fc9780722c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.639+0000 7fc97e29a640 1 --2- 172.21.15.67:0/1136177469 >> v2:172.21.15.176:3300/0 conn(0x7fc9780acda0 0x7fc9780aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.639+0000 7fc97e29a640 1 --2- 172.21.15.67:0/1136177469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc97815c230 0x7fc978071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.639+0000 7fc97e29a640 1 -- 172.21.15.67:0/1136177469 >> 172.21.15.67:0/1136177469 conn(0x7fc9780b19c0 msgr2=0x7fc9780b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.639+0000 7fc97e29a640 1 -- 172.21.15.67:0/1136177469 shutdown_connections 2024-04-25T02:29:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.639+0000 7fc97e29a640 1 -- 172.21.15.67:0/1136177469 wait complete. 2024-04-25T02:29:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.640+0000 7fc97e29a640 1 Processor -- start 2024-04-25T02:29:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.640+0000 7fc97e29a640 1 -- start start 2024-04-25T02:29:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.641+0000 7fc97e29a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9780acda0 0x7fc978150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.641+0000 7fc97e29a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9780aef50 0x7fc9780c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.641+0000 7fc97e29a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc97815c230 0x7fc97809b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.641+0000 7fc97e29a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc978160600 con 0x7fc9780aef50 2024-04-25T02:29:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.641+0000 7fc97e29a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc978160320 con 0x7fc9780acda0 2024-04-25T02:29:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.641+0000 7fc97e29a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc9780af3e0 con 0x7fc97815c230 2024-04-25T02:29:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.641+0000 7fc9777fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9780aef50 0x7fc9780c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.641+0000 7fc9777fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9780aef50 0x7fc9780c9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58666/0 (socket says 172.21.15.67:58666) 2024-04-25T02:29:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.641+0000 7fc9777fe640 1 -- 172.21.15.67:0/4200494913 learned_addr learned my addr 172.21.15.67:0/4200494913 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.641+0000 7fc97c837640 1 --2- 172.21.15.67:0/4200494913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc97815c230 0x7fc97809b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.641+0000 7fc977fff640 1 --2- 172.21.15.67:0/4200494913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9780acda0 0x7fc978150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.641+0000 7fc9777fe640 1 -- 172.21.15.67:0/4200494913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc97815c230 msgr2=0x7fc97809b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.641+0000 7fc9777fe640 1 --2- 172.21.15.67:0/4200494913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc97815c230 0x7fc97809b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.641+0000 7fc9777fe640 1 -- 172.21.15.67:0/4200494913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9780acda0 msgr2=0x7fc978150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.641+0000 7fc9777fe640 1 --2- 172.21.15.67:0/4200494913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9780acda0 0x7fc978150550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.641+0000 7fc9777fe640 1 -- 172.21.15.67:0/4200494913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9780ca480 con 0x7fc9780aef50 2024-04-25T02:29:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.642+0000 7fc9777fe640 1 --2- 172.21.15.67:0/4200494913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9780aef50 0x7fc9780c9a50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc96800d830 tx=0x7fc96800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.642+0000 7fc974ff9640 1 -- 172.21.15.67:0/4200494913 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968018020 con 0x7fc9780aef50 2024-04-25T02:29:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.642+0000 7fc974ff9640 1 -- 172.21.15.67:0/4200494913 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9680096a0 con 0x7fc9780aef50 2024-04-25T02:29:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.642+0000 7fc974ff9640 1 -- 172.21.15.67:0/4200494913 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968009a70 con 0x7fc9780aef50 2024-04-25T02:29:43.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.642+0000 7fc97e29a640 1 -- 172.21.15.67:0/4200494913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9780ca760 con 0x7fc9780aef50 2024-04-25T02:29:43.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.642+0000 7fc97e29a640 1 -- 172.21.15.67:0/4200494913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9780cad20 con 0x7fc9780aef50 2024-04-25T02:29:43.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.643+0000 7fc97e29a640 1 -- 172.21.15.67:0/4200494913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9780730f0 con 0x7fc9780aef50 2024-04-25T02:29:43.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.643+0000 7fc974ff9640 1 -- 172.21.15.67:0/4200494913 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fc96801b020 con 0x7fc9780aef50 2024-04-25T02:29:43.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.644+0000 7fc974ff9640 1 --2- 172.21.15.67:0/4200494913 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc96406bfe0 0x7fc96406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.644+0000 7fc974ff9640 1 -- 172.21.15.67:0/4200494913 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc96808b810 con 0x7fc9780aef50 2024-04-25T02:29:43.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.644+0000 7fc977fff640 1 --2- 172.21.15.67:0/4200494913 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc96406bfe0 0x7fc96406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:43.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.644+0000 7fc977fff640 1 --2- 172.21.15.67:0/4200494913 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc96406bfe0 0x7fc96406e4a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0079a0 tx=0x7fc96c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:43.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.648+0000 7fc974ff9640 1 -- 172.21.15.67:0/4200494913 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc9780730f0 con 0x7fc9780aef50 2024-04-25T02:29:43.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.867+0000 7fc97e29a640 1 -- 172.21.15.67:0/4200494913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc97806f6a0 con 0x7fc9780aef50 2024-04-25T02:29:43.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.867+0000 7fc974ff9640 1 -- 172.21.15.67:0/4200494913 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5181 (secure 0 0 0) 0x7fc97806f6a0 con 0x7fc9780aef50 2024-04-25T02:29:43.870 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:43.870 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/101037939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":101037939},{"type":"v1","addr":"172.21.15.176:6837","nonce":101037939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4873,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/958313587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":958313587},{"type":"v1","addr":"172.21.15.176:6836","nonce":958313587}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/2806970849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2806970849},{"type":"v1","addr":"172.21.15.67:6834","nonce":2806970849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:29:17.693906+0000","modified":"2024-04-25T02:29:19.690632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/2564564590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":2564564590},{"type":"v1","addr":"172.21.15.67:6835","nonce":2564564590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5085,"qdb_cluster":[5085]},"id":2}]} 2024-04-25T02:29:43.871 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 15 2024-04-25T02:29:43.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.869+0000 7fc97e29a640 1 -- 172.21.15.67:0/4200494913 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc96406bfe0 msgr2=0x7fc96406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:43.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.869+0000 7fc97e29a640 1 --2- 172.21.15.67:0/4200494913 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc96406bfe0 0x7fc96406e4a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0079a0 tx=0x7fc96c008040 comp rx=0 tx=0).stop 2024-04-25T02:29:43.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.869+0000 7fc97e29a640 1 -- 172.21.15.67:0/4200494913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9780aef50 msgr2=0x7fc9780c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:43.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.869+0000 7fc97e29a640 1 --2- 172.21.15.67:0/4200494913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9780aef50 0x7fc9780c9a50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc96800d830 tx=0x7fc96800dcf0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.869+0000 7fc97e29a640 1 -- 172.21.15.67:0/4200494913 shutdown_connections 2024-04-25T02:29:43.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.869+0000 7fc97e29a640 1 --2- 172.21.15.67:0/4200494913 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fc96406bfe0 0x7fc96406e4a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.869+0000 7fc97e29a640 1 --2- 172.21.15.67:0/4200494913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc97815c230 0x7fc97809b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.869+0000 7fc97e29a640 1 --2- 172.21.15.67:0/4200494913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9780aef50 0x7fc9780c9a50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.869+0000 7fc97e29a640 1 --2- 172.21.15.67:0/4200494913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9780acda0 0x7fc978150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.869+0000 7fc97e29a640 1 -- 172.21.15.67:0/4200494913 >> 172.21.15.67:0/4200494913 conn(0x7fc9780b19c0 msgr2=0x7fc9780720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:43.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.869+0000 7fc97e29a640 1 -- 172.21.15.67:0/4200494913 shutdown_connections 2024-04-25T02:29:43.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.869+0000 7fc97e29a640 1 -- 172.21.15.67:0/4200494913 wait complete. 2024-04-25T02:29:43.883 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:29:43.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.980+0000 7ff864b09640 1 Processor -- start 2024-04-25T02:29:43.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.980+0000 7ff864b09640 1 -- start start 2024-04-25T02:29:43.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.981+0000 7ff864b09640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff86015c230 0x7ff860071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.981+0000 7ff864b09640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff8600acda0 0x7ff8600aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.981+0000 7ff864b09640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff860160b20 con 0x7ff8600aef50 2024-04-25T02:29:43.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.981+0000 7ff864b09640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff86015c610 con 0x7ff8600acda0 2024-04-25T02:29:43.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.981+0000 7ff864b09640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff8600ad230 con 0x7ff86015c230 2024-04-25T02:29:43.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.981+0000 7ff85dd9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff8600acda0 0x7ff8600aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:43.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.981+0000 7ff85dd9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff8600acda0 0x7ff8600aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58674/0 (socket says 172.21.15.67:58674) 2024-04-25T02:29:43.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.981+0000 7ff85dd9b640 1 -- 172.21.15.67:0/3373457201 learned_addr learned my addr 172.21.15.67:0/3373457201 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:43.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.981+0000 7ff85dd9b640 1 -- 172.21.15.67:0/3373457201 >> v2:172.21.15.176:3300/0 conn(0x7ff86015c230 msgr2=0x7ff860071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:43.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.981+0000 7ff85dd9b640 1 --2- 172.21.15.67:0/3373457201 >> v2:172.21.15.176:3300/0 conn(0x7ff86015c230 0x7ff860071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.981+0000 7ff85dd9b640 1 -- 172.21.15.67:0/3373457201 >> v1:172.21.15.176:6789/0 conn(0x7ff8600aef50 legacy=0x7ff8600722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:43.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.981+0000 7ff85dd9b640 1 -- 172.21.15.67:0/3373457201 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86015fd60 con 0x7ff8600acda0 2024-04-25T02:29:43.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.982+0000 7ff85dd9b640 1 --2- 172.21.15.67:0/3373457201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8600acda0 0x7ff8600aea10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff86006c070 tx=0x7ff84802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89998a475826a635 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:43.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.982+0000 7ff85d59a640 1 -- 172.21.15.67:0/3373457201 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848037070 con 0x7ff8600acda0 2024-04-25T02:29:43.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.982+0000 7ff85d59a640 1 -- 172.21.15.67:0/3373457201 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff848032440 con 0x7ff8600acda0 2024-04-25T02:29:43.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.982+0000 7ff85d59a640 1 -- 172.21.15.67:0/3373457201 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848032810 con 0x7ff8600acda0 2024-04-25T02:29:43.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.983+0000 7ff864b09640 1 -- 172.21.15.67:0/3373457201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8600acda0 msgr2=0x7ff8600aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:43.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.983+0000 7ff864b09640 1 --2- 172.21.15.67:0/3373457201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8600acda0 0x7ff8600aea10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff86006c070 tx=0x7ff84802a230 comp rx=0 tx=0).stop 2024-04-25T02:29:43.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.983+0000 7ff864b09640 1 -- 172.21.15.67:0/3373457201 shutdown_connections 2024-04-25T02:29:43.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.983+0000 7ff864b09640 1 --2- 172.21.15.67:0/3373457201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8600acda0 0x7ff8600aea10 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.983+0000 7ff864b09640 1 --2- 172.21.15.67:0/3373457201 >> v2:172.21.15.176:3300/0 conn(0x7ff86015c230 0x7ff860071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.983+0000 7ff864b09640 1 -- 172.21.15.67:0/3373457201 >> 172.21.15.67:0/3373457201 conn(0x7ff8600b19c0 msgr2=0x7ff8600b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:43.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.983+0000 7ff864b09640 1 -- 172.21.15.67:0/3373457201 shutdown_connections 2024-04-25T02:29:43.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.983+0000 7ff864b09640 1 -- 172.21.15.67:0/3373457201 wait complete. 2024-04-25T02:29:43.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.984+0000 7ff864b09640 1 Processor -- start 2024-04-25T02:29:43.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.984+0000 7ff864b09640 1 -- start start 2024-04-25T02:29:43.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.985+0000 7ff864b09640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8600acda0 0x7ff8600cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.985+0000 7ff864b09640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8600aef50 0x7ff8600b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.985+0000 7ff864b09640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff86015c230 0x7ff86014eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.985+0000 7ff864b09640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff860160600 con 0x7ff8600aef50 2024-04-25T02:29:43.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.985+0000 7ff864b09640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff860160320 con 0x7ff8600acda0 2024-04-25T02:29:43.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.985+0000 7ff864b09640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff86006db80 con 0x7ff86015c230 2024-04-25T02:29:43.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.985+0000 7ff85dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8600aef50 0x7ff8600b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:43.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.985+0000 7ff85dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8600aef50 0x7ff8600b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58684/0 (socket says 172.21.15.67:58684) 2024-04-25T02:29:43.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.985+0000 7ff85dd9b640 1 -- 172.21.15.67:0/12764652 learned_addr learned my addr 172.21.15.67:0/12764652 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:43.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.985+0000 7ff85e59c640 1 --2- 172.21.15.67:0/12764652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8600acda0 0x7ff8600cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:43.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.985+0000 7ff85ed9d640 1 --2- 172.21.15.67:0/12764652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff86015c230 0x7ff86014eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:43.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.986+0000 7ff85dd9b640 1 -- 172.21.15.67:0/12764652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff86015c230 msgr2=0x7ff86014eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:43.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.986+0000 7ff85dd9b640 1 --2- 172.21.15.67:0/12764652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff86015c230 0x7ff86014eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.986+0000 7ff85dd9b640 1 -- 172.21.15.67:0/12764652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8600acda0 msgr2=0x7ff8600cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:43.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.986+0000 7ff85dd9b640 1 --2- 172.21.15.67:0/12764652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8600acda0 0x7ff8600cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:43.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.986+0000 7ff85dd9b640 1 -- 172.21.15.67:0/12764652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff860147d40 con 0x7ff8600aef50 2024-04-25T02:29:43.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.986+0000 7ff85dd9b640 1 --2- 172.21.15.67:0/12764652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8600aef50 0x7ff8600b4740 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff848000c00 tx=0x7ff8480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:43.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.986+0000 7ff856ffd640 1 -- 172.21.15.67:0/12764652 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848041070 con 0x7ff8600aef50 2024-04-25T02:29:43.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.986+0000 7ff856ffd640 1 -- 172.21.15.67:0/12764652 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff84803c870 con 0x7ff8600aef50 2024-04-25T02:29:43.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.986+0000 7ff864b09640 1 -- 172.21.15.67:0/12764652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8600cca30 con 0x7ff8600aef50 2024-04-25T02:29:43.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.986+0000 7ff856ffd640 1 -- 172.21.15.67:0/12764652 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848037040 con 0x7ff8600aef50 2024-04-25T02:29:43.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.986+0000 7ff864b09640 1 -- 172.21.15.67:0/12764652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8600ccff0 con 0x7ff8600aef50 2024-04-25T02:29:43.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.987+0000 7ff864b09640 1 -- 172.21.15.67:0/12764652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff860069110 con 0x7ff8600aef50 2024-04-25T02:29:43.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.987+0000 7ff856ffd640 1 -- 172.21.15.67:0/12764652 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7ff848044070 con 0x7ff8600aef50 2024-04-25T02:29:43.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.988+0000 7ff856ffd640 1 --2- 172.21.15.67:0/12764652 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff84006bfe0 0x7ff84006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:43.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.988+0000 7ff856ffd640 1 -- 172.21.15.67:0/12764652 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff8480abc20 con 0x7ff8600aef50 2024-04-25T02:29:43.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.988+0000 7ff85e59c640 1 --2- 172.21.15.67:0/12764652 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff84006bfe0 0x7ff84006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:43.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.989+0000 7ff85e59c640 1 --2- 172.21.15.67:0/12764652 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff84006bfe0 0x7ff84006e4a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff8580098e0 tx=0x7ff858009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:43.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:43.992+0000 7ff856ffd640 1 -- 172.21.15.67:0/12764652 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff848079d90 con 0x7ff8600aef50 2024-04-25T02:29:44.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.174+0000 7ff864b09640 1 -- 172.21.15.67:0/12764652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8600ce010 con 0x7ff8600aef50 2024-04-25T02:29:44.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.175+0000 7ff856ffd640 1 -- 172.21.15.67:0/12764652 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16645 (secure 0 0 0) 0x7ff84807e090 con 0x7ff8600aef50 2024-04-25T02:29:44.179 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:44.179 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":33,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:29:19.335566+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:29:16.301169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T02:29:16.663379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:29:44.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.177+0000 7ff864b09640 1 -- 172.21.15.67:0/12764652 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff84006bfe0 msgr2=0x7ff84006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:44.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.177+0000 7ff864b09640 1 --2- 172.21.15.67:0/12764652 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff84006bfe0 0x7ff84006e4a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff8580098e0 tx=0x7ff858009060 comp rx=0 tx=0).stop 2024-04-25T02:29:44.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.177+0000 7ff864b09640 1 -- 172.21.15.67:0/12764652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8600aef50 msgr2=0x7ff8600b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:44.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.177+0000 7ff864b09640 1 --2- 172.21.15.67:0/12764652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8600aef50 0x7ff8600b4740 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff848000c00 tx=0x7ff8480046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.177+0000 7ff864b09640 1 -- 172.21.15.67:0/12764652 shutdown_connections 2024-04-25T02:29:44.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.177+0000 7ff864b09640 1 --2- 172.21.15.67:0/12764652 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7ff84006bfe0 0x7ff84006e4a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.177+0000 7ff864b09640 1 --2- 172.21.15.67:0/12764652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff86015c230 0x7ff86014eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.177+0000 7ff864b09640 1 --2- 172.21.15.67:0/12764652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8600aef50 0x7ff8600b4740 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.177+0000 7ff864b09640 1 --2- 172.21.15.67:0/12764652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8600acda0 0x7ff8600cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.177+0000 7ff864b09640 1 -- 172.21.15.67:0/12764652 >> 172.21.15.67:0/12764652 conn(0x7ff8600b19c0 msgr2=0x7ff8600afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:44.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.177+0000 7ff864b09640 1 -- 172.21.15.67:0/12764652 shutdown_connections 2024-04-25T02:29:44.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.177+0000 7ff864b09640 1 -- 172.21.15.67:0/12764652 wait complete. 2024-04-25T02:29:44.192 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:29:44.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.290+0000 7f3fc642a640 1 Processor -- start 2024-04-25T02:29:44.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.290+0000 7f3fc642a640 1 -- start start 2024-04-25T02:29:44.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.291+0000 7f3fc642a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fc0070df0 0x7f3fc015f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:44.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.291+0000 7f3fc642a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fc00b2cc0 0x7f3fc00b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:44.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.291+0000 7f3fc642a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fc00713d0 con 0x7f3fc015b220 2024-04-25T02:29:44.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.291+0000 7f3fc642a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3fc00aee00 con 0x7f3fc0070df0 2024-04-25T02:29:44.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.291+0000 7f3fc642a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc00ae4d0 con 0x7f3fc00b2cc0 2024-04-25T02:29:44.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.291+0000 7f3fbf7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fc0070df0 0x7f3fc015f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:44.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.291+0000 7f3fbf7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fc0070df0 0x7f3fc015f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58692/0 (socket says 172.21.15.67:58692) 2024-04-25T02:29:44.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.291+0000 7f3fbf7fe640 1 -- 172.21.15.67:0/1389840264 learned_addr learned my addr 172.21.15.67:0/1389840264 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:44.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.291+0000 7f3fc49c7640 1 --2- 172.21.15.67:0/1389840264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fc00b2cc0 0x7f3fc00b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:44.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.292+0000 7f3fbf7fe640 1 -- 172.21.15.67:0/1389840264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fc00b2cc0 msgr2=0x7f3fc00b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:44.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.292+0000 7f3fbf7fe640 1 --2- 172.21.15.67:0/1389840264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fc00b2cc0 0x7f3fc00b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.292+0000 7f3fbf7fe640 1 -- 172.21.15.67:0/1389840264 >> v1:172.21.15.176:6789/0 conn(0x7f3fc015b220 legacy=0x7f3fc015ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:44.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.292+0000 7f3fbf7fe640 1 -- 172.21.15.67:0/1389840264 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc00ae7b0 con 0x7f3fc0070df0 2024-04-25T02:29:44.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.292+0000 7f3fc49c7640 1 --2- 172.21.15.67:0/1389840264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fc00b2cc0 0x7f3fc00b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:44.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.292+0000 7f3fbf7fe640 1 --2- 172.21.15.67:0/1389840264 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc0070df0 0x7f3fc015f380 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009870 tx=0x7f3fb002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85712925fac6ab68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:44.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.292+0000 7f3fbeffd640 1 -- 172.21.15.67:0/1389840264 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0037070 con 0x7f3fc0070df0 2024-04-25T02:29:44.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.292+0000 7f3fbeffd640 1 -- 172.21.15.67:0/1389840264 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fb0032440 con 0x7f3fc0070df0 2024-04-25T02:29:44.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.293+0000 7f3fbeffd640 1 -- 172.21.15.67:0/1389840264 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0032810 con 0x7f3fc0070df0 2024-04-25T02:29:44.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.293+0000 7f3fc642a640 1 -- 172.21.15.67:0/1389840264 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc0070df0 msgr2=0x7f3fc015f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:44.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.293+0000 7f3fc642a640 1 --2- 172.21.15.67:0/1389840264 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc0070df0 0x7f3fc015f380 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009870 tx=0x7f3fb002a270 comp rx=0 tx=0).stop 2024-04-25T02:29:44.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.293+0000 7f3fc642a640 1 -- 172.21.15.67:0/1389840264 shutdown_connections 2024-04-25T02:29:44.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.293+0000 7f3fc642a640 1 --2- 172.21.15.67:0/1389840264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fc00b2cc0 0x7f3fc00b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.293+0000 7f3fc642a640 1 --2- 172.21.15.67:0/1389840264 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc0070df0 0x7f3fc015f380 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.293+0000 7f3fc642a640 1 -- 172.21.15.67:0/1389840264 >> 172.21.15.67:0/1389840264 conn(0x7f3fc00b19c0 msgr2=0x7f3fc00b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:44.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.293+0000 7f3fc642a640 1 -- 172.21.15.67:0/1389840264 shutdown_connections 2024-04-25T02:29:44.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.293+0000 7f3fc642a640 1 -- 172.21.15.67:0/1389840264 wait complete. 2024-04-25T02:29:44.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.294+0000 7f3fc642a640 1 Processor -- start 2024-04-25T02:29:44.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.294+0000 7f3fc642a640 1 -- start start 2024-04-25T02:29:44.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.295+0000 7f3fc642a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fc0070df0 0x7f3fc014add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:44.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.295+0000 7f3fc642a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc00b2cc0 0x7f3fc014c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:44.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.295+0000 7f3fc642a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fc015b220 0x7f3fc014c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:44.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.295+0000 7f3fc642a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc006ed10 con 0x7f3fc00b2cc0 2024-04-25T02:29:44.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.295+0000 7f3fc642a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc006eb90 con 0x7f3fc015b220 2024-04-25T02:29:44.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.295+0000 7f3fc642a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc015f8c0 con 0x7f3fc0070df0 2024-04-25T02:29:44.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.295+0000 7f3fbf7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc00b2cc0 0x7f3fc014c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:44.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.295+0000 7f3fbf7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc00b2cc0 0x7f3fc014c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58694/0 (socket says 172.21.15.67:58694) 2024-04-25T02:29:44.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.295+0000 7f3fbf7fe640 1 -- 172.21.15.67:0/1982764819 learned_addr learned my addr 172.21.15.67:0/1982764819 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:44.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.295+0000 7f3fbffff640 1 --2- 172.21.15.67:0/1982764819 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fc0070df0 0x7f3fc014add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:44.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.295+0000 7f3fc49c7640 1 --2- 172.21.15.67:0/1982764819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fc015b220 0x7f3fc014c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:44.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.296+0000 7f3fbf7fe640 1 -- 172.21.15.67:0/1982764819 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fc0070df0 msgr2=0x7f3fc014add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:44.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.296+0000 7f3fbf7fe640 1 --2- 172.21.15.67:0/1982764819 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fc0070df0 0x7f3fc014add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.296+0000 7f3fbf7fe640 1 -- 172.21.15.67:0/1982764819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fc015b220 msgr2=0x7f3fc014c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:44.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.296+0000 7f3fbf7fe640 1 --2- 172.21.15.67:0/1982764819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fc015b220 0x7f3fc014c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.296+0000 7f3fbf7fe640 1 -- 172.21.15.67:0/1982764819 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc015b7a0 con 0x7f3fc00b2cc0 2024-04-25T02:29:44.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.296+0000 7f3fbf7fe640 1 --2- 172.21.15.67:0/1982764819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc00b2cc0 0x7f3fc014c450 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0000c00 tx=0x7f3fb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:44.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.296+0000 7f3fbcff9640 1 -- 172.21.15.67:0/1982764819 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0041020 con 0x7f3fc00b2cc0 2024-04-25T02:29:44.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.296+0000 7f3fbcff9640 1 -- 172.21.15.67:0/1982764819 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fb00306c0 con 0x7f3fc00b2cc0 2024-04-25T02:29:44.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.296+0000 7f3fc642a640 1 -- 172.21.15.67:0/1982764819 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc009d640 con 0x7f3fc00b2cc0 2024-04-25T02:29:44.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.296+0000 7f3fbcff9640 1 -- 172.21.15.67:0/1982764819 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0037040 con 0x7f3fc00b2cc0 2024-04-25T02:29:44.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.296+0000 7f3fc642a640 1 -- 172.21.15.67:0/1982764819 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc015ba40 con 0x7f3fc00b2cc0 2024-04-25T02:29:44.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.297+0000 7f3fc642a640 1 -- 172.21.15.67:0/1982764819 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fc014b310 con 0x7f3fc00b2cc0 2024-04-25T02:29:44.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.298+0000 7f3fbcff9640 1 -- 172.21.15.67:0/1982764819 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f3fb0044020 con 0x7f3fc00b2cc0 2024-04-25T02:29:44.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.298+0000 7f3fbcff9640 1 --2- 172.21.15.67:0/1982764819 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3fac06bfe0 0x7f3fac06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:44.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.298+0000 7f3fbcff9640 1 -- 172.21.15.67:0/1982764819 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f3fb00ab8b0 con 0x7f3fc00b2cc0 2024-04-25T02:29:44.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.298+0000 7f3fbffff640 1 --2- 172.21.15.67:0/1982764819 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3fac06bfe0 0x7f3fac06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:44.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.299+0000 7f3fbffff640 1 --2- 172.21.15.67:0/1982764819 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3fac06bfe0 0x7f3fac06e4a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40016e0 tx=0x7f3fb4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:44.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.302+0000 7f3fbcff9640 1 -- 172.21.15.67:0/1982764819 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3fb004b030 con 0x7f3fc00b2cc0 2024-04-25T02:29:44.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.527+0000 7f3fc642a640 1 -- 172.21.15.67:0/1982764819 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3fc0069110 con 0x7f3fc00b2cc0 2024-04-25T02:29:44.531 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-04-25T02:29:44.528+0000 7f23f648f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:29:44.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.529+0000 7f3fbcff9640 1 -- 172.21.15.67:0/1982764819 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) ==== 161+0+0 (secure 0 0 0) 0x7f3fb0079900 con 0x7f3fc00b2cc0 2024-04-25T02:29:44.532 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:29:44.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.532+0000 7f3fc642a640 1 -- 172.21.15.67:0/1982764819 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3fac06bfe0 msgr2=0x7f3fac06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:44.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.532+0000 7f3fc642a640 1 --2- 172.21.15.67:0/1982764819 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3fac06bfe0 0x7f3fac06e4a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40016e0 tx=0x7f3fb4009040 comp rx=0 tx=0).stop 2024-04-25T02:29:44.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.532+0000 7f3fc642a640 1 -- 172.21.15.67:0/1982764819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc00b2cc0 msgr2=0x7f3fc014c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:44.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.532+0000 7f3fc642a640 1 --2- 172.21.15.67:0/1982764819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc00b2cc0 0x7f3fc014c450 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0000c00 tx=0x7f3fb00046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.533+0000 7f3fc642a640 1 -- 172.21.15.67:0/1982764819 shutdown_connections 2024-04-25T02:29:44.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.533+0000 7f3fc642a640 1 --2- 172.21.15.67:0/1982764819 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f3fac06bfe0 0x7f3fac06e4a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.533+0000 7f3fc642a640 1 --2- 172.21.15.67:0/1982764819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fc015b220 0x7f3fc014c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.533+0000 7f3fc642a640 1 --2- 172.21.15.67:0/1982764819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc00b2cc0 0x7f3fc014c450 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.533+0000 7f3fc642a640 1 --2- 172.21.15.67:0/1982764819 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3fc0070df0 0x7f3fc014add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.533+0000 7f3fc642a640 1 -- 172.21.15.67:0/1982764819 >> 172.21.15.67:0/1982764819 conn(0x7f3fc00b19c0 msgr2=0x7f3fc01546a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:44.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.533+0000 7f3fc642a640 1 -- 172.21.15.67:0/1982764819 shutdown_connections 2024-04-25T02:29:44.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.533+0000 7f3fc642a640 1 -- 172.21.15.67:0/1982764819 wait complete. 2024-04-25T02:29:44.551 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T02:29:44.578 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-04-25T02:29:44.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.652+0000 7f379d479640 1 Processor -- start 2024-04-25T02:29:44.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.653+0000 7f379d479640 1 -- start start 2024-04-25T02:29:44.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.653+0000 7f379d479640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379815e760 0x7f37980cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:44.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.653+0000 7f379d479640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f37980d0900 0x7f37980d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:44.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.653+0000 7f379d479640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37980d1730 con 0x7f37980d12a0 2024-04-25T02:29:44.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.653+0000 7f379d479640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f37980d28a0 con 0x7f37980d0900 2024-04-25T02:29:44.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.653+0000 7f379d479640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f37980cff80 con 0x7f379815e760 2024-04-25T02:29:44.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.654+0000 7f3796ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379815e760 0x7f37980cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:44.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.654+0000 7f37967fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f37980d0900 0x7f37980d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:44.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.654+0000 7f3796ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379815e760 0x7f37980cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:33090/0 (socket says 172.21.15.67:33090) 2024-04-25T02:29:44.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.654+0000 7f3796ffd640 1 -- 172.21.15.67:0/3074155021 learned_addr learned my addr 172.21.15.67:0/3074155021 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:44.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.654+0000 7f3796ffd640 1 -- 172.21.15.67:0/3074155021 >> v2:172.21.15.176:3300/0 conn(0x7f37980d0900 msgr2=0x7f37980d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:44.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.654+0000 7f3796ffd640 1 --2- 172.21.15.67:0/3074155021 >> v2:172.21.15.176:3300/0 conn(0x7f37980d0900 0x7f37980d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.654+0000 7f3796ffd640 1 -- 172.21.15.67:0/3074155021 >> v1:172.21.15.176:6789/0 conn(0x7f37980d12a0 legacy=0x7f37980d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:44.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.654+0000 7f3796ffd640 1 -- 172.21.15.67:0/3074155021 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37980d2250 con 0x7f379815e760 2024-04-25T02:29:44.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.654+0000 7f37967fc640 1 --2- 172.21.15.67:0/3074155021 >> v2:172.21.15.176:3300/0 conn(0x7f37980d0900 0x7f37980d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:44.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.655+0000 7f3796ffd640 1 --2- 172.21.15.67:0/3074155021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379815e760 0x7f37980cf8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3780009870 tx=0x7f378002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39e69f1f4017dc4c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:44.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.655+0000 7f3795ffb640 1 -- 172.21.15.67:0/3074155021 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780037070 con 0x7f379815e760 2024-04-25T02:29:44.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.655+0000 7f3795ffb640 1 -- 172.21.15.67:0/3074155021 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3780032440 con 0x7f379815e760 2024-04-25T02:29:44.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.655+0000 7f3795ffb640 1 -- 172.21.15.67:0/3074155021 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780032810 con 0x7f379815e760 2024-04-25T02:29:44.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.656+0000 7f379d479640 1 -- 172.21.15.67:0/3074155021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379815e760 msgr2=0x7f37980cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:44.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.656+0000 7f379d479640 1 --2- 172.21.15.67:0/3074155021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379815e760 0x7f37980cf8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3780009870 tx=0x7f378002a250 comp rx=0 tx=0).stop 2024-04-25T02:29:44.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.656+0000 7f379d479640 1 -- 172.21.15.67:0/3074155021 shutdown_connections 2024-04-25T02:29:44.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.656+0000 7f379d479640 1 --2- 172.21.15.67:0/3074155021 >> v2:172.21.15.176:3300/0 conn(0x7f37980d0900 0x7f37980d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.656+0000 7f379d479640 1 --2- 172.21.15.67:0/3074155021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379815e760 0x7f37980cf8f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.656+0000 7f379d479640 1 -- 172.21.15.67:0/3074155021 >> 172.21.15.67:0/3074155021 conn(0x7f37980d41b0 msgr2=0x7f37980d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:44.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.656+0000 7f379d479640 1 -- 172.21.15.67:0/3074155021 shutdown_connections 2024-04-25T02:29:44.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.656+0000 7f379d479640 1 -- 172.21.15.67:0/3074155021 wait complete. 2024-04-25T02:29:44.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.657+0000 7f379d479640 1 Processor -- start 2024-04-25T02:29:44.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.657+0000 7f379d479640 1 -- start start 2024-04-25T02:29:44.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.658+0000 7f379d479640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37980d0900 0x7f37980cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:44.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.658+0000 7f379d479640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37980d12a0 0x7f379814f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:44.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.658+0000 7f379d479640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f379815e760 0x7f37980ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:44.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.658+0000 7f379d479640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f379806cfc0 con 0x7f379815e760 2024-04-25T02:29:44.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.658+0000 7f379d479640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f37980b0e40 con 0x7f37980d12a0 2024-04-25T02:29:44.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.658+0000 7f379d479640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f379815eb40 con 0x7f37980d0900 2024-04-25T02:29:44.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.658+0000 7f37977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f379815e760 0x7f37980ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:44.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.658+0000 7f37977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f379815e760 0x7f37980ca1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58726/0 (socket says 172.21.15.67:58726) 2024-04-25T02:29:44.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.658+0000 7f37977fe640 1 -- 172.21.15.67:0/2261129072 learned_addr learned my addr 172.21.15.67:0/2261129072 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:44.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.658+0000 7f37967fc640 1 --2- 172.21.15.67:0/2261129072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37980d12a0 0x7f379814f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:44.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.658+0000 7f3796ffd640 1 --2- 172.21.15.67:0/2261129072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37980d0900 0x7f37980cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:44.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.658+0000 7f37977fe640 1 -- 172.21.15.67:0/2261129072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37980d0900 msgr2=0x7f37980cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:44.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.658+0000 7f37977fe640 1 --2- 172.21.15.67:0/2261129072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37980d0900 0x7f37980cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.658+0000 7f37977fe640 1 -- 172.21.15.67:0/2261129072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37980d12a0 msgr2=0x7f379814f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:44.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.658+0000 7f37977fe640 1 --2- 172.21.15.67:0/2261129072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37980d12a0 0x7f379814f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:44.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.658+0000 7f37977fe640 1 -- 172.21.15.67:0/2261129072 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37980c9150 con 0x7f379815e760 2024-04-25T02:29:44.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.658+0000 7f3796ffd640 1 --2- 172.21.15.67:0/2261129072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37980d0900 0x7f37980cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:44.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.659+0000 7f37977fe640 1 --2- 172.21.15.67:0/2261129072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f379815e760 0x7f37980ca1f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f379000c710 tx=0x7f379000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:44.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.659+0000 7f378f7fe640 1 -- 172.21.15.67:0/2261129072 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3790016020 con 0x7f379815e760 2024-04-25T02:29:44.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.659+0000 7f378f7fe640 1 -- 172.21.15.67:0/2261129072 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3790006d50 con 0x7f379815e760 2024-04-25T02:29:44.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.659+0000 7f379d479640 1 -- 172.21.15.67:0/2261129072 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37980c9430 con 0x7f379815e760 2024-04-25T02:29:44.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.659+0000 7f378f7fe640 1 -- 172.21.15.67:0/2261129072 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3790003bb0 con 0x7f379815e760 2024-04-25T02:29:44.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.659+0000 7f379d479640 1 -- 172.21.15.67:0/2261129072 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37980c99f0 con 0x7f379815e760 2024-04-25T02:29:44.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.660+0000 7f379d479640 1 -- 172.21.15.67:0/2261129072 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3798069110 con 0x7f379815e760 2024-04-25T02:29:44.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.660+0000 7f378f7fe640 1 -- 172.21.15.67:0/2261129072 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f379000a850 con 0x7f379815e760 2024-04-25T02:29:44.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.661+0000 7f378f7fe640 1 --2- 172.21.15.67:0/2261129072 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f377806c010 0x7f377806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:44.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.661+0000 7f378f7fe640 1 -- 172.21.15.67:0/2261129072 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7f379008acd0 con 0x7f379815e760 2024-04-25T02:29:44.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.661+0000 7f3796ffd640 1 --2- 172.21.15.67:0/2261129072 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f377806c010 0x7f377806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:44.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.661+0000 7f3796ffd640 1 --2- 172.21.15.67:0/2261129072 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f377806c010 0x7f377806e4d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3780034000 tx=0x7f378002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:44.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.665+0000 7f378f7fe640 1 -- 172.21.15.67:0/2261129072 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3790020020 con 0x7f379815e760 2024-04-25T02:29:44.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:44.891+0000 7f379d479640 1 -- 172.21.15.67:0/2261129072 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f37980d3990 con 0x7f379815e760 2024-04-25T02:29:45.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.530+0000 7f378f7fe640 1 -- 172.21.15.67:0/2261129072 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f37980d1730 con 0x7f379815e760 2024-04-25T02:29:45.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.533+0000 7f379d479640 1 -- 172.21.15.67:0/2261129072 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f377806c010 msgr2=0x7f377806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:45.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.533+0000 7f379d479640 1 --2- 172.21.15.67:0/2261129072 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f377806c010 0x7f377806e4d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3780034000 tx=0x7f378002e000 comp rx=0 tx=0).stop 2024-04-25T02:29:45.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.533+0000 7f379d479640 1 -- 172.21.15.67:0/2261129072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f379815e760 msgr2=0x7f37980ca1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:45.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.533+0000 7f379d479640 1 --2- 172.21.15.67:0/2261129072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f379815e760 0x7f37980ca1f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f379000c710 tx=0x7f379000cbd0 comp rx=0 tx=0).stop 2024-04-25T02:29:45.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.533+0000 7f379d479640 1 -- 172.21.15.67:0/2261129072 shutdown_connections 2024-04-25T02:29:45.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.533+0000 7f379d479640 1 --2- 172.21.15.67:0/2261129072 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f377806c010 0x7f377806e4d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:45.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.533+0000 7f379d479640 1 --2- 172.21.15.67:0/2261129072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f379815e760 0x7f37980ca1f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:45.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.533+0000 7f379d479640 1 --2- 172.21.15.67:0/2261129072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37980d12a0 0x7f379814f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:45.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.533+0000 7f379d479640 1 --2- 172.21.15.67:0/2261129072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37980d0900 0x7f37980cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:45.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.533+0000 7f379d479640 1 -- 172.21.15.67:0/2261129072 >> 172.21.15.67:0/2261129072 conn(0x7f37980d41b0 msgr2=0x7f379815d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:45.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.533+0000 7f379d479640 1 -- 172.21.15.67:0/2261129072 shutdown_connections 2024-04-25T02:29:45.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.533+0000 7f379d479640 1 -- 172.21.15.67:0/2261129072 wait complete. 2024-04-25T02:29:45.550 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T02:29:45.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.696+0000 7f50acdf9640 1 Processor -- start 2024-04-25T02:29:45.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.697+0000 7f50acdf9640 1 -- start start 2024-04-25T02:29:45.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.698+0000 7f50acdf9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50a815a9b0 0x7f50a8070e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:45.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.698+0000 7f50acdf9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f50a80b2dc0 0x7f50a8072890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.698+0000 7f50acdf9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f50a8071350 0x7f50a80b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.698+0000 7f50acdf9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f50a8072400 con 0x7f50a80b2dc0 2024-04-25T02:29:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.698+0000 7f50acdf9640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f50a80717f0 con 0x7f50a8071350 2024-04-25T02:29:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.698+0000 7f50acdf9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f50a8071ad0 con 0x7f50a815a9b0 2024-04-25T02:29:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.698+0000 7f50a5d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f50a80b2dc0 0x7f50a8072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.698+0000 7f50a5d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f50a80b2dc0 0x7f50a8072890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58742/0 (socket says 172.21.15.67:58742) 2024-04-25T02:29:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.698+0000 7f50a5d9b640 1 -- 172.21.15.67:0/3026271321 learned_addr learned my addr 172.21.15.67:0/3026271321 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.698+0000 7f50a5d9b640 1 -- 172.21.15.67:0/3026271321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50a815a9b0 msgr2=0x7f50a8070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.698+0000 7f50a659c640 1 --2- 172.21.15.67:0/3026271321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50a815a9b0 0x7f50a8070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.698+0000 7f50a5d9b640 1 --2- 172.21.15.67:0/3026271321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50a815a9b0 0x7f50a8070e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.698+0000 7f50a6d9d640 1 --2- 172.21.15.67:0/3026271321 >> v2:172.21.15.176:3300/0 conn(0x7f50a8071350 0x7f50a80b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.698+0000 7f50a5d9b640 1 -- 172.21.15.67:0/3026271321 >> v2:172.21.15.176:3300/0 conn(0x7f50a8071350 msgr2=0x7f50a80b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.698+0000 7f50a5d9b640 1 --2- 172.21.15.67:0/3026271321 >> v2:172.21.15.176:3300/0 conn(0x7f50a8071350 0x7f50a80b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:45.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.698+0000 7f50a5d9b640 1 -- 172.21.15.67:0/3026271321 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a8071db0 con 0x7f50a80b2dc0 2024-04-25T02:29:45.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.698+0000 7f50a6d9d640 1 --2- 172.21.15.67:0/3026271321 >> v2:172.21.15.176:3300/0 conn(0x7f50a8071350 0x7f50a80b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:45.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.699+0000 7f50a5d9b640 1 --2- 172.21.15.67:0/3026271321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50a80b2dc0 0x7f50a8072890 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f50a8070da0 tx=0x7f509002b2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2003f96649c5ed9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:45.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.699+0000 7f50a559a640 1 -- 172.21.15.67:0/3026271321 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090038070 con 0x7f50a80b2dc0 2024-04-25T02:29:45.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.699+0000 7f50a559a640 1 -- 172.21.15.67:0/3026271321 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5090033640 con 0x7f50a80b2dc0 2024-04-25T02:29:45.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.699+0000 7f50a559a640 1 -- 172.21.15.67:0/3026271321 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090033a10 con 0x7f50a80b2dc0 2024-04-25T02:29:45.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.699+0000 7f50acdf9640 1 -- 172.21.15.67:0/3026271321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50a80b2dc0 msgr2=0x7f50a8072890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:45.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.699+0000 7f50acdf9640 1 --2- 172.21.15.67:0/3026271321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50a80b2dc0 0x7f50a8072890 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f50a8070da0 tx=0x7f509002b2f0 comp rx=0 tx=0).stop 2024-04-25T02:29:45.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.700+0000 7f50acdf9640 1 -- 172.21.15.67:0/3026271321 shutdown_connections 2024-04-25T02:29:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.700+0000 7f50acdf9640 1 --2- 172.21.15.67:0/3026271321 >> v2:172.21.15.176:3300/0 conn(0x7f50a8071350 0x7f50a80b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.700+0000 7f50acdf9640 1 --2- 172.21.15.67:0/3026271321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50a80b2dc0 0x7f50a8072890 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.700+0000 7f50acdf9640 1 --2- 172.21.15.67:0/3026271321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50a815a9b0 0x7f50a8070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.700+0000 7f50acdf9640 1 -- 172.21.15.67:0/3026271321 >> 172.21.15.67:0/3026271321 conn(0x7f50a80b19c0 msgr2=0x7f50a80b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.700+0000 7f50acdf9640 1 -- 172.21.15.67:0/3026271321 shutdown_connections 2024-04-25T02:29:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.700+0000 7f50acdf9640 1 -- 172.21.15.67:0/3026271321 wait complete. 2024-04-25T02:29:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.701+0000 7f50acdf9640 1 Processor -- start 2024-04-25T02:29:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.701+0000 7f50acdf9640 1 -- start start 2024-04-25T02:29:45.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.702+0000 7f50acdf9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50a8071350 0x7f50a81f86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:45.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.702+0000 7f50acdf9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50a80b2dc0 0x7f50a809c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:45.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.702+0000 7f50acdf9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50a815a9b0 0x7f50a81f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:45.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.702+0000 7f50acdf9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f50a8072f50 con 0x7f50a815a9b0 2024-04-25T02:29:45.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.702+0000 7f50acdf9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f50a8072dd0 con 0x7f50a80b2dc0 2024-04-25T02:29:45.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.702+0000 7f50acdf9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f50a80730d0 con 0x7f50a8071350 2024-04-25T02:29:45.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.702+0000 7f50a6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50a815a9b0 0x7f50a81f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:45.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.702+0000 7f50a6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50a815a9b0 0x7f50a81f3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58748/0 (socket says 172.21.15.67:58748) 2024-04-25T02:29:45.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.702+0000 7f50a6d9d640 1 -- 172.21.15.67:0/2978355362 learned_addr learned my addr 172.21.15.67:0/2978355362 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:45.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.702+0000 7f50a659c640 1 --2- 172.21.15.67:0/2978355362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50a8071350 0x7f50a81f86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:45.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.702+0000 7f50a5d9b640 1 --2- 172.21.15.67:0/2978355362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50a80b2dc0 0x7f50a809c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:45.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.702+0000 7f50a6d9d640 1 -- 172.21.15.67:0/2978355362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50a8071350 msgr2=0x7f50a81f86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:45.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.702+0000 7f50a6d9d640 1 --2- 172.21.15.67:0/2978355362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50a8071350 0x7f50a81f86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:45.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.702+0000 7f50a6d9d640 1 -- 172.21.15.67:0/2978355362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50a80b2dc0 msgr2=0x7f50a809c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:45.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.702+0000 7f50a6d9d640 1 --2- 172.21.15.67:0/2978355362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50a80b2dc0 0x7f50a809c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:45.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.702+0000 7f50a6d9d640 1 -- 172.21.15.67:0/2978355362 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a809d0c0 con 0x7f50a815a9b0 2024-04-25T02:29:45.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.702+0000 7f50a5d9b640 1 --2- 172.21.15.67:0/2978355362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50a80b2dc0 0x7f50a809c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:45.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.702+0000 7f50a6d9d640 1 --2- 172.21.15.67:0/2978355362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50a815a9b0 0x7f50a81f3db0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f509800cf20 tx=0x7f509800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:45.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.703+0000 7f509effd640 1 -- 172.21.15.67:0/2978355362 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509801a070 con 0x7f50a815a9b0 2024-04-25T02:29:45.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.703+0000 7f509effd640 1 -- 172.21.15.67:0/2978355362 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f509800d840 con 0x7f50a815a9b0 2024-04-25T02:29:45.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.703+0000 7f50acdf9640 1 -- 172.21.15.67:0/2978355362 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50a809d3a0 con 0x7f50a815a9b0 2024-04-25T02:29:45.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.703+0000 7f509effd640 1 -- 172.21.15.67:0/2978355362 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509800dc30 con 0x7f50a815a9b0 2024-04-25T02:29:45.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.703+0000 7f50acdf9640 1 -- 172.21.15.67:0/2978355362 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50a809d960 con 0x7f50a815a9b0 2024-04-25T02:29:45.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.704+0000 7f50acdf9640 1 -- 172.21.15.67:0/2978355362 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50a8069110 con 0x7f50a815a9b0 2024-04-25T02:29:45.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.704+0000 7f509effd640 1 -- 172.21.15.67:0/2978355362 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f509801d070 con 0x7f50a815a9b0 2024-04-25T02:29:45.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.704+0000 7f509effd640 1 --2- 172.21.15.67:0/2978355362 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f508806bfe0 0x7f508806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:45.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.705+0000 7f509effd640 1 -- 172.21.15.67:0/2978355362 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7f509808ba70 con 0x7f50a815a9b0 2024-04-25T02:29:45.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.705+0000 7f50a659c640 1 --2- 172.21.15.67:0/2978355362 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f508806bfe0 0x7f508806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:45.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.705+0000 7f50a659c640 1 --2- 172.21.15.67:0/2978355362 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f508806bfe0 0x7f508806e4a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f50a0006fd0 tx=0x7f50a0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:45.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.709+0000 7f509effd640 1 -- 172.21.15.67:0/2978355362 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f509805a140 con 0x7f50a815a9b0 2024-04-25T02:29:45.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:45.891+0000 7f50acdf9640 1 -- 172.21.15.67:0/2978355362 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f50a806e360 con 0x7f50a815a9b0 2024-04-25T02:29:46.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.539+0000 7f509effd640 1 -- 172.21.15.67:0/2978355362 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) ==== 181+0+0 (secure 0 0 0) 0x7f5098059a40 con 0x7f50a815a9b0 2024-04-25T02:29:46.543 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-04-25T02:29:46.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.542+0000 7f50acdf9640 1 -- 172.21.15.67:0/2978355362 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f508806bfe0 msgr2=0x7f508806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:46.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.542+0000 7f50acdf9640 1 --2- 172.21.15.67:0/2978355362 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f508806bfe0 0x7f508806e4a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f50a0006fd0 tx=0x7f50a0008040 comp rx=0 tx=0).stop 2024-04-25T02:29:46.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.542+0000 7f50acdf9640 1 -- 172.21.15.67:0/2978355362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50a815a9b0 msgr2=0x7f50a81f3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:46.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.542+0000 7f50acdf9640 1 --2- 172.21.15.67:0/2978355362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50a815a9b0 0x7f50a81f3db0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f509800cf20 tx=0x7f509800a7d0 comp rx=0 tx=0).stop 2024-04-25T02:29:46.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.542+0000 7f50acdf9640 1 -- 172.21.15.67:0/2978355362 shutdown_connections 2024-04-25T02:29:46.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.542+0000 7f50acdf9640 1 --2- 172.21.15.67:0/2978355362 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f508806bfe0 0x7f508806e4a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:46.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.542+0000 7f50acdf9640 1 --2- 172.21.15.67:0/2978355362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50a815a9b0 0x7f50a81f3db0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:46.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.542+0000 7f50acdf9640 1 --2- 172.21.15.67:0/2978355362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50a80b2dc0 0x7f50a809c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:46.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.542+0000 7f50acdf9640 1 --2- 172.21.15.67:0/2978355362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50a8071350 0x7f50a81f86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:46.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.542+0000 7f50acdf9640 1 -- 172.21.15.67:0/2978355362 >> 172.21.15.67:0/2978355362 conn(0x7f50a80b19c0 msgr2=0x7f50a815b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:46.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.542+0000 7f50acdf9640 1 -- 172.21.15.67:0/2978355362 shutdown_connections 2024-04-25T02:29:46.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.542+0000 7f50acdf9640 1 -- 172.21.15.67:0/2978355362 wait complete. 2024-04-25T02:29:46.560 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T02:29:46.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.666+0000 7f83c702c640 1 Processor -- start 2024-04-25T02:29:46.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.666+0000 7f83c702c640 1 -- start start 2024-04-25T02:29:46.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.667+0000 7f83c702c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c00b4020 0x7f83c006c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:46.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.667+0000 7f83c702c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f83c006ddd0 0x7f83c00b5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:46.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.667+0000 7f83c702c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83c006b0c0 con 0x7f83c006c6a0 2024-04-25T02:29:46.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.667+0000 7f83c702c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f83c006bcd0 con 0x7f83c006ddd0 2024-04-25T02:29:46.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.667+0000 7f83c702c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f83c006b3a0 con 0x7f83c00b4020 2024-04-25T02:29:46.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.667+0000 7f83bffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f83c006c6a0 0x7f83c006d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55538/0 (socket says 172.21.15.67:55538) 2024-04-25T02:29:46.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.667+0000 7f83bffff640 1 -- 172.21.15.67:0/2109988317 learned_addr learned my addr 172.21.15.67:0/2109988317 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:46.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.667+0000 7f83c4dc8640 1 --2- 172.21.15.67:0/2109988317 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c00b4020 0x7f83c006c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:46.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.667+0000 7f83c55c9640 1 --2- 172.21.15.67:0/2109988317 >> v2:172.21.15.176:3300/0 conn(0x7f83c006ddd0 0x7f83c00b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:46.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.667+0000 7f83bf7fe640 1 -- 172.21.15.67:0/2109988317 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2013168932 0 0) 0x7f83c006b0c0 con 0x7f83c006c6a0 2024-04-25T02:29:46.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.667+0000 7f83bf7fe640 1 -- 172.21.15.67:0/2109988317 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83b0003520 con 0x7f83c006c6a0 2024-04-25T02:29:46.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.667+0000 7f83c4dc8640 1 -- 172.21.15.67:0/2109988317 >> v2:172.21.15.176:3300/0 conn(0x7f83c006ddd0 msgr2=0x7f83c00b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:46.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.667+0000 7f83c4dc8640 1 --2- 172.21.15.67:0/2109988317 >> v2:172.21.15.176:3300/0 conn(0x7f83c006ddd0 0x7f83c00b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:46.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.667+0000 7f83c4dc8640 1 -- 172.21.15.67:0/2109988317 >> v1:172.21.15.67:6789/0 conn(0x7f83c006c6a0 legacy=0x7f83c006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:46.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.667+0000 7f83c4dc8640 1 -- 172.21.15.67:0/2109988317 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c006b680 con 0x7f83c00b4020 2024-04-25T02:29:46.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.667+0000 7f83c55c9640 1 --2- 172.21.15.67:0/2109988317 >> v2:172.21.15.176:3300/0 conn(0x7f83c006ddd0 0x7f83c00b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:46.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.668+0000 7f83c4dc8640 1 --2- 172.21.15.67:0/2109988317 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c00b4020 0x7f83c006c160 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f83b40097a0 tx=0x7f83b402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d237719d232d9680 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:46.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.668+0000 7f83bf7fe640 1 -- 172.21.15.67:0/2109988317 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b4037070 con 0x7f83c00b4020 2024-04-25T02:29:46.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.668+0000 7f83bf7fe640 1 -- 172.21.15.67:0/2109988317 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b4032440 con 0x7f83c00b4020 2024-04-25T02:29:46.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.668+0000 7f83bf7fe640 1 -- 172.21.15.67:0/2109988317 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b40327f0 con 0x7f83c00b4020 2024-04-25T02:29:46.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.669+0000 7f83c702c640 1 -- 172.21.15.67:0/2109988317 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c00b4020 msgr2=0x7f83c006c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:46.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.669+0000 7f83c702c640 1 --2- 172.21.15.67:0/2109988317 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c00b4020 0x7f83c006c160 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f83b40097a0 tx=0x7f83b402a210 comp rx=0 tx=0).stop 2024-04-25T02:29:46.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.669+0000 7f83c702c640 1 -- 172.21.15.67:0/2109988317 shutdown_connections 2024-04-25T02:29:46.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.669+0000 7f83c702c640 1 --2- 172.21.15.67:0/2109988317 >> v2:172.21.15.176:3300/0 conn(0x7f83c006ddd0 0x7f83c00b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:46.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.669+0000 7f83c702c640 1 --2- 172.21.15.67:0/2109988317 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c00b4020 0x7f83c006c160 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:46.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.669+0000 7f83c702c640 1 -- 172.21.15.67:0/2109988317 >> 172.21.15.67:0/2109988317 conn(0x7f83c00d04b0 msgr2=0x7f83c00d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:46.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.669+0000 7f83c702c640 1 -- 172.21.15.67:0/2109988317 shutdown_connections 2024-04-25T02:29:46.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.669+0000 7f83c702c640 1 -- 172.21.15.67:0/2109988317 wait complete. 2024-04-25T02:29:46.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.670+0000 7f83c702c640 1 Processor -- start 2024-04-25T02:29:46.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.670+0000 7f83c702c640 1 -- start start 2024-04-25T02:29:46.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.671+0000 7f83c702c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83c006c6a0 0x7f83c0149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:46.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.671+0000 7f83c702c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83c006ddd0 0x7f83c014ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:46.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.671+0000 7f83c702c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c00b4020 0x7f83c0150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:46.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.671+0000 7f83c702c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f83c00adc10 con 0x7f83c006c6a0 2024-04-25T02:29:46.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.671+0000 7f83c702c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f83c00ada90 con 0x7f83c006ddd0 2024-04-25T02:29:46.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.671+0000 7f83c702c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f83c0167d90 con 0x7f83c00b4020 2024-04-25T02:29:46.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.671+0000 7f83c4dc8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83c006c6a0 0x7f83c0149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:46.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.671+0000 7f83c4dc8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83c006c6a0 0x7f83c0149060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58764/0 (socket says 172.21.15.67:58764) 2024-04-25T02:29:46.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.671+0000 7f83c4dc8640 1 -- 172.21.15.67:0/3303877142 learned_addr learned my addr 172.21.15.67:0/3303877142 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:46.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.671+0000 7f83c55c9640 1 --2- 172.21.15.67:0/3303877142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c00b4020 0x7f83c0150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:46.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.671+0000 7f83bffff640 1 --2- 172.21.15.67:0/3303877142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83c006ddd0 0x7f83c014ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:46.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.671+0000 7f83c4dc8640 1 -- 172.21.15.67:0/3303877142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c00b4020 msgr2=0x7f83c0150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:46.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.671+0000 7f83c4dc8640 1 --2- 172.21.15.67:0/3303877142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c00b4020 0x7f83c0150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:46.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.671+0000 7f83c4dc8640 1 -- 172.21.15.67:0/3303877142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83c006ddd0 msgr2=0x7f83c014ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:46.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.671+0000 7f83c4dc8640 1 --2- 172.21.15.67:0/3303877142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83c006ddd0 0x7f83c014ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:46.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.671+0000 7f83c4dc8640 1 -- 172.21.15.67:0/3303877142 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c014f4b0 con 0x7f83c006c6a0 2024-04-25T02:29:46.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.671+0000 7f83bffff640 1 --2- 172.21.15.67:0/3303877142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83c006ddd0 0x7f83c014ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:46.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.672+0000 7f83c4dc8640 1 --2- 172.21.15.67:0/3303877142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83c006c6a0 0x7f83c0149060 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f83b402a250 tx=0x7f83b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:46.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.672+0000 7f83bd7fa640 1 -- 172.21.15.67:0/3303877142 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b4037040 con 0x7f83c006c6a0 2024-04-25T02:29:46.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.672+0000 7f83bd7fa640 1 -- 172.21.15.67:0/3303877142 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b4042070 con 0x7f83c006c6a0 2024-04-25T02:29:46.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.672+0000 7f83bd7fa640 1 -- 172.21.15.67:0/3303877142 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b4032810 con 0x7f83c006c6a0 2024-04-25T02:29:46.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.672+0000 7f83c702c640 1 -- 172.21.15.67:0/3303877142 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c0156850 con 0x7f83c006c6a0 2024-04-25T02:29:46.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.672+0000 7f83c702c640 1 -- 172.21.15.67:0/3303877142 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c0156200 con 0x7f83c006c6a0 2024-04-25T02:29:46.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.673+0000 7f83c702c640 1 -- 172.21.15.67:0/3303877142 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83c0069110 con 0x7f83c006c6a0 2024-04-25T02:29:46.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.674+0000 7f83bd7fa640 1 -- 172.21.15.67:0/3303877142 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f83b40329b0 con 0x7f83c006c6a0 2024-04-25T02:29:46.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.674+0000 7f83bd7fa640 1 --2- 172.21.15.67:0/3303877142 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f83a406bfe0 0x7f83a406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:46.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.674+0000 7f83bd7fa640 1 -- 172.21.15.67:0/3303877142 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5357+0+0 (secure 0 0 0) 0x7f83b40ab7c0 con 0x7f83c006c6a0 2024-04-25T02:29:46.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.674+0000 7f83bffff640 1 --2- 172.21.15.67:0/3303877142 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f83a406bfe0 0x7f83a406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:46.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.675+0000 7f83bffff640 1 --2- 172.21.15.67:0/3303877142 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f83a406bfe0 0x7f83a406e4a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f83ac007fd0 tx=0x7f83ac009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:46.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.678+0000 7f83bd7fa640 1 -- 172.21.15.67:0/3303877142 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f83c014f4b0 con 0x7f83c006c6a0 2024-04-25T02:29:46.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:46.860+0000 7f83c702c640 1 -- 172.21.15.67:0/3303877142 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f83c014ac50 con 0x7f83c006c6a0 2024-04-25T02:29:47.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.546+0000 7f83bd7fa640 1 -- 172.21.15.67:0/3303877142 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) ==== 169+0+0 (secure 0 0 0) 0x7f83b407a050 con 0x7f83c006c6a0 2024-04-25T02:29:47.549 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-04-25T02:29:47.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.548+0000 7f83c702c640 1 -- 172.21.15.67:0/3303877142 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f83a406bfe0 msgr2=0x7f83a406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:47.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.548+0000 7f83c702c640 1 --2- 172.21.15.67:0/3303877142 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f83a406bfe0 0x7f83a406e4a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f83ac007fd0 tx=0x7f83ac009040 comp rx=0 tx=0).stop 2024-04-25T02:29:47.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.548+0000 7f83c702c640 1 -- 172.21.15.67:0/3303877142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83c006c6a0 msgr2=0x7f83c0149060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:47.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.548+0000 7f83c702c640 1 --2- 172.21.15.67:0/3303877142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83c006c6a0 0x7f83c0149060 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f83b402a250 tx=0x7f83b40046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.549+0000 7f83c702c640 1 -- 172.21.15.67:0/3303877142 shutdown_connections 2024-04-25T02:29:47.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.549+0000 7f83c702c640 1 --2- 172.21.15.67:0/3303877142 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f83a406bfe0 0x7f83a406e4a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.549+0000 7f83c702c640 1 --2- 172.21.15.67:0/3303877142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c00b4020 0x7f83c0150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.549+0000 7f83c702c640 1 --2- 172.21.15.67:0/3303877142 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83c006ddd0 0x7f83c014ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.549+0000 7f83c702c640 1 --2- 172.21.15.67:0/3303877142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83c006c6a0 0x7f83c0149060 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.549+0000 7f83c702c640 1 -- 172.21.15.67:0/3303877142 >> 172.21.15.67:0/3303877142 conn(0x7f83c00d04b0 msgr2=0x7f83c0157d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:47.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.549+0000 7f83c702c640 1 -- 172.21.15.67:0/3303877142 shutdown_connections 2024-04-25T02:29:47.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.549+0000 7f83c702c640 1 -- 172.21.15.67:0/3303877142 wait complete. 2024-04-25T02:29:47.568 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T02:29:47.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.673+0000 7f97c3a95640 1 Processor -- start 2024-04-25T02:29:47.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.674+0000 7f97c3a95640 1 -- start start 2024-04-25T02:29:47.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.674+0000 7f97c3a95640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97bc167420 0x7f97bc169810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:47.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.674+0000 7f97c3a95640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97bc0d1720 con 0x7f97bc0cf8f0 2024-04-25T02:29:47.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.674+0000 7f97c3a95640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97bc0cff80 con 0x7f97bc15e760 2024-04-25T02:29:47.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.674+0000 7f97c3a95640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f97bc0cfd50 con 0x7f97bc167420 2024-04-25T02:29:47.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c1030640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f97bc0cf8f0 0x7f97bc0d1010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55550/0 (socket says 172.21.15.67:55550) 2024-04-25T02:29:47.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c1030640 1 -- 172.21.15.67:0/4239139889 learned_addr learned my addr 172.21.15.67:0/4239139889 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:47.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c2032640 1 --2- 172.21.15.67:0/4239139889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97bc167420 0x7f97bc169810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:47.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c082f640 1 -- 172.21.15.67:0/4239139889 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 484885761 0 0) 0x7f97bc0d1720 con 0x7f97bc0cf8f0 2024-04-25T02:29:47.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c082f640 1 -- 172.21.15.67:0/4239139889 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97a8003520 con 0x7f97bc0cf8f0 2024-04-25T02:29:47.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c082f640 1 -- 172.21.15.67:0/4239139889 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3796913785 0 0) 0x7f97a8003520 con 0x7f97bc0cf8f0 2024-04-25T02:29:47.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c082f640 1 -- 172.21.15.67:0/4239139889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97bc167420 msgr2=0x7f97bc169810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:47.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c082f640 1 --2- 172.21.15.67:0/4239139889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97bc167420 0x7f97bc169810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c082f640 1 -- 172.21.15.67:0/4239139889 >> v1:172.21.15.176:6789/0 conn(0x7f97bc15e760 legacy=0x7f97bc0d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:47.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c082f640 1 -- 172.21.15.67:0/4239139889 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97bc0d2250 con 0x7f97bc0cf8f0 2024-04-25T02:29:47.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c082f640 1 -- 172.21.15.67:0/4239139889 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f97ac001670 con 0x7f97bc0cf8f0 2024-04-25T02:29:47.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c082f640 1 -- 172.21.15.67:0/4239139889 >> v1:172.21.15.67:6789/0 conn(0x7f97bc0cf8f0 legacy=0x7f97bc0d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:47.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c082f640 1 --2- 172.21.15.67:0/4239139889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97a80039e0 0x7f97a8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:47.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c082f640 1 --2- 172.21.15.67:0/4239139889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97bc167420 0x7f97a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:47.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c082f640 1 --2- 172.21.15.67:0/4239139889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97a8004d40 0x7f97a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:47.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c082f640 1 -- 172.21.15.67:0/4239139889 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f97a800ba70 con 0x7f97a8004d40 2024-04-25T02:29:47.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c082f640 1 -- 172.21.15.67:0/4239139889 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f97a800bbf0 con 0x7f97a80039e0 2024-04-25T02:29:47.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c082f640 1 -- 172.21.15.67:0/4239139889 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f97a800bdf0 con 0x7f97bc167420 2024-04-25T02:29:47.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c2032640 1 --2- 172.21.15.67:0/4239139889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97a8004d40 0x7f97a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:47.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c1831640 1 --2- 172.21.15.67:0/4239139889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97a80039e0 0x7f97a8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:47.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.675+0000 7f97c1030640 1 --2- 172.21.15.67:0/4239139889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97bc167420 0x7f97a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:47.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.676+0000 7f97c2032640 1 -- 172.21.15.67:0/4239139889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97bc167420 msgr2=0x7f97a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:47.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.676+0000 7f97c2032640 1 --2- 172.21.15.67:0/4239139889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97bc167420 0x7f97a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.676+0000 7f97c2032640 1 -- 172.21.15.67:0/4239139889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97a80039e0 msgr2=0x7f97a8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:47.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.676+0000 7f97c2032640 1 --2- 172.21.15.67:0/4239139889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97a80039e0 0x7f97a8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.676+0000 7f97c2032640 1 -- 172.21.15.67:0/4239139889 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a8003520 con 0x7f97a8004d40 2024-04-25T02:29:47.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.676+0000 7f97c1831640 1 --2- 172.21.15.67:0/4239139889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97a80039e0 0x7f97a8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:47.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.676+0000 7f97c2032640 1 --2- 172.21.15.67:0/4239139889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97a8004d40 0x7f97a80051c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0ce8b0 tx=0x7f97a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d993037e9f4c6f61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:47.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.676+0000 7f97c082f640 1 -- 172.21.15.67:0/4239139889 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8037070 con 0x7f97a8004d40 2024-04-25T02:29:47.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.676+0000 7f97c082f640 1 -- 172.21.15.67:0/4239139889 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b802e050 con 0x7f97a8004d40 2024-04-25T02:29:47.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.676+0000 7f97c082f640 1 -- 172.21.15.67:0/4239139889 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8009c10 con 0x7f97a8004d40 2024-04-25T02:29:47.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.677+0000 7f97c3a95640 1 -- 172.21.15.67:0/4239139889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97a8004d40 msgr2=0x7f97a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:47.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.677+0000 7f97c3a95640 1 --2- 172.21.15.67:0/4239139889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97a8004d40 0x7f97a80051c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0ce8b0 tx=0x7f97a8005830 comp rx=0 tx=0).stop 2024-04-25T02:29:47.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.677+0000 7f97c2032640 1 -- 172.21.15.67:0/4239139889 reap_dead start 2024-04-25T02:29:47.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.677+0000 7f97c3a95640 1 -- 172.21.15.67:0/4239139889 shutdown_connections 2024-04-25T02:29:47.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.677+0000 7f97c3a95640 1 -- 172.21.15.67:0/4239139889 >> 172.21.15.67:0/4239139889 conn(0x7f97bc0d41b0 msgr2=0x7f97bc0d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:47.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.677+0000 7f97c3a95640 1 -- 172.21.15.67:0/4239139889 shutdown_connections 2024-04-25T02:29:47.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.677+0000 7f97c3a95640 1 -- 172.21.15.67:0/4239139889 wait complete. 2024-04-25T02:29:47.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.678+0000 7f97c3a95640 1 Processor -- start 2024-04-25T02:29:47.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.678+0000 7f97c3a95640 1 -- start start 2024-04-25T02:29:47.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.679+0000 7f97c3a95640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97a8004d40 0x7f97bc14e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:47.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.679+0000 7f97c3a95640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97bc0cdc90 0x7f97bc0c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:47.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.679+0000 7f97c3a95640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97bc0c9750 0x7f97bc158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:47.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.679+0000 7f97c3a95640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f97bc0b0e40 con 0x7f97bc0c9750 2024-04-25T02:29:47.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.679+0000 7f97c3a95640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f97bc0d28a0 con 0x7f97a8004d40 2024-04-25T02:29:47.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.679+0000 7f97c3a95640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f97bc0d3d40 con 0x7f97bc0cdc90 2024-04-25T02:29:47.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.679+0000 7f97c2032640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97bc0c9750 0x7f97bc158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:47.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.679+0000 7f97c2032640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97bc0c9750 0x7f97bc158d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58794/0 (socket says 172.21.15.67:58794) 2024-04-25T02:29:47.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.679+0000 7f97c2032640 1 -- 172.21.15.67:0/3596500645 learned_addr learned my addr 172.21.15.67:0/3596500645 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:47.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.679+0000 7f97c1030640 1 --2- 172.21.15.67:0/3596500645 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97bc0cdc90 0x7f97bc0c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:47.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.679+0000 7f97c1831640 1 --2- 172.21.15.67:0/3596500645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97a8004d40 0x7f97bc14e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:47.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.679+0000 7f97c2032640 1 -- 172.21.15.67:0/3596500645 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97bc0cdc90 msgr2=0x7f97bc0c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:47.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.679+0000 7f97c2032640 1 --2- 172.21.15.67:0/3596500645 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97bc0cdc90 0x7f97bc0c9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.679+0000 7f97c2032640 1 -- 172.21.15.67:0/3596500645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97a8004d40 msgr2=0x7f97bc14e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.679+0000 7f97c2032640 1 --2- 172.21.15.67:0/3596500645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97a8004d40 0x7f97bc14e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.679+0000 7f97c2032640 1 -- 172.21.15.67:0/3596500645 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97bc15fe60 con 0x7f97bc0c9750 2024-04-25T02:29:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.680+0000 7f97c2032640 1 --2- 172.21.15.67:0/3596500645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97bc0c9750 0x7f97bc158d20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f97b8002230 tx=0x7f97b8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.680+0000 7f97b27fc640 1 -- 172.21.15.67:0/3596500645 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8041020 con 0x7f97bc0c9750 2024-04-25T02:29:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.680+0000 7f97b27fc640 1 -- 172.21.15.67:0/3596500645 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b8038040 con 0x7f97bc0c9750 2024-04-25T02:29:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.680+0000 7f97c3a95640 1 -- 172.21.15.67:0/3596500645 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97bc160140 con 0x7f97bc0c9750 2024-04-25T02:29:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.680+0000 7f97b27fc640 1 -- 172.21.15.67:0/3596500645 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8037070 con 0x7f97bc0c9750 2024-04-25T02:29:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.680+0000 7f97c3a95640 1 -- 172.21.15.67:0/3596500645 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97bc0ce110 con 0x7f97bc0c9750 2024-04-25T02:29:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.681+0000 7f97c3a95640 1 -- 172.21.15.67:0/3596500645 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97bc069110 con 0x7f97bc0c9750 2024-04-25T02:29:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.681+0000 7f97b27fc640 1 -- 172.21.15.67:0/3596500645 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f97b8005d10 con 0x7f97bc0c9750 2024-04-25T02:29:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.682+0000 7f97b27fc640 1 --2- 172.21.15.67:0/3596500645 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f97a006c010 0x7f97a006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.682+0000 7f97b27fc640 1 -- 172.21.15.67:0/3596500645 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f97b80aaf50 con 0x7f97bc0c9750 2024-04-25T02:29:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.682+0000 7f97c1831640 1 --2- 172.21.15.67:0/3596500645 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f97a006c010 0x7f97a006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:47.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.682+0000 7f97c1831640 1 --2- 172.21.15.67:0/3596500645 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f97a006c010 0x7f97a006e4d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f97bc161c60 tx=0x7f97b4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:47.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.686+0000 7f97b27fc640 1 -- 172.21.15.67:0/3596500645 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f97b804b060 con 0x7f97bc0c9750 2024-04-25T02:29:47.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.868+0000 7f97c3a95640 1 -- 172.21.15.67:0/3596500645 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f97bc06cbb0 con 0x7f97bc0c9750 2024-04-25T02:29:47.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.872+0000 7f97b27fc640 1 -- 172.21.15.67:0/3596500645 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f97b8079470 con 0x7f97bc0c9750 2024-04-25T02:29:47.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.874+0000 7f97c3a95640 1 -- 172.21.15.67:0/3596500645 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f97a006c010 msgr2=0x7f97a006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:47.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.874+0000 7f97c3a95640 1 --2- 172.21.15.67:0/3596500645 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f97a006c010 0x7f97a006e4d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f97bc161c60 tx=0x7f97b4009040 comp rx=0 tx=0).stop 2024-04-25T02:29:47.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.874+0000 7f97c3a95640 1 -- 172.21.15.67:0/3596500645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97bc0c9750 msgr2=0x7f97bc158d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:47.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.874+0000 7f97c3a95640 1 --2- 172.21.15.67:0/3596500645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97bc0c9750 0x7f97bc158d20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f97b8002230 tx=0x7f97b8009750 comp rx=0 tx=0).stop 2024-04-25T02:29:47.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.874+0000 7f97c3a95640 1 -- 172.21.15.67:0/3596500645 shutdown_connections 2024-04-25T02:29:47.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.874+0000 7f97c3a95640 1 --2- 172.21.15.67:0/3596500645 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f97a006c010 0x7f97a006e4d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.874+0000 7f97c3a95640 1 --2- 172.21.15.67:0/3596500645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97bc0c9750 0x7f97bc158d20 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.874+0000 7f97c3a95640 1 --2- 172.21.15.67:0/3596500645 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97bc0cdc90 0x7f97bc0c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.874+0000 7f97c3a95640 1 --2- 172.21.15.67:0/3596500645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97a8004d40 0x7f97bc14e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.874+0000 7f97c3a95640 1 -- 172.21.15.67:0/3596500645 >> 172.21.15.67:0/3596500645 conn(0x7f97bc0d41b0 msgr2=0x7f97bc157a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:47.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.874+0000 7f97c3a95640 1 -- 172.21.15.67:0/3596500645 shutdown_connections 2024-04-25T02:29:47.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.874+0000 7f97c3a95640 1 -- 172.21.15.67:0/3596500645 wait complete. 2024-04-25T02:29:47.888 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2024-04-25T02:29:47.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.986+0000 7f42fbe76640 1 Processor -- start 2024-04-25T02:29:47.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.986+0000 7f42fbe76640 1 -- start start 2024-04-25T02:29:47.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.987+0000 7f42fbe76640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f42f40af120 0x7f42f4071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:47.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.987+0000 7f42fbe76640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42f40acda0 0x7f42f406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:47.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.987+0000 7f42fbe76640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42f4160b20 con 0x7f42f415c230 2024-04-25T02:29:47.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.987+0000 7f42fbe76640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f42f415c610 con 0x7f42f40af120 2024-04-25T02:29:47.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.987+0000 7f42fbe76640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f42f40ad230 con 0x7f42f40acda0 2024-04-25T02:29:47.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.987+0000 7f42f9411640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f42f40af120 0x7f42f4071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:47.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.987+0000 7f42f9c12640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f42f415c230 0x7f42f40aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55566/0 (socket says 172.21.15.67:55566) 2024-04-25T02:29:47.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.987+0000 7f42f9c12640 1 -- 172.21.15.67:0/1253062570 learned_addr learned my addr 172.21.15.67:0/1253062570 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:47.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.987+0000 7f42fa413640 1 --2- 172.21.15.67:0/1253062570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42f40acda0 0x7f42f406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:47.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.987+0000 7f42f9411640 1 -- 172.21.15.67:0/1253062570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42f40acda0 msgr2=0x7f42f406cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:47.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.987+0000 7f42f9411640 1 --2- 172.21.15.67:0/1253062570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42f40acda0 0x7f42f406cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.987+0000 7f42f9411640 1 -- 172.21.15.67:0/1253062570 >> v1:172.21.15.67:6789/0 conn(0x7f42f415c230 legacy=0x7f42f40aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:47.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.987+0000 7f42f8c10640 1 -- 172.21.15.67:0/1253062570 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1486199808 0 0) 0x7f42f4160b20 con 0x7f42f415c230 2024-04-25T02:29:47.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.987+0000 7f42f9411640 1 -- 172.21.15.67:0/1253062570 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f415fd60 con 0x7f42f40af120 2024-04-25T02:29:47.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.987+0000 7f42fa413640 1 --2- 172.21.15.67:0/1253062570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42f40acda0 0x7f42f406cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:47.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.988+0000 7f42f9411640 1 --2- 172.21.15.67:0/1253062570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f40af120 0x7f42f4071800 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f42e80097a0 tx=0x7f42e802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05e206785ce0cb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:47.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.988+0000 7f42f8c10640 1 -- 172.21.15.67:0/1253062570 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e8037070 con 0x7f42f40af120 2024-04-25T02:29:47.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.988+0000 7f42f8c10640 1 -- 172.21.15.67:0/1253062570 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e8032440 con 0x7f42f40af120 2024-04-25T02:29:47.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.988+0000 7f42f8c10640 1 -- 172.21.15.67:0/1253062570 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e8032810 con 0x7f42f40af120 2024-04-25T02:29:47.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.989+0000 7f42fbe76640 1 -- 172.21.15.67:0/1253062570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f40af120 msgr2=0x7f42f4071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:47.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.989+0000 7f42fbe76640 1 --2- 172.21.15.67:0/1253062570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f40af120 0x7f42f4071800 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f42e80097a0 tx=0x7f42e802a180 comp rx=0 tx=0).stop 2024-04-25T02:29:47.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.989+0000 7f42fbe76640 1 -- 172.21.15.67:0/1253062570 shutdown_connections 2024-04-25T02:29:47.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.989+0000 7f42fbe76640 1 --2- 172.21.15.67:0/1253062570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42f40acda0 0x7f42f406cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.989+0000 7f42fbe76640 1 --2- 172.21.15.67:0/1253062570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f40af120 0x7f42f4071800 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.989+0000 7f42fbe76640 1 -- 172.21.15.67:0/1253062570 >> 172.21.15.67:0/1253062570 conn(0x7f42f40b19c0 msgr2=0x7f42f40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:47.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.989+0000 7f42fbe76640 1 -- 172.21.15.67:0/1253062570 shutdown_connections 2024-04-25T02:29:47.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.989+0000 7f42fbe76640 1 -- 172.21.15.67:0/1253062570 wait complete. 2024-04-25T02:29:47.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.990+0000 7f42fbe76640 1 Processor -- start 2024-04-25T02:29:47.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.990+0000 7f42fbe76640 1 -- start start 2024-04-25T02:29:47.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.991+0000 7f42fbe76640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f40acda0 0x7f42f414abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:47.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.991+0000 7f42fbe76640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42f40af120 0x7f42f40ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:47.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.991+0000 7f42fbe76640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42f415c230 0x7f42f409b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:47.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.991+0000 7f42fbe76640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f42f4160600 con 0x7f42f40acda0 2024-04-25T02:29:47.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.991+0000 7f42fbe76640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f42f4160320 con 0x7f42f40af120 2024-04-25T02:29:47.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.991+0000 7f42fbe76640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f42f40ad4d0 con 0x7f42f415c230 2024-04-25T02:29:47.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.991+0000 7f42f9c12640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f40acda0 0x7f42f414abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:47.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.991+0000 7f42f9c12640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f40acda0 0x7f42f414abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58818/0 (socket says 172.21.15.67:58818) 2024-04-25T02:29:47.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.991+0000 7f42f9c12640 1 -- 172.21.15.67:0/814611760 learned_addr learned my addr 172.21.15.67:0/814611760 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:47.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.991+0000 7f42fa413640 1 --2- 172.21.15.67:0/814611760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42f415c230 0x7f42f409b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:47.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.991+0000 7f42f9411640 1 --2- 172.21.15.67:0/814611760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42f40af120 0x7f42f40ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:47.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.991+0000 7f42f9c12640 1 -- 172.21.15.67:0/814611760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42f415c230 msgr2=0x7f42f409b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:47.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.991+0000 7f42f9c12640 1 --2- 172.21.15.67:0/814611760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42f415c230 0x7f42f409b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.991+0000 7f42f9c12640 1 -- 172.21.15.67:0/814611760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42f40af120 msgr2=0x7f42f40ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:47.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.991+0000 7f42f9c12640 1 --2- 172.21.15.67:0/814611760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42f40af120 0x7f42f40ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:47.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.991+0000 7f42f9c12640 1 -- 172.21.15.67:0/814611760 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f40cd4d0 con 0x7f42f40acda0 2024-04-25T02:29:47.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.991+0000 7f42f9411640 1 --2- 172.21.15.67:0/814611760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42f40af120 0x7f42f40ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:47.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.992+0000 7f42f9c12640 1 --2- 172.21.15.67:0/814611760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f40acda0 0x7f42f414abb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f42e400c7c0 tx=0x7f42e400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:47.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.992+0000 7f42f27fc640 1 -- 172.21.15.67:0/814611760 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4018070 con 0x7f42f40acda0 2024-04-25T02:29:47.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.992+0000 7f42f27fc640 1 -- 172.21.15.67:0/814611760 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e400a640 con 0x7f42f40acda0 2024-04-25T02:29:47.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.992+0000 7f42fbe76640 1 -- 172.21.15.67:0/814611760 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f41f51e0 con 0x7f42f40acda0 2024-04-25T02:29:47.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.992+0000 7f42f27fc640 1 -- 172.21.15.67:0/814611760 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e400aa30 con 0x7f42f40acda0 2024-04-25T02:29:47.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.992+0000 7f42fbe76640 1 -- 172.21.15.67:0/814611760 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f41f57a0 con 0x7f42f40acda0 2024-04-25T02:29:47.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.993+0000 7f42fbe76640 1 -- 172.21.15.67:0/814611760 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f4069110 con 0x7f42f40acda0 2024-04-25T02:29:47.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.993+0000 7f42f27fc640 1 -- 172.21.15.67:0/814611760 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f42e401b070 con 0x7f42f40acda0 2024-04-25T02:29:47.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.994+0000 7f42f27fc640 1 --2- 172.21.15.67:0/814611760 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f42e006bfe0 0x7f42e006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:47.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.994+0000 7f42f27fc640 1 -- 172.21.15.67:0/814611760 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f42e408a490 con 0x7f42f40acda0 2024-04-25T02:29:47.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.994+0000 7f42f9411640 1 --2- 172.21.15.67:0/814611760 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f42e006bfe0 0x7f42e006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:47.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.995+0000 7f42f9411640 1 --2- 172.21.15.67:0/814611760 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f42e006bfe0 0x7f42e006e4a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f42e8034000 tx=0x7f42e802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:48.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:47.998+0000 7f42f27fc640 1 -- 172.21.15.67:0/814611760 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f42e4058ec0 con 0x7f42f40acda0 2024-04-25T02:29:48.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.263+0000 7f42fbe76640 1 -- 172.21.15.67:0/814611760 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) -- 0x7f42f4074880 con 0x7f42f40acda0 2024-04-25T02:29:48.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.548+0000 7f42f27fc640 1 -- 172.21.15.67:0/814611760 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v102) ==== 167+0+0 (secure 0 0 0) 0x7f42e40587c0 con 0x7f42f40acda0 2024-04-25T02:29:48.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.550+0000 7f42fbe76640 1 -- 172.21.15.67:0/814611760 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f42e006bfe0 msgr2=0x7f42e006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:48.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.550+0000 7f42fbe76640 1 --2- 172.21.15.67:0/814611760 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f42e006bfe0 0x7f42e006e4a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f42e8034000 tx=0x7f42e802e000 comp rx=0 tx=0).stop 2024-04-25T02:29:48.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.550+0000 7f42fbe76640 1 -- 172.21.15.67:0/814611760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f40acda0 msgr2=0x7f42f414abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:48.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.550+0000 7f42fbe76640 1 --2- 172.21.15.67:0/814611760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f40acda0 0x7f42f414abb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f42e400c7c0 tx=0x7f42e400cc80 comp rx=0 tx=0).stop 2024-04-25T02:29:48.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.550+0000 7f42fbe76640 1 -- 172.21.15.67:0/814611760 shutdown_connections 2024-04-25T02:29:48.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.550+0000 7f42fbe76640 1 --2- 172.21.15.67:0/814611760 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f42e006bfe0 0x7f42e006e4a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:48.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.550+0000 7f42fbe76640 1 --2- 172.21.15.67:0/814611760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42f415c230 0x7f42f409b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:48.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.550+0000 7f42fbe76640 1 --2- 172.21.15.67:0/814611760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42f40af120 0x7f42f40ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:48.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.550+0000 7f42fbe76640 1 --2- 172.21.15.67:0/814611760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f40acda0 0x7f42f414abb0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:48.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.550+0000 7f42fbe76640 1 -- 172.21.15.67:0/814611760 >> 172.21.15.67:0/814611760 conn(0x7f42f40b19c0 msgr2=0x7f42f415a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:48.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.550+0000 7f42fbe76640 1 -- 172.21.15.67:0/814611760 shutdown_connections 2024-04-25T02:29:48.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.550+0000 7f42fbe76640 1 -- 172.21.15.67:0/814611760 wait complete. 2024-04-25T02:29:48.565 INFO:tasks.cephfs_test_runner:test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) ... ok 2024-04-25T02:29:48.565 INFO:tasks.cephfs_test_runner: 2024-04-25T02:29:48.565 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T02:29:48.565 INFO:tasks.cephfs_test_runner:Ran 1 test in 53.731s 2024-04-25T02:29:48.565 INFO:tasks.cephfs_test_runner: 2024-04-25T02:29:48.565 INFO:tasks.cephfs_test_runner:OK 2024-04-25T02:29:48.566 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-25T02:29:48.577 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-04-25T02:29:48.586 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:29:48.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.686+0000 7f930d29a640 1 Processor -- start 2024-04-25T02:29:48.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.686+0000 7f930d29a640 1 -- start start 2024-04-25T02:29:48.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.686+0000 7f930d29a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93080cef60 0x7f930806c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:48.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.686+0000 7f930d29a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f93080b1600 0x7f93080d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:48.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.686+0000 7f930d29a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93080b3770 con 0x7f93080b3390 2024-04-25T02:29:48.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.686+0000 7f930d29a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f93080cc500 con 0x7f93080b1600 2024-04-25T02:29:48.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.686+0000 7f930d29a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f93080cd080 con 0x7f93080cef60 2024-04-25T02:29:48.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.687+0000 7f93077fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f93080b1600 0x7f93080d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:48.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.687+0000 7f9306ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f93080b3390 0x7f93080ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55570/0 (socket says 172.21.15.67:55570) 2024-04-25T02:29:48.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.687+0000 7f9306ffd640 1 -- 172.21.15.67:0/4260183128 learned_addr learned my addr 172.21.15.67:0/4260183128 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:48.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.687+0000 7f93067fc640 1 --2- 172.21.15.67:0/4260183128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93080cef60 0x7f930806c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:48.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.687+0000 7f93077fe640 1 -- 172.21.15.67:0/4260183128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93080cef60 msgr2=0x7f930806c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:48.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.687+0000 7f93077fe640 1 --2- 172.21.15.67:0/4260183128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93080cef60 0x7f930806c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:48.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.687+0000 7f93077fe640 1 -- 172.21.15.67:0/4260183128 >> v1:172.21.15.67:6789/0 conn(0x7f93080b3390 legacy=0x7f93080ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:48.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.687+0000 7f93077fe640 1 -- 172.21.15.67:0/4260183128 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93080cc750 con 0x7f93080b1600 2024-04-25T02:29:48.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.688+0000 7f93077fe640 1 --2- 172.21.15.67:0/4260183128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93080b1600 0x7f93080d0250 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9300009d90 tx=0x7f930002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63c3795fddc9b7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:48.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.688+0000 7f9305ffb640 1 -- 172.21.15.67:0/4260183128 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300007740 con 0x7f93080b1600 2024-04-25T02:29:48.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.688+0000 7f9305ffb640 1 -- 172.21.15.67:0/4260183128 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93000078e0 con 0x7f93080b1600 2024-04-25T02:29:48.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.688+0000 7f9305ffb640 1 -- 172.21.15.67:0/4260183128 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300007cb0 con 0x7f93080b1600 2024-04-25T02:29:48.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.688+0000 7f930d29a640 1 -- 172.21.15.67:0/4260183128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93080b1600 msgr2=0x7f93080d0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:48.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.688+0000 7f930d29a640 1 --2- 172.21.15.67:0/4260183128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93080b1600 0x7f93080d0250 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9300009d90 tx=0x7f930002a660 comp rx=0 tx=0).stop 2024-04-25T02:29:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.688+0000 7f930d29a640 1 -- 172.21.15.67:0/4260183128 shutdown_connections 2024-04-25T02:29:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.688+0000 7f930d29a640 1 --2- 172.21.15.67:0/4260183128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93080b1600 0x7f93080d0250 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.688+0000 7f930d29a640 1 --2- 172.21.15.67:0/4260183128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93080cef60 0x7f930806c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.688+0000 7f930d29a640 1 -- 172.21.15.67:0/4260183128 >> 172.21.15.67:0/4260183128 conn(0x7f93080d1eb0 msgr2=0x7f93080d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.688+0000 7f930d29a640 1 -- 172.21.15.67:0/4260183128 shutdown_connections 2024-04-25T02:29:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.688+0000 7f930d29a640 1 -- 172.21.15.67:0/4260183128 wait complete. 2024-04-25T02:29:48.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.690+0000 7f930d29a640 1 Processor -- start 2024-04-25T02:29:48.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.690+0000 7f930d29a640 1 -- start start 2024-04-25T02:29:48.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.690+0000 7f930d29a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93080b1600 0x7f93081f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.690+0000 7f930d29a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93080b3390 0x7f93080cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.690+0000 7f930d29a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93080cef60 0x7f930814df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.690+0000 7f930d29a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f93080d14f0 con 0x7f93080b1600 2024-04-25T02:29:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.690+0000 7f930d29a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f93080ccd10 con 0x7f93080cef60 2024-04-25T02:29:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.690+0000 7f930d29a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f93080d29d0 con 0x7f93080b3390 2024-04-25T02:29:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.690+0000 7f9306ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93080b1600 0x7f93081f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.690+0000 7f9306ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93080b1600 0x7f93081f4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58838/0 (socket says 172.21.15.67:58838) 2024-04-25T02:29:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.690+0000 7f9306ffd640 1 -- 172.21.15.67:0/2190139532 learned_addr learned my addr 172.21.15.67:0/2190139532 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.691+0000 7f93067fc640 1 --2- 172.21.15.67:0/2190139532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93080b3390 0x7f93080cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.691+0000 7f93077fe640 1 --2- 172.21.15.67:0/2190139532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93080cef60 0x7f930814df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.691+0000 7f9306ffd640 1 -- 172.21.15.67:0/2190139532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93080b3390 msgr2=0x7f93080cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.691+0000 7f9306ffd640 1 --2- 172.21.15.67:0/2190139532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93080b3390 0x7f93080cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:48.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.691+0000 7f9306ffd640 1 -- 172.21.15.67:0/2190139532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93080cef60 msgr2=0x7f930814df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.691+0000 7f9306ffd640 1 --2- 172.21.15.67:0/2190139532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93080cef60 0x7f930814df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.691+0000 7f9306ffd640 1 -- 172.21.15.67:0/2190139532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9308159320 con 0x7f93080b1600 2024-04-25T02:29:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.691+0000 7f93077fe640 1 --2- 172.21.15.67:0/2190139532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93080cef60 0x7f930814df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.691+0000 7f9306ffd640 1 --2- 172.21.15.67:0/2190139532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93080b1600 0x7f93081f4930 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f92f800c400 tx=0x7f92f800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.691+0000 7f92ef7fe640 1 -- 172.21.15.67:0/2190139532 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8017070 con 0x7f93080b1600 2024-04-25T02:29:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.691+0000 7f92ef7fe640 1 -- 172.21.15.67:0/2190139532 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f8005ce0 con 0x7f93080b1600 2024-04-25T02:29:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.691+0000 7f92ef7fe640 1 -- 172.21.15.67:0/2190139532 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f80072f0 con 0x7f93080b1600 2024-04-25T02:29:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.691+0000 7f930d29a640 1 -- 172.21.15.67:0/2190139532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9308158280 con 0x7f93080b1600 2024-04-25T02:29:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.691+0000 7f930d29a640 1 -- 172.21.15.67:0/2190139532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9308158840 con 0x7f93080b1600 2024-04-25T02:29:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.692+0000 7f930d29a640 1 -- 172.21.15.67:0/2190139532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93080681f0 con 0x7f93080b1600 2024-04-25T02:29:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.693+0000 7f92ef7fe640 1 -- 172.21.15.67:0/2190139532 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f92f801a070 con 0x7f93080b1600 2024-04-25T02:29:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.693+0000 7f92ef7fe640 1 --2- 172.21.15.67:0/2190139532 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f92f406c010 0x7f92f406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.693+0000 7f92ef7fe640 1 -- 172.21.15.67:0/2190139532 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f92f808a160 con 0x7f93080b1600 2024-04-25T02:29:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.693+0000 7f93067fc640 1 --2- 172.21.15.67:0/2190139532 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f92f406c010 0x7f92f406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.694+0000 7f93067fc640 1 --2- 172.21.15.67:0/2190139532 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f92f406c010 0x7f92f406e4d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9308070ba0 tx=0x7f92fc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.697+0000 7f92ef7fe640 1 -- 172.21.15.67:0/2190139532 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f92f80585d0 con 0x7f93080b1600 2024-04-25T02:29:48.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.880+0000 7f930d29a640 1 -- 172.21.15.67:0/2190139532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9308160d60 con 0x7f93080b1600 2024-04-25T02:29:48.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.881+0000 7f92ef7fe640 1 -- 172.21.15.67:0/2190139532 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+12996 (secure 0 0 0) 0x7f92f805c8d0 con 0x7f93080b1600 2024-04-25T02:29:48.884 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:48.884 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":36,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:29:47.540527+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6835/2564564590":"2024-04-26T02:29:44.528721+0000","172.21.15.67:6833/2564564590":"2024-04-26T02:29:44.528721+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:29:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.883+0000 7f930d29a640 1 -- 172.21.15.67:0/2190139532 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f92f406c010 msgr2=0x7f92f406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.883+0000 7f930d29a640 1 --2- 172.21.15.67:0/2190139532 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f92f406c010 0x7f92f406e4d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9308070ba0 tx=0x7f92fc008040 comp rx=0 tx=0).stop 2024-04-25T02:29:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.883+0000 7f930d29a640 1 -- 172.21.15.67:0/2190139532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93080b1600 msgr2=0x7f93081f4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.883+0000 7f930d29a640 1 --2- 172.21.15.67:0/2190139532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93080b1600 0x7f93081f4930 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f92f800c400 tx=0x7f92f800c8c0 comp rx=0 tx=0).stop 2024-04-25T02:29:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.883+0000 7f930d29a640 1 -- 172.21.15.67:0/2190139532 shutdown_connections 2024-04-25T02:29:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.883+0000 7f930d29a640 1 --2- 172.21.15.67:0/2190139532 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f92f406c010 0x7f92f406e4d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.883+0000 7f930d29a640 1 --2- 172.21.15.67:0/2190139532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93080cef60 0x7f930814df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.883+0000 7f930d29a640 1 --2- 172.21.15.67:0/2190139532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93080b3390 0x7f93080cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.883+0000 7f930d29a640 1 --2- 172.21.15.67:0/2190139532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93080b1600 0x7f93081f4930 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.883+0000 7f930d29a640 1 -- 172.21.15.67:0/2190139532 >> 172.21.15.67:0/2190139532 conn(0x7f93080d1eb0 msgr2=0x7f93080d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.883+0000 7f930d29a640 1 -- 172.21.15.67:0/2190139532 shutdown_connections 2024-04-25T02:29:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.883+0000 7f930d29a640 1 -- 172.21.15.67:0/2190139532 wait complete. 2024-04-25T02:29:48.897 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:28:14.374244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:29:48.897 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:29:49.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.997+0000 7fd062f1b640 1 Processor -- start 2024-04-25T02:29:49.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.997+0000 7fd062f1b640 1 -- start start 2024-04-25T02:29:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.998+0000 7fd062f1b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd05c15b090 0x7fd05c09db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.998+0000 7fd062f1b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd05c0ad820 con 0x7fd05c0b2cc0 2024-04-25T02:29:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.998+0000 7fd062f1b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd05c0b3260 con 0x7fd05c06ec40 2024-04-25T02:29:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.998+0000 7fd062f1b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd05c0b3540 con 0x7fd05c15b090 2024-04-25T02:29:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.998+0000 7fd05bfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd05c0b2cc0 0x7fd05c06e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55586/0 (socket says 172.21.15.67:55586) 2024-04-25T02:29:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.998+0000 7fd05bfff640 1 -- 172.21.15.67:0/1396412781 learned_addr learned my addr 172.21.15.67:0/1396412781 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:49.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.999+0000 7fd060cb7640 1 --2- 172.21.15.67:0/1396412781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd05c15b090 0x7fd05c09db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:49.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.999+0000 7fd05b7fe640 1 -- 172.21.15.67:0/1396412781 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 325417406 0 0) 0x7fd05c0ad820 con 0x7fd05c0b2cc0 2024-04-25T02:29:49.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.999+0000 7fd05b7fe640 1 -- 172.21.15.67:0/1396412781 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd048003520 con 0x7fd05c0b2cc0 2024-04-25T02:29:49.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.999+0000 7fd05b7fe640 1 -- 172.21.15.67:0/1396412781 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1116686932 0 0) 0x7fd05c0b3260 con 0x7fd05c06ec40 2024-04-25T02:29:49.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.999+0000 7fd05b7fe640 1 -- 172.21.15.67:0/1396412781 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd05c0ad820 con 0x7fd05c06ec40 2024-04-25T02:29:49.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.999+0000 7fd060cb7640 1 -- 172.21.15.67:0/1396412781 >> v1:172.21.15.176:6789/0 conn(0x7fd05c06ec40 legacy=0x7fd05c0add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:49.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.999+0000 7fd060cb7640 1 -- 172.21.15.67:0/1396412781 >> v1:172.21.15.67:6789/0 conn(0x7fd05c0b2cc0 legacy=0x7fd05c06e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:49.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:48.999+0000 7fd060cb7640 1 -- 172.21.15.67:0/1396412781 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05c0b3820 con 0x7fd05c15b090 2024-04-25T02:29:49.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.000+0000 7fd060cb7640 1 --2- 172.21.15.67:0/1396412781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd05c15b090 0x7fd05c09db30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd054009dc0 tx=0x7fd05402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d60389f3acb62fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:49.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.000+0000 7fd05b7fe640 1 -- 172.21.15.67:0/1396412781 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd054007740 con 0x7fd05c15b090 2024-04-25T02:29:49.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.000+0000 7fd05b7fe640 1 -- 172.21.15.67:0/1396412781 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0540078e0 con 0x7fd05c15b090 2024-04-25T02:29:49.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.000+0000 7fd05b7fe640 1 -- 172.21.15.67:0/1396412781 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd054007c90 con 0x7fd05c15b090 2024-04-25T02:29:49.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.000+0000 7fd062f1b640 1 -- 172.21.15.67:0/1396412781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd05c15b090 msgr2=0x7fd05c09db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:49.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.000+0000 7fd062f1b640 1 --2- 172.21.15.67:0/1396412781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd05c15b090 0x7fd05c09db30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd054009dc0 tx=0x7fd05402a6d0 comp rx=0 tx=0).stop 2024-04-25T02:29:49.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.000+0000 7fd062f1b640 1 -- 172.21.15.67:0/1396412781 shutdown_connections 2024-04-25T02:29:49.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.000+0000 7fd062f1b640 1 --2- 172.21.15.67:0/1396412781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd05c15b090 0x7fd05c09db30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:49.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.000+0000 7fd062f1b640 1 -- 172.21.15.67:0/1396412781 >> 172.21.15.67:0/1396412781 conn(0x7fd05c0b19c0 msgr2=0x7fd05c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:49.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.000+0000 7fd062f1b640 1 -- 172.21.15.67:0/1396412781 shutdown_connections 2024-04-25T02:29:49.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.000+0000 7fd062f1b640 1 -- 172.21.15.67:0/1396412781 wait complete. 2024-04-25T02:29:49.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.002+0000 7fd062f1b640 1 Processor -- start 2024-04-25T02:29:49.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.002+0000 7fd062f1b640 1 -- start start 2024-04-25T02:29:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.002+0000 7fd062f1b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c06ec40 0x7fd05c14a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.002+0000 7fd062f1b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd05c0b2cc0 0x7fd05c06e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.002+0000 7fd062f1b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd05c15b090 0x7fd05c06e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.002+0000 7fd062f1b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c15b470 con 0x7fd05c06ec40 2024-04-25T02:29:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.002+0000 7fd062f1b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c0b4f70 con 0x7fd05c0b2cc0 2024-04-25T02:29:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.002+0000 7fd062f1b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd05c070e10 con 0x7fd05c15b090 2024-04-25T02:29:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.003+0000 7fd060cb7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c06ec40 0x7fd05c14a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.003+0000 7fd060cb7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c06ec40 0x7fd05c14a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58846/0 (socket says 172.21.15.67:58846) 2024-04-25T02:29:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.003+0000 7fd060cb7640 1 -- 172.21.15.67:0/1656000748 learned_addr learned my addr 172.21.15.67:0/1656000748 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.003+0000 7fd0614b8640 1 --2- 172.21.15.67:0/1656000748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd05c15b090 0x7fd05c06e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.003+0000 7fd05bfff640 1 --2- 172.21.15.67:0/1656000748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd05c0b2cc0 0x7fd05c06e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.003+0000 7fd060cb7640 1 -- 172.21.15.67:0/1656000748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd05c15b090 msgr2=0x7fd05c06e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:49.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.003+0000 7fd060cb7640 1 --2- 172.21.15.67:0/1656000748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd05c15b090 0x7fd05c06e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:49.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.003+0000 7fd060cb7640 1 -- 172.21.15.67:0/1656000748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd05c0b2cc0 msgr2=0x7fd05c06e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:49.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.003+0000 7fd060cb7640 1 --2- 172.21.15.67:0/1656000748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd05c0b2cc0 0x7fd05c06e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:49.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.003+0000 7fd060cb7640 1 -- 172.21.15.67:0/1656000748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05c15d8a0 con 0x7fd05c06ec40 2024-04-25T02:29:49.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.003+0000 7fd05bfff640 1 --2- 172.21.15.67:0/1656000748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd05c0b2cc0 0x7fd05c06e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:49.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.003+0000 7fd060cb7640 1 --2- 172.21.15.67:0/1656000748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c06ec40 0x7fd05c14a660 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd054009ee0 tx=0x7fd054004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:49.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.003+0000 7fd0597fa640 1 -- 172.21.15.67:0/1656000748 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05403f070 con 0x7fd05c06ec40 2024-04-25T02:29:49.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.003+0000 7fd0597fa640 1 -- 172.21.15.67:0/1656000748 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd054031c40 con 0x7fd05c06ec40 2024-04-25T02:29:49.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.003+0000 7fd062f1b640 1 -- 172.21.15.67:0/1656000748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05c15db80 con 0x7fd05c06ec40 2024-04-25T02:29:49.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.003+0000 7fd0597fa640 1 -- 172.21.15.67:0/1656000748 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd054009450 con 0x7fd05c06ec40 2024-04-25T02:29:49.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.003+0000 7fd062f1b640 1 -- 172.21.15.67:0/1656000748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd05c15e140 con 0x7fd05c06ec40 2024-04-25T02:29:49.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.004+0000 7fd062f1b640 1 -- 172.21.15.67:0/1656000748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd05c069110 con 0x7fd05c06ec40 2024-04-25T02:29:49.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.005+0000 7fd0597fa640 1 -- 172.21.15.67:0/1656000748 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fd05403b410 con 0x7fd05c06ec40 2024-04-25T02:29:49.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.005+0000 7fd0597fa640 1 --2- 172.21.15.67:0/1656000748 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd03c06bfe0 0x7fd03c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:49.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.005+0000 7fd0597fa640 1 -- 172.21.15.67:0/1656000748 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fd0540ac130 con 0x7fd05c06ec40 2024-04-25T02:29:49.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.006+0000 7fd05bfff640 1 --2- 172.21.15.67:0/1656000748 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd03c06bfe0 0x7fd03c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:49.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.006+0000 7fd05bfff640 1 --2- 172.21.15.67:0/1656000748 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd03c06bfe0 0x7fd03c06e4a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd05c155630 tx=0x7fd04c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:49.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.010+0000 7fd0597fa640 1 -- 172.21.15.67:0/1656000748 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd05407ab60 con 0x7fd05c06ec40 2024-04-25T02:29:49.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.190+0000 7fd062f1b640 1 -- 172.21.15.67:0/1656000748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd05c06cdd0 con 0x7fd05c06ec40 2024-04-25T02:29:49.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.190+0000 7fd0597fa640 1 -- 172.21.15.67:0/1656000748 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7fd05407a460 con 0x7fd05c06ec40 2024-04-25T02:29:49.193 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-25T02:29:49.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.192+0000 7fd062f1b640 1 -- 172.21.15.67:0/1656000748 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd03c06bfe0 msgr2=0x7fd03c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:49.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.192+0000 7fd062f1b640 1 --2- 172.21.15.67:0/1656000748 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd03c06bfe0 0x7fd03c06e4a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd05c155630 tx=0x7fd04c009040 comp rx=0 tx=0).stop 2024-04-25T02:29:49.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.192+0000 7fd062f1b640 1 -- 172.21.15.67:0/1656000748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c06ec40 msgr2=0x7fd05c14a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:49.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.192+0000 7fd062f1b640 1 --2- 172.21.15.67:0/1656000748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c06ec40 0x7fd05c14a660 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd054009ee0 tx=0x7fd054004a40 comp rx=0 tx=0).stop 2024-04-25T02:29:49.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.192+0000 7fd062f1b640 1 -- 172.21.15.67:0/1656000748 shutdown_connections 2024-04-25T02:29:49.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.192+0000 7fd062f1b640 1 --2- 172.21.15.67:0/1656000748 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fd03c06bfe0 0x7fd03c06e4a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:49.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.192+0000 7fd062f1b640 1 --2- 172.21.15.67:0/1656000748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd05c15b090 0x7fd05c06e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:49.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.192+0000 7fd062f1b640 1 --2- 172.21.15.67:0/1656000748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd05c0b2cc0 0x7fd05c06e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:49.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.192+0000 7fd062f1b640 1 --2- 172.21.15.67:0/1656000748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c06ec40 0x7fd05c14a660 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:49.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.192+0000 7fd062f1b640 1 -- 172.21.15.67:0/1656000748 >> 172.21.15.67:0/1656000748 conn(0x7fd05c0b19c0 msgr2=0x7fd05c0b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:49.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.192+0000 7fd062f1b640 1 -- 172.21.15.67:0/1656000748 shutdown_connections 2024-04-25T02:29:49.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.192+0000 7fd062f1b640 1 -- 172.21.15.67:0/1656000748 wait complete. 2024-04-25T02:29:49.206 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-04-25T02:29:49.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.303+0000 7f4dfc012640 1 Processor -- start 2024-04-25T02:29:49.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.303+0000 7f4dfc012640 1 -- start start 2024-04-25T02:29:49.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.304+0000 7f4dfc012640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4df40af120 0x7f4df4071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:49.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.304+0000 7f4dfc012640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4df40acda0 0x7f4df406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:49.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.304+0000 7f4dfc012640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4df4160b20 con 0x7f4df415c230 2024-04-25T02:29:49.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.304+0000 7f4dfc012640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4df415c610 con 0x7f4df40af120 2024-04-25T02:29:49.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.304+0000 7f4dfc012640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4df40ad230 con 0x7f4df40acda0 2024-04-25T02:29:49.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.304+0000 7f4df9dae640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f4df415c230 0x7f4df40aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55600/0 (socket says 172.21.15.67:55600) 2024-04-25T02:29:49.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.304+0000 7f4df9dae640 1 -- 172.21.15.67:0/4146596089 learned_addr learned my addr 172.21.15.67:0/4146596089 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:49.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.305+0000 7f4dfa5af640 1 --2- 172.21.15.67:0/4146596089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4df40acda0 0x7f4df406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:49.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.305+0000 7f4df95ad640 1 --2- 172.21.15.67:0/4146596089 >> v2:172.21.15.176:3300/0 conn(0x7f4df40af120 0x7f4df4071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:49.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.305+0000 7f4df8dac640 1 -- 172.21.15.67:0/4146596089 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1117852462 0 0) 0x7f4df4160b20 con 0x7f4df415c230 2024-04-25T02:29:49.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.305+0000 7f4df8dac640 1 -- 172.21.15.67:0/4146596089 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ddc003520 con 0x7f4df415c230 2024-04-25T02:29:49.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.305+0000 7f4dfa5af640 1 -- 172.21.15.67:0/4146596089 >> v2:172.21.15.176:3300/0 conn(0x7f4df40af120 msgr2=0x7f4df4071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:49.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.305+0000 7f4dfa5af640 1 --2- 172.21.15.67:0/4146596089 >> v2:172.21.15.176:3300/0 conn(0x7f4df40af120 0x7f4df4071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:49.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.305+0000 7f4dfa5af640 1 -- 172.21.15.67:0/4146596089 >> v1:172.21.15.67:6789/0 conn(0x7f4df415c230 legacy=0x7f4df40aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:49.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.305+0000 7f4dfa5af640 1 -- 172.21.15.67:0/4146596089 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df415fd60 con 0x7f4df40acda0 2024-04-25T02:29:49.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.305+0000 7f4df95ad640 1 --2- 172.21.15.67:0/4146596089 >> v2:172.21.15.176:3300/0 conn(0x7f4df40af120 0x7f4df4071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:49.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.306+0000 7f4dfa5af640 1 --2- 172.21.15.67:0/4146596089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4df40acda0 0x7f4df406cb70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009d90 tx=0x7f4de402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a61dbce73c4f460 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:49.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.306+0000 7f4df8dac640 1 -- 172.21.15.67:0/4146596089 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de4007740 con 0x7f4df40acda0 2024-04-25T02:29:49.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.306+0000 7f4df8dac640 1 -- 172.21.15.67:0/4146596089 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de40078e0 con 0x7f4df40acda0 2024-04-25T02:29:49.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.306+0000 7f4df8dac640 1 -- 172.21.15.67:0/4146596089 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de4007cb0 con 0x7f4df40acda0 2024-04-25T02:29:49.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.306+0000 7f4dfc012640 1 -- 172.21.15.67:0/4146596089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4df40acda0 msgr2=0x7f4df406cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:49.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.306+0000 7f4dfc012640 1 --2- 172.21.15.67:0/4146596089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4df40acda0 0x7f4df406cb70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009d90 tx=0x7f4de402a660 comp rx=0 tx=0).stop 2024-04-25T02:29:49.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.307+0000 7f4dfc012640 1 -- 172.21.15.67:0/4146596089 shutdown_connections 2024-04-25T02:29:49.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.307+0000 7f4dfc012640 1 --2- 172.21.15.67:0/4146596089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4df40acda0 0x7f4df406cb70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:49.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.307+0000 7f4dfc012640 1 --2- 172.21.15.67:0/4146596089 >> v2:172.21.15.176:3300/0 conn(0x7f4df40af120 0x7f4df4071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:49.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.307+0000 7f4dfc012640 1 -- 172.21.15.67:0/4146596089 >> 172.21.15.67:0/4146596089 conn(0x7f4df40b19c0 msgr2=0x7f4df40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:49.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.307+0000 7f4dfc012640 1 -- 172.21.15.67:0/4146596089 shutdown_connections 2024-04-25T02:29:49.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.307+0000 7f4dfc012640 1 -- 172.21.15.67:0/4146596089 wait complete. 2024-04-25T02:29:49.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.308+0000 7f4dfc012640 1 Processor -- start 2024-04-25T02:29:49.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.308+0000 7f4dfc012640 1 -- start start 2024-04-25T02:29:49.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4dfc012640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4df40acda0 0x7f4df414fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:49.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4dfc012640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4df40af120 0x7f4df4158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:49.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4dfc012640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4df415c230 0x7f4df40c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:49.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4dfc012640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4df4160600 con 0x7f4df40af120 2024-04-25T02:29:49.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4dfc012640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4df4160320 con 0x7f4df40acda0 2024-04-25T02:29:49.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4dfc012640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4df40ad4d0 con 0x7f4df415c230 2024-04-25T02:29:49.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4df95ad640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4df40af120 0x7f4df4158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:49.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4df95ad640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4df40af120 0x7f4df4158b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58860/0 (socket says 172.21.15.67:58860) 2024-04-25T02:29:49.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4df95ad640 1 -- 172.21.15.67:0/1137846641 learned_addr learned my addr 172.21.15.67:0/1137846641 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:49.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4dfa5af640 1 --2- 172.21.15.67:0/1137846641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4df415c230 0x7f4df40c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:49.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4df9dae640 1 --2- 172.21.15.67:0/1137846641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4df40acda0 0x7f4df414fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:49.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4df95ad640 1 -- 172.21.15.67:0/1137846641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4df415c230 msgr2=0x7f4df40c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:49.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4df95ad640 1 --2- 172.21.15.67:0/1137846641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4df415c230 0x7f4df40c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:49.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4df95ad640 1 -- 172.21.15.67:0/1137846641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4df40acda0 msgr2=0x7f4df414fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:49.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4df95ad640 1 --2- 172.21.15.67:0/1137846641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4df40acda0 0x7f4df414fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:49.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4df95ad640 1 -- 172.21.15.67:0/1137846641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df40b2dc0 con 0x7f4df40af120 2024-04-25T02:29:49.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4dfa5af640 1 --2- 172.21.15.67:0/1137846641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4df415c230 0x7f4df40c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:49.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4df9dae640 1 --2- 172.21.15.67:0/1137846641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4df40acda0 0x7f4df414fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:49.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4df95ad640 1 --2- 172.21.15.67:0/1137846641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4df40af120 0x7f4df4158b90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4de800ebe0 tx=0x7f4de800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:49.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4df27fc640 1 -- 172.21.15.67:0/1137846641 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de8017070 con 0x7f4df40af120 2024-04-25T02:29:49.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4df27fc640 1 -- 172.21.15.67:0/1137846641 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de800cc30 con 0x7f4df40af120 2024-04-25T02:29:49.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4dfc012640 1 -- 172.21.15.67:0/1137846641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df41594e0 con 0x7f4df40af120 2024-04-25T02:29:49.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4df27fc640 1 -- 172.21.15.67:0/1137846641 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de8013470 con 0x7f4df40af120 2024-04-25T02:29:49.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.309+0000 7f4dfc012640 1 -- 172.21.15.67:0/1137846641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df4159aa0 con 0x7f4df40af120 2024-04-25T02:29:49.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.310+0000 7f4dfc012640 1 -- 172.21.15.67:0/1137846641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df4069110 con 0x7f4df40af120 2024-04-25T02:29:49.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.311+0000 7f4df27fc640 1 -- 172.21.15.67:0/1137846641 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f4de801a070 con 0x7f4df40af120 2024-04-25T02:29:49.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.311+0000 7f4df27fc640 1 --2- 172.21.15.67:0/1137846641 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f4de006bfe0 0x7f4de006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:49.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.311+0000 7f4df27fc640 1 -- 172.21.15.67:0/1137846641 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f4de808b160 con 0x7f4df40af120 2024-04-25T02:29:49.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.312+0000 7f4df9dae640 1 --2- 172.21.15.67:0/1137846641 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f4de006bfe0 0x7f4de006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:49.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.312+0000 7f4df9dae640 1 --2- 172.21.15.67:0/1137846641 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f4de006bfe0 0x7f4de006e4a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4dec005880 tx=0x7f4dec009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:49.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.316+0000 7f4df27fc640 1 -- 172.21.15.67:0/1137846641 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4de8059b90 con 0x7f4df40af120 2024-04-25T02:29:49.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.549+0000 7f4dfc012640 1 -- 172.21.15.67:0/1137846641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f4df406d990 con 0x7f4df40af120 2024-04-25T02:29:49.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.556+0000 7f4df27fc640 1 -- 172.21.15.67:0/1137846641 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v7) ==== 81+0+471200 (secure 0 0 0) 0x7f4de8059490 con 0x7f4df40af120 2024-04-25T02:29:49.565 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:49.565 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-25T02:29:49.565 INFO:teuthology.orchestra.run.smithi067.stdout: "epoch": 7, 2024-04-25T02:29:49.565 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.565 INFO:teuthology.orchestra.run.smithi067.stdout: "active_gid": 4111, 2024-04-25T02:29:49.565 INFO:teuthology.orchestra.run.smithi067.stdout: "active_name": "x", 2024-04-25T02:29:49.565 INFO:teuthology.orchestra.run.smithi067.stdout: "active_addrs": { 2024-04-25T02:29:49.565 INFO:teuthology.orchestra.run.smithi067.stdout: "addrvec": [ 2024-04-25T02:29:49.565 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.565 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v2", 2024-04-25T02:29:49.565 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "172.21.15.176:6832", 2024-04-25T02:29:49.565 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 641694317 2024-04-25T02:29:49.566 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.566 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.566 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-04-25T02:29:49.566 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "172.21.15.176:6833", 2024-04-25T02:29:49.566 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 641694317 2024-04-25T02:29:49.566 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.566 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-04-25T02:29:49.566 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.566 INFO:teuthology.orchestra.run.smithi067.stdout: "active_addr": "172.21.15.176:6833/641694317", 2024-04-25T02:29:49.566 INFO:teuthology.orchestra.run.smithi067.stdout: "active_change": "2024-04-25T02:28:06.316677+0000", 2024-04-25T02:29:49.566 INFO:teuthology.orchestra.run.smithi067.stdout: "active_mgr_features": 4540701547738038271, 2024-04-25T02:29:49.566 INFO:teuthology.orchestra.run.smithi067.stdout: "available": true, 2024-04-25T02:29:49.566 INFO:teuthology.orchestra.run.smithi067.stdout: "standbys": [ 2024-04-25T02:29:49.566 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.567 INFO:teuthology.orchestra.run.smithi067.stdout: "gid": 4107, 2024-04-25T02:29:49.567 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "y", 2024-04-25T02:29:49.567 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr_features": 4540701547738038271, 2024-04-25T02:29:49.567 INFO:teuthology.orchestra.run.smithi067.stdout: "available_modules": [ 2024-04-25T02:29:49.567 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.567 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "alerts", 2024-04-25T02:29:49.567 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.567 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.567 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.567 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-04-25T02:29:49.567 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-04-25T02:29:49.567 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.567 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.567 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.568 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-04-25T02:29:49.568 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.568 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.568 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.568 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How frequently to reexamine health status", 2024-04-25T02:29:49.568 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.568 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.568 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.568 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.568 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.568 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.568 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.568 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.568 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.568 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.569 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.569 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.569 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.569 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.569 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.569 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.569 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.569 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.569 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.569 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.569 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.569 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.569 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.569 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.569 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.570 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.570 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.570 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.570 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.570 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.570 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.570 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.570 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.570 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.570 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.570 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.570 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.570 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.570 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.570 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.571 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.571 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.571 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.571 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.571 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.571 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.571 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.571 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.571 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.571 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.571 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.571 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.571 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.571 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.572 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.572 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.572 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.572 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.572 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.572 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.572 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.572 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.572 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.572 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.572 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.572 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.572 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.572 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.572 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.573 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.573 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.573 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.573 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.573 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.573 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_destination": { 2024-04-25T02:29:49.573 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_destination", 2024-04-25T02:29:49.573 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.573 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.573 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.573 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.573 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.573 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.573 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.573 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Email address to send alerts to", 2024-04-25T02:29:49.574 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.574 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.574 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.574 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.574 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_from_name": { 2024-04-25T02:29:49.574 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_from_name", 2024-04-25T02:29:49.574 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.574 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.574 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.574 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "Ceph", 2024-04-25T02:29:49.574 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.574 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.574 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.574 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Email From: name", 2024-04-25T02:29:49.575 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.575 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.575 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.575 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.575 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_host": { 2024-04-25T02:29:49.575 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_host", 2024-04-25T02:29:49.575 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.575 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.575 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.575 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.575 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.575 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.575 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.575 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SMTP server", 2024-04-25T02:29:49.575 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.576 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.576 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.576 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.576 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_password": { 2024-04-25T02:29:49.576 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_password", 2024-04-25T02:29:49.576 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.576 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.576 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.576 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.576 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.576 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.576 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.576 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Password to authenticate with", 2024-04-25T02:29:49.576 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.576 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.577 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.577 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.577 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_port": { 2024-04-25T02:29:49.577 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_port", 2024-04-25T02:29:49.577 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.577 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.577 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.577 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "465", 2024-04-25T02:29:49.577 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.577 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.577 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.577 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SMTP port", 2024-04-25T02:29:49.577 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.577 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.578 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.578 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.578 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_sender": { 2024-04-25T02:29:49.578 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_sender", 2024-04-25T02:29:49.578 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.578 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.578 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.578 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.578 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.578 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.578 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.578 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SMTP envelope sender", 2024-04-25T02:29:49.578 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.578 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.579 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.579 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.579 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_ssl": { 2024-04-25T02:29:49.579 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_ssl", 2024-04-25T02:29:49.579 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.579 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.579 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.579 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.579 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.579 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.579 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.579 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-25T02:29:49.579 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.579 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.580 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.580 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.580 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_user": { 2024-04-25T02:29:49.580 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_user", 2024-04-25T02:29:49.580 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.580 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.580 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.580 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.580 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.580 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.580 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.580 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "User to authenticate as", 2024-04-25T02:29:49.580 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.580 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.580 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.581 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.581 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.581 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.581 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.581 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "balancer", 2024-04-25T02:29:49.581 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.581 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.581 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.581 INFO:teuthology.orchestra.run.smithi067.stdout: "active": { 2024-04-25T02:29:49.581 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "active", 2024-04-25T02:29:49.581 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.581 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.581 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.581 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.581 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.581 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.582 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.582 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "automatically balance PGs across cluster", 2024-04-25T02:29:49.582 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.582 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.582 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.582 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.582 INFO:teuthology.orchestra.run.smithi067.stdout: "begin_time": { 2024-04-25T02:29:49.582 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "begin_time", 2024-04-25T02:29:49.582 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.582 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.582 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.582 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0000", 2024-04-25T02:29:49.582 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.582 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.583 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.583 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "beginning time of day to automatically balance", 2024-04-25T02:29:49.583 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T02:29:49.583 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.583 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.583 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.583 INFO:teuthology.orchestra.run.smithi067.stdout: "begin_weekday": { 2024-04-25T02:29:49.583 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "begin_weekday", 2024-04-25T02:29:49.583 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-04-25T02:29:49.583 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.583 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.583 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-04-25T02:29:49.583 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "0", 2024-04-25T02:29:49.583 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "6", 2024-04-25T02:29:49.583 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.584 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-25T02:29:49.584 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T02:29:49.584 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.584 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.584 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.584 INFO:teuthology.orchestra.run.smithi067.stdout: "crush_compat_max_iterations": { 2024-04-25T02:29:49.584 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crush_compat_max_iterations", 2024-04-25T02:29:49.584 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-04-25T02:29:49.584 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.584 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.584 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "25", 2024-04-25T02:29:49.584 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-04-25T02:29:49.584 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "250", 2024-04-25T02:29:49.584 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.584 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-25T02:29:49.585 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.585 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.585 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.585 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.585 INFO:teuthology.orchestra.run.smithi067.stdout: "crush_compat_metrics": { 2024-04-25T02:29:49.585 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crush_compat_metrics", 2024-04-25T02:29:49.585 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.585 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.585 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.585 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "pgs,objects,bytes", 2024-04-25T02:29:49.585 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.585 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.585 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.585 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-25T02:29:49.586 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-25T02:29:49.586 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.586 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.586 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.586 INFO:teuthology.orchestra.run.smithi067.stdout: "crush_compat_step": { 2024-04-25T02:29:49.586 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crush_compat_step", 2024-04-25T02:29:49.586 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-04-25T02:29:49.586 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.586 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.586 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0.5", 2024-04-25T02:29:49.586 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "0.001", 2024-04-25T02:29:49.586 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "0.999", 2024-04-25T02:29:49.586 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.586 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "aggressiveness of optimization", 2024-04-25T02:29:49.587 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-25T02:29:49.587 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.587 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.587 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.587 INFO:teuthology.orchestra.run.smithi067.stdout: "end_time": { 2024-04-25T02:29:49.587 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "end_time", 2024-04-25T02:29:49.587 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.587 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.587 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.587 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "2359", 2024-04-25T02:29:49.587 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.587 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.587 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.588 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "ending time of day to automatically balance", 2024-04-25T02:29:49.588 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T02:29:49.588 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.588 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.588 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.588 INFO:teuthology.orchestra.run.smithi067.stdout: "end_weekday": { 2024-04-25T02:29:49.588 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "end_weekday", 2024-04-25T02:29:49.588 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-04-25T02:29:49.588 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.588 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.588 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-04-25T02:29:49.589 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "0", 2024-04-25T02:29:49.589 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "6", 2024-04-25T02:29:49.589 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.589 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-25T02:29:49.589 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T02:29:49.589 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.589 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.589 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.589 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.589 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.589 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.589 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.589 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.589 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.590 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.590 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.590 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.590 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.590 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.590 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.590 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.590 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.590 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.590 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.590 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.590 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.590 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.590 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.591 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.591 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.591 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.591 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.591 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.591 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.591 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.591 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.591 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.591 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.591 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.591 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.591 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.592 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.592 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.592 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.592 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.592 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.592 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.592 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.592 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.592 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.592 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.592 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.592 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.592 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.592 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.593 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.593 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.593 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.593 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.593 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.593 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.593 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.593 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.593 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.593 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.593 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.593 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.593 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.593 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.593 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.594 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.594 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.594 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.594 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.594 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.594 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.594 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.594 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.594 INFO:teuthology.orchestra.run.smithi067.stdout: "min_score": { 2024-04-25T02:29:49.594 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "min_score", 2024-04-25T02:29:49.594 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-04-25T02:29:49.594 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.594 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.594 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-04-25T02:29:49.595 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.595 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.595 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.595 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-25T02:29:49.595 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.595 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.595 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.595 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.595 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": { 2024-04-25T02:29:49.595 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mode", 2024-04-25T02:29:49.595 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.595 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.595 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.595 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "upmap", 2024-04-25T02:29:49.595 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.596 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.596 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.596 INFO:teuthology.orchestra.run.smithi067.stdout: "crush-compat", 2024-04-25T02:29:49.596 INFO:teuthology.orchestra.run.smithi067.stdout: "none", 2024-04-25T02:29:49.596 INFO:teuthology.orchestra.run.smithi067.stdout: "read", 2024-04-25T02:29:49.596 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap", 2024-04-25T02:29:49.596 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap-read" 2024-04-25T02:29:49.596 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.596 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Balancer mode", 2024-04-25T02:29:49.596 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.596 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.596 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.596 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.596 INFO:teuthology.orchestra.run.smithi067.stdout: "pool_ids": { 2024-04-25T02:29:49.597 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pool_ids", 2024-04-25T02:29:49.597 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.597 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.597 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.597 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.597 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.597 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.597 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.597 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-25T02:29:49.597 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.597 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.597 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.598 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.598 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-04-25T02:29:49.598 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-04-25T02:29:49.598 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.598 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.598 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.598 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-04-25T02:29:49.598 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.598 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.598 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.598 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-25T02:29:49.598 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.598 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.598 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.599 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.599 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap_max_deviation": { 2024-04-25T02:29:49.599 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "upmap_max_deviation", 2024-04-25T02:29:49.599 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.599 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.599 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.599 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-04-25T02:29:49.599 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-04-25T02:29:49.599 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.599 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.599 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-25T02:29:49.599 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-25T02:29:49.599 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.599 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.600 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.600 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap_max_optimizations": { 2024-04-25T02:29:49.600 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "upmap_max_optimizations", 2024-04-25T02:29:49.600 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-04-25T02:29:49.600 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.600 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.600 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-04-25T02:29:49.600 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.600 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.600 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.600 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-25T02:29:49.600 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.600 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.600 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.601 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.601 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.601 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.601 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.601 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cephadm", 2024-04-25T02:29:49.601 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.601 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.601 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.601 INFO:teuthology.orchestra.run.smithi067.stdout: "agent_down_multiplier": { 2024-04-25T02:29:49.601 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "agent_down_multiplier", 2024-04-25T02:29:49.601 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-04-25T02:29:49.601 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.601 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.602 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "3.0", 2024-04-25T02:29:49.602 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.602 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.602 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.602 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-25T02:29:49.602 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.602 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.602 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.602 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.602 INFO:teuthology.orchestra.run.smithi067.stdout: "agent_refresh_rate": { 2024-04-25T02:29:49.602 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "agent_refresh_rate", 2024-04-25T02:29:49.603 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.603 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.603 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.603 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "20", 2024-04-25T02:29:49.603 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.603 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.603 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.603 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-25T02:29:49.603 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.603 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.603 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.603 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.604 INFO:teuthology.orchestra.run.smithi067.stdout: "agent_starting_port": { 2024-04-25T02:29:49.604 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "agent_starting_port", 2024-04-25T02:29:49.604 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.604 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.604 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.604 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "4721", 2024-04-25T02:29:49.604 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.604 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.604 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.604 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-25T02:29:49.604 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.604 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.604 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.605 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.605 INFO:teuthology.orchestra.run.smithi067.stdout: "allow_ptrace": { 2024-04-25T02:29:49.605 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "allow_ptrace", 2024-04-25T02:29:49.605 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.605 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.605 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.605 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.605 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.605 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.605 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.605 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-25T02:29:49.605 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-25T02:29:49.605 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.606 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.606 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.606 INFO:teuthology.orchestra.run.smithi067.stdout: "autotune_interval": { 2024-04-25T02:29:49.606 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "autotune_interval", 2024-04-25T02:29:49.606 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.606 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.606 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.606 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-04-25T02:29:49.606 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.606 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.606 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.606 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-25T02:29:49.606 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.607 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.607 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.607 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.607 INFO:teuthology.orchestra.run.smithi067.stdout: "autotune_memory_target_ratio": { 2024-04-25T02:29:49.607 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "autotune_memory_target_ratio", 2024-04-25T02:29:49.607 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-04-25T02:29:49.607 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.607 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.607 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0.7", 2024-04-25T02:29:49.607 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.607 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.607 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.607 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-25T02:29:49.607 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.607 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.608 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.608 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.608 INFO:teuthology.orchestra.run.smithi067.stdout: "cephadm_log_destination": { 2024-04-25T02:29:49.608 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cephadm_log_destination", 2024-04-25T02:29:49.608 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.608 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.608 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.608 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.608 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.608 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.608 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.608 INFO:teuthology.orchestra.run.smithi067.stdout: "file", 2024-04-25T02:29:49.608 INFO:teuthology.orchestra.run.smithi067.stdout: "file,syslog", 2024-04-25T02:29:49.608 INFO:teuthology.orchestra.run.smithi067.stdout: "syslog" 2024-04-25T02:29:49.609 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.609 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-25T02:29:49.609 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.609 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.609 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.609 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.609 INFO:teuthology.orchestra.run.smithi067.stdout: "cgroups_split": { 2024-04-25T02:29:49.609 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cgroups_split", 2024-04-25T02:29:49.609 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.609 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.609 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.609 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.609 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.609 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.610 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.610 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-25T02:29:49.610 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.610 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.610 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.610 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.610 INFO:teuthology.orchestra.run.smithi067.stdout: "config_checks_enabled": { 2024-04-25T02:29:49.610 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "config_checks_enabled", 2024-04-25T02:29:49.610 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.610 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.610 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.610 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.610 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.611 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.611 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.611 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-25T02:29:49.611 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.611 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.611 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.611 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.611 INFO:teuthology.orchestra.run.smithi067.stdout: "config_dashboard": { 2024-04-25T02:29:49.611 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "config_dashboard", 2024-04-25T02:29:49.611 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.611 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.611 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.611 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.611 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.611 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.612 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.612 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-25T02:29:49.612 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.612 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.612 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.612 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.612 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_alertmanager": { 2024-04-25T02:29:49.612 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_alertmanager", 2024-04-25T02:29:49.612 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.612 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.612 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.612 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-25T02:29:49.612 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.612 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.613 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.613 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-04-25T02:29:49.613 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.613 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.613 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.613 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.613 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_base": { 2024-04-25T02:29:49.613 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_base", 2024-04-25T02:29:49.613 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.613 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.613 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.613 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-25T02:29:49.613 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.613 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.614 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.614 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Container image name, without the tag", 2024-04-25T02:29:49.614 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.614 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.614 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.614 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.614 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_elasticsearch": { 2024-04-25T02:29:49.614 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_elasticsearch", 2024-04-25T02:29:49.614 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.614 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.614 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.614 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-25T02:29:49.614 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.614 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.615 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.615 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "elasticsearch container image", 2024-04-25T02:29:49.615 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.615 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.615 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.615 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.615 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_grafana": { 2024-04-25T02:29:49.615 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_grafana", 2024-04-25T02:29:49.615 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.615 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.615 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.615 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-25T02:29:49.615 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.615 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.616 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.616 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-04-25T02:29:49.616 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.616 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.616 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.616 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.616 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_haproxy": { 2024-04-25T02:29:49.616 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_haproxy", 2024-04-25T02:29:49.616 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.616 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.616 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.616 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-25T02:29:49.616 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.616 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.617 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.617 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "HAproxy container image", 2024-04-25T02:29:49.617 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.617 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.617 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.617 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.617 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_jaeger_agent": { 2024-04-25T02:29:49.617 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_jaeger_agent", 2024-04-25T02:29:49.617 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.617 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.617 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.617 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-25T02:29:49.617 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.617 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.618 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.618 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Jaeger agent container image", 2024-04-25T02:29:49.618 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.618 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.618 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.618 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.618 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_jaeger_collector": { 2024-04-25T02:29:49.618 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_jaeger_collector", 2024-04-25T02:29:49.618 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.618 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.618 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.618 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-25T02:29:49.618 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.618 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.619 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.619 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Jaeger collector container image", 2024-04-25T02:29:49.619 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.619 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.619 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.619 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.619 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_jaeger_query": { 2024-04-25T02:29:49.619 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_jaeger_query", 2024-04-25T02:29:49.619 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.619 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.619 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.619 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-25T02:29:49.619 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.619 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.620 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.620 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Jaeger query container image", 2024-04-25T02:29:49.620 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.620 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.620 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.620 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.620 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_keepalived": { 2024-04-25T02:29:49.620 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_keepalived", 2024-04-25T02:29:49.620 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.620 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.620 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.620 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-25T02:29:49.620 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.620 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.621 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.621 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Keepalived container image", 2024-04-25T02:29:49.621 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.621 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.621 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.621 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.621 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_loki": { 2024-04-25T02:29:49.621 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_loki", 2024-04-25T02:29:49.621 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.621 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.621 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.621 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-25T02:29:49.621 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.621 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.621 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.622 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Loki container image", 2024-04-25T02:29:49.622 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.622 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.622 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.622 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.622 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_node_exporter": { 2024-04-25T02:29:49.622 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_node_exporter", 2024-04-25T02:29:49.622 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.622 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.622 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.622 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-25T02:29:49.622 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.622 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.622 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.623 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-04-25T02:29:49.623 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.623 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.623 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.623 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.623 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_nvmeof": { 2024-04-25T02:29:49.623 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_nvmeof", 2024-04-25T02:29:49.623 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.623 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.623 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.623 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-25T02:29:49.623 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.623 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.623 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.624 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Nvme-of container image", 2024-04-25T02:29:49.624 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.624 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.624 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.624 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.624 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_prometheus": { 2024-04-25T02:29:49.624 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_prometheus", 2024-04-25T02:29:49.624 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.624 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.624 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.624 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-25T02:29:49.624 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.624 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.624 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.625 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-04-25T02:29:49.625 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.625 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.625 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.625 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.625 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_promtail": { 2024-04-25T02:29:49.625 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_promtail", 2024-04-25T02:29:49.625 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.625 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.625 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.625 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-25T02:29:49.625 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.625 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.625 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.626 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Promtail container image", 2024-04-25T02:29:49.626 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.626 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.626 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.626 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.626 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_samba": { 2024-04-25T02:29:49.626 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_samba", 2024-04-25T02:29:49.626 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.626 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.626 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.626 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-25T02:29:49.626 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.626 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.626 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.627 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Samba/SMB container image", 2024-04-25T02:29:49.627 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.627 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.627 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.627 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.627 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_snmp_gateway": { 2024-04-25T02:29:49.627 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_snmp_gateway", 2024-04-25T02:29:49.627 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.627 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.627 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.627 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-25T02:29:49.627 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.627 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.627 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.628 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SNMP Gateway container image", 2024-04-25T02:29:49.628 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.628 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.628 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.628 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.628 INFO:teuthology.orchestra.run.smithi067.stdout: "container_init": { 2024-04-25T02:29:49.628 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_init", 2024-04-25T02:29:49.628 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.628 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.628 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.628 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.628 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.628 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.629 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.629 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Run podman/docker with `--init`", 2024-04-25T02:29:49.629 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.629 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.629 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.629 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.629 INFO:teuthology.orchestra.run.smithi067.stdout: "daemon_cache_timeout": { 2024-04-25T02:29:49.629 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "daemon_cache_timeout", 2024-04-25T02:29:49.629 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.629 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.629 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.629 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-04-25T02:29:49.629 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.629 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.630 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.630 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-25T02:29:49.630 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.630 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.630 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.630 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.630 INFO:teuthology.orchestra.run.smithi067.stdout: "default_cephadm_command_timeout": { 2024-04-25T02:29:49.630 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "default_cephadm_command_timeout", 2024-04-25T02:29:49.630 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.630 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.630 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.630 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "900", 2024-04-25T02:29:49.630 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.630 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.631 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.631 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-25T02:29:49.631 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.631 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.631 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.631 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.631 INFO:teuthology.orchestra.run.smithi067.stdout: "default_registry": { 2024-04-25T02:29:49.631 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "default_registry", 2024-04-25T02:29:49.631 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.631 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.631 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.631 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io", 2024-04-25T02:29:49.631 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.631 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.631 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.632 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-25T02:29:49.632 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.632 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.632 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.632 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.632 INFO:teuthology.orchestra.run.smithi067.stdout: "device_cache_timeout": { 2024-04-25T02:29:49.632 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "device_cache_timeout", 2024-04-25T02:29:49.632 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.632 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.632 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.632 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "1800", 2024-04-25T02:29:49.632 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.632 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.633 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.633 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "seconds to cache device inventory", 2024-04-25T02:29:49.633 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.633 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.633 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.633 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.633 INFO:teuthology.orchestra.run.smithi067.stdout: "device_enhanced_scan": { 2024-04-25T02:29:49.633 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "device_enhanced_scan", 2024-04-25T02:29:49.633 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.633 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.633 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.633 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.633 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.633 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.633 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.634 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-25T02:29:49.634 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.634 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.634 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.634 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.634 INFO:teuthology.orchestra.run.smithi067.stdout: "facts_cache_timeout": { 2024-04-25T02:29:49.634 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "facts_cache_timeout", 2024-04-25T02:29:49.634 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.634 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.634 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.634 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-04-25T02:29:49.634 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.634 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.634 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.635 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "seconds to cache host facts data", 2024-04-25T02:29:49.635 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.635 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.635 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.635 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.635 INFO:teuthology.orchestra.run.smithi067.stdout: "grafana_dashboards_path": { 2024-04-25T02:29:49.635 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "grafana_dashboards_path", 2024-04-25T02:29:49.635 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.635 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.635 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.635 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-25T02:29:49.635 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.635 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.635 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.635 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-25T02:29:49.636 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.636 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.636 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.636 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.636 INFO:teuthology.orchestra.run.smithi067.stdout: "host_check_interval": { 2024-04-25T02:29:49.636 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "host_check_interval", 2024-04-25T02:29:49.636 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.636 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.636 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.636 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-04-25T02:29:49.636 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.636 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.636 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.636 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to perform a host check", 2024-04-25T02:29:49.636 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.637 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.637 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.637 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.637 INFO:teuthology.orchestra.run.smithi067.stdout: "hw_monitoring": { 2024-04-25T02:29:49.637 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "hw_monitoring", 2024-04-25T02:29:49.637 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.637 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.637 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.637 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.637 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.637 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.637 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.637 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-25T02:29:49.637 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.637 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.638 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.638 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.638 INFO:teuthology.orchestra.run.smithi067.stdout: "inventory_list_all": { 2024-04-25T02:29:49.638 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "inventory_list_all", 2024-04-25T02:29:49.638 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.638 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.638 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.638 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.638 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.638 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.638 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.638 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-25T02:29:49.638 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.638 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.638 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.639 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.639 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.639 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.639 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.639 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.639 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.639 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.639 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.639 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.640 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.640 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.640 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.640 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.640 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.640 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.640 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.640 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.640 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.640 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.640 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.640 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.640 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.640 INFO:teuthology.orchestra.run.smithi067.stdout: "log_refresh_metadata": { 2024-04-25T02:29:49.640 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_refresh_metadata", 2024-04-25T02:29:49.640 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.641 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.641 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.641 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.641 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.641 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.641 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.641 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-25T02:29:49.641 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.641 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.641 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.641 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.641 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.641 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.642 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.642 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.642 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.642 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.642 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.642 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.642 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.642 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-25T02:29:49.642 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.642 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.642 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.642 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.642 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.642 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.642 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.643 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.643 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.643 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.643 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.643 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.643 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.643 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.643 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.643 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.643 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.643 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.643 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.643 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.643 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.644 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.644 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.644 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.644 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.644 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.644 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.644 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.644 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.644 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.644 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.644 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.644 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.644 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.644 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.644 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.645 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.645 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.645 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.645 INFO:teuthology.orchestra.run.smithi067.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-25T02:29:49.645 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-25T02:29:49.645 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.645 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.645 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.645 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.645 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.645 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.645 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.645 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-25T02:29:49.645 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.645 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.646 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.646 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.646 INFO:teuthology.orchestra.run.smithi067.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-25T02:29:49.646 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-25T02:29:49.646 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.646 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.646 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.646 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "*", 2024-04-25T02:29:49.646 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.646 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.646 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.646 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-25T02:29:49.646 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.646 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.647 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.647 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.647 INFO:teuthology.orchestra.run.smithi067.stdout: "max_count_per_host": { 2024-04-25T02:29:49.647 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_count_per_host", 2024-04-25T02:29:49.647 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.647 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.647 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.647 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-04-25T02:29:49.647 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.647 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.647 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.647 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "max number of daemons per service per host", 2024-04-25T02:29:49.647 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.647 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.647 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.648 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.648 INFO:teuthology.orchestra.run.smithi067.stdout: "max_osd_draining_count": { 2024-04-25T02:29:49.648 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_osd_draining_count", 2024-04-25T02:29:49.648 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.648 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.648 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.648 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-04-25T02:29:49.648 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.648 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.648 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.648 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-25T02:29:49.648 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.648 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.648 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.649 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.649 INFO:teuthology.orchestra.run.smithi067.stdout: "migration_current": { 2024-04-25T02:29:49.649 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "migration_current", 2024-04-25T02:29:49.649 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.649 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.649 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.649 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.649 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.649 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.649 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.649 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "internal - do not modify", 2024-04-25T02:29:49.649 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.649 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.649 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.649 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.650 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": { 2024-04-25T02:29:49.650 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mode", 2024-04-25T02:29:49.650 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.650 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.650 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.650 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "root", 2024-04-25T02:29:49.650 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.650 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.650 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.650 INFO:teuthology.orchestra.run.smithi067.stdout: "cephadm-package", 2024-04-25T02:29:49.650 INFO:teuthology.orchestra.run.smithi067.stdout: "root" 2024-04-25T02:29:49.650 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.650 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "mode for remote execution of cephadm", 2024-04-25T02:29:49.650 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.651 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.651 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.651 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.651 INFO:teuthology.orchestra.run.smithi067.stdout: "oob_default_addr": { 2024-04-25T02:29:49.651 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "oob_default_addr", 2024-04-25T02:29:49.651 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.651 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.651 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.651 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "169.254.1.1", 2024-04-25T02:29:49.651 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.651 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.651 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.651 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-25T02:29:49.651 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.652 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.652 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.652 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.652 INFO:teuthology.orchestra.run.smithi067.stdout: "prometheus_alerts_path": { 2024-04-25T02:29:49.652 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "prometheus_alerts_path", 2024-04-25T02:29:49.652 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.652 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.652 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.652 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-25T02:29:49.652 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.652 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.652 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.652 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-25T02:29:49.652 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.652 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.653 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.653 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.653 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_insecure": { 2024-04-25T02:29:49.653 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_insecure", 2024-04-25T02:29:49.653 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.653 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.653 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.653 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.653 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.653 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.653 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.653 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-25T02:29:49.653 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.654 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.654 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.654 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.654 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_password": { 2024-04-25T02:29:49.654 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_password", 2024-04-25T02:29:49.654 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.654 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.654 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.654 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.654 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.654 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.654 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.654 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-25T02:29:49.655 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.655 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.655 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.655 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.655 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_url": { 2024-04-25T02:29:49.655 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_url", 2024-04-25T02:29:49.655 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.655 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.655 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.655 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.655 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.655 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.655 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.655 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-25T02:29:49.656 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.656 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.656 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.656 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.656 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_username": { 2024-04-25T02:29:49.656 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_username", 2024-04-25T02:29:49.656 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.656 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.656 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.656 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.656 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.656 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.656 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.656 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-25T02:29:49.656 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.656 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.657 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.657 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.657 INFO:teuthology.orchestra.run.smithi067.stdout: "secure_monitoring_stack": { 2024-04-25T02:29:49.657 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "secure_monitoring_stack", 2024-04-25T02:29:49.657 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.657 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.657 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.657 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.657 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.657 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.657 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.657 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-25T02:29:49.657 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.657 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.658 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.658 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.658 INFO:teuthology.orchestra.run.smithi067.stdout: "service_discovery_port": { 2024-04-25T02:29:49.658 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "service_discovery_port", 2024-04-25T02:29:49.658 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.658 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.658 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.658 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8765", 2024-04-25T02:29:49.658 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.658 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.658 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.658 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "cephadm service discovery port", 2024-04-25T02:29:49.658 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.658 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.659 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.659 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.659 INFO:teuthology.orchestra.run.smithi067.stdout: "ssh_config_file": { 2024-04-25T02:29:49.659 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssh_config_file", 2024-04-25T02:29:49.659 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.659 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.659 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.659 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.659 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.659 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.659 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.659 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-25T02:29:49.659 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.659 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.659 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.660 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.660 INFO:teuthology.orchestra.run.smithi067.stdout: "use_agent": { 2024-04-25T02:29:49.660 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "use_agent", 2024-04-25T02:29:49.660 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.660 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.660 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.660 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.660 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.660 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.660 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.660 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-25T02:29:49.660 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.660 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.660 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.660 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.661 INFO:teuthology.orchestra.run.smithi067.stdout: "use_repo_digest": { 2024-04-25T02:29:49.661 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "use_repo_digest", 2024-04-25T02:29:49.661 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.661 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.661 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.661 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.661 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.661 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.661 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.661 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-25T02:29:49.661 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.661 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.661 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.661 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.662 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_on_failed_host_check": { 2024-04-25T02:29:49.662 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_on_failed_host_check", 2024-04-25T02:29:49.662 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.662 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.662 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.662 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.662 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.662 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.662 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.662 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise a health warning if the host check fails", 2024-04-25T02:29:49.662 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.662 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.662 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.662 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.662 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_on_stray_daemons": { 2024-04-25T02:29:49.663 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_on_stray_daemons", 2024-04-25T02:29:49.663 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.663 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.663 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.663 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.663 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.663 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.663 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.663 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-25T02:29:49.663 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.663 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.663 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.663 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.663 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_on_stray_hosts": { 2024-04-25T02:29:49.664 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_on_stray_hosts", 2024-04-25T02:29:49.664 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.664 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.664 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.664 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.664 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.664 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.664 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.664 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-25T02:29:49.664 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.664 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.664 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.664 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.664 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.664 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.665 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.665 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crash", 2024-04-25T02:29:49.665 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.665 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.665 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.665 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.665 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.665 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.665 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.665 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.665 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.665 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.665 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.666 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.666 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.666 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.666 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.666 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.666 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.666 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.666 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.666 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.666 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.666 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.666 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.666 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.666 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.666 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.667 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.667 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.667 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.667 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.667 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.667 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.667 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.667 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.667 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.667 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.667 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.667 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.667 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.667 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.667 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.668 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.668 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.668 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.668 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.668 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.668 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.668 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.668 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.668 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.668 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.668 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.668 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.668 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.668 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.669 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.669 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.669 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.669 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.669 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.669 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.669 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.669 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.669 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.669 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.669 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.669 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.669 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.669 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.669 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.669 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.670 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.670 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.670 INFO:teuthology.orchestra.run.smithi067.stdout: "retain_interval": { 2024-04-25T02:29:49.670 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "retain_interval", 2024-04-25T02:29:49.670 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.670 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.670 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.670 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "31536000", 2024-04-25T02:29:49.670 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.670 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.670 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.670 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-25T02:29:49.670 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.670 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.671 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.671 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.671 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_recent_interval": { 2024-04-25T02:29:49.671 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_recent_interval", 2024-04-25T02:29:49.671 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.671 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.671 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.671 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "1209600", 2024-04-25T02:29:49.671 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.671 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.671 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.671 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-25T02:29:49.671 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.671 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.671 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.672 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.672 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.672 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.672 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.672 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "dashboard", 2024-04-25T02:29:49.672 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.672 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.672 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.672 INFO:teuthology.orchestra.run.smithi067.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-25T02:29:49.672 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-25T02:29:49.672 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.672 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.672 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.672 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-04-25T02:29:49.673 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.673 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.673 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.673 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.673 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.673 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.673 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.673 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.673 INFO:teuthology.orchestra.run.smithi067.stdout: "ALERTMANAGER_API_HOST": { 2024-04-25T02:29:49.673 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-25T02:29:49.673 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.673 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.673 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.673 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.673 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.674 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.674 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.674 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.674 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.674 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.674 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.674 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.674 INFO:teuthology.orchestra.run.smithi067.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-25T02:29:49.674 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-25T02:29:49.674 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.674 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.674 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.674 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.674 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.675 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.675 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.675 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.675 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.675 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.675 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.675 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.675 INFO:teuthology.orchestra.run.smithi067.stdout: "AUDIT_API_ENABLED": { 2024-04-25T02:29:49.675 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "AUDIT_API_ENABLED", 2024-04-25T02:29:49.675 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.675 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.675 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.675 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.676 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.676 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.676 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.676 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.676 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.676 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.676 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.676 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.676 INFO:teuthology.orchestra.run.smithi067.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-25T02:29:49.676 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-25T02:29:49.676 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.676 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.676 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.676 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.676 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.677 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.677 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.677 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.677 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.677 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.677 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.677 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.677 INFO:teuthology.orchestra.run.smithi067.stdout: "ENABLE_BROWSABLE_API": { 2024-04-25T02:29:49.677 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-25T02:29:49.677 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.677 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.677 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.677 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.677 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.678 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.678 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.678 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.678 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.678 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.678 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.678 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.678 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-25T02:29:49.678 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-25T02:29:49.678 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.678 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.678 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.678 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.678 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.679 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.679 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.679 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.679 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.679 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.679 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.679 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.679 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-25T02:29:49.679 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-25T02:29:49.679 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.679 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.679 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.679 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.680 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.680 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.680 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.680 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.680 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.680 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.680 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.680 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.680 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-25T02:29:49.680 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-25T02:29:49.680 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.680 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.680 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.680 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.681 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.681 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.681 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.681 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.681 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.681 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.681 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.681 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.681 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-25T02:29:49.681 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-25T02:29:49.681 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.681 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.681 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.681 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.681 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.682 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.682 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.682 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.682 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.682 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.682 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.682 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.682 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-25T02:29:49.682 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-25T02:29:49.682 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.682 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.682 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.682 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.682 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.682 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.683 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.683 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.683 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.683 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.683 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.683 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.683 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-25T02:29:49.683 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-25T02:29:49.683 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.683 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.683 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.683 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.683 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.683 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.683 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.684 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.684 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.684 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.684 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.684 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.684 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-25T02:29:49.684 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-25T02:29:49.684 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.684 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.684 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.684 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.684 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.684 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.684 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.684 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.685 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.685 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.685 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.685 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.685 INFO:teuthology.orchestra.run.smithi067.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-25T02:29:49.685 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-25T02:29:49.685 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.685 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.685 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.685 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.685 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.685 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.685 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.685 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.686 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.686 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.686 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.686 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.686 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_PASSWORD": { 2024-04-25T02:29:49.686 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-25T02:29:49.686 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.686 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.686 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.686 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "admin", 2024-04-25T02:29:49.686 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.686 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.686 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.686 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.686 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.687 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.687 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.687 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.687 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-25T02:29:49.687 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-25T02:29:49.687 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.687 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.687 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.687 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.687 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.687 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.687 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.687 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.687 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.688 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.688 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.688 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.688 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_URL": { 2024-04-25T02:29:49.688 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_URL", 2024-04-25T02:29:49.688 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.688 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.688 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.688 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.688 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.688 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.688 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.688 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.688 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.688 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.689 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.689 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.689 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_USERNAME": { 2024-04-25T02:29:49.689 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-25T02:29:49.689 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.689 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.689 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.689 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "admin", 2024-04-25T02:29:49.689 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.689 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.689 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.689 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.689 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.689 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.689 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.690 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.690 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-25T02:29:49.690 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-25T02:29:49.690 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.690 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.690 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.690 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.690 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.690 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.690 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.690 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.690 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.690 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.690 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.690 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.691 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-25T02:29:49.691 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-25T02:29:49.691 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.691 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.691 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.691 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.691 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.691 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.691 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.691 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.691 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.691 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.691 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.691 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.692 INFO:teuthology.orchestra.run.smithi067.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-25T02:29:49.692 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-25T02:29:49.692 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.692 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.692 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.692 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.692 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.692 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.692 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.692 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.692 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.692 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.692 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.692 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.692 INFO:teuthology.orchestra.run.smithi067.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-25T02:29:49.693 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-25T02:29:49.693 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.693 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.693 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.693 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.693 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.693 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.693 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.693 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.693 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.693 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.693 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.693 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.693 INFO:teuthology.orchestra.run.smithi067.stdout: "PROMETHEUS_API_HOST": { 2024-04-25T02:29:49.694 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-25T02:29:49.694 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.694 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.694 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.694 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.694 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.694 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.694 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.694 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.694 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.694 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.694 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.694 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.694 INFO:teuthology.orchestra.run.smithi067.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-25T02:29:49.694 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-25T02:29:49.695 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.695 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.695 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.695 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.695 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.695 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.695 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.695 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.695 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.695 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.695 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.695 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.695 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-25T02:29:49.695 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-25T02:29:49.695 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.696 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.696 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.696 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.696 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.696 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.696 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.696 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.696 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.696 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.696 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.696 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.696 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-25T02:29:49.696 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-25T02:29:49.696 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.696 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.697 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.697 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.697 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.697 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.697 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.697 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.697 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.697 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.697 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.697 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.697 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-25T02:29:49.697 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-25T02:29:49.697 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.697 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.697 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.698 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.698 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.698 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.698 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.698 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.698 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.698 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.698 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.698 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.698 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-25T02:29:49.698 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-25T02:29:49.698 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.698 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.698 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.699 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.699 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.699 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.699 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.699 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.699 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.699 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.699 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.699 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.699 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-25T02:29:49.699 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-25T02:29:49.699 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.699 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.699 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.699 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.699 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.700 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.700 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.700 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.700 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.700 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.700 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.700 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.700 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-25T02:29:49.700 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-25T02:29:49.700 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.700 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.700 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.700 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.700 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.700 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.701 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.701 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.701 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.701 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.701 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.701 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.701 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-25T02:29:49.701 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-25T02:29:49.701 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.701 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.701 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.701 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.701 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.701 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.701 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.702 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.702 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.702 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.702 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.702 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.702 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_ENABLED": { 2024-04-25T02:29:49.702 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-25T02:29:49.702 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.702 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.702 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.702 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.702 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.702 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.702 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.703 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.703 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.703 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.703 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.703 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.703 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-25T02:29:49.703 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-25T02:29:49.703 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.703 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.703 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.703 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-25T02:29:49.703 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.703 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.703 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.704 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.704 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.704 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.704 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.704 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.704 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-25T02:29:49.704 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-25T02:29:49.704 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.704 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.704 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.704 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-04-25T02:29:49.704 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.704 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.704 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.704 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.705 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.705 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.705 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.705 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.705 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-25T02:29:49.705 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-25T02:29:49.705 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.705 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.705 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.705 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8", 2024-04-25T02:29:49.705 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.705 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.705 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.705 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.706 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.706 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.706 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.706 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.706 INFO:teuthology.orchestra.run.smithi067.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-25T02:29:49.706 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-25T02:29:49.706 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.706 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.706 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.706 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "45", 2024-04-25T02:29:49.706 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.706 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.706 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.706 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.707 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.707 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.707 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.707 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.707 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_ACCESS_KEY": { 2024-04-25T02:29:49.707 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-25T02:29:49.707 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.707 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.707 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.707 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.707 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.707 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.707 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.707 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.707 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.708 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.708 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.708 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.708 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-25T02:29:49.708 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-25T02:29:49.708 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.708 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.708 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.708 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "admin", 2024-04-25T02:29:49.708 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.708 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.708 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.708 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.708 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.709 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.709 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.709 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.709 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_SECRET_KEY": { 2024-04-25T02:29:49.709 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-25T02:29:49.709 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.709 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.709 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.709 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.709 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.709 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.709 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.709 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.709 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.709 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.710 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.710 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.710 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_SSL_VERIFY": { 2024-04-25T02:29:49.710 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-25T02:29:49.710 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.710 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.710 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.710 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.710 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.710 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.710 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.710 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.710 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.711 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.711 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.711 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.711 INFO:teuthology.orchestra.run.smithi067.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-25T02:29:49.711 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-25T02:29:49.711 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.711 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.711 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.711 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-04-25T02:29:49.711 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.711 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.711 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.711 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.711 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.711 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.712 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.712 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.712 INFO:teuthology.orchestra.run.smithi067.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-25T02:29:49.712 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-25T02:29:49.712 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.712 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.712 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.712 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-04-25T02:29:49.712 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.712 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.712 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.712 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.712 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.712 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.713 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.713 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.713 INFO:teuthology.orchestra.run.smithi067.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-25T02:29:49.713 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-25T02:29:49.713 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.713 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.713 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.713 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-04-25T02:29:49.713 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.713 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.713 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.713 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.713 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.713 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.713 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.713 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.714 INFO:teuthology.orchestra.run.smithi067.stdout: "cross_origin_url": { 2024-04-25T02:29:49.714 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cross_origin_url", 2024-04-25T02:29:49.714 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.714 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.714 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.714 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.714 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.714 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.714 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.714 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.714 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.714 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.714 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.714 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.715 INFO:teuthology.orchestra.run.smithi067.stdout: "crt_file": { 2024-04-25T02:29:49.715 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crt_file", 2024-04-25T02:29:49.715 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.715 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.715 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.715 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.715 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.715 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.715 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.715 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.715 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.715 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.715 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.715 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.715 INFO:teuthology.orchestra.run.smithi067.stdout: "debug": { 2024-04-25T02:29:49.715 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "debug", 2024-04-25T02:29:49.716 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.716 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.716 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.716 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.716 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.716 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.716 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.716 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Enable/disable debug options", 2024-04-25T02:29:49.716 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.716 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.716 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.716 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.716 INFO:teuthology.orchestra.run.smithi067.stdout: "jwt_token_ttl": { 2024-04-25T02:29:49.717 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "jwt_token_ttl", 2024-04-25T02:29:49.717 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.717 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.717 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.717 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "28800", 2024-04-25T02:29:49.717 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.717 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.717 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.717 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.717 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.717 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.717 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.717 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.717 INFO:teuthology.orchestra.run.smithi067.stdout: "key_file": { 2024-04-25T02:29:49.717 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "key_file", 2024-04-25T02:29:49.718 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.718 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.718 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.718 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.718 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.718 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.718 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.718 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.718 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.718 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.718 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.718 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.718 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.719 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.719 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.719 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.719 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.719 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.719 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.719 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.719 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.719 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.719 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.719 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.719 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.719 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.719 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.720 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.720 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.720 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.720 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.720 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.720 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.720 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.720 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.720 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.720 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.720 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.720 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.720 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.720 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.720 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.721 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.721 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.721 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.721 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.721 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.721 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.721 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.721 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.721 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.721 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.721 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.721 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.721 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.721 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.721 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.722 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.722 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.722 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.722 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.722 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.722 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.722 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.722 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.722 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.722 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.722 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.722 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.722 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.723 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.723 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.723 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.723 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.723 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.723 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.723 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.723 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.723 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.723 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.723 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.723 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.723 INFO:teuthology.orchestra.run.smithi067.stdout: "motd": { 2024-04-25T02:29:49.723 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "motd", 2024-04-25T02:29:49.723 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.724 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.724 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.724 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.724 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.724 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.724 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.724 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "The message of the day", 2024-04-25T02:29:49.724 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.724 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.724 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.724 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.724 INFO:teuthology.orchestra.run.smithi067.stdout: "redirect_resolve_ip_addr": { 2024-04-25T02:29:49.724 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "redirect_resolve_ip_addr", 2024-04-25T02:29:49.724 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.725 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.725 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.725 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.725 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.725 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.725 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.725 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.725 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.725 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.725 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.725 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.725 INFO:teuthology.orchestra.run.smithi067.stdout: "server_addr": { 2024-04-25T02:29:49.725 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_addr", 2024-04-25T02:29:49.725 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.726 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.726 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.726 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "::", 2024-04-25T02:29:49.726 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.726 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.726 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.726 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.726 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.726 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.726 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.726 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.726 INFO:teuthology.orchestra.run.smithi067.stdout: "server_port": { 2024-04-25T02:29:49.726 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_port", 2024-04-25T02:29:49.726 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.727 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.727 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.727 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8080", 2024-04-25T02:29:49.727 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.727 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.727 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.727 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.727 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.727 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.727 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.727 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.727 INFO:teuthology.orchestra.run.smithi067.stdout: "ssl": { 2024-04-25T02:29:49.727 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssl", 2024-04-25T02:29:49.727 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.728 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.728 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.728 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.728 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.728 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.728 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.728 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.728 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.728 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.728 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.728 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.728 INFO:teuthology.orchestra.run.smithi067.stdout: "ssl_server_port": { 2024-04-25T02:29:49.728 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssl_server_port", 2024-04-25T02:29:49.728 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.729 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.729 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.729 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8443", 2024-04-25T02:29:49.729 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.729 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.729 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.729 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.729 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.729 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.729 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.729 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.729 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_behaviour": { 2024-04-25T02:29:49.729 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_behaviour", 2024-04-25T02:29:49.730 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.730 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.730 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.730 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "redirect", 2024-04-25T02:29:49.730 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.730 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.730 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.730 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.730 INFO:teuthology.orchestra.run.smithi067.stdout: "redirect" 2024-04-25T02:29:49.730 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.730 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.730 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.730 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.730 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.731 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.731 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_error_status_code": { 2024-04-25T02:29:49.731 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_error_status_code", 2024-04-25T02:29:49.731 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.731 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.731 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.731 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "500", 2024-04-25T02:29:49.731 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "400", 2024-04-25T02:29:49.731 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "599", 2024-04-25T02:29:49.731 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.731 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.731 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.731 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.731 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.732 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.732 INFO:teuthology.orchestra.run.smithi067.stdout: "url_prefix": { 2024-04-25T02:29:49.732 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "url_prefix", 2024-04-25T02:29:49.732 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.732 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.732 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.732 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.732 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.732 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.732 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.732 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.732 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.732 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.732 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.733 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.733 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.733 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.733 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.733 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "devicehealth", 2024-04-25T02:29:49.733 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.733 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.733 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.733 INFO:teuthology.orchestra.run.smithi067.stdout: "enable_monitoring": { 2024-04-25T02:29:49.733 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enable_monitoring", 2024-04-25T02:29:49.733 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.733 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.733 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.733 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.734 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.734 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.734 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.734 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "monitor device health metrics", 2024-04-25T02:29:49.734 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.734 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.734 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.734 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.734 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.734 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.734 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.734 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.734 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.734 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.735 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.735 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.735 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.735 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.735 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.735 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.735 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.735 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.735 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.735 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.735 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.735 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.735 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.735 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.736 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.736 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.736 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.736 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.736 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.736 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.736 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.736 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.736 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.736 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.736 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.736 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.736 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.736 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.736 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.737 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.737 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.737 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.737 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.737 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.737 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.737 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.737 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.737 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.737 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.737 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.737 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.737 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.737 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.738 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.738 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.738 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.738 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.738 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.738 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.738 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.738 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.738 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.738 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.738 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.738 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.738 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.738 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.738 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.739 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.739 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.739 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.739 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.739 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.739 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.739 INFO:teuthology.orchestra.run.smithi067.stdout: "mark_out_threshold": { 2024-04-25T02:29:49.739 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mark_out_threshold", 2024-04-25T02:29:49.739 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.739 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.739 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.739 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "2419200", 2024-04-25T02:29:49.739 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.739 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.739 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.740 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-25T02:29:49.740 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.740 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.740 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.740 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.740 INFO:teuthology.orchestra.run.smithi067.stdout: "pool_name": { 2024-04-25T02:29:49.740 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pool_name", 2024-04-25T02:29:49.740 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.740 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.740 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.740 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "device_health_metrics", 2024-04-25T02:29:49.740 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.740 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.740 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.741 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-25T02:29:49.741 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.741 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.741 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.741 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.741 INFO:teuthology.orchestra.run.smithi067.stdout: "retention_period": { 2024-04-25T02:29:49.741 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "retention_period", 2024-04-25T02:29:49.741 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.741 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.741 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.741 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "15552000", 2024-04-25T02:29:49.741 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.741 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.741 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.741 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how long to retain device health metrics", 2024-04-25T02:29:49.742 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.742 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.742 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.742 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.742 INFO:teuthology.orchestra.run.smithi067.stdout: "scrape_frequency": { 2024-04-25T02:29:49.742 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "scrape_frequency", 2024-04-25T02:29:49.742 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.742 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.742 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.742 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "86400", 2024-04-25T02:29:49.742 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.742 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.743 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.743 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-25T02:29:49.743 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.743 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.743 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.743 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.743 INFO:teuthology.orchestra.run.smithi067.stdout: "self_heal": { 2024-04-25T02:29:49.743 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "self_heal", 2024-04-25T02:29:49.743 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.743 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.743 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.743 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.743 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.743 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.744 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.744 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-25T02:29:49.744 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.744 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.744 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.744 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.744 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-04-25T02:29:49.744 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-04-25T02:29:49.744 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.744 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.744 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.744 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-04-25T02:29:49.744 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.744 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.745 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.745 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to wake up and check device health", 2024-04-25T02:29:49.745 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.745 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.745 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.745 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.745 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_threshold": { 2024-04-25T02:29:49.745 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_threshold", 2024-04-25T02:29:49.745 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.745 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.745 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.745 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "7257600", 2024-04-25T02:29:49.745 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.746 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.746 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.746 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-25T02:29:49.746 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.746 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.746 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.746 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.746 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.746 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.746 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.746 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "diskprediction_local", 2024-04-25T02:29:49.746 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.746 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.746 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.747 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.747 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.747 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.747 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.747 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.747 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.747 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.747 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.747 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.747 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.747 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.747 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.747 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.747 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.747 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.748 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.748 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.748 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.748 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.748 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.748 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.748 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.748 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.748 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.748 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.748 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.748 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.748 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.748 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.749 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.749 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.749 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.749 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.749 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.749 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.749 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.749 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.749 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.749 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.749 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.749 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.749 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.750 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.750 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.750 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.750 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.750 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.750 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.750 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.750 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.750 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.750 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.750 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.750 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.750 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.750 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.750 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.751 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.751 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.751 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.751 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.751 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.751 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.751 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.751 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.751 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.751 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.751 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.751 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.751 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.751 INFO:teuthology.orchestra.run.smithi067.stdout: "predict_interval": { 2024-04-25T02:29:49.752 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "predict_interval", 2024-04-25T02:29:49.752 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.752 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.752 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.752 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "86400", 2024-04-25T02:29:49.752 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.752 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.752 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.752 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.752 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.752 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.752 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.752 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.752 INFO:teuthology.orchestra.run.smithi067.stdout: "predictor_model": { 2024-04-25T02:29:49.752 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "predictor_model", 2024-04-25T02:29:49.753 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.753 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.753 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.753 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "prophetstor", 2024-04-25T02:29:49.753 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.753 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.753 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.753 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.753 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.753 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.753 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.753 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.753 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-04-25T02:29:49.753 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-04-25T02:29:49.754 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.754 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.754 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.754 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-04-25T02:29:49.754 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.754 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.754 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.754 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.754 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.754 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.754 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.754 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.754 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.754 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.755 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.755 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "influx", 2024-04-25T02:29:49.755 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": false, 2024-04-25T02:29:49.755 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "influxdb python module not found", 2024-04-25T02:29:49.755 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.755 INFO:teuthology.orchestra.run.smithi067.stdout: "batch_size": { 2024-04-25T02:29:49.755 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "batch_size", 2024-04-25T02:29:49.755 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.755 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.755 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.755 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5000", 2024-04-25T02:29:49.755 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.755 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.755 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.756 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-25T02:29:49.756 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.756 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.756 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.756 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.756 INFO:teuthology.orchestra.run.smithi067.stdout: "database": { 2024-04-25T02:29:49.756 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "database", 2024-04-25T02:29:49.756 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.756 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.756 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.756 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "ceph", 2024-04-25T02:29:49.756 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.756 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.757 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.757 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-25T02:29:49.757 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.757 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.757 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.757 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.757 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": { 2024-04-25T02:29:49.757 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "hostname", 2024-04-25T02:29:49.757 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.757 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.757 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.757 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.757 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.757 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.757 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.758 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "InfluxDB server hostname", 2024-04-25T02:29:49.758 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.758 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.758 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.758 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.758 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-04-25T02:29:49.758 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-04-25T02:29:49.758 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.758 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.758 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.758 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "30", 2024-04-25T02:29:49.758 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "5", 2024-04-25T02:29:49.758 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.758 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.759 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-25T02:29:49.759 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.759 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.759 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.759 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.759 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.759 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.759 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.759 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.759 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.759 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.759 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.759 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.759 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.759 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.760 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.760 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.760 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.760 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.760 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.760 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.760 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.760 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.760 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.760 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.760 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.760 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.760 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.760 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.760 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.761 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.761 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.761 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.761 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.761 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.761 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.761 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.761 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.761 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.761 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.761 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.761 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.761 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.761 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.762 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.762 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.762 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.762 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.762 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.762 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.762 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.762 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.762 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.762 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.762 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.762 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.762 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.762 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.763 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.763 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.763 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.763 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.763 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.763 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.763 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.763 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.763 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.763 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.763 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.763 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.763 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.763 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.764 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.764 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.764 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.764 INFO:teuthology.orchestra.run.smithi067.stdout: "password": { 2024-04-25T02:29:49.764 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "password", 2024-04-25T02:29:49.764 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.764 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.764 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.764 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.764 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.764 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.764 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.764 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "password of InfluxDB server user", 2024-04-25T02:29:49.764 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.764 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.765 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.765 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.765 INFO:teuthology.orchestra.run.smithi067.stdout: "port": { 2024-04-25T02:29:49.765 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "port", 2024-04-25T02:29:49.765 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.765 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.765 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.765 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8086", 2024-04-25T02:29:49.765 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.765 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.765 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.765 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "InfluxDB server port", 2024-04-25T02:29:49.765 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.765 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.765 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.766 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.766 INFO:teuthology.orchestra.run.smithi067.stdout: "ssl": { 2024-04-25T02:29:49.766 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssl", 2024-04-25T02:29:49.766 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.766 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.766 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.766 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "false", 2024-04-25T02:29:49.766 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.766 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.766 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.766 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T02:29:49.766 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.766 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.766 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.767 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.767 INFO:teuthology.orchestra.run.smithi067.stdout: "threads": { 2024-04-25T02:29:49.767 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "threads", 2024-04-25T02:29:49.767 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.767 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.767 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.767 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-04-25T02:29:49.767 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-04-25T02:29:49.767 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "32", 2024-04-25T02:29:49.767 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.767 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-25T02:29:49.767 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.767 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.767 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.767 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.768 INFO:teuthology.orchestra.run.smithi067.stdout: "username": { 2024-04-25T02:29:49.768 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "username", 2024-04-25T02:29:49.768 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.768 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.768 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.768 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.768 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.768 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.768 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.768 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "username of InfluxDB server user", 2024-04-25T02:29:49.768 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.768 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.768 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.768 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.768 INFO:teuthology.orchestra.run.smithi067.stdout: "verify_ssl": { 2024-04-25T02:29:49.769 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "verify_ssl", 2024-04-25T02:29:49.769 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.769 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.769 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.769 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "true", 2024-04-25T02:29:49.769 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.769 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.769 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.769 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T02:29:49.769 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.769 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.769 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.769 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.769 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.769 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.770 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.770 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "insights", 2024-04-25T02:29:49.770 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.770 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.770 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.770 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.770 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.770 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.770 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.770 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.770 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.770 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.770 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.770 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.771 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.771 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.771 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.771 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.771 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.771 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.771 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.771 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.771 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.771 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.771 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.771 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.771 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.771 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.771 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.772 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.772 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.772 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.772 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.772 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.772 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.772 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.772 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.772 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.772 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.772 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.772 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.772 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.772 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.772 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.773 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.773 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.773 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.773 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.773 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.773 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.773 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.773 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.773 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.773 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.773 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.773 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.773 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.773 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.774 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.774 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.774 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.774 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.774 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.774 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.774 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.774 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.774 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.774 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.774 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.774 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.774 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.774 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.774 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.775 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.775 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.775 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.775 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.775 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.775 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "iostat", 2024-04-25T02:29:49.775 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.775 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.775 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.775 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.775 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.775 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.775 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.775 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.776 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.776 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.776 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.776 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.776 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.776 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.776 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.776 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.776 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.776 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.776 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.776 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.776 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.776 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.776 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.777 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.777 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.777 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.777 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.777 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.777 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.777 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.777 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.777 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.777 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.777 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.777 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.777 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.777 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.778 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.778 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.778 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.778 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.778 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.778 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.778 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.778 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.778 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.778 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.778 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.778 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.778 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.778 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.778 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.779 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.779 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.779 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.779 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.779 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.779 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.779 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.779 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.779 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.779 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.779 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.779 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.779 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.779 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.779 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.780 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.780 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.780 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.780 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.780 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.780 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.780 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.780 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.780 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.780 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "localpool", 2024-04-25T02:29:49.780 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.780 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.780 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.780 INFO:teuthology.orchestra.run.smithi067.stdout: "failure_domain": { 2024-04-25T02:29:49.780 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "failure_domain", 2024-04-25T02:29:49.780 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.781 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.781 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.781 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "host", 2024-04-25T02:29:49.781 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.781 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.781 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.781 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "failure domain for any created local pool", 2024-04-25T02:29:49.781 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-25T02:29:49.781 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.781 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.781 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.781 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.781 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.781 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.781 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.782 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.782 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.782 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.782 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.782 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.782 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.782 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.782 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.782 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.782 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.782 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.782 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.782 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.782 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.783 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.783 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.783 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.783 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.783 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.783 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.783 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.783 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.783 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.783 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.783 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.783 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.783 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.783 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.784 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.784 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.784 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.784 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.784 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.784 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.784 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.784 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.784 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.784 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.784 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.784 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.784 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.784 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.785 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.785 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.785 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.785 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.785 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.785 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.785 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.785 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.785 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.785 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.785 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.785 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.785 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.785 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.786 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.786 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.786 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.786 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.786 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.786 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.786 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.786 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.786 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.786 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.786 INFO:teuthology.orchestra.run.smithi067.stdout: "min_size": { 2024-04-25T02:29:49.786 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "min_size", 2024-04-25T02:29:49.786 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.786 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.787 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.787 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.787 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.787 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.787 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.787 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "default min_size for any created local pool", 2024-04-25T02:29:49.787 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-25T02:29:49.787 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.787 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.787 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.787 INFO:teuthology.orchestra.run.smithi067.stdout: "num_rep": { 2024-04-25T02:29:49.787 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "num_rep", 2024-04-25T02:29:49.787 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.788 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.788 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.788 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "3", 2024-04-25T02:29:49.788 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.788 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.788 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.788 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "default replica count for any created local pool", 2024-04-25T02:29:49.788 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.788 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.788 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.788 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.788 INFO:teuthology.orchestra.run.smithi067.stdout: "pg_num": { 2024-04-25T02:29:49.788 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pg_num", 2024-04-25T02:29:49.788 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.788 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.788 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.789 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "128", 2024-04-25T02:29:49.789 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.789 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.789 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.789 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "default pg_num for any created local pool", 2024-04-25T02:29:49.789 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.789 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.789 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.789 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.789 INFO:teuthology.orchestra.run.smithi067.stdout: "prefix": { 2024-04-25T02:29:49.789 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "prefix", 2024-04-25T02:29:49.789 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.789 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.789 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.789 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.790 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.790 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.790 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.790 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "name prefix for any created local pool", 2024-04-25T02:29:49.790 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.790 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.790 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.790 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.790 INFO:teuthology.orchestra.run.smithi067.stdout: "subtree": { 2024-04-25T02:29:49.790 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "subtree", 2024-04-25T02:29:49.790 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.790 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.790 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.790 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "rack", 2024-04-25T02:29:49.791 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.791 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.791 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.791 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-25T02:29:49.791 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-25T02:29:49.791 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.791 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.791 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.791 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.791 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.791 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.791 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mds_autoscaler", 2024-04-25T02:29:49.791 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.791 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.792 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.792 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.792 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.792 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.792 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.792 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.792 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.792 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.792 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.792 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.792 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.792 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.792 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.792 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.793 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.793 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.793 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.793 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.793 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.793 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.793 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.793 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.793 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.793 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.793 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.793 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.793 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.793 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.793 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.793 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.794 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.794 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.794 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.794 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.794 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.794 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.794 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.794 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.794 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.794 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.794 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.794 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.794 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.794 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.795 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.795 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.795 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.795 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.795 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.795 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.795 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.795 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.795 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.795 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.795 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.795 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.795 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.795 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.796 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.796 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.796 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.796 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.796 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.796 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.796 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.796 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.796 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.796 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.796 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.796 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.796 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.796 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.796 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.797 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.797 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mirroring", 2024-04-25T02:29:49.797 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.797 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.797 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.797 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.797 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.797 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.797 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.797 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.797 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.797 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.797 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.797 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.797 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.798 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.798 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.798 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.798 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.798 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.798 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.798 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.798 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.798 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.798 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.798 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.798 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.798 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.798 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.799 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.799 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.799 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.799 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.799 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.799 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.799 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.799 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.799 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.799 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.799 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.799 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.799 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.799 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.799 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.800 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.800 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.800 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.800 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.800 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.800 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.800 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.800 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.800 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.800 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.800 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.800 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.800 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.800 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.800 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.801 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.801 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.801 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.801 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.801 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.801 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.801 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.801 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.801 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.801 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.801 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.801 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.801 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.801 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.801 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.802 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.802 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.802 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.802 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.802 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "nfs", 2024-04-25T02:29:49.802 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.802 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.802 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.802 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.802 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.802 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.802 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.802 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.802 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.803 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.803 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.803 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.803 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.803 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.803 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.803 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.803 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.803 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.803 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.803 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.803 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.803 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.803 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.803 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.804 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.804 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.804 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.804 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.804 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.804 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.804 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.804 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.804 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.804 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.804 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.804 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.804 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.804 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.804 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.805 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.805 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.805 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.805 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.805 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.805 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.805 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.805 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.805 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.805 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.805 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.805 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.805 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.805 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.805 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.806 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.806 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.806 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.806 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.806 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.806 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.806 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.806 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.806 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.806 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.806 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.806 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.806 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.806 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.807 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.807 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.807 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.807 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.807 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.807 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.807 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.807 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.807 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "orchestrator", 2024-04-25T02:29:49.807 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.807 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.807 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.807 INFO:teuthology.orchestra.run.smithi067.stdout: "fail_fs": { 2024-04-25T02:29:49.807 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "fail_fs", 2024-04-25T02:29:49.807 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.808 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.808 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.808 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.808 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.808 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.808 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.808 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-25T02:29:49.808 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.808 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.808 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.808 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.808 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.808 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.809 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.809 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.809 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.809 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.809 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.809 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.809 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.809 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.809 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.809 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.809 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.809 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.809 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.809 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.809 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.810 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.810 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.810 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.810 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.810 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.810 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.810 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.810 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.810 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.810 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.810 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.810 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.810 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.811 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.811 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.811 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.811 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.811 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.811 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.811 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.811 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.811 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.811 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.811 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.811 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.811 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.812 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.812 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.812 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.812 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.812 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.812 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.812 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.812 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.812 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.812 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.812 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.812 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.812 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.812 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.813 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.813 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.813 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.813 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.813 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.813 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.813 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.813 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.813 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.813 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.813 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.813 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.813 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.813 INFO:teuthology.orchestra.run.smithi067.stdout: "orchestrator": { 2024-04-25T02:29:49.814 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "orchestrator", 2024-04-25T02:29:49.814 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.814 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.814 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.814 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.814 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.814 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.814 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.814 INFO:teuthology.orchestra.run.smithi067.stdout: "cephadm", 2024-04-25T02:29:49.814 INFO:teuthology.orchestra.run.smithi067.stdout: "rook", 2024-04-25T02:29:49.814 INFO:teuthology.orchestra.run.smithi067.stdout: "test_orchestrator" 2024-04-25T02:29:49.814 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.814 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Orchestrator backend", 2024-04-25T02:29:49.814 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.815 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.815 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.815 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.815 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.815 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.815 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.815 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "osd_perf_query", 2024-04-25T02:29:49.815 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.815 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.815 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.815 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.815 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.815 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.815 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.815 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.816 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.816 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.816 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.816 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.816 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.816 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.816 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.816 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.816 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.816 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.816 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.816 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.816 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.816 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.816 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.817 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.817 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.817 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.817 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.817 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.817 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.817 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.817 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.817 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.817 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.817 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.817 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.817 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.817 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.818 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.818 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.818 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.818 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.818 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.818 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.818 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.818 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.818 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.818 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.818 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.818 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.818 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.818 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.818 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.819 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.819 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.819 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.819 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.819 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.819 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.819 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.819 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.819 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.819 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.819 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.819 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.819 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.819 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.819 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.819 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.820 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.820 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.820 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.820 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.820 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.820 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.820 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.820 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.820 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "osd_support", 2024-04-25T02:29:49.820 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.820 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.820 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.820 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.820 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.820 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.821 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.821 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.821 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.821 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.821 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.821 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.821 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.821 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.821 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.821 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.821 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.821 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.821 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.821 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.821 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.824 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.824 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.824 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.824 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.824 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.824 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.824 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.824 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.824 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.824 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.824 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.824 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.824 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.824 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.824 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.825 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.825 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.825 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.825 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.825 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.825 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.825 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.825 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.825 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.825 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.825 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.825 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pg_autoscaler", 2024-04-25T02:29:49.825 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.825 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.825 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.826 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.826 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.826 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.826 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.826 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.826 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.826 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.826 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.826 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.826 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.826 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.826 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.826 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.826 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.827 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.827 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.827 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.827 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.827 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.827 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.827 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.827 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.827 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.827 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.827 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.827 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.827 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.827 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.827 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.828 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.828 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.828 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.828 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.828 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.828 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.828 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.828 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.828 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.828 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.828 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.828 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.828 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.828 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.828 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.829 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.829 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.829 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.829 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.829 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.829 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.829 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.829 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.829 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.829 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.829 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.829 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.829 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.829 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.829 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.830 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.830 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.830 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.830 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.830 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.830 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.830 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.830 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.830 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.830 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.830 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.830 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-04-25T02:29:49.830 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-04-25T02:29:49.830 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.830 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.831 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.831 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-04-25T02:29:49.831 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.831 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.831 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.831 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.831 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.831 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.831 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.831 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.831 INFO:teuthology.orchestra.run.smithi067.stdout: "threshold": { 2024-04-25T02:29:49.832 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "threshold", 2024-04-25T02:29:49.832 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-04-25T02:29:49.832 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.832 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.832 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "3.0", 2024-04-25T02:29:49.832 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1.0", 2024-04-25T02:29:49.832 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.832 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.832 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "scaling threshold", 2024-04-25T02:29:49.832 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-25T02:29:49.832 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.832 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.832 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.832 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.833 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.833 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.833 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "progress", 2024-04-25T02:29:49.833 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.833 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.833 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.833 INFO:teuthology.orchestra.run.smithi067.stdout: "allow_pg_recovery_event": { 2024-04-25T02:29:49.833 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "allow_pg_recovery_event", 2024-04-25T02:29:49.833 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.833 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.833 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.833 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.833 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.833 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.834 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.834 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-25T02:29:49.834 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.834 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.834 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.834 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.834 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": { 2024-04-25T02:29:49.834 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enabled", 2024-04-25T02:29:49.834 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.834 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.834 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.834 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.834 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.834 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.835 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.835 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.835 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.835 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.835 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.835 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.835 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.835 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.835 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.835 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.835 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.835 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.835 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.835 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.836 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.836 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.836 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.836 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.836 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.836 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.836 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.836 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.836 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.836 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.836 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.836 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.836 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.837 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.837 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.837 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.837 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.837 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.837 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.837 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.837 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.837 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.837 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.837 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.837 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.837 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.837 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.837 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.838 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.838 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.838 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.838 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.838 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.838 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.838 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.838 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.838 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.838 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.838 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.838 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.838 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.839 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.839 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.839 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.839 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.839 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.839 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.839 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.839 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.839 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.839 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.839 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.839 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.839 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.839 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.839 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.840 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.840 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.840 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.840 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.840 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.840 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.840 INFO:teuthology.orchestra.run.smithi067.stdout: "max_completed_events": { 2024-04-25T02:29:49.840 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_completed_events", 2024-04-25T02:29:49.840 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.840 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.840 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.840 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "50", 2024-04-25T02:29:49.840 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.840 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.840 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.841 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "number of past completed events to remember", 2024-04-25T02:29:49.841 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.841 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.841 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.841 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.841 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-04-25T02:29:49.841 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-04-25T02:29:49.841 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.841 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.841 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.841 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-04-25T02:29:49.841 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.841 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.841 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.842 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how long the module is going to sleep", 2024-04-25T02:29:49.842 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.842 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.842 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.842 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.842 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.842 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.842 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.842 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "prometheus", 2024-04-25T02:29:49.842 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.842 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.842 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.842 INFO:teuthology.orchestra.run.smithi067.stdout: "cache": { 2024-04-25T02:29:49.842 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cache", 2024-04-25T02:29:49.843 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.843 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.843 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.843 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.843 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.843 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.843 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.843 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.843 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.843 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.843 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.843 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.843 INFO:teuthology.orchestra.run.smithi067.stdout: "exclude_perf_counters": { 2024-04-25T02:29:49.843 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "exclude_perf_counters", 2024-04-25T02:29:49.843 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.844 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.844 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.844 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.844 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.844 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.844 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.844 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-25T02:29:49.844 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-25T02:29:49.844 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.844 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.844 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.844 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.844 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.844 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.844 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.845 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.845 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.845 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.845 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.845 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.845 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.845 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.845 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.845 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.845 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.845 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.845 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.845 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.845 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.845 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.846 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.846 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.846 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.846 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.846 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.846 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.846 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.846 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.846 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.846 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.846 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.846 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.846 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.846 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.847 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.847 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.847 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.847 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.847 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.847 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.847 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.847 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.847 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.847 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.847 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.847 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.847 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.847 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.848 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.848 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.848 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.848 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.848 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.848 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.848 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.848 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.848 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.848 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.848 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.848 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.848 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.848 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.849 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.849 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.849 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.849 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.849 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.849 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.849 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.849 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.849 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.849 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_stats_pools": { 2024-04-25T02:29:49.849 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rbd_stats_pools", 2024-04-25T02:29:49.850 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.850 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.850 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.850 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.850 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.850 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.850 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.850 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.850 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.850 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.850 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.850 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.851 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-25T02:29:49.851 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-25T02:29:49.851 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.851 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.851 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.851 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "300", 2024-04-25T02:29:49.851 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.851 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.851 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.851 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.851 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.851 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.851 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.851 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.852 INFO:teuthology.orchestra.run.smithi067.stdout: "scrape_interval": { 2024-04-25T02:29:49.852 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "scrape_interval", 2024-04-25T02:29:49.852 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-04-25T02:29:49.852 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.852 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.852 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "15.0", 2024-04-25T02:29:49.852 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.852 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.852 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.852 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.852 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.852 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.852 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.852 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.852 INFO:teuthology.orchestra.run.smithi067.stdout: "server_addr": { 2024-04-25T02:29:49.853 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_addr", 2024-04-25T02:29:49.853 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.853 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.853 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.853 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "::", 2024-04-25T02:29:49.853 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.853 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.853 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.853 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-25T02:29:49.853 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.853 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.853 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.853 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.853 INFO:teuthology.orchestra.run.smithi067.stdout: "server_port": { 2024-04-25T02:29:49.853 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_port", 2024-04-25T02:29:49.854 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.854 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.854 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.854 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "9283", 2024-04-25T02:29:49.854 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.854 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.854 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.854 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-25T02:29:49.854 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.854 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.854 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.854 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.854 INFO:teuthology.orchestra.run.smithi067.stdout: "stale_cache_strategy": { 2024-04-25T02:29:49.854 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "stale_cache_strategy", 2024-04-25T02:29:49.855 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.855 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.855 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.855 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "log", 2024-04-25T02:29:49.855 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.855 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.855 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.855 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.855 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.855 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.855 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.855 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.855 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_behaviour": { 2024-04-25T02:29:49.855 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_behaviour", 2024-04-25T02:29:49.856 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.856 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.856 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.856 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "default", 2024-04-25T02:29:49.856 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.856 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.856 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.856 INFO:teuthology.orchestra.run.smithi067.stdout: "default", 2024-04-25T02:29:49.856 INFO:teuthology.orchestra.run.smithi067.stdout: "error" 2024-04-25T02:29:49.856 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.856 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.856 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.856 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.856 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.857 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.857 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_error_status_code": { 2024-04-25T02:29:49.857 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_error_status_code", 2024-04-25T02:29:49.857 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.857 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.857 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.857 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "500", 2024-04-25T02:29:49.857 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "400", 2024-04-25T02:29:49.857 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "599", 2024-04-25T02:29:49.857 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.857 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.857 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.857 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.857 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.858 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.858 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.858 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.858 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.858 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rbd_support", 2024-04-25T02:29:49.858 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.858 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.858 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.858 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.858 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.858 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.858 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.858 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.858 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.859 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.859 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.859 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.859 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.859 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.859 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.859 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.859 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.859 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.859 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.859 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.859 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.859 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.859 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.859 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.860 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.860 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.860 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.860 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.860 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.860 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.860 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.860 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.860 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.860 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.860 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.860 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.860 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.860 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.861 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.861 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.861 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.861 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.861 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.861 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.861 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.861 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.861 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.861 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.861 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.861 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.861 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.861 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.862 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.862 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.862 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.862 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.862 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.862 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.862 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.862 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.862 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.862 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.863 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.863 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.863 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.863 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.863 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.863 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.863 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.863 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.863 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.863 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.863 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.863 INFO:teuthology.orchestra.run.smithi067.stdout: "max_concurrent_snap_create": { 2024-04-25T02:29:49.863 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_concurrent_snap_create", 2024-04-25T02:29:49.863 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.864 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.864 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.864 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-04-25T02:29:49.864 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.864 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.864 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.864 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.864 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.864 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.864 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.864 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.864 INFO:teuthology.orchestra.run.smithi067.stdout: "mirror_snapshot_schedule": { 2024-04-25T02:29:49.864 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mirror_snapshot_schedule", 2024-04-25T02:29:49.864 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.865 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.865 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.865 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.865 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.865 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.865 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.865 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.865 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.865 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.865 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.865 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.865 INFO:teuthology.orchestra.run.smithi067.stdout: "trash_purge_schedule": { 2024-04-25T02:29:49.865 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "trash_purge_schedule", 2024-04-25T02:29:49.865 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.865 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.866 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.866 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.866 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.866 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.866 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.866 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.866 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.866 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.866 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.866 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.866 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.866 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.866 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.866 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "restful", 2024-04-25T02:29:49.867 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.867 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.867 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.867 INFO:teuthology.orchestra.run.smithi067.stdout: "enable_auth": { 2024-04-25T02:29:49.867 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enable_auth", 2024-04-25T02:29:49.867 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.867 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.867 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.867 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.867 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.867 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.867 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.867 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.867 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.868 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.868 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.868 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.868 INFO:teuthology.orchestra.run.smithi067.stdout: "key_file": { 2024-04-25T02:29:49.868 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "key_file", 2024-04-25T02:29:49.868 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.868 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.868 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.868 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.868 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.868 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.868 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.868 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.868 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.868 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.869 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.869 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.869 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.869 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.869 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.869 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.869 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.869 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.869 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.869 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.869 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.869 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.869 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.869 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.870 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.870 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.870 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.870 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.870 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.870 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.870 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.870 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.870 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.870 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.870 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.870 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.870 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.870 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.871 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.871 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.871 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.871 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.871 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.871 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.871 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.871 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.871 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.871 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.871 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.871 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.871 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.871 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.871 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.872 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.872 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.872 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.872 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.872 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.872 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.872 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.872 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.872 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.872 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.872 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.872 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.872 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.872 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.873 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.873 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.873 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.873 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.873 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.873 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.873 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.873 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.873 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.873 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.873 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.873 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.873 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.873 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.873 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.874 INFO:teuthology.orchestra.run.smithi067.stdout: "server_addr": { 2024-04-25T02:29:49.874 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_addr", 2024-04-25T02:29:49.874 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.874 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.874 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.874 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.874 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.874 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.874 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.874 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.874 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.874 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.874 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.874 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.875 INFO:teuthology.orchestra.run.smithi067.stdout: "server_port": { 2024-04-25T02:29:49.875 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_port", 2024-04-25T02:29:49.875 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.875 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.875 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.875 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.875 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.875 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.875 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.875 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.875 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.875 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.875 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.875 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.876 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.876 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.876 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.876 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rgw", 2024-04-25T02:29:49.876 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.876 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.876 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.876 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.876 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.876 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.876 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.876 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.876 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.876 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.877 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.877 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.877 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.877 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.877 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.877 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.877 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.877 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.877 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.877 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.877 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.877 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.877 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.877 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.877 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.878 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.878 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.878 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.878 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.878 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.878 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.878 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.878 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.878 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.878 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.878 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.878 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.878 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.879 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.879 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.879 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.879 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.879 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.879 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.879 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.879 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.879 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.879 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.879 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.879 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.879 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.879 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.879 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.880 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.880 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.880 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.880 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.880 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.880 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.880 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.880 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.880 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.880 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.880 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.880 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.880 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.880 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.881 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.881 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.881 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.881 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.881 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.881 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.881 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.881 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.881 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.881 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rook", 2024-04-25T02:29:49.881 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.881 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.881 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.882 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.882 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.882 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.882 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.882 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.882 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.882 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.882 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.882 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.882 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.882 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.882 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.882 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.882 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.883 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.883 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.883 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.883 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.883 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.883 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.883 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.883 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.883 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.883 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.883 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.883 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.883 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.884 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.884 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.884 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.884 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.884 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.884 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.884 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.884 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.884 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.884 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.884 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.884 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.884 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.884 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.884 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.885 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.885 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.885 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.885 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.885 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.885 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.885 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.885 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.885 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.885 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.885 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.885 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.885 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.885 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.886 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.886 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.886 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.886 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.886 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.886 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.886 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.886 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.886 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.886 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.886 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.886 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.886 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.887 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.887 INFO:teuthology.orchestra.run.smithi067.stdout: "storage_class": { 2024-04-25T02:29:49.887 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "storage_class", 2024-04-25T02:29:49.887 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.887 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.887 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.887 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "local", 2024-04-25T02:29:49.887 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.887 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.887 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.887 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-25T02:29:49.887 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.887 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.887 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.888 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.888 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.888 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.888 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.888 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "selftest", 2024-04-25T02:29:49.888 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.888 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.888 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.888 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.888 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.888 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.888 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.888 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.888 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.889 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.889 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.889 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.889 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.889 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.889 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.889 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.889 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.889 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.889 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.889 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.889 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.889 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.889 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.890 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.890 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.890 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.890 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.890 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.890 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.890 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.890 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.890 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.890 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.890 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.890 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.890 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.890 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.891 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.891 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.891 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.891 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.891 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.891 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.891 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.891 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.891 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.891 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.891 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.891 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.891 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.892 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.892 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.892 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.892 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.892 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.892 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.892 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.892 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.892 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.892 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.892 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.892 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.892 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.892 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.893 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.893 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.893 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.893 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.893 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.893 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.893 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.893 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.893 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.893 INFO:teuthology.orchestra.run.smithi067.stdout: "roption1": { 2024-04-25T02:29:49.893 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "roption1", 2024-04-25T02:29:49.893 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.893 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.893 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.894 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.894 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.894 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.894 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.894 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.894 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.894 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.894 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.894 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.894 INFO:teuthology.orchestra.run.smithi067.stdout: "roption2": { 2024-04-25T02:29:49.894 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "roption2", 2024-04-25T02:29:49.894 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.894 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.894 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.895 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "xyz", 2024-04-25T02:29:49.895 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.895 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.895 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.895 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.895 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.895 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.895 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.895 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.895 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption1": { 2024-04-25T02:29:49.895 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption1", 2024-04-25T02:29:49.895 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.895 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.895 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.896 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.896 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.896 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.896 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.896 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.896 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.896 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.896 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.896 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.896 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption2": { 2024-04-25T02:29:49.896 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption2", 2024-04-25T02:29:49.896 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.896 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.896 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.896 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.897 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.897 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.897 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.897 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.897 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.897 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.897 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.897 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.897 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption3": { 2024-04-25T02:29:49.897 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption3", 2024-04-25T02:29:49.897 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-04-25T02:29:49.897 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.897 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.897 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.898 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.898 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.898 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.898 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.898 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.898 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.898 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.898 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.898 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption4": { 2024-04-25T02:29:49.898 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption4", 2024-04-25T02:29:49.898 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.898 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.898 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.898 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.899 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.899 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.899 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.899 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.899 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.899 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.899 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.899 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.899 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption5": { 2024-04-25T02:29:49.899 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption5", 2024-04-25T02:29:49.899 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.899 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.899 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.899 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.899 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.900 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.900 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.900 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.900 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.900 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.900 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.900 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.900 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption6": { 2024-04-25T02:29:49.900 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption6", 2024-04-25T02:29:49.900 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.900 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.900 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.900 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.900 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.901 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.901 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.901 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.901 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.901 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.901 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.901 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.901 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption7": { 2024-04-25T02:29:49.901 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption7", 2024-04-25T02:29:49.901 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.901 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.901 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.901 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.901 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-04-25T02:29:49.902 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "42", 2024-04-25T02:29:49.902 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.902 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.902 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.902 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.902 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.902 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.902 INFO:teuthology.orchestra.run.smithi067.stdout: "testkey": { 2024-04-25T02:29:49.902 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "testkey", 2024-04-25T02:29:49.902 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.902 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.902 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.902 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.902 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.902 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.903 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.903 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.903 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.903 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.903 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.903 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.903 INFO:teuthology.orchestra.run.smithi067.stdout: "testlkey": { 2024-04-25T02:29:49.903 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "testlkey", 2024-04-25T02:29:49.903 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.903 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.903 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.903 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.903 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.903 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.903 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.904 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.904 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.904 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.904 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.904 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.904 INFO:teuthology.orchestra.run.smithi067.stdout: "testnewline": { 2024-04-25T02:29:49.904 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "testnewline", 2024-04-25T02:29:49.904 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.904 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.904 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.904 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.904 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.905 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.905 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.905 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.905 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.905 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.905 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.905 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.905 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.905 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.905 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.905 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "snap_schedule", 2024-04-25T02:29:49.905 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.905 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.905 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.906 INFO:teuthology.orchestra.run.smithi067.stdout: "allow_m_granularity": { 2024-04-25T02:29:49.906 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "allow_m_granularity", 2024-04-25T02:29:49.906 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.906 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.906 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.906 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.906 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.906 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.906 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.906 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "allow minute scheduled snapshots", 2024-04-25T02:29:49.906 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.906 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.906 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.907 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.907 INFO:teuthology.orchestra.run.smithi067.stdout: "dump_on_update": { 2024-04-25T02:29:49.907 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "dump_on_update", 2024-04-25T02:29:49.907 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.907 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.907 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.907 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.907 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.907 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.907 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.907 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "dump database to debug log on update", 2024-04-25T02:29:49.907 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.907 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.907 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.908 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.908 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.908 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.908 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.908 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.908 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.908 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.908 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.908 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.908 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.908 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.908 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.908 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.908 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.908 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.909 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.909 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.909 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.909 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.909 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.909 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.909 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.909 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.909 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.909 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.909 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.909 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.909 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.909 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.909 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.910 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.910 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.910 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.910 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.910 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.910 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.910 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.910 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.910 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.910 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.910 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.910 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.910 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.910 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.911 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.911 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.911 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.911 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.911 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.911 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.911 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.911 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.911 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.911 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.911 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.911 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.911 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.911 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.912 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.912 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.912 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.912 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.912 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.912 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.912 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.912 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.912 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.912 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.912 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.912 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.912 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.912 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.912 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.913 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.913 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "stats", 2024-04-25T02:29:49.913 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.913 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.913 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.913 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.913 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.913 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.913 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.913 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.913 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.913 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.913 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.913 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.914 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.914 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.914 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.914 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.914 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.914 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.914 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.914 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.914 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.914 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.914 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.914 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.914 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.915 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.915 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.915 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.915 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.915 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.915 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.915 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.915 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.915 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.915 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.915 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.915 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.915 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.915 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.916 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.916 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.916 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.916 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.916 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.916 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.916 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.916 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.916 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.916 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.916 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.916 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.916 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.916 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.917 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.917 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.917 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.917 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.917 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.917 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.917 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.917 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.917 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.917 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.917 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.917 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.917 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.917 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.917 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.917 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.918 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.918 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.918 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.918 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.918 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.918 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.918 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.918 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "status", 2024-04-25T02:29:49.918 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.918 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.918 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.918 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.918 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.919 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.919 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.919 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.919 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.919 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.919 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.919 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.919 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.919 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.919 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.919 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.919 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.919 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.919 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.919 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.920 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.920 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.920 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.920 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.920 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.920 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.920 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.920 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.920 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.920 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.920 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.920 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.920 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.920 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.921 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.921 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.921 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.921 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.921 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.921 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.921 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.921 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.921 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.921 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.921 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.921 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.921 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.921 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.921 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.921 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.922 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.922 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.922 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.922 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.922 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.922 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.922 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.922 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.922 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.922 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.922 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.922 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.922 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.922 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.923 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.923 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.923 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.923 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.923 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.923 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.923 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.923 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.923 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.923 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.923 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.923 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.923 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "telegraf", 2024-04-25T02:29:49.923 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.924 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.924 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.924 INFO:teuthology.orchestra.run.smithi067.stdout: "address": { 2024-04-25T02:29:49.924 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "address", 2024-04-25T02:29:49.924 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.924 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.924 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.924 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-25T02:29:49.924 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.924 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.924 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.924 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.924 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.925 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.925 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.925 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.925 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-04-25T02:29:49.925 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-04-25T02:29:49.925 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.925 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.925 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.925 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "15", 2024-04-25T02:29:49.925 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.925 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.925 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.925 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.925 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.925 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.926 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.926 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.926 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.926 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.926 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.926 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.926 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.926 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.926 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.926 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.926 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.926 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.926 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.926 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.926 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.927 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.927 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.927 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.927 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.927 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.927 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.927 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.927 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.927 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.927 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.927 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.927 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.927 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.927 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.928 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.928 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.928 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.928 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.928 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.928 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.928 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.928 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.928 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.928 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.928 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.928 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.928 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.928 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.929 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.929 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.929 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.929 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.929 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.929 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.929 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.929 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.929 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.929 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.929 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.929 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.929 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.929 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.929 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.930 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.930 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.930 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.930 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.930 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.930 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.930 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.930 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.930 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.930 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.930 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.930 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.930 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.930 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.930 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.931 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.931 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.931 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "telemetry", 2024-04-25T02:29:49.931 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.931 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.931 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.931 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_basic": { 2024-04-25T02:29:49.931 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_basic", 2024-04-25T02:29:49.931 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.931 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.931 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.931 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.931 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.931 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.932 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.932 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-25T02:29:49.932 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.932 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.932 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.932 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.932 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_crash": { 2024-04-25T02:29:49.932 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_crash", 2024-04-25T02:29:49.932 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.932 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.932 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.932 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.932 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.932 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.933 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.933 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-25T02:29:49.933 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.933 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.933 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.933 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.933 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_device": { 2024-04-25T02:29:49.933 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_device", 2024-04-25T02:29:49.933 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.933 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.933 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.933 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.933 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.933 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.933 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.934 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-25T02:29:49.934 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.934 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.934 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.934 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.934 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_ident": { 2024-04-25T02:29:49.934 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_ident", 2024-04-25T02:29:49.934 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.934 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.934 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.934 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.934 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.934 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.935 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.935 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-25T02:29:49.935 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.935 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.935 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.935 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.935 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_perf": { 2024-04-25T02:29:49.935 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_perf", 2024-04-25T02:29:49.935 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.935 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.935 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.935 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.935 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.935 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.936 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.936 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-25T02:29:49.936 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.936 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.936 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.936 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.936 INFO:teuthology.orchestra.run.smithi067.stdout: "contact": { 2024-04-25T02:29:49.936 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "contact", 2024-04-25T02:29:49.936 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.936 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.936 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.936 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.936 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.936 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.937 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.937 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.937 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.937 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.937 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.937 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.937 INFO:teuthology.orchestra.run.smithi067.stdout: "description": { 2024-04-25T02:29:49.937 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "description", 2024-04-25T02:29:49.937 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.937 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.937 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.937 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.937 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.937 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.937 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.938 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.938 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.938 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.938 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.938 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.938 INFO:teuthology.orchestra.run.smithi067.stdout: "device_url": { 2024-04-25T02:29:49.938 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "device_url", 2024-04-25T02:29:49.938 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.938 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.938 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.938 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-25T02:29:49.938 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.938 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.938 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.939 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.939 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.939 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.939 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.939 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.939 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": { 2024-04-25T02:29:49.939 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enabled", 2024-04-25T02:29:49.939 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.939 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.939 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.939 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.939 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.939 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.939 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.940 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.940 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.940 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.940 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.940 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.940 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-04-25T02:29:49.940 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-04-25T02:29:49.940 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.940 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.940 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.940 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "24", 2024-04-25T02:29:49.940 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "8", 2024-04-25T02:29:49.940 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.940 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.941 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.941 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.941 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.941 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.941 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.941 INFO:teuthology.orchestra.run.smithi067.stdout: "last_opt_revision": { 2024-04-25T02:29:49.941 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "last_opt_revision", 2024-04-25T02:29:49.941 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.941 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.941 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.941 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "1", 2024-04-25T02:29:49.941 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.941 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.941 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.941 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.942 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.942 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.942 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.942 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.942 INFO:teuthology.orchestra.run.smithi067.stdout: "leaderboard": { 2024-04-25T02:29:49.942 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "leaderboard", 2024-04-25T02:29:49.942 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.942 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.942 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.942 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.942 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.942 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.942 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.943 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.943 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.943 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.943 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.943 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.943 INFO:teuthology.orchestra.run.smithi067.stdout: "leaderboard_description": { 2024-04-25T02:29:49.943 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "leaderboard_description", 2024-04-25T02:29:49.943 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.943 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.943 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.943 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.943 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.943 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.943 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.943 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.944 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.944 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.944 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.944 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.944 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.944 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.944 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.944 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.944 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.944 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.944 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.944 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.944 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.944 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.945 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.945 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.945 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.945 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.945 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.945 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.945 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.945 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.945 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.945 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.945 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.945 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.945 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.945 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.946 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.946 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.946 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.946 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.946 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.946 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.946 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.946 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.946 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.946 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.946 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.946 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.947 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.947 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.947 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.947 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.947 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.947 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.947 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.947 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.947 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.947 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.947 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.947 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.947 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.947 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.947 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.948 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.948 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.948 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.948 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.948 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.948 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.948 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.948 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.948 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.948 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.948 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.948 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.948 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.949 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.949 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.949 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.949 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.949 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.949 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.949 INFO:teuthology.orchestra.run.smithi067.stdout: "organization": { 2024-04-25T02:29:49.949 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "organization", 2024-04-25T02:29:49.949 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.949 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.949 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.949 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.950 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.950 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.950 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.950 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.950 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.950 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.950 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.950 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.950 INFO:teuthology.orchestra.run.smithi067.stdout: "proxy": { 2024-04-25T02:29:49.950 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "proxy", 2024-04-25T02:29:49.950 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.950 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.951 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.951 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.951 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.951 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.951 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.951 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.951 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.951 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.951 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.951 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.951 INFO:teuthology.orchestra.run.smithi067.stdout: "url": { 2024-04-25T02:29:49.951 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "url", 2024-04-25T02:29:49.951 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.951 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.951 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.952 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-25T02:29:49.952 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.952 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.952 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.952 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.952 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.952 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.952 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.952 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.952 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.952 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.952 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.952 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "test_orchestrator", 2024-04-25T02:29:49.953 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.953 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.953 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.953 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.953 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.953 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.953 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.953 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.953 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.953 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.953 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.953 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.953 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.953 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.954 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.954 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.954 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.954 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.954 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.954 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.954 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.954 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.954 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.954 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.954 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.954 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.955 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.955 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.955 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.955 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.955 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.955 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.955 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.955 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.955 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.955 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.955 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.955 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.955 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.956 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.956 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.956 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.956 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.956 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.956 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.956 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.956 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.956 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.956 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.956 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.956 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.956 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.956 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.957 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.957 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.957 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.957 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.957 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.957 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.957 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.957 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.957 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.957 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.957 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.957 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.957 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.957 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.958 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.958 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.958 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.958 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.958 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.958 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.958 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.958 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.958 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.958 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "volumes", 2024-04-25T02:29:49.958 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.958 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.959 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.959 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.959 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.959 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.959 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.959 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.959 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.959 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.959 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.959 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.959 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.959 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.959 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.959 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.960 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.960 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.960 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.960 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.960 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.960 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.960 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.960 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.960 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.960 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.960 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.960 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.960 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.960 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.961 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.961 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.961 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.961 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.961 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.961 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.961 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.961 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.961 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.961 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.961 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.961 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.961 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.961 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.961 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.962 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.962 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.962 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.962 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.962 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.962 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.962 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.962 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.962 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.962 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.962 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.962 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.962 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.963 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.963 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.963 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.963 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.963 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.963 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.963 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.963 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.963 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.963 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.963 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.963 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.963 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.963 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.964 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.964 INFO:teuthology.orchestra.run.smithi067.stdout: "max_concurrent_clones": { 2024-04-25T02:29:49.964 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_concurrent_clones", 2024-04-25T02:29:49.964 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.964 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.964 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.964 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "4", 2024-04-25T02:29:49.964 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.964 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.964 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.964 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-25T02:29:49.964 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.964 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.964 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.964 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.965 INFO:teuthology.orchestra.run.smithi067.stdout: "periodic_async_work": { 2024-04-25T02:29:49.965 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "periodic_async_work", 2024-04-25T02:29:49.965 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.965 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.965 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.965 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.965 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.965 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.965 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.965 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Periodically check for async work", 2024-04-25T02:29:49.965 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.965 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.965 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.965 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.965 INFO:teuthology.orchestra.run.smithi067.stdout: "snapshot_clone_delay": { 2024-04-25T02:29:49.966 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "snapshot_clone_delay", 2024-04-25T02:29:49.966 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.966 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.966 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.966 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-04-25T02:29:49.966 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.966 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.966 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.966 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-25T02:29:49.966 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.966 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.966 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.966 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.966 INFO:teuthology.orchestra.run.smithi067.stdout: "snapshot_clone_no_wait": { 2024-04-25T02:29:49.967 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "snapshot_clone_no_wait", 2024-04-25T02:29:49.967 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.967 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.967 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.967 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.967 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.967 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.967 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.967 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-25T02:29:49.967 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.967 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.967 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.967 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.967 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.968 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.968 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.968 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix", 2024-04-25T02:29:49.968 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.968 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.968 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.968 INFO:teuthology.orchestra.run.smithi067.stdout: "discovery_interval": { 2024-04-25T02:29:49.968 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "discovery_interval", 2024-04-25T02:29:49.968 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-04-25T02:29:49.968 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.968 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.968 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "100", 2024-04-25T02:29:49.968 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.968 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.968 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.969 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.969 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.969 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.969 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.969 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.969 INFO:teuthology.orchestra.run.smithi067.stdout: "identifier": { 2024-04-25T02:29:49.969 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "identifier", 2024-04-25T02:29:49.969 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.969 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.969 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.969 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.969 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.969 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.969 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.970 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.970 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.970 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.970 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.970 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.970 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-04-25T02:29:49.970 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-04-25T02:29:49.970 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.970 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.970 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.970 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-04-25T02:29:49.970 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.970 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.970 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.970 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.971 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.971 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.971 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.971 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.971 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.971 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.971 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.971 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.971 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.971 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.971 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.971 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.971 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.971 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.971 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.972 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.972 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.972 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.972 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.972 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.972 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.972 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.972 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.972 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.972 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.972 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.972 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.972 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.972 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.973 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.973 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.973 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.973 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.973 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.973 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.973 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.973 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.973 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.973 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.973 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.973 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.973 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.973 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.973 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.974 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.974 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.974 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.974 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.974 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.974 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.974 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.974 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.974 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.974 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.974 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.974 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.974 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.974 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.975 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.975 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.975 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.975 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.975 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.975 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.975 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.975 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.975 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.975 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.975 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.975 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.975 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.975 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.975 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.975 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.976 INFO:teuthology.orchestra.run.smithi067.stdout: "zabbix_host": { 2024-04-25T02:29:49.976 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix_host", 2024-04-25T02:29:49.976 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.976 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.976 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.976 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.976 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.976 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.976 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.976 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.976 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.976 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.976 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.976 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.976 INFO:teuthology.orchestra.run.smithi067.stdout: "zabbix_port": { 2024-04-25T02:29:49.977 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix_port", 2024-04-25T02:29:49.977 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.977 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.977 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.977 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10051", 2024-04-25T02:29:49.977 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.977 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.977 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.977 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.977 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.977 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.977 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.977 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.977 INFO:teuthology.orchestra.run.smithi067.stdout: "zabbix_sender": { 2024-04-25T02:29:49.977 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix_sender", 2024-04-25T02:29:49.978 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.978 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.978 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:49.978 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-25T02:29:49.978 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.978 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.978 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.978 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.978 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.978 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.978 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.978 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.978 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.979 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.979 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-04-25T02:29:49.979 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.979 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.979 INFO:teuthology.orchestra.run.smithi067.stdout: "modules": [ 2024-04-25T02:29:49.979 INFO:teuthology.orchestra.run.smithi067.stdout: "iostat", 2024-04-25T02:29:49.979 INFO:teuthology.orchestra.run.smithi067.stdout: "nfs", 2024-04-25T02:29:49.979 INFO:teuthology.orchestra.run.smithi067.stdout: "restful" 2024-04-25T02:29:49.979 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.979 INFO:teuthology.orchestra.run.smithi067.stdout: "available_modules": [ 2024-04-25T02:29:49.979 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.979 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "alerts", 2024-04-25T02:29:49.979 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.979 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.980 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.980 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-04-25T02:29:49.980 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-04-25T02:29:49.980 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:49.980 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.980 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.980 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-04-25T02:29:49.980 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.980 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.980 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.980 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How frequently to reexamine health status", 2024-04-25T02:29:49.980 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.980 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.980 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.980 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.981 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:49.981 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:49.981 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.981 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.981 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.981 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.981 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.981 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.981 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.981 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.981 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.981 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.981 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.981 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.982 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.982 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.982 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.982 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.982 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.982 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.982 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.982 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:49.982 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:49.982 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.982 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.982 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.982 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.983 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.983 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.983 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.983 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.983 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.983 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.983 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.983 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.983 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:49.983 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:49.983 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.983 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.983 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.983 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:49.983 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.983 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.984 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:49.984 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:49.984 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:49.984 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:49.984 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:49.984 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:49.984 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:49.984 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:49.984 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.984 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.984 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.984 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.984 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.984 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:49.984 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:49.985 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.985 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.985 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.985 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:49.985 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.985 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.985 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.985 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:49.985 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.985 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.985 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.985 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.985 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_destination": { 2024-04-25T02:29:49.985 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_destination", 2024-04-25T02:29:49.986 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.986 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.986 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.986 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.986 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.986 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.986 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.986 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Email address to send alerts to", 2024-04-25T02:29:49.986 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.986 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.986 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.986 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.986 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_from_name": { 2024-04-25T02:29:49.986 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_from_name", 2024-04-25T02:29:49.987 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.987 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.987 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.987 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "Ceph", 2024-04-25T02:29:49.987 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.987 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.987 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.987 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Email From: name", 2024-04-25T02:29:49.987 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.987 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.987 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.987 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.987 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_host": { 2024-04-25T02:29:49.987 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_host", 2024-04-25T02:29:49.987 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.988 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.988 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.988 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.988 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.988 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.988 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.988 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SMTP server", 2024-04-25T02:29:49.988 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.988 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.988 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.988 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.988 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_password": { 2024-04-25T02:29:49.988 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_password", 2024-04-25T02:29:49.989 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.989 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.989 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.989 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.989 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.989 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.989 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.989 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Password to authenticate with", 2024-04-25T02:29:49.989 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.989 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.989 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.989 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.989 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_port": { 2024-04-25T02:29:49.989 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_port", 2024-04-25T02:29:49.989 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:49.990 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.990 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.990 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "465", 2024-04-25T02:29:49.990 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.990 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.990 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.990 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SMTP port", 2024-04-25T02:29:49.990 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.990 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.990 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.990 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.990 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_sender": { 2024-04-25T02:29:49.990 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_sender", 2024-04-25T02:29:49.991 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.991 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.991 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.991 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.991 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.991 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.991 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.991 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SMTP envelope sender", 2024-04-25T02:29:49.991 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.991 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.991 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.991 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.991 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_ssl": { 2024-04-25T02:29:49.991 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_ssl", 2024-04-25T02:29:49.992 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.992 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.992 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.992 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.992 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.992 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.992 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.992 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-25T02:29:49.992 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.992 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.992 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.992 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.992 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_user": { 2024-04-25T02:29:49.992 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_user", 2024-04-25T02:29:49.993 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.993 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.993 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.993 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:49.993 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.993 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.993 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.993 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "User to authenticate as", 2024-04-25T02:29:49.993 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.993 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.993 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.993 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.994 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:49.994 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.994 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:49.994 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "balancer", 2024-04-25T02:29:49.994 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:49.994 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:49.994 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:49.994 INFO:teuthology.orchestra.run.smithi067.stdout: "active": { 2024-04-25T02:29:49.994 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "active", 2024-04-25T02:29:49.994 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:49.994 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.994 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.994 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:49.994 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.994 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.995 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.995 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "automatically balance PGs across cluster", 2024-04-25T02:29:49.995 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.995 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.995 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.995 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.995 INFO:teuthology.orchestra.run.smithi067.stdout: "begin_time": { 2024-04-25T02:29:49.995 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "begin_time", 2024-04-25T02:29:49.995 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.995 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.995 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.995 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0000", 2024-04-25T02:29:49.995 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.995 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.996 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.996 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "beginning time of day to automatically balance", 2024-04-25T02:29:49.996 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T02:29:49.996 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.996 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.996 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.996 INFO:teuthology.orchestra.run.smithi067.stdout: "begin_weekday": { 2024-04-25T02:29:49.996 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "begin_weekday", 2024-04-25T02:29:49.996 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-04-25T02:29:49.996 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.996 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.996 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-04-25T02:29:49.996 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "0", 2024-04-25T02:29:49.996 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "6", 2024-04-25T02:29:49.996 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.996 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-25T02:29:49.997 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T02:29:49.997 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.997 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.997 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.997 INFO:teuthology.orchestra.run.smithi067.stdout: "crush_compat_max_iterations": { 2024-04-25T02:29:49.997 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crush_compat_max_iterations", 2024-04-25T02:29:49.997 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-04-25T02:29:49.997 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.997 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.997 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "25", 2024-04-25T02:29:49.997 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-04-25T02:29:49.997 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "250", 2024-04-25T02:29:49.997 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.997 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-25T02:29:49.998 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:49.998 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.998 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.998 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.998 INFO:teuthology.orchestra.run.smithi067.stdout: "crush_compat_metrics": { 2024-04-25T02:29:49.998 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crush_compat_metrics", 2024-04-25T02:29:49.998 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:49.998 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.998 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.998 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "pgs,objects,bytes", 2024-04-25T02:29:49.998 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:49.998 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:49.998 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.998 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-25T02:29:49.999 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-25T02:29:49.999 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:49.999 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:49.999 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:49.999 INFO:teuthology.orchestra.run.smithi067.stdout: "crush_compat_step": { 2024-04-25T02:29:49.999 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crush_compat_step", 2024-04-25T02:29:49.999 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-04-25T02:29:49.999 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:49.999 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:49.999 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0.5", 2024-04-25T02:29:49.999 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "0.001", 2024-04-25T02:29:49.999 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "0.999", 2024-04-25T02:29:49.999 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:49.999 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "aggressiveness of optimization", 2024-04-25T02:29:50.000 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-25T02:29:50.000 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.000 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.000 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.000 INFO:teuthology.orchestra.run.smithi067.stdout: "end_time": { 2024-04-25T02:29:50.000 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "end_time", 2024-04-25T02:29:50.000 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.000 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.000 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.000 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "2359", 2024-04-25T02:29:50.000 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.000 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.000 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.000 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "ending time of day to automatically balance", 2024-04-25T02:29:50.001 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T02:29:50.001 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.001 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.001 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.001 INFO:teuthology.orchestra.run.smithi067.stdout: "end_weekday": { 2024-04-25T02:29:50.001 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "end_weekday", 2024-04-25T02:29:50.001 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-04-25T02:29:50.001 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.001 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.001 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-04-25T02:29:50.001 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "0", 2024-04-25T02:29:50.001 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "6", 2024-04-25T02:29:50.001 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.001 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-25T02:29:50.001 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T02:29:50.002 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.002 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.002 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.002 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.002 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.002 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.002 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.002 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.002 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.002 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.002 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.002 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.003 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.003 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.003 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.003 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.003 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.003 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.003 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.003 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.003 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.003 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.003 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.003 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.004 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.004 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.004 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.004 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.004 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.004 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.004 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.004 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.004 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.004 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.004 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.004 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.004 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.004 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.005 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.005 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.005 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.005 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.005 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.005 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.005 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.005 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.005 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.005 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.005 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.005 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.005 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.005 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.006 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.006 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.006 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.006 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.006 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.006 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.006 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.006 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.006 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.006 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.006 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.006 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.006 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.006 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.007 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.007 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.007 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.007 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.007 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.007 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.007 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.007 INFO:teuthology.orchestra.run.smithi067.stdout: "min_score": { 2024-04-25T02:29:50.007 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "min_score", 2024-04-25T02:29:50.007 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-04-25T02:29:50.007 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.007 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.007 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-04-25T02:29:50.007 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.007 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.008 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.008 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-25T02:29:50.008 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.008 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.008 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.008 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.008 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": { 2024-04-25T02:29:50.008 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mode", 2024-04-25T02:29:50.008 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.008 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.008 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.008 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "upmap", 2024-04-25T02:29:50.008 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.008 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.009 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.009 INFO:teuthology.orchestra.run.smithi067.stdout: "crush-compat", 2024-04-25T02:29:50.009 INFO:teuthology.orchestra.run.smithi067.stdout: "none", 2024-04-25T02:29:50.009 INFO:teuthology.orchestra.run.smithi067.stdout: "read", 2024-04-25T02:29:50.009 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap", 2024-04-25T02:29:50.009 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap-read" 2024-04-25T02:29:50.009 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.009 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Balancer mode", 2024-04-25T02:29:50.009 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.009 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.009 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.009 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.009 INFO:teuthology.orchestra.run.smithi067.stdout: "pool_ids": { 2024-04-25T02:29:50.009 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pool_ids", 2024-04-25T02:29:50.009 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.009 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.010 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.010 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.010 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.010 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.010 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.010 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-25T02:29:50.010 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.010 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.010 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.010 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.010 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-04-25T02:29:50.010 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-04-25T02:29:50.010 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.010 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.011 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.011 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-04-25T02:29:50.011 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.011 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.011 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.011 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-25T02:29:50.011 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.011 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.011 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.011 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.011 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap_max_deviation": { 2024-04-25T02:29:50.011 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "upmap_max_deviation", 2024-04-25T02:29:50.011 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.012 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.012 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.012 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-04-25T02:29:50.012 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-04-25T02:29:50.012 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.012 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.012 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-25T02:29:50.012 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-25T02:29:50.012 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.012 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.012 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.012 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap_max_optimizations": { 2024-04-25T02:29:50.012 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "upmap_max_optimizations", 2024-04-25T02:29:50.012 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-04-25T02:29:50.013 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.013 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.013 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-04-25T02:29:50.013 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.013 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.013 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.013 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-25T02:29:50.013 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.013 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.013 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.013 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.013 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.013 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.014 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.014 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cephadm", 2024-04-25T02:29:50.014 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.014 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.014 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.014 INFO:teuthology.orchestra.run.smithi067.stdout: "agent_down_multiplier": { 2024-04-25T02:29:50.014 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "agent_down_multiplier", 2024-04-25T02:29:50.014 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-04-25T02:29:50.014 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.014 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.014 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "3.0", 2024-04-25T02:29:50.014 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.014 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.014 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.014 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-25T02:29:50.015 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.015 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.015 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.015 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.015 INFO:teuthology.orchestra.run.smithi067.stdout: "agent_refresh_rate": { 2024-04-25T02:29:50.015 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "agent_refresh_rate", 2024-04-25T02:29:50.015 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.015 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.015 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.015 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "20", 2024-04-25T02:29:50.015 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.015 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.015 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.015 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-25T02:29:50.016 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.016 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.016 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.016 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.016 INFO:teuthology.orchestra.run.smithi067.stdout: "agent_starting_port": { 2024-04-25T02:29:50.016 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "agent_starting_port", 2024-04-25T02:29:50.016 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.016 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.016 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.016 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "4721", 2024-04-25T02:29:50.016 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.016 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.016 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.017 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-25T02:29:50.017 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.017 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.017 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.017 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.017 INFO:teuthology.orchestra.run.smithi067.stdout: "allow_ptrace": { 2024-04-25T02:29:50.017 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "allow_ptrace", 2024-04-25T02:29:50.017 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.017 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.017 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.017 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.017 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.017 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.017 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.017 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-25T02:29:50.018 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-25T02:29:50.018 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.018 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.018 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.018 INFO:teuthology.orchestra.run.smithi067.stdout: "autotune_interval": { 2024-04-25T02:29:50.018 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "autotune_interval", 2024-04-25T02:29:50.018 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.018 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.018 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.018 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-04-25T02:29:50.018 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.018 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.018 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.019 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-25T02:29:50.019 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.019 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.019 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.019 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.019 INFO:teuthology.orchestra.run.smithi067.stdout: "autotune_memory_target_ratio": { 2024-04-25T02:29:50.019 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "autotune_memory_target_ratio", 2024-04-25T02:29:50.019 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-04-25T02:29:50.019 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.019 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.019 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0.7", 2024-04-25T02:29:50.019 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.019 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.019 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.020 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-25T02:29:50.020 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.020 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.020 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.020 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.020 INFO:teuthology.orchestra.run.smithi067.stdout: "cephadm_log_destination": { 2024-04-25T02:29:50.020 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cephadm_log_destination", 2024-04-25T02:29:50.020 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.020 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.020 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.020 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.020 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.020 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.020 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.020 INFO:teuthology.orchestra.run.smithi067.stdout: "file", 2024-04-25T02:29:50.021 INFO:teuthology.orchestra.run.smithi067.stdout: "file,syslog", 2024-04-25T02:29:50.021 INFO:teuthology.orchestra.run.smithi067.stdout: "syslog" 2024-04-25T02:29:50.021 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.021 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-25T02:29:50.021 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.021 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.021 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.021 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.021 INFO:teuthology.orchestra.run.smithi067.stdout: "cgroups_split": { 2024-04-25T02:29:50.021 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cgroups_split", 2024-04-25T02:29:50.021 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.021 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.021 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.021 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.022 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.022 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.022 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.022 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-25T02:29:50.022 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.022 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.022 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.022 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.022 INFO:teuthology.orchestra.run.smithi067.stdout: "config_checks_enabled": { 2024-04-25T02:29:50.022 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "config_checks_enabled", 2024-04-25T02:29:50.022 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.022 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.022 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.023 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.023 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.023 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.023 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.023 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-25T02:29:50.023 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.023 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.023 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.023 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.023 INFO:teuthology.orchestra.run.smithi067.stdout: "config_dashboard": { 2024-04-25T02:29:50.023 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "config_dashboard", 2024-04-25T02:29:50.023 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.023 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.023 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.023 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.024 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.024 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.024 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.024 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-25T02:29:50.024 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.024 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.024 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.024 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.024 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_alertmanager": { 2024-04-25T02:29:50.024 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_alertmanager", 2024-04-25T02:29:50.024 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.024 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.024 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.024 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-25T02:29:50.025 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.025 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.025 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.025 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-04-25T02:29:50.025 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.025 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.025 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.025 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.025 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_base": { 2024-04-25T02:29:50.025 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_base", 2024-04-25T02:29:50.025 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.025 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.025 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.025 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-25T02:29:50.026 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.026 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.026 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.026 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Container image name, without the tag", 2024-04-25T02:29:50.026 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.026 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.026 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.026 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.026 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_elasticsearch": { 2024-04-25T02:29:50.026 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_elasticsearch", 2024-04-25T02:29:50.026 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.026 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.026 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.027 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-25T02:29:50.027 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.027 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.027 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.027 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "elasticsearch container image", 2024-04-25T02:29:50.027 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.027 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.027 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.027 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.027 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_grafana": { 2024-04-25T02:29:50.027 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_grafana", 2024-04-25T02:29:50.027 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.027 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.027 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.028 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-25T02:29:50.028 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.028 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.028 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.028 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-04-25T02:29:50.028 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.028 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.028 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.028 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.028 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_haproxy": { 2024-04-25T02:29:50.028 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_haproxy", 2024-04-25T02:29:50.028 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.028 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.028 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.028 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-25T02:29:50.029 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.029 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.029 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.029 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "HAproxy container image", 2024-04-25T02:29:50.029 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.029 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.029 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.029 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.029 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_jaeger_agent": { 2024-04-25T02:29:50.029 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_jaeger_agent", 2024-04-25T02:29:50.029 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.029 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.029 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.029 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-25T02:29:50.030 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.030 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.030 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.030 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Jaeger agent container image", 2024-04-25T02:29:50.030 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.030 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.030 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.030 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.030 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_jaeger_collector": { 2024-04-25T02:29:50.030 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_jaeger_collector", 2024-04-25T02:29:50.030 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.030 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.030 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.031 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-25T02:29:50.031 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.031 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.031 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.031 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Jaeger collector container image", 2024-04-25T02:29:50.031 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.031 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.031 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.031 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.031 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_jaeger_query": { 2024-04-25T02:29:50.031 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_jaeger_query", 2024-04-25T02:29:50.031 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.031 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.031 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.032 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-25T02:29:50.032 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.032 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.032 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.032 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Jaeger query container image", 2024-04-25T02:29:50.032 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.032 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.032 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.032 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.032 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_keepalived": { 2024-04-25T02:29:50.032 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_keepalived", 2024-04-25T02:29:50.032 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.033 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.033 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.033 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-25T02:29:50.033 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.033 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.033 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.033 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Keepalived container image", 2024-04-25T02:29:50.033 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.033 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.033 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.033 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.033 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_loki": { 2024-04-25T02:29:50.033 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_loki", 2024-04-25T02:29:50.033 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.034 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.034 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.034 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-25T02:29:50.034 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.034 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.034 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.034 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Loki container image", 2024-04-25T02:29:50.034 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.034 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.034 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.034 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.034 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_node_exporter": { 2024-04-25T02:29:50.034 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_node_exporter", 2024-04-25T02:29:50.035 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.035 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.035 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.035 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-25T02:29:50.035 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.035 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.035 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.035 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-04-25T02:29:50.035 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.035 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.035 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.035 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.035 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_nvmeof": { 2024-04-25T02:29:50.035 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_nvmeof", 2024-04-25T02:29:50.036 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.036 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.036 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.036 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-25T02:29:50.036 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.036 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.036 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.036 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Nvme-of container image", 2024-04-25T02:29:50.036 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.036 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.036 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.036 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.036 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_prometheus": { 2024-04-25T02:29:50.036 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_prometheus", 2024-04-25T02:29:50.037 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.037 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.037 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.037 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-25T02:29:50.037 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.037 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.037 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.037 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-04-25T02:29:50.037 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.037 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.037 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.037 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.037 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_promtail": { 2024-04-25T02:29:50.037 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_promtail", 2024-04-25T02:29:50.038 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.038 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.038 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.038 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-25T02:29:50.038 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.038 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.038 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.038 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Promtail container image", 2024-04-25T02:29:50.038 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.038 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.038 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.038 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.038 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_samba": { 2024-04-25T02:29:50.038 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_samba", 2024-04-25T02:29:50.039 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.039 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.039 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.039 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-25T02:29:50.039 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.039 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.039 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.039 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Samba/SMB container image", 2024-04-25T02:29:50.039 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.039 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.039 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.039 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.039 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_snmp_gateway": { 2024-04-25T02:29:50.039 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_snmp_gateway", 2024-04-25T02:29:50.040 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.040 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.040 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.040 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-25T02:29:50.040 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.040 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.040 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.040 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SNMP Gateway container image", 2024-04-25T02:29:50.040 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.040 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.040 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.040 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.040 INFO:teuthology.orchestra.run.smithi067.stdout: "container_init": { 2024-04-25T02:29:50.040 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_init", 2024-04-25T02:29:50.041 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.041 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.041 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.041 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.041 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.041 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.041 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.041 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Run podman/docker with `--init`", 2024-04-25T02:29:50.041 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.041 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.041 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.041 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.041 INFO:teuthology.orchestra.run.smithi067.stdout: "daemon_cache_timeout": { 2024-04-25T02:29:50.041 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "daemon_cache_timeout", 2024-04-25T02:29:50.042 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.042 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.042 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.042 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-04-25T02:29:50.042 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.042 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.042 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.042 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-25T02:29:50.042 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.042 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.042 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.046 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.046 INFO:teuthology.orchestra.run.smithi067.stdout: "default_cephadm_command_timeout": { 2024-04-25T02:29:50.047 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "default_cephadm_command_timeout", 2024-04-25T02:29:50.047 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.047 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.047 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.047 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "900", 2024-04-25T02:29:50.047 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.047 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.047 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.047 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-25T02:29:50.047 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.047 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.047 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.047 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.048 INFO:teuthology.orchestra.run.smithi067.stdout: "default_registry": { 2024-04-25T02:29:50.048 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "default_registry", 2024-04-25T02:29:50.048 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.048 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.048 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.048 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io", 2024-04-25T02:29:50.048 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.048 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.048 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.048 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-25T02:29:50.048 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.048 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.048 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.048 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.049 INFO:teuthology.orchestra.run.smithi067.stdout: "device_cache_timeout": { 2024-04-25T02:29:50.049 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "device_cache_timeout", 2024-04-25T02:29:50.049 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.049 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.049 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.049 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "1800", 2024-04-25T02:29:50.049 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.049 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.049 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.049 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "seconds to cache device inventory", 2024-04-25T02:29:50.049 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.050 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.050 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.050 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.050 INFO:teuthology.orchestra.run.smithi067.stdout: "device_enhanced_scan": { 2024-04-25T02:29:50.050 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "device_enhanced_scan", 2024-04-25T02:29:50.050 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.050 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.050 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.050 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.050 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.050 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.050 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.051 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-25T02:29:50.051 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.051 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.051 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.051 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.051 INFO:teuthology.orchestra.run.smithi067.stdout: "facts_cache_timeout": { 2024-04-25T02:29:50.051 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "facts_cache_timeout", 2024-04-25T02:29:50.051 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.051 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.051 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.051 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-04-25T02:29:50.051 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.051 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.052 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.052 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "seconds to cache host facts data", 2024-04-25T02:29:50.052 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.052 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.052 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.052 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.052 INFO:teuthology.orchestra.run.smithi067.stdout: "grafana_dashboards_path": { 2024-04-25T02:29:50.052 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "grafana_dashboards_path", 2024-04-25T02:29:50.052 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.052 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.052 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.053 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-25T02:29:50.053 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.053 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.053 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.053 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-25T02:29:50.053 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.053 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.053 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.053 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.053 INFO:teuthology.orchestra.run.smithi067.stdout: "host_check_interval": { 2024-04-25T02:29:50.053 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "host_check_interval", 2024-04-25T02:29:50.053 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.053 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.053 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.054 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-04-25T02:29:50.054 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.054 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.054 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.054 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to perform a host check", 2024-04-25T02:29:50.054 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.054 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.054 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.054 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.054 INFO:teuthology.orchestra.run.smithi067.stdout: "hw_monitoring": { 2024-04-25T02:29:50.054 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "hw_monitoring", 2024-04-25T02:29:50.054 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.054 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.055 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.055 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.055 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.055 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.055 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.055 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-25T02:29:50.055 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.055 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.055 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.055 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.055 INFO:teuthology.orchestra.run.smithi067.stdout: "inventory_list_all": { 2024-04-25T02:29:50.055 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "inventory_list_all", 2024-04-25T02:29:50.055 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.055 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.056 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.056 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.056 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.056 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.056 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.056 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-25T02:29:50.056 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.056 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.056 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.056 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.057 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.057 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.057 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.057 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.057 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.057 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.057 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.057 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.057 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.057 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.057 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.057 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.057 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.058 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.058 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.058 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.058 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.058 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.058 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.058 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.058 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.058 INFO:teuthology.orchestra.run.smithi067.stdout: "log_refresh_metadata": { 2024-04-25T02:29:50.058 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_refresh_metadata", 2024-04-25T02:29:50.058 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.058 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.058 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.059 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.059 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.059 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.059 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.059 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-25T02:29:50.059 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.059 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.059 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.059 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.059 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.059 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.059 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.059 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.059 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.060 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.060 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.060 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.060 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.060 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-25T02:29:50.060 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.060 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.060 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.060 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.060 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.060 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.060 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.060 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.061 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.061 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.061 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.061 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.061 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.061 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.061 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.061 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.061 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.061 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.061 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.061 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.061 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.062 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.062 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.062 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.062 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.062 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.062 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.062 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.062 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.062 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.062 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.062 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.062 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.063 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.063 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.063 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.063 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.063 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.063 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.063 INFO:teuthology.orchestra.run.smithi067.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-25T02:29:50.063 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-25T02:29:50.063 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.063 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.063 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.063 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.063 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.063 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.064 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.064 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-25T02:29:50.064 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.064 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.064 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.064 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.064 INFO:teuthology.orchestra.run.smithi067.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-25T02:29:50.064 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-25T02:29:50.064 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.064 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.064 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.064 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "*", 2024-04-25T02:29:50.064 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.064 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.065 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.065 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-25T02:29:50.065 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.065 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.065 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.065 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.065 INFO:teuthology.orchestra.run.smithi067.stdout: "max_count_per_host": { 2024-04-25T02:29:50.065 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_count_per_host", 2024-04-25T02:29:50.065 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.065 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.065 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.065 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-04-25T02:29:50.065 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.065 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.066 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.066 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "max number of daemons per service per host", 2024-04-25T02:29:50.066 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.066 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.066 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.066 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.066 INFO:teuthology.orchestra.run.smithi067.stdout: "max_osd_draining_count": { 2024-04-25T02:29:50.066 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_osd_draining_count", 2024-04-25T02:29:50.066 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.066 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.066 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.066 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-04-25T02:29:50.066 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.066 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.067 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.067 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-25T02:29:50.067 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.067 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.067 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.067 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.067 INFO:teuthology.orchestra.run.smithi067.stdout: "migration_current": { 2024-04-25T02:29:50.067 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "migration_current", 2024-04-25T02:29:50.067 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.067 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.067 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.067 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.067 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.067 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.067 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.067 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "internal - do not modify", 2024-04-25T02:29:50.068 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.068 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.068 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.068 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.068 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": { 2024-04-25T02:29:50.068 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mode", 2024-04-25T02:29:50.068 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.068 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.068 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.068 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "root", 2024-04-25T02:29:50.068 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.068 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.068 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.069 INFO:teuthology.orchestra.run.smithi067.stdout: "cephadm-package", 2024-04-25T02:29:50.069 INFO:teuthology.orchestra.run.smithi067.stdout: "root" 2024-04-25T02:29:50.069 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.069 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "mode for remote execution of cephadm", 2024-04-25T02:29:50.069 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.069 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.069 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.069 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.069 INFO:teuthology.orchestra.run.smithi067.stdout: "oob_default_addr": { 2024-04-25T02:29:50.069 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "oob_default_addr", 2024-04-25T02:29:50.069 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.069 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.069 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.069 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "169.254.1.1", 2024-04-25T02:29:50.070 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.070 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.070 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.070 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-25T02:29:50.070 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.070 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.070 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.070 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.070 INFO:teuthology.orchestra.run.smithi067.stdout: "prometheus_alerts_path": { 2024-04-25T02:29:50.070 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "prometheus_alerts_path", 2024-04-25T02:29:50.070 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.070 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.070 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.070 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-25T02:29:50.071 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.071 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.071 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.071 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-25T02:29:50.071 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.071 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.071 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.071 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.071 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_insecure": { 2024-04-25T02:29:50.071 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_insecure", 2024-04-25T02:29:50.071 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.071 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.071 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.071 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.072 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.072 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.072 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.072 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-25T02:29:50.072 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.072 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.072 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.072 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.072 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_password": { 2024-04-25T02:29:50.072 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_password", 2024-04-25T02:29:50.072 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.072 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.072 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.072 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.073 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.073 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.073 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.073 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-25T02:29:50.073 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.073 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.073 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.073 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.073 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_url": { 2024-04-25T02:29:50.073 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_url", 2024-04-25T02:29:50.073 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.073 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.073 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.073 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.074 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.074 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.074 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.074 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-25T02:29:50.074 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.074 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.074 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.074 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.074 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_username": { 2024-04-25T02:29:50.074 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_username", 2024-04-25T02:29:50.074 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.074 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.074 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.074 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.075 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.075 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.075 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.075 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-25T02:29:50.075 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.075 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.075 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.075 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.075 INFO:teuthology.orchestra.run.smithi067.stdout: "secure_monitoring_stack": { 2024-04-25T02:29:50.075 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "secure_monitoring_stack", 2024-04-25T02:29:50.075 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.075 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.075 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.075 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.075 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.076 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.076 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.076 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-25T02:29:50.076 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.076 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.076 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.076 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.076 INFO:teuthology.orchestra.run.smithi067.stdout: "service_discovery_port": { 2024-04-25T02:29:50.076 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "service_discovery_port", 2024-04-25T02:29:50.076 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.076 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.076 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.076 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8765", 2024-04-25T02:29:50.076 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.077 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.077 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.077 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "cephadm service discovery port", 2024-04-25T02:29:50.077 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.077 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.077 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.077 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.077 INFO:teuthology.orchestra.run.smithi067.stdout: "ssh_config_file": { 2024-04-25T02:29:50.077 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssh_config_file", 2024-04-25T02:29:50.077 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.077 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.077 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.077 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.077 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.077 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.078 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.078 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-25T02:29:50.078 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.078 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.078 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.078 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.078 INFO:teuthology.orchestra.run.smithi067.stdout: "use_agent": { 2024-04-25T02:29:50.078 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "use_agent", 2024-04-25T02:29:50.078 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.078 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.078 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.078 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.078 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.079 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.079 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.079 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-25T02:29:50.079 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.079 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.079 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.079 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.079 INFO:teuthology.orchestra.run.smithi067.stdout: "use_repo_digest": { 2024-04-25T02:29:50.079 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "use_repo_digest", 2024-04-25T02:29:50.079 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.079 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.079 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.079 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.079 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.080 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.080 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.080 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-25T02:29:50.080 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.080 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.080 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.080 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.080 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_on_failed_host_check": { 2024-04-25T02:29:50.080 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_on_failed_host_check", 2024-04-25T02:29:50.080 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.080 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.080 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.080 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.080 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.081 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.081 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.081 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise a health warning if the host check fails", 2024-04-25T02:29:50.081 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.081 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.081 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.081 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.081 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_on_stray_daemons": { 2024-04-25T02:29:50.081 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_on_stray_daemons", 2024-04-25T02:29:50.081 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.081 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.081 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.081 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.081 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.081 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.082 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.082 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-25T02:29:50.082 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.082 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.082 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.082 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.082 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_on_stray_hosts": { 2024-04-25T02:29:50.082 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_on_stray_hosts", 2024-04-25T02:29:50.082 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.082 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.082 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.082 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.082 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.082 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.083 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.083 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-25T02:29:50.083 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.083 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.083 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.083 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.083 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.083 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.083 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.083 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crash", 2024-04-25T02:29:50.083 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.083 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.083 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.083 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.084 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.084 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.084 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.084 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.084 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.084 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.084 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.084 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.084 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.084 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.084 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.084 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.084 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.085 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.085 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.085 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.085 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.085 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.085 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.085 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.085 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.085 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.085 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.085 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.085 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.085 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.085 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.085 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.086 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.086 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.086 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.086 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.086 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.086 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.086 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.086 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.086 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.086 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.086 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.086 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.086 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.086 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.087 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.087 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.087 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.087 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.087 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.087 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.087 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.087 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.087 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.087 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.087 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.087 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.087 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.087 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.088 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.088 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.088 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.088 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.088 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.088 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.088 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.088 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.088 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.088 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.088 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.088 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.088 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.088 INFO:teuthology.orchestra.run.smithi067.stdout: "retain_interval": { 2024-04-25T02:29:50.088 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "retain_interval", 2024-04-25T02:29:50.089 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.089 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.089 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.089 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "31536000", 2024-04-25T02:29:50.089 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.089 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.089 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.089 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-25T02:29:50.089 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.089 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.089 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.089 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.089 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_recent_interval": { 2024-04-25T02:29:50.090 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_recent_interval", 2024-04-25T02:29:50.090 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.090 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.090 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.090 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "1209600", 2024-04-25T02:29:50.090 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.090 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.090 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.090 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-25T02:29:50.090 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.090 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.090 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.090 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.090 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.090 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.091 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.091 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "dashboard", 2024-04-25T02:29:50.091 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.091 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.091 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.091 INFO:teuthology.orchestra.run.smithi067.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-25T02:29:50.091 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-25T02:29:50.091 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.091 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.091 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.091 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-04-25T02:29:50.091 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.091 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.091 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.092 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.092 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.092 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.092 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.092 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.092 INFO:teuthology.orchestra.run.smithi067.stdout: "ALERTMANAGER_API_HOST": { 2024-04-25T02:29:50.092 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-25T02:29:50.092 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.092 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.092 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.092 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.092 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.092 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.092 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.092 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.093 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.093 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.093 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.093 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.093 INFO:teuthology.orchestra.run.smithi067.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-25T02:29:50.093 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-25T02:29:50.093 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.093 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.093 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.093 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.093 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.093 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.093 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.093 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.094 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.094 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.094 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.094 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.094 INFO:teuthology.orchestra.run.smithi067.stdout: "AUDIT_API_ENABLED": { 2024-04-25T02:29:50.094 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "AUDIT_API_ENABLED", 2024-04-25T02:29:50.094 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.094 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.094 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.094 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.094 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.094 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.094 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.094 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.095 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.095 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.095 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.095 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.095 INFO:teuthology.orchestra.run.smithi067.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-25T02:29:50.095 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-25T02:29:50.095 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.095 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.095 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.095 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.095 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.095 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.095 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.095 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.095 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.096 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.096 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.096 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.096 INFO:teuthology.orchestra.run.smithi067.stdout: "ENABLE_BROWSABLE_API": { 2024-04-25T02:29:50.096 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-25T02:29:50.096 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.096 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.096 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.096 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.096 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.096 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.096 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.096 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.097 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.097 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.097 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.097 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.097 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-25T02:29:50.097 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-25T02:29:50.097 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.097 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.097 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.097 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.097 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.097 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.097 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.097 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.098 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.098 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.098 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.098 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.098 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-25T02:29:50.098 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-25T02:29:50.098 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.098 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.098 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.098 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.098 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.098 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.098 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.099 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.099 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.099 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.099 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.099 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.099 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-25T02:29:50.099 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-25T02:29:50.099 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.099 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.099 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.099 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.099 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.099 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.100 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.100 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.100 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.100 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.100 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.100 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.100 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-25T02:29:50.100 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-25T02:29:50.100 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.100 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.100 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.100 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.100 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.100 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.101 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.101 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.101 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.101 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.101 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.101 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.101 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-25T02:29:50.101 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-25T02:29:50.101 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.101 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.101 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.101 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.101 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.101 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.101 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.102 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.102 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.102 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.102 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.102 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.102 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-25T02:29:50.102 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-25T02:29:50.102 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.102 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.102 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.102 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.102 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.102 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.103 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.103 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.103 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.103 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.103 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.103 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.103 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-25T02:29:50.103 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-25T02:29:50.103 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.103 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.103 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.103 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.103 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.103 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.103 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.104 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.104 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.104 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.104 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.104 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.104 INFO:teuthology.orchestra.run.smithi067.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-25T02:29:50.104 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-25T02:29:50.104 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.104 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.104 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.104 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.104 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.104 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.104 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.105 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.105 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.105 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.105 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.105 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.105 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_PASSWORD": { 2024-04-25T02:29:50.105 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-25T02:29:50.105 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.105 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.105 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.105 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "admin", 2024-04-25T02:29:50.105 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.105 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.105 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.106 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.106 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.106 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.106 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.106 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.106 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-25T02:29:50.106 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-25T02:29:50.106 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.106 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.106 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.106 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.106 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.106 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.107 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.107 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.107 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.107 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.107 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.107 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.107 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_URL": { 2024-04-25T02:29:50.107 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_URL", 2024-04-25T02:29:50.107 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.107 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.107 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.107 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.107 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.107 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.108 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.108 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.108 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.108 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.108 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.108 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.108 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_USERNAME": { 2024-04-25T02:29:50.108 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-25T02:29:50.108 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.108 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.108 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.108 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "admin", 2024-04-25T02:29:50.108 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.108 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.108 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.109 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.109 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.109 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.109 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.109 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.109 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-25T02:29:50.109 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-25T02:29:50.109 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.109 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.109 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.109 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.109 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.109 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.109 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.109 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.110 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.110 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.110 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.110 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.110 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-25T02:29:50.110 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-25T02:29:50.110 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.110 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.110 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.110 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.110 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.110 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.110 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.110 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.111 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.111 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.111 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.111 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.111 INFO:teuthology.orchestra.run.smithi067.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-25T02:29:50.111 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-25T02:29:50.111 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.111 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.111 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.111 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.111 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.111 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.111 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.111 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.112 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.112 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.112 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.112 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.112 INFO:teuthology.orchestra.run.smithi067.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-25T02:29:50.112 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-25T02:29:50.112 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.112 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.112 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.112 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.112 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.112 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.112 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.112 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.113 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.113 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.113 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.113 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.113 INFO:teuthology.orchestra.run.smithi067.stdout: "PROMETHEUS_API_HOST": { 2024-04-25T02:29:50.113 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-25T02:29:50.113 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.113 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.113 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.113 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.113 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.113 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.113 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.113 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.113 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.113 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.114 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.114 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.114 INFO:teuthology.orchestra.run.smithi067.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-25T02:29:50.114 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-25T02:29:50.114 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.114 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.114 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.114 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.114 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.114 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.114 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.114 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.114 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.114 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.115 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.115 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.115 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-25T02:29:50.115 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-25T02:29:50.115 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.115 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.115 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.115 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.115 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.115 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.115 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.115 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.115 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.116 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.116 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.116 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.116 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-25T02:29:50.116 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-25T02:29:50.116 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.116 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.116 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.116 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.116 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.116 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.116 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.116 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.116 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.117 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.117 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.117 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.117 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-25T02:29:50.117 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-25T02:29:50.117 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.117 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.117 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.117 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.117 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.117 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.117 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.117 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.117 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.118 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.118 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.118 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.118 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-25T02:29:50.118 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-25T02:29:50.118 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.118 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.118 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.118 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.118 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.118 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.118 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.118 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.118 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.119 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.119 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.119 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.119 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-25T02:29:50.119 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-25T02:29:50.119 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.119 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.119 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.119 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.119 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.119 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.119 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.119 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.119 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.120 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.120 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.120 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.120 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-25T02:29:50.120 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-25T02:29:50.120 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.120 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.120 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.120 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.120 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.120 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.120 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.120 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.120 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.121 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.121 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.121 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.121 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-25T02:29:50.121 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-25T02:29:50.121 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.121 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.121 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.121 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.121 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.121 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.121 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.121 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.121 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.122 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.122 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.122 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.122 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_ENABLED": { 2024-04-25T02:29:50.122 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-25T02:29:50.122 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.122 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.122 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.122 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.122 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.122 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.122 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.122 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.122 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.123 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.123 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.123 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.123 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-25T02:29:50.123 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-25T02:29:50.123 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.123 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.123 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.123 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-25T02:29:50.123 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.123 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.123 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.123 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.123 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.124 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.124 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.124 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.124 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-25T02:29:50.124 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-25T02:29:50.124 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.124 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.124 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.124 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-04-25T02:29:50.124 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.124 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.124 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.124 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.124 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.124 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.125 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.125 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.125 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-25T02:29:50.125 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-25T02:29:50.125 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.125 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.125 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.125 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8", 2024-04-25T02:29:50.125 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.125 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.125 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.125 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.125 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.125 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.126 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.126 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.126 INFO:teuthology.orchestra.run.smithi067.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-25T02:29:50.126 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-25T02:29:50.126 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.126 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.126 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.126 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "45", 2024-04-25T02:29:50.126 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.126 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.126 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.126 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.126 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.126 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.127 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.127 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.127 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_ACCESS_KEY": { 2024-04-25T02:29:50.127 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-25T02:29:50.127 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.127 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.127 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.127 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.127 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.127 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.127 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.127 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.127 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.127 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.128 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.128 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.128 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-25T02:29:50.128 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-25T02:29:50.128 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.128 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.128 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.128 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "admin", 2024-04-25T02:29:50.128 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.128 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.128 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.128 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.128 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.129 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.129 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.129 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.129 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_SECRET_KEY": { 2024-04-25T02:29:50.129 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-25T02:29:50.129 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.129 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.129 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.129 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.129 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.129 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.129 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.129 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.129 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.129 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.130 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.130 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.130 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_SSL_VERIFY": { 2024-04-25T02:29:50.130 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-25T02:29:50.130 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.130 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.130 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.130 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.130 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.130 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.130 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.130 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.130 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.131 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.131 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.131 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.131 INFO:teuthology.orchestra.run.smithi067.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-25T02:29:50.131 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-25T02:29:50.131 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.131 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.131 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.131 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-04-25T02:29:50.131 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.131 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.131 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.132 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.132 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.132 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.132 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.132 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.132 INFO:teuthology.orchestra.run.smithi067.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-25T02:29:50.132 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-25T02:29:50.132 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.132 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.132 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.132 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-04-25T02:29:50.132 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.132 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.133 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.133 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.133 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.133 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.133 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.133 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.133 INFO:teuthology.orchestra.run.smithi067.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-25T02:29:50.133 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-25T02:29:50.133 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.133 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.133 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.133 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-04-25T02:29:50.133 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.133 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.134 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.134 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.134 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.134 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.134 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.134 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.134 INFO:teuthology.orchestra.run.smithi067.stdout: "cross_origin_url": { 2024-04-25T02:29:50.134 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cross_origin_url", 2024-04-25T02:29:50.134 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.134 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.134 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.134 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.134 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.135 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.135 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.135 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.135 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.135 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.135 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.135 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.135 INFO:teuthology.orchestra.run.smithi067.stdout: "crt_file": { 2024-04-25T02:29:50.135 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crt_file", 2024-04-25T02:29:50.135 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.135 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.135 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.135 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.136 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.136 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.136 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.136 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.136 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.136 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.136 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.136 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.136 INFO:teuthology.orchestra.run.smithi067.stdout: "debug": { 2024-04-25T02:29:50.136 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "debug", 2024-04-25T02:29:50.136 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.136 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.136 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.136 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.136 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.137 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.137 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.137 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Enable/disable debug options", 2024-04-25T02:29:50.137 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.137 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.137 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.137 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.137 INFO:teuthology.orchestra.run.smithi067.stdout: "jwt_token_ttl": { 2024-04-25T02:29:50.137 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "jwt_token_ttl", 2024-04-25T02:29:50.137 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.137 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.137 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.137 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "28800", 2024-04-25T02:29:50.137 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.138 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.138 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.138 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.138 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.138 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.138 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.138 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.138 INFO:teuthology.orchestra.run.smithi067.stdout: "key_file": { 2024-04-25T02:29:50.138 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "key_file", 2024-04-25T02:29:50.138 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.138 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.138 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.138 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.138 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.138 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.139 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.139 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.139 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.139 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.139 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.139 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.139 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.139 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.139 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.139 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.139 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.139 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.139 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.139 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.140 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.140 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.140 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.140 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.140 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.140 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.140 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.140 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.140 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.140 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.140 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.140 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.140 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.140 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.141 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.141 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.141 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.141 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.141 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.141 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.141 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.141 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.141 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.141 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.141 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.141 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.141 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.141 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.142 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.142 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.142 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.142 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.142 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.142 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.142 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.142 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.142 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.142 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.142 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.142 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.142 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.142 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.143 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.143 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.143 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.143 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.143 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.143 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.143 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.143 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.143 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.143 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.143 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.143 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.143 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.143 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.144 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.144 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.144 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.144 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.144 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.144 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.144 INFO:teuthology.orchestra.run.smithi067.stdout: "motd": { 2024-04-25T02:29:50.144 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "motd", 2024-04-25T02:29:50.144 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.144 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.144 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.144 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.144 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.144 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.144 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.145 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "The message of the day", 2024-04-25T02:29:50.145 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.145 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.145 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.145 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.145 INFO:teuthology.orchestra.run.smithi067.stdout: "redirect_resolve_ip_addr": { 2024-04-25T02:29:50.145 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "redirect_resolve_ip_addr", 2024-04-25T02:29:50.145 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.145 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.145 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.145 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.145 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.145 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.145 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.145 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.146 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.146 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.146 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.146 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.146 INFO:teuthology.orchestra.run.smithi067.stdout: "server_addr": { 2024-04-25T02:29:50.146 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_addr", 2024-04-25T02:29:50.146 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.146 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.146 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.146 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "::", 2024-04-25T02:29:50.146 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.146 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.146 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.146 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.147 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.147 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.147 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.147 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.147 INFO:teuthology.orchestra.run.smithi067.stdout: "server_port": { 2024-04-25T02:29:50.147 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_port", 2024-04-25T02:29:50.147 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.147 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.147 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.147 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8080", 2024-04-25T02:29:50.147 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.147 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.147 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.147 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.148 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.148 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.148 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.148 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.148 INFO:teuthology.orchestra.run.smithi067.stdout: "ssl": { 2024-04-25T02:29:50.148 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssl", 2024-04-25T02:29:50.148 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.148 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.148 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.148 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.148 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.148 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.148 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.149 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.149 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.149 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.149 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.149 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.149 INFO:teuthology.orchestra.run.smithi067.stdout: "ssl_server_port": { 2024-04-25T02:29:50.149 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssl_server_port", 2024-04-25T02:29:50.149 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.149 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.149 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.149 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8443", 2024-04-25T02:29:50.149 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.149 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.149 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.149 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.150 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.150 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.150 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.150 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.150 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_behaviour": { 2024-04-25T02:29:50.150 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_behaviour", 2024-04-25T02:29:50.150 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.150 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.150 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.150 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "redirect", 2024-04-25T02:29:50.150 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.150 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.150 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.151 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.151 INFO:teuthology.orchestra.run.smithi067.stdout: "redirect" 2024-04-25T02:29:50.151 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.151 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.151 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.151 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.151 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.151 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.151 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_error_status_code": { 2024-04-25T02:29:50.151 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_error_status_code", 2024-04-25T02:29:50.151 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.151 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.151 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.151 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "500", 2024-04-25T02:29:50.151 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "400", 2024-04-25T02:29:50.152 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "599", 2024-04-25T02:29:50.152 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.152 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.152 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.152 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.152 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.152 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.152 INFO:teuthology.orchestra.run.smithi067.stdout: "url_prefix": { 2024-04-25T02:29:50.152 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "url_prefix", 2024-04-25T02:29:50.152 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.152 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.152 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.153 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.153 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.153 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.153 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.153 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.153 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.153 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.153 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.153 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.153 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.153 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.153 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.153 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "devicehealth", 2024-04-25T02:29:50.153 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.154 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.154 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.154 INFO:teuthology.orchestra.run.smithi067.stdout: "enable_monitoring": { 2024-04-25T02:29:50.154 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enable_monitoring", 2024-04-25T02:29:50.154 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.154 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.154 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.154 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.154 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.154 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.154 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.154 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "monitor device health metrics", 2024-04-25T02:29:50.154 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.154 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.154 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.155 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.155 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.155 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.155 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.155 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.155 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.155 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.155 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.155 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.155 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.155 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.155 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.155 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.155 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.155 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.156 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.156 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.156 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.156 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.156 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.156 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.156 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.156 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.156 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.156 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.156 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.156 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.156 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.156 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.156 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.156 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.157 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.157 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.157 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.157 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.157 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.157 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.157 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.157 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.157 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.157 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.157 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.157 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.157 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.157 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.157 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.158 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.158 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.158 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.158 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.158 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.158 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.158 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.158 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.158 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.158 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.158 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.158 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.159 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.159 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.159 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.159 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.159 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.159 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.159 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.159 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.159 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.159 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.159 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.159 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.159 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.159 INFO:teuthology.orchestra.run.smithi067.stdout: "mark_out_threshold": { 2024-04-25T02:29:50.160 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mark_out_threshold", 2024-04-25T02:29:50.160 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.160 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.160 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.160 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "2419200", 2024-04-25T02:29:50.160 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.160 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.160 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.160 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-25T02:29:50.160 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.160 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.160 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.160 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.160 INFO:teuthology.orchestra.run.smithi067.stdout: "pool_name": { 2024-04-25T02:29:50.161 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pool_name", 2024-04-25T02:29:50.161 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.161 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.161 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.161 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "device_health_metrics", 2024-04-25T02:29:50.161 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.161 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.161 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.161 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-25T02:29:50.161 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.161 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.161 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.161 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.161 INFO:teuthology.orchestra.run.smithi067.stdout: "retention_period": { 2024-04-25T02:29:50.162 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "retention_period", 2024-04-25T02:29:50.162 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.162 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.162 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.162 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "15552000", 2024-04-25T02:29:50.162 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.162 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.162 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.162 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how long to retain device health metrics", 2024-04-25T02:29:50.162 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.162 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.162 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.162 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.162 INFO:teuthology.orchestra.run.smithi067.stdout: "scrape_frequency": { 2024-04-25T02:29:50.162 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "scrape_frequency", 2024-04-25T02:29:50.163 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.163 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.163 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.163 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "86400", 2024-04-25T02:29:50.163 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.163 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.163 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.163 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-25T02:29:50.163 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.163 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.163 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.163 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.163 INFO:teuthology.orchestra.run.smithi067.stdout: "self_heal": { 2024-04-25T02:29:50.163 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "self_heal", 2024-04-25T02:29:50.163 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.164 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.164 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.164 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.164 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.164 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.164 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.164 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-25T02:29:50.164 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.164 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.164 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.164 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.164 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-04-25T02:29:50.164 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-04-25T02:29:50.165 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.165 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.165 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.165 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-04-25T02:29:50.165 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.165 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.165 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.165 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to wake up and check device health", 2024-04-25T02:29:50.165 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.165 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.165 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.165 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.165 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_threshold": { 2024-04-25T02:29:50.165 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_threshold", 2024-04-25T02:29:50.166 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.166 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.166 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.166 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "7257600", 2024-04-25T02:29:50.166 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.166 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.166 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.166 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-25T02:29:50.166 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.166 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.166 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.166 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.166 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.167 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.167 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.167 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "diskprediction_local", 2024-04-25T02:29:50.167 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.167 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.167 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.167 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.167 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.167 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.167 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.167 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.167 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.167 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.167 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.168 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.168 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.168 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.168 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.168 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.168 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.168 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.168 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.168 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.168 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.168 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.168 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.168 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.168 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.168 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.168 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.169 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.169 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.169 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.169 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.169 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.169 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.169 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.169 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.169 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.169 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.169 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.169 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.169 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.169 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.169 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.170 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.170 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.170 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.170 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.170 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.170 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.170 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.170 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.170 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.170 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.170 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.170 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.170 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.170 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.171 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.171 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.171 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.171 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.171 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.171 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.171 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.171 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.171 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.171 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.171 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.171 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.171 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.171 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.171 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.172 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.172 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.172 INFO:teuthology.orchestra.run.smithi067.stdout: "predict_interval": { 2024-04-25T02:29:50.172 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "predict_interval", 2024-04-25T02:29:50.172 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.172 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.172 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.172 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "86400", 2024-04-25T02:29:50.172 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.172 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.172 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.172 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.172 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.172 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.172 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.173 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.173 INFO:teuthology.orchestra.run.smithi067.stdout: "predictor_model": { 2024-04-25T02:29:50.173 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "predictor_model", 2024-04-25T02:29:50.173 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.173 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.173 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.173 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "prophetstor", 2024-04-25T02:29:50.173 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.173 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.173 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.173 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.173 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.173 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.173 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.173 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.174 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-04-25T02:29:50.174 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-04-25T02:29:50.174 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.174 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.174 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.174 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-04-25T02:29:50.174 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.174 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.174 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.174 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.174 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.174 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.174 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.174 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.175 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.175 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.175 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.175 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "influx", 2024-04-25T02:29:50.175 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": false, 2024-04-25T02:29:50.175 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "influxdb python module not found", 2024-04-25T02:29:50.175 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.175 INFO:teuthology.orchestra.run.smithi067.stdout: "batch_size": { 2024-04-25T02:29:50.175 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "batch_size", 2024-04-25T02:29:50.175 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.175 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.175 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.175 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5000", 2024-04-25T02:29:50.175 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.175 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.176 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.176 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-25T02:29:50.176 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.176 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.176 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.176 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.176 INFO:teuthology.orchestra.run.smithi067.stdout: "database": { 2024-04-25T02:29:50.176 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "database", 2024-04-25T02:29:50.176 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.176 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.176 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.176 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "ceph", 2024-04-25T02:29:50.176 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.176 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.176 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.177 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-25T02:29:50.177 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.177 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.177 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.177 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.177 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": { 2024-04-25T02:29:50.177 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "hostname", 2024-04-25T02:29:50.177 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.177 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.177 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.177 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.177 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.177 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.177 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.177 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "InfluxDB server hostname", 2024-04-25T02:29:50.178 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.178 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.178 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.178 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.178 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-04-25T02:29:50.178 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-04-25T02:29:50.178 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.178 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.178 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.178 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "30", 2024-04-25T02:29:50.178 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "5", 2024-04-25T02:29:50.178 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.178 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.178 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-25T02:29:50.179 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.179 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.179 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.179 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.179 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.179 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.179 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.179 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.179 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.179 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.179 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.179 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.179 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.179 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.180 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.180 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.180 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.180 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.180 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.180 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.180 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.180 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.180 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.180 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.180 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.180 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.180 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.181 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.181 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.181 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.181 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.181 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.181 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.181 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.181 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.181 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.181 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.181 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.181 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.181 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.181 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.181 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.182 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.182 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.182 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.182 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.182 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.182 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.182 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.182 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.182 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.182 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.182 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.182 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.182 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.182 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.183 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.183 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.183 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.183 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.183 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.183 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.183 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.183 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.183 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.183 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.183 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.183 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.183 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.184 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.184 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.184 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.184 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.184 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.184 INFO:teuthology.orchestra.run.smithi067.stdout: "password": { 2024-04-25T02:29:50.184 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "password", 2024-04-25T02:29:50.184 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.184 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.184 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.184 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.184 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.184 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.184 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.184 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "password of InfluxDB server user", 2024-04-25T02:29:50.185 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.185 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.185 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.185 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.185 INFO:teuthology.orchestra.run.smithi067.stdout: "port": { 2024-04-25T02:29:50.185 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "port", 2024-04-25T02:29:50.185 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.185 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.185 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.185 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8086", 2024-04-25T02:29:50.185 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.185 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.185 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.186 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "InfluxDB server port", 2024-04-25T02:29:50.186 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.186 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.186 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.186 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.186 INFO:teuthology.orchestra.run.smithi067.stdout: "ssl": { 2024-04-25T02:29:50.186 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssl", 2024-04-25T02:29:50.186 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.186 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.186 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.186 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "false", 2024-04-25T02:29:50.186 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.186 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.187 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.187 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T02:29:50.187 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.187 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.187 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.187 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.187 INFO:teuthology.orchestra.run.smithi067.stdout: "threads": { 2024-04-25T02:29:50.187 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "threads", 2024-04-25T02:29:50.187 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.187 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.187 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.187 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-04-25T02:29:50.187 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-04-25T02:29:50.187 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "32", 2024-04-25T02:29:50.188 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.188 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-25T02:29:50.188 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.188 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.188 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.188 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.188 INFO:teuthology.orchestra.run.smithi067.stdout: "username": { 2024-04-25T02:29:50.188 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "username", 2024-04-25T02:29:50.188 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.188 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.188 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.188 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.188 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.188 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.188 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.189 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "username of InfluxDB server user", 2024-04-25T02:29:50.189 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.189 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.189 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.189 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.189 INFO:teuthology.orchestra.run.smithi067.stdout: "verify_ssl": { 2024-04-25T02:29:50.189 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "verify_ssl", 2024-04-25T02:29:50.189 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.189 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.189 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.189 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "true", 2024-04-25T02:29:50.189 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.189 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.189 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.190 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T02:29:50.190 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.190 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.190 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.190 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.190 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.190 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.190 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.190 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "insights", 2024-04-25T02:29:50.190 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.190 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.190 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.190 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.190 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.191 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.191 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.191 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.191 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.191 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.191 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.191 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.191 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.191 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.191 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.191 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.191 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.191 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.191 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.192 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.192 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.192 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.192 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.192 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.192 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.192 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.192 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.192 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.192 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.192 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.192 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.192 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.192 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.193 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.193 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.193 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.193 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.193 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.193 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.193 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.193 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.193 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.193 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.193 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.193 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.193 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.193 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.193 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.194 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.194 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.194 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.194 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.194 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.194 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.194 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.194 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.194 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.194 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.194 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.194 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.194 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.194 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.194 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.195 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.195 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.195 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.195 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.195 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.195 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.195 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.195 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.195 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.195 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.195 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.195 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.195 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.195 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "iostat", 2024-04-25T02:29:50.196 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.196 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.196 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.196 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.196 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.196 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.196 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.196 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.196 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.196 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.196 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.196 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.196 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.196 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.197 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.197 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.197 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.197 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.197 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.197 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.197 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.197 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.197 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.197 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.197 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.197 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.197 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.197 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.198 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.198 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.198 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.198 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.198 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.198 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.198 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.198 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.198 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.198 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.198 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.198 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.198 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.198 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.199 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.199 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.199 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.199 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.199 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.199 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.199 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.199 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.199 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.199 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.199 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.199 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.199 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.199 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.200 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.200 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.200 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.200 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.200 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.200 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.200 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.200 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.200 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.200 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.200 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.200 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.200 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.200 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.201 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.201 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.201 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.201 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.201 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.201 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.201 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "localpool", 2024-04-25T02:29:50.201 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.201 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.201 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.201 INFO:teuthology.orchestra.run.smithi067.stdout: "failure_domain": { 2024-04-25T02:29:50.201 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "failure_domain", 2024-04-25T02:29:50.201 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.201 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.202 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.202 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "host", 2024-04-25T02:29:50.202 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.202 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.202 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.202 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "failure domain for any created local pool", 2024-04-25T02:29:50.202 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-25T02:29:50.202 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.202 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.202 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.202 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.202 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.203 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.203 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.203 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.203 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.203 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.203 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.203 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.203 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.203 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.203 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.203 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.203 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.203 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.203 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.204 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.204 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.204 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.204 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.204 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.204 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.204 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.204 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.204 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.204 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.204 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.204 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.204 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.204 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.205 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.205 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.205 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.205 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.205 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.205 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.205 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.205 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.205 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.205 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.205 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.205 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.205 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.206 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.206 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.206 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.206 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.206 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.206 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.206 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.206 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.206 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.206 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.206 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.206 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.206 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.207 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.207 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.207 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.207 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.207 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.207 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.207 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.207 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.207 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.207 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.207 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.207 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.207 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.207 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.207 INFO:teuthology.orchestra.run.smithi067.stdout: "min_size": { 2024-04-25T02:29:50.208 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "min_size", 2024-04-25T02:29:50.208 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.208 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.208 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.208 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.208 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.208 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.208 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.208 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "default min_size for any created local pool", 2024-04-25T02:29:50.208 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-25T02:29:50.208 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.208 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.208 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.208 INFO:teuthology.orchestra.run.smithi067.stdout: "num_rep": { 2024-04-25T02:29:50.209 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "num_rep", 2024-04-25T02:29:50.209 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.209 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.209 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.209 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "3", 2024-04-25T02:29:50.209 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.209 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.209 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.209 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "default replica count for any created local pool", 2024-04-25T02:29:50.209 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.209 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.209 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.209 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.209 INFO:teuthology.orchestra.run.smithi067.stdout: "pg_num": { 2024-04-25T02:29:50.209 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pg_num", 2024-04-25T02:29:50.210 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.210 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.210 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.210 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "128", 2024-04-25T02:29:50.210 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.210 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.210 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.210 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "default pg_num for any created local pool", 2024-04-25T02:29:50.210 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.210 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.210 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.210 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.210 INFO:teuthology.orchestra.run.smithi067.stdout: "prefix": { 2024-04-25T02:29:50.211 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "prefix", 2024-04-25T02:29:50.211 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.211 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.211 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.211 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.211 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.211 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.211 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.211 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "name prefix for any created local pool", 2024-04-25T02:29:50.211 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.211 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.211 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.211 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.211 INFO:teuthology.orchestra.run.smithi067.stdout: "subtree": { 2024-04-25T02:29:50.211 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "subtree", 2024-04-25T02:29:50.212 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.212 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.212 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.212 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "rack", 2024-04-25T02:29:50.212 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.212 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.212 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.212 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-25T02:29:50.212 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-25T02:29:50.212 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.212 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.212 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.212 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.212 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.212 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.213 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mds_autoscaler", 2024-04-25T02:29:50.213 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.213 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.213 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.213 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.213 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.213 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.213 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.213 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.213 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.213 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.213 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.213 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.214 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.214 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.214 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.214 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.214 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.214 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.214 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.214 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.214 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.214 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.214 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.214 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.214 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.214 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.215 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.215 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.215 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.215 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.215 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.215 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.215 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.215 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.215 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.215 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.215 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.215 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.215 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.215 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.215 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.216 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.216 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.216 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.216 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.216 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.216 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.216 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.216 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.216 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.216 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.216 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.216 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.216 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.217 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.217 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.217 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.217 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.217 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.217 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.217 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.217 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.217 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.217 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.217 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.217 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.217 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.217 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.217 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.218 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.218 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.218 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.218 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.218 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.218 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.218 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.218 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mirroring", 2024-04-25T02:29:50.218 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.218 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.218 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.218 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.219 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.219 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.219 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.219 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.219 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.219 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.219 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.219 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.219 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.219 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.219 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.219 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.219 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.219 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.220 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.220 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.220 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.220 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.220 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.220 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.220 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.220 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.220 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.220 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.220 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.220 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.220 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.220 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.221 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.221 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.221 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.221 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.221 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.221 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.221 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.221 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.221 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.221 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.221 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.221 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.221 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.222 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.222 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.222 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.222 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.222 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.222 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.222 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.222 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.222 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.222 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.222 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.222 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.223 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.223 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.223 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.223 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.223 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.223 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.223 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.223 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.223 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.223 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.223 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.223 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.223 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.223 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.223 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.224 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.224 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.224 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.224 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.224 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "nfs", 2024-04-25T02:29:50.224 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.224 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.224 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.224 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.224 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.224 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.224 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.224 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.225 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.225 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.225 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.225 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.225 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.225 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.225 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.225 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.225 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.225 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.225 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.225 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.225 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.225 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.225 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.225 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.226 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.226 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.226 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.226 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.226 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.226 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.226 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.226 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.226 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.226 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.226 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.226 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.226 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.227 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.227 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.227 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.227 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.227 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.227 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.227 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.227 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.227 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.227 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.227 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.227 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.227 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.227 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.227 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.228 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.228 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.228 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.228 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.228 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.228 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.228 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.228 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.228 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.228 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.228 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.228 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.228 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.228 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.228 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.228 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.229 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.229 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.229 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.229 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.229 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.229 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.229 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.229 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.229 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "orchestrator", 2024-04-25T02:29:50.229 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.229 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.229 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.229 INFO:teuthology.orchestra.run.smithi067.stdout: "fail_fs": { 2024-04-25T02:29:50.229 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "fail_fs", 2024-04-25T02:29:50.229 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.230 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.230 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.230 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.230 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.230 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.230 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.230 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-25T02:29:50.230 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.230 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.230 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.230 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.230 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.230 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.230 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.231 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.231 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.231 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.231 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.231 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.231 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.231 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.231 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.231 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.231 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.231 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.231 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.231 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.231 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.232 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.232 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.232 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.232 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.232 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.232 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.232 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.232 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.232 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.232 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.232 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.232 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.232 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.232 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.233 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.233 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.233 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.233 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.233 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.233 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.233 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.233 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.233 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.233 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.233 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.233 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.233 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.233 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.233 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.234 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.234 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.234 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.234 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.234 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.234 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.234 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.234 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.234 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.234 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.234 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.234 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.234 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.235 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.235 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.235 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.235 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.235 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.235 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.235 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.235 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.235 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.235 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.235 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.235 INFO:teuthology.orchestra.run.smithi067.stdout: "orchestrator": { 2024-04-25T02:29:50.235 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "orchestrator", 2024-04-25T02:29:50.235 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.235 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.236 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.236 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.236 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.236 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.236 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.236 INFO:teuthology.orchestra.run.smithi067.stdout: "cephadm", 2024-04-25T02:29:50.236 INFO:teuthology.orchestra.run.smithi067.stdout: "rook", 2024-04-25T02:29:50.236 INFO:teuthology.orchestra.run.smithi067.stdout: "test_orchestrator" 2024-04-25T02:29:50.236 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.236 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Orchestrator backend", 2024-04-25T02:29:50.236 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.236 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.236 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.236 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.237 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.237 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.237 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.237 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "osd_perf_query", 2024-04-25T02:29:50.237 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.237 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.237 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.237 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.237 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.237 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.237 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.237 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.237 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.237 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.237 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.237 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.238 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.238 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.238 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.238 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.238 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.238 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.238 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.238 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.238 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.238 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.238 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.238 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.238 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.238 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.239 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.239 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.239 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.239 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.239 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.239 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.239 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.239 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.239 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.239 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.239 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.239 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.239 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.239 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.239 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.240 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.240 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.240 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.240 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.240 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.240 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.240 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.240 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.240 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.240 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.240 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.240 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.240 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.240 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.241 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.241 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.241 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.241 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.241 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.241 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.241 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.241 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.241 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.241 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.241 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.241 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.241 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.241 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.241 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.242 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.242 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.242 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.242 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.242 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.242 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.242 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "osd_support", 2024-04-25T02:29:50.242 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.242 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.242 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.242 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.242 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.242 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.242 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.243 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.243 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.243 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.243 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.243 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.243 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.243 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.243 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.243 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.243 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.243 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.243 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.243 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.243 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.243 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.244 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.244 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.244 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.244 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.244 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.244 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.244 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.244 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.244 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.244 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.244 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.244 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.244 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.244 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.245 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.245 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.245 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.245 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.245 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.245 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.245 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.245 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.245 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.245 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.245 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.245 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.245 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.245 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.246 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.246 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.246 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.246 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.246 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.246 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.246 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.246 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.246 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.246 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.246 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.246 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.246 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.246 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.246 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.247 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.247 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.247 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.247 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.247 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.247 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.247 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.247 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.247 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.247 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.247 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.247 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pg_autoscaler", 2024-04-25T02:29:50.247 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.251 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.251 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.251 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.252 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.252 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.252 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.252 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.252 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.252 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.252 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.252 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.252 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.252 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.252 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.252 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.252 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.252 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.253 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.253 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.253 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.253 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.253 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.253 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.253 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.253 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.253 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.253 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.253 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.253 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.253 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.253 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.254 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.254 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.254 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.254 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.254 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.254 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.254 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.254 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.254 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.254 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.254 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.254 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.254 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.254 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.255 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.255 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.255 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.255 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.255 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.255 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.255 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.255 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.255 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.255 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.255 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.255 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.255 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.255 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.256 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.256 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.256 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.256 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.256 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.256 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.256 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.256 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.256 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.256 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.256 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.256 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.256 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.256 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-04-25T02:29:50.257 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-04-25T02:29:50.257 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.257 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.257 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.257 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-04-25T02:29:50.257 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.257 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.257 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.257 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.257 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.257 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.257 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.257 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.257 INFO:teuthology.orchestra.run.smithi067.stdout: "threshold": { 2024-04-25T02:29:50.257 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "threshold", 2024-04-25T02:29:50.258 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-04-25T02:29:50.258 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.258 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.258 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "3.0", 2024-04-25T02:29:50.258 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1.0", 2024-04-25T02:29:50.258 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.258 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.258 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "scaling threshold", 2024-04-25T02:29:50.258 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-25T02:29:50.258 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.258 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.258 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.258 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.258 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.259 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.259 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "progress", 2024-04-25T02:29:50.259 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.259 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.259 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.259 INFO:teuthology.orchestra.run.smithi067.stdout: "allow_pg_recovery_event": { 2024-04-25T02:29:50.259 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "allow_pg_recovery_event", 2024-04-25T02:29:50.259 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.259 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.259 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.259 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.259 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.259 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.260 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.260 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-25T02:29:50.260 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.260 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.260 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.260 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.260 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": { 2024-04-25T02:29:50.260 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enabled", 2024-04-25T02:29:50.260 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.260 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.260 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.260 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.260 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.260 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.261 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.261 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.261 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.261 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.261 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.261 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.261 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.261 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.261 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.261 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.261 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.261 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.261 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.261 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.261 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.262 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.262 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.262 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.262 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.262 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.262 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.262 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.262 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.262 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.262 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.262 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.262 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.262 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.263 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.263 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.263 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.263 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.263 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.263 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.263 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.263 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.263 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.263 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.263 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.263 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.263 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.263 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.263 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.264 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.264 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.264 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.264 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.264 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.264 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.264 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.264 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.264 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.264 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.264 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.264 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.264 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.264 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.265 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.265 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.265 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.265 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.265 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.265 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.265 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.265 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.265 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.265 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.265 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.265 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.265 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.266 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.266 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.266 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.266 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.266 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.266 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.266 INFO:teuthology.orchestra.run.smithi067.stdout: "max_completed_events": { 2024-04-25T02:29:50.266 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_completed_events", 2024-04-25T02:29:50.266 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.266 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.266 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.266 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "50", 2024-04-25T02:29:50.266 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.267 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.267 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.267 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "number of past completed events to remember", 2024-04-25T02:29:50.267 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.267 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.267 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.267 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.267 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-04-25T02:29:50.267 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-04-25T02:29:50.267 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.267 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.267 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.267 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-04-25T02:29:50.267 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.267 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.268 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.268 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how long the module is going to sleep", 2024-04-25T02:29:50.268 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.268 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.268 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.268 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.268 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.268 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.269 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.269 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "prometheus", 2024-04-25T02:29:50.269 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.269 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.269 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.269 INFO:teuthology.orchestra.run.smithi067.stdout: "cache": { 2024-04-25T02:29:50.269 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cache", 2024-04-25T02:29:50.269 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.269 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.269 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.269 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.269 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.269 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.269 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.270 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.270 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.270 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.270 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.270 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.270 INFO:teuthology.orchestra.run.smithi067.stdout: "exclude_perf_counters": { 2024-04-25T02:29:50.270 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "exclude_perf_counters", 2024-04-25T02:29:50.270 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.270 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.270 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.270 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.270 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.270 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.271 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.271 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-25T02:29:50.271 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-25T02:29:50.271 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.271 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.271 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.271 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.271 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.271 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.271 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.271 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.271 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.271 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.271 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.272 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.272 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.272 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.272 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.272 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.272 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.272 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.272 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.272 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.272 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.272 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.272 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.272 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.272 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.273 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.273 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.273 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.273 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.273 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.273 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.273 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.273 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.273 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.273 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.273 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.273 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.273 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.274 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.274 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.274 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.274 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.274 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.274 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.274 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.274 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.274 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.274 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.274 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.274 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.274 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.274 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.274 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.275 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.275 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.275 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.275 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.275 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.275 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.275 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.275 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.275 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.275 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.275 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.275 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.275 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.276 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.276 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.276 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.276 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.276 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.276 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.276 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.276 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_stats_pools": { 2024-04-25T02:29:50.276 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rbd_stats_pools", 2024-04-25T02:29:50.276 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.276 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.276 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.276 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.276 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.277 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.277 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.277 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.277 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.277 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.277 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.277 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.277 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-25T02:29:50.277 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-25T02:29:50.277 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.277 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.277 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.277 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "300", 2024-04-25T02:29:50.277 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.278 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.278 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.278 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.278 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.278 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.278 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.278 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.278 INFO:teuthology.orchestra.run.smithi067.stdout: "scrape_interval": { 2024-04-25T02:29:50.278 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "scrape_interval", 2024-04-25T02:29:50.278 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-04-25T02:29:50.278 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.278 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.278 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "15.0", 2024-04-25T02:29:50.278 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.279 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.279 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.279 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.279 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.279 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.279 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.279 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.279 INFO:teuthology.orchestra.run.smithi067.stdout: "server_addr": { 2024-04-25T02:29:50.279 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_addr", 2024-04-25T02:29:50.279 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.279 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.279 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.279 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "::", 2024-04-25T02:29:50.279 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.279 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.280 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.280 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-25T02:29:50.280 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.280 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.280 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.280 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.280 INFO:teuthology.orchestra.run.smithi067.stdout: "server_port": { 2024-04-25T02:29:50.280 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_port", 2024-04-25T02:29:50.280 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.280 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.280 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.280 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "9283", 2024-04-25T02:29:50.280 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.280 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.281 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.281 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-25T02:29:50.281 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.281 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.281 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.281 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.281 INFO:teuthology.orchestra.run.smithi067.stdout: "stale_cache_strategy": { 2024-04-25T02:29:50.281 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "stale_cache_strategy", 2024-04-25T02:29:50.281 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.281 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.281 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.281 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "log", 2024-04-25T02:29:50.281 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.281 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.281 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.282 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.282 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.282 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.282 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.282 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.282 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_behaviour": { 2024-04-25T02:29:50.282 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_behaviour", 2024-04-25T02:29:50.282 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.282 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.282 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.282 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "default", 2024-04-25T02:29:50.282 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.282 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.282 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.282 INFO:teuthology.orchestra.run.smithi067.stdout: "default", 2024-04-25T02:29:50.283 INFO:teuthology.orchestra.run.smithi067.stdout: "error" 2024-04-25T02:29:50.283 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.283 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.283 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.283 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.283 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.283 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.283 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_error_status_code": { 2024-04-25T02:29:50.283 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_error_status_code", 2024-04-25T02:29:50.283 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.283 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.283 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.283 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "500", 2024-04-25T02:29:50.283 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "400", 2024-04-25T02:29:50.283 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "599", 2024-04-25T02:29:50.283 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.284 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.284 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.284 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.284 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.284 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.284 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.284 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.284 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.284 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rbd_support", 2024-04-25T02:29:50.284 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.284 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.284 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.284 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.284 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.285 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.285 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.285 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.285 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.285 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.285 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.285 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.285 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.285 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.285 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.285 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.285 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.285 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.286 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.286 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.286 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.286 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.286 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.286 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.286 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.286 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.286 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.286 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.286 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.286 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.286 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.287 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.287 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.287 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.287 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.287 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.287 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.287 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.287 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.287 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.287 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.287 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.287 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.287 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.287 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.288 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.288 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.288 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.288 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.288 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.288 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.288 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.288 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.288 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.288 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.288 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.288 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.288 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.289 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.289 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.289 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.289 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.289 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.289 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.289 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.289 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.289 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.289 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.289 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.289 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.290 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.290 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.290 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.290 INFO:teuthology.orchestra.run.smithi067.stdout: "max_concurrent_snap_create": { 2024-04-25T02:29:50.290 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_concurrent_snap_create", 2024-04-25T02:29:50.290 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.290 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.290 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.290 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-04-25T02:29:50.290 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.290 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.290 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.290 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.291 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.291 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.291 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.291 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.291 INFO:teuthology.orchestra.run.smithi067.stdout: "mirror_snapshot_schedule": { 2024-04-25T02:29:50.291 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mirror_snapshot_schedule", 2024-04-25T02:29:50.291 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.291 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.291 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.291 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.291 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.291 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.291 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.292 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.292 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.292 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.292 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.292 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.292 INFO:teuthology.orchestra.run.smithi067.stdout: "trash_purge_schedule": { 2024-04-25T02:29:50.292 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "trash_purge_schedule", 2024-04-25T02:29:50.292 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.292 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.292 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.292 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.292 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.293 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.293 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.293 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.293 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.293 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.293 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.293 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.293 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.293 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.293 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.293 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "restful", 2024-04-25T02:29:50.293 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.293 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.293 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.294 INFO:teuthology.orchestra.run.smithi067.stdout: "enable_auth": { 2024-04-25T02:29:50.294 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enable_auth", 2024-04-25T02:29:50.294 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.294 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.294 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.294 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.294 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.294 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.294 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.294 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.294 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.294 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.295 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.295 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.295 INFO:teuthology.orchestra.run.smithi067.stdout: "key_file": { 2024-04-25T02:29:50.295 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "key_file", 2024-04-25T02:29:50.295 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.295 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.295 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.295 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.295 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.295 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.295 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.295 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.295 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.295 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.296 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.296 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.296 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.296 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.296 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.296 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.296 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.296 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.296 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.296 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.296 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.296 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.296 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.296 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.297 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.297 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.297 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.297 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.297 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.297 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.297 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.297 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.297 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.297 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.297 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.297 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.297 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.297 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.298 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.298 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.298 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.298 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.298 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.298 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.298 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.298 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.298 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.298 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.298 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.298 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.298 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.299 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.299 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.299 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.299 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.299 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.299 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.299 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.299 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.299 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.299 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.299 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.299 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.299 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.299 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.300 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.300 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.300 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.300 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.300 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.300 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.300 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.300 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.300 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.300 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.300 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.300 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.300 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.301 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.301 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.301 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.301 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.301 INFO:teuthology.orchestra.run.smithi067.stdout: "server_addr": { 2024-04-25T02:29:50.301 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_addr", 2024-04-25T02:29:50.301 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.301 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.301 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.301 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.301 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.302 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.302 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.302 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.302 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.302 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.302 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.302 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.302 INFO:teuthology.orchestra.run.smithi067.stdout: "server_port": { 2024-04-25T02:29:50.302 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_port", 2024-04-25T02:29:50.302 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.302 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.303 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.303 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.303 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.303 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.303 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.303 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.303 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.303 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.303 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.303 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.303 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.303 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.303 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.303 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rgw", 2024-04-25T02:29:50.303 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.304 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.304 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.304 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.304 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.304 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.304 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.304 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.304 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.304 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.304 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.304 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.304 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.304 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.304 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.304 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.305 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.305 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.305 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.305 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.305 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.305 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.305 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.305 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.305 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.305 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.305 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.305 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.305 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.305 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.306 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.306 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.306 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.306 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.306 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.306 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.306 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.306 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.306 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.306 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.306 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.306 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.306 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.306 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.307 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.307 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.307 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.307 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.307 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.307 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.307 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.307 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.307 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.307 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.307 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.307 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.307 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.307 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.307 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.308 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.308 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.308 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.308 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.308 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.308 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.308 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.308 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.308 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.308 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.308 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.308 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.308 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.308 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.309 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.309 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.309 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.309 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rook", 2024-04-25T02:29:50.309 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.309 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.309 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.309 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.309 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.309 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.309 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.309 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.309 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.309 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.310 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.310 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.310 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.310 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.310 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.310 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.310 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.310 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.310 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.310 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.310 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.310 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.310 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.310 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.311 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.311 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.311 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.311 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.311 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.311 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.311 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.311 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.311 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.311 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.311 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.311 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.311 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.311 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.311 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.312 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.312 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.312 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.312 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.312 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.312 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.312 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.312 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.312 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.312 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.312 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.312 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.312 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.312 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.312 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.313 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.313 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.313 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.313 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.313 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.313 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.313 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.313 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.313 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.313 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.313 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.313 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.313 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.313 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.314 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.314 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.314 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.314 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.314 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.314 INFO:teuthology.orchestra.run.smithi067.stdout: "storage_class": { 2024-04-25T02:29:50.314 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "storage_class", 2024-04-25T02:29:50.314 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.314 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.314 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.314 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "local", 2024-04-25T02:29:50.314 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.314 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.314 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.315 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-25T02:29:50.315 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.315 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.315 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.315 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.315 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.315 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.315 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.315 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "selftest", 2024-04-25T02:29:50.315 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.315 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.315 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.315 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.316 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.316 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.316 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.316 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.316 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.316 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.316 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.316 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.316 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.316 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.316 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.316 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.316 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.316 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.317 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.317 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.317 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.317 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.317 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.317 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.317 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.317 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.317 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.317 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.317 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.317 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.317 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.317 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.318 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.318 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.318 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.318 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.318 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.318 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.318 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.318 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.318 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.318 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.318 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.318 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.318 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.318 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.319 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.319 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.319 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.319 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.319 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.319 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.319 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.319 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.319 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.319 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.319 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.319 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.319 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.320 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.320 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.320 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.320 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.320 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.320 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.320 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.320 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.320 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.320 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.320 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.320 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.320 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.320 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.320 INFO:teuthology.orchestra.run.smithi067.stdout: "roption1": { 2024-04-25T02:29:50.321 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "roption1", 2024-04-25T02:29:50.321 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.321 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.321 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.321 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.321 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.321 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.321 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.321 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.321 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.321 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.321 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.321 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.321 INFO:teuthology.orchestra.run.smithi067.stdout: "roption2": { 2024-04-25T02:29:50.321 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "roption2", 2024-04-25T02:29:50.322 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.322 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.322 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.322 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "xyz", 2024-04-25T02:29:50.322 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.322 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.322 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.322 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.322 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.322 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.322 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.322 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.322 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption1": { 2024-04-25T02:29:50.322 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption1", 2024-04-25T02:29:50.323 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.323 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.323 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.323 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.323 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.323 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.323 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.323 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.323 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.323 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.323 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.323 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.323 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption2": { 2024-04-25T02:29:50.323 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption2", 2024-04-25T02:29:50.324 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.324 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.324 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.324 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.324 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.324 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.324 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.324 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.324 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.324 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.324 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.324 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.324 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption3": { 2024-04-25T02:29:50.324 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption3", 2024-04-25T02:29:50.325 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-04-25T02:29:50.325 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.325 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.325 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.325 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.325 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.325 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.325 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.325 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.325 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.325 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.325 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.325 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption4": { 2024-04-25T02:29:50.325 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption4", 2024-04-25T02:29:50.326 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.326 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.326 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.326 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.326 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.326 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.326 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.326 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.326 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.326 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.326 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.326 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.326 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption5": { 2024-04-25T02:29:50.326 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption5", 2024-04-25T02:29:50.327 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.327 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.327 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.327 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.327 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.327 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.327 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.327 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.327 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.327 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.327 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.327 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.327 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption6": { 2024-04-25T02:29:50.327 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption6", 2024-04-25T02:29:50.328 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.328 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.328 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.328 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.328 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.328 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.328 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.328 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.328 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.328 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.328 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.328 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.328 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption7": { 2024-04-25T02:29:50.328 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption7", 2024-04-25T02:29:50.328 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.329 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.329 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.329 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.329 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-04-25T02:29:50.329 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "42", 2024-04-25T02:29:50.329 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.329 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.329 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.329 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.329 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.329 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.329 INFO:teuthology.orchestra.run.smithi067.stdout: "testkey": { 2024-04-25T02:29:50.329 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "testkey", 2024-04-25T02:29:50.329 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.330 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.330 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.330 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.330 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.330 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.330 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.330 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.330 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.330 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.330 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.330 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.330 INFO:teuthology.orchestra.run.smithi067.stdout: "testlkey": { 2024-04-25T02:29:50.330 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "testlkey", 2024-04-25T02:29:50.330 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.331 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.331 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.331 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.331 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.331 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.331 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.331 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.331 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.331 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.331 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.331 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.331 INFO:teuthology.orchestra.run.smithi067.stdout: "testnewline": { 2024-04-25T02:29:50.331 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "testnewline", 2024-04-25T02:29:50.331 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.331 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.332 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.332 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.332 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.332 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.332 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.332 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.332 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.332 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.332 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.332 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.332 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.332 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.332 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.332 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "snap_schedule", 2024-04-25T02:29:50.332 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.333 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.333 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.333 INFO:teuthology.orchestra.run.smithi067.stdout: "allow_m_granularity": { 2024-04-25T02:29:50.333 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "allow_m_granularity", 2024-04-25T02:29:50.333 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.333 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.333 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.333 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.333 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.333 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.333 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.333 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "allow minute scheduled snapshots", 2024-04-25T02:29:50.333 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.333 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.334 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.334 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.334 INFO:teuthology.orchestra.run.smithi067.stdout: "dump_on_update": { 2024-04-25T02:29:50.334 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "dump_on_update", 2024-04-25T02:29:50.334 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.334 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.334 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.334 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.334 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.334 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.334 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.334 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "dump database to debug log on update", 2024-04-25T02:29:50.334 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.334 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.335 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.335 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.335 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.335 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.335 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.335 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.335 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.335 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.335 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.335 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.335 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.335 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.335 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.335 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.335 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.336 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.336 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.336 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.336 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.336 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.336 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.336 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.336 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.336 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.336 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.336 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.336 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.336 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.336 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.337 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.337 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.337 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.337 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.337 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.337 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.337 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.337 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.337 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.337 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.337 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.337 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.337 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.337 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.337 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.338 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.338 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.338 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.338 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.338 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.338 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.338 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.338 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.338 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.338 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.338 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.338 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.338 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.338 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.339 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.339 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.339 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.339 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.339 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.339 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.339 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.339 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.339 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.339 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.339 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.339 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.339 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.339 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.340 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.340 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.340 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.340 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "stats", 2024-04-25T02:29:50.340 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.340 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.340 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.340 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.340 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.340 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.340 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.340 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.340 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.340 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.340 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.341 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.341 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.341 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.341 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.341 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.341 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.341 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.341 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.341 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.341 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.341 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.341 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.341 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.341 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.342 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.342 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.342 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.342 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.342 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.342 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.342 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.342 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.342 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.342 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.342 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.342 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.342 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.342 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.343 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.343 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.343 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.343 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.343 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.343 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.343 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.343 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.343 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.343 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.343 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.343 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.343 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.343 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.344 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.344 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.344 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.344 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.344 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.344 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.344 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.344 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.344 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.344 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.344 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.344 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.345 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.345 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.345 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.345 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.345 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.345 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.345 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.345 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.345 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.345 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.345 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.345 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "status", 2024-04-25T02:29:50.345 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.345 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.346 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.346 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.346 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.346 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.346 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.346 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.346 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.346 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.346 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.346 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.346 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.346 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.346 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.346 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.347 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.347 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.347 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.347 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.347 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.347 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.347 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.347 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.347 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.347 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.347 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.347 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.347 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.347 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.348 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.348 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.348 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.348 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.348 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.348 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.348 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.348 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.348 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.348 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.348 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.348 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.348 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.348 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.349 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.349 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.349 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.349 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.349 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.349 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.349 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.349 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.349 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.349 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.349 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.349 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.349 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.349 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.349 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.350 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.350 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.350 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.350 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.350 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.350 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.350 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.350 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.350 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.350 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.350 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.350 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.350 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.350 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.351 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.351 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.351 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.351 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "telegraf", 2024-04-25T02:29:50.351 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.351 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.351 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.351 INFO:teuthology.orchestra.run.smithi067.stdout: "address": { 2024-04-25T02:29:50.351 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "address", 2024-04-25T02:29:50.351 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.351 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.351 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.351 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-25T02:29:50.352 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.352 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.352 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.352 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.352 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.352 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.352 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.352 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.352 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-04-25T02:29:50.352 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-04-25T02:29:50.352 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.352 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.352 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.352 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "15", 2024-04-25T02:29:50.352 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.353 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.353 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.353 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.353 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.353 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.353 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.353 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.353 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.353 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.353 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.353 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.353 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.353 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.353 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.354 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.354 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.354 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.354 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.354 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.354 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.354 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.354 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.354 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.354 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.354 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.354 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.354 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.355 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.355 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.355 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.355 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.355 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.355 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.355 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.355 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.355 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.355 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.355 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.355 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.355 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.355 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.355 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.355 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.356 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.356 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.356 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.356 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.356 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.356 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.356 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.356 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.356 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.356 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.356 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.356 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.356 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.356 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.357 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.357 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.357 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.357 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.357 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.357 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.357 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.357 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.357 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.357 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.357 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.357 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.357 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.357 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.358 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.358 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.358 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.358 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.358 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.358 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.358 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.358 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.358 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.358 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "telemetry", 2024-04-25T02:29:50.358 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.358 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.358 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.359 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_basic": { 2024-04-25T02:29:50.359 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_basic", 2024-04-25T02:29:50.359 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.359 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.359 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.359 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.359 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.359 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.359 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.359 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-25T02:29:50.359 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.359 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.359 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.359 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.359 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_crash": { 2024-04-25T02:29:50.360 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_crash", 2024-04-25T02:29:50.360 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.360 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.360 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.360 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.360 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.360 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.360 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.360 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-25T02:29:50.360 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.360 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.360 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.360 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.361 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_device": { 2024-04-25T02:29:50.361 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_device", 2024-04-25T02:29:50.361 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.361 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.361 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.361 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.361 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.361 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.361 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.361 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-25T02:29:50.361 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.361 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.361 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.361 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.362 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_ident": { 2024-04-25T02:29:50.362 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_ident", 2024-04-25T02:29:50.362 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.362 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.362 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.362 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.362 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.362 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.362 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.362 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-25T02:29:50.362 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.362 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.362 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.362 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.363 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_perf": { 2024-04-25T02:29:50.363 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_perf", 2024-04-25T02:29:50.363 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.363 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.363 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.363 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.363 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.363 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.363 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.363 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-25T02:29:50.363 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.363 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.363 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.363 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.363 INFO:teuthology.orchestra.run.smithi067.stdout: "contact": { 2024-04-25T02:29:50.364 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "contact", 2024-04-25T02:29:50.364 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.364 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.364 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.364 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.364 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.364 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.364 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.364 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.364 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.364 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.364 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.364 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.364 INFO:teuthology.orchestra.run.smithi067.stdout: "description": { 2024-04-25T02:29:50.365 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "description", 2024-04-25T02:29:50.365 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.365 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.365 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.365 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.365 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.365 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.365 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.365 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.365 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.365 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.365 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.365 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.365 INFO:teuthology.orchestra.run.smithi067.stdout: "device_url": { 2024-04-25T02:29:50.365 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "device_url", 2024-04-25T02:29:50.366 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.366 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.366 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.366 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-25T02:29:50.366 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.366 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.366 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.366 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.366 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.366 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.366 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.366 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.366 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": { 2024-04-25T02:29:50.367 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enabled", 2024-04-25T02:29:50.367 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.367 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.367 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.367 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.367 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.367 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.367 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.367 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.367 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.367 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.367 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.367 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.367 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-04-25T02:29:50.368 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-04-25T02:29:50.368 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.368 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.368 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.368 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "24", 2024-04-25T02:29:50.368 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "8", 2024-04-25T02:29:50.368 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.368 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.368 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.368 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.368 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.368 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.368 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.368 INFO:teuthology.orchestra.run.smithi067.stdout: "last_opt_revision": { 2024-04-25T02:29:50.368 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "last_opt_revision", 2024-04-25T02:29:50.369 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.369 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.369 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.369 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "1", 2024-04-25T02:29:50.369 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.369 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.369 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.369 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.369 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.369 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.369 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.369 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.369 INFO:teuthology.orchestra.run.smithi067.stdout: "leaderboard": { 2024-04-25T02:29:50.369 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "leaderboard", 2024-04-25T02:29:50.369 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.370 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.370 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.370 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.370 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.370 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.370 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.370 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.370 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.370 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.370 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.370 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.370 INFO:teuthology.orchestra.run.smithi067.stdout: "leaderboard_description": { 2024-04-25T02:29:50.370 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "leaderboard_description", 2024-04-25T02:29:50.370 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.371 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.371 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.371 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.371 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.371 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.371 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.371 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.371 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.371 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.371 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.371 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.371 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.371 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.371 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.371 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.372 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.372 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.372 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.372 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.372 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.372 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.372 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.372 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.372 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.372 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.372 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.372 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.372 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.372 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.372 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.373 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.373 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.373 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.373 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.373 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.373 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.373 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.373 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.373 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.373 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.373 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.373 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.373 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.373 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.374 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.374 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.374 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.374 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.374 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.374 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.374 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.374 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.374 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.374 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.374 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.374 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.374 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.374 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.374 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.375 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.375 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.375 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.375 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.375 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.375 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.375 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.375 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.375 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.375 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.375 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.375 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.375 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.375 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.376 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.376 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.376 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.376 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.376 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.376 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.376 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.376 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.376 INFO:teuthology.orchestra.run.smithi067.stdout: "organization": { 2024-04-25T02:29:50.376 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "organization", 2024-04-25T02:29:50.376 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.376 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.376 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.376 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.376 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.377 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.377 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.377 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.377 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.377 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.377 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.377 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.377 INFO:teuthology.orchestra.run.smithi067.stdout: "proxy": { 2024-04-25T02:29:50.377 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "proxy", 2024-04-25T02:29:50.377 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.377 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.377 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.377 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.377 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.378 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.378 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.378 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.378 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.378 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.378 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.378 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.378 INFO:teuthology.orchestra.run.smithi067.stdout: "url": { 2024-04-25T02:29:50.378 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "url", 2024-04-25T02:29:50.378 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.378 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.378 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.378 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-25T02:29:50.378 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.379 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.379 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.379 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.379 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.379 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.379 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.379 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.379 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.379 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.379 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.379 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "test_orchestrator", 2024-04-25T02:29:50.379 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.379 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.379 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.379 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.380 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.380 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.380 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.380 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.380 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.380 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.380 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.380 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.380 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.380 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.380 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.380 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.380 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.380 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.380 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.381 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.381 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.381 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.381 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.381 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.381 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.381 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.381 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.381 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.381 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.381 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.381 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.381 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.381 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.382 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.382 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.382 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.382 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.382 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.382 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.382 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.382 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.382 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.382 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.382 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.382 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.382 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.382 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.382 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.383 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.383 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.383 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.383 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.383 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.383 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.383 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.383 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.383 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.383 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.383 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.383 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.383 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.383 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.383 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.384 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.384 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.384 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.384 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.384 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.384 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.384 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.384 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.384 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.384 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.384 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.384 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.384 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.384 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "volumes", 2024-04-25T02:29:50.385 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.385 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.385 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.385 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.385 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.385 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.385 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.385 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.385 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.385 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.385 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.385 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.385 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.385 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.385 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.386 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.386 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.386 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.386 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.386 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.386 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.386 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.386 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.386 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.386 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.386 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.386 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.386 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.386 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.386 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.387 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.387 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.387 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.387 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.387 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.387 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.387 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.387 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.387 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.387 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.387 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.387 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.387 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.387 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.388 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.388 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.388 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.388 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.388 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.388 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.388 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.388 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.388 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.388 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.388 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.388 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.388 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.388 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.389 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.389 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.389 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.389 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.389 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.389 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.389 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.389 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.389 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.389 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.389 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.389 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.389 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.389 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.390 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.390 INFO:teuthology.orchestra.run.smithi067.stdout: "max_concurrent_clones": { 2024-04-25T02:29:50.390 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_concurrent_clones", 2024-04-25T02:29:50.390 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.390 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.390 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.390 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "4", 2024-04-25T02:29:50.390 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.390 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.390 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.390 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-25T02:29:50.390 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.390 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.390 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.391 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.391 INFO:teuthology.orchestra.run.smithi067.stdout: "periodic_async_work": { 2024-04-25T02:29:50.391 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "periodic_async_work", 2024-04-25T02:29:50.391 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.391 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.391 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.391 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.391 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.391 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.391 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.391 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Periodically check for async work", 2024-04-25T02:29:50.391 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.391 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.391 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.391 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.392 INFO:teuthology.orchestra.run.smithi067.stdout: "snapshot_clone_delay": { 2024-04-25T02:29:50.392 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "snapshot_clone_delay", 2024-04-25T02:29:50.392 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.392 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.392 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.392 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-04-25T02:29:50.392 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.392 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.392 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.392 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-25T02:29:50.392 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.392 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.392 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.392 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.392 INFO:teuthology.orchestra.run.smithi067.stdout: "snapshot_clone_no_wait": { 2024-04-25T02:29:50.393 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "snapshot_clone_no_wait", 2024-04-25T02:29:50.393 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.393 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.393 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.393 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-04-25T02:29:50.393 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.393 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.393 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.393 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-25T02:29:50.393 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.393 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.393 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.393 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.393 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.393 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.394 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.394 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix", 2024-04-25T02:29:50.394 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-04-25T02:29:50.394 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-04-25T02:29:50.394 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-04-25T02:29:50.394 INFO:teuthology.orchestra.run.smithi067.stdout: "discovery_interval": { 2024-04-25T02:29:50.394 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "discovery_interval", 2024-04-25T02:29:50.394 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-04-25T02:29:50.394 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.394 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.394 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "100", 2024-04-25T02:29:50.394 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.394 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.394 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.395 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.395 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.395 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.395 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.395 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.395 INFO:teuthology.orchestra.run.smithi067.stdout: "identifier": { 2024-04-25T02:29:50.395 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "identifier", 2024-04-25T02:29:50.395 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.395 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.395 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.395 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.395 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.395 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.395 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.395 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.396 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.396 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.396 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.396 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.396 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-04-25T02:29:50.396 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-04-25T02:29:50.396 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-04-25T02:29:50.396 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.396 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.396 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-04-25T02:29:50.396 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.396 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.396 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.396 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.397 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.397 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.397 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.397 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.397 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-04-25T02:29:50.397 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-04-25T02:29:50.397 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.397 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.397 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.397 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.397 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.397 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.397 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.397 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.398 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.398 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.398 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.398 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.398 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.398 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.398 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.398 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.398 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.398 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.398 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.398 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-04-25T02:29:50.398 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-04-25T02:29:50.398 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.399 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.399 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.399 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.399 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.399 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.399 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.399 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.399 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.399 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.399 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.399 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.399 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-04-25T02:29:50.399 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-04-25T02:29:50.399 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.399 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.400 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.400 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-04-25T02:29:50.400 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.400 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.400 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-04-25T02:29:50.400 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-04-25T02:29:50.400 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-04-25T02:29:50.400 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-04-25T02:29:50.400 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-04-25T02:29:50.400 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-04-25T02:29:50.400 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-04-25T02:29:50.400 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.400 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.401 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.401 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.401 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.401 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.401 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-04-25T02:29:50.401 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-04-25T02:29:50.401 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-04-25T02:29:50.401 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.401 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-04-25T02:29:50.401 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-04-25T02:29:50.401 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.401 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.401 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.402 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.402 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.402 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.402 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.402 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.402 INFO:teuthology.orchestra.run.smithi067.stdout: "zabbix_host": { 2024-04-25T02:29:50.402 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix_host", 2024-04-25T02:29:50.402 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.402 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.402 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.402 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-04-25T02:29:50.402 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.402 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.402 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.403 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.403 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.403 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.403 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.403 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.403 INFO:teuthology.orchestra.run.smithi067.stdout: "zabbix_port": { 2024-04-25T02:29:50.403 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix_port", 2024-04-25T02:29:50.403 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-04-25T02:29:50.403 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.403 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.403 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10051", 2024-04-25T02:29:50.403 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.403 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.403 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.404 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.404 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.404 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.404 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.404 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.404 INFO:teuthology.orchestra.run.smithi067.stdout: "zabbix_sender": { 2024-04-25T02:29:50.404 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix_sender", 2024-04-25T02:29:50.404 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-04-25T02:29:50.404 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-04-25T02:29:50.404 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-04-25T02:29:50.404 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-25T02:29:50.404 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-04-25T02:29:50.404 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-04-25T02:29:50.404 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-04-25T02:29:50.404 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-04-25T02:29:50.405 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-04-25T02:29:50.405 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-04-25T02:29:50.405 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-04-25T02:29:50.405 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.405 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.405 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.405 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.405 INFO:teuthology.orchestra.run.smithi067.stdout: "services": {}, 2024-04-25T02:29:50.405 INFO:teuthology.orchestra.run.smithi067.stdout: "always_on_modules": { 2024-04-25T02:29:50.405 INFO:teuthology.orchestra.run.smithi067.stdout: "octopus": [ 2024-04-25T02:29:50.405 INFO:teuthology.orchestra.run.smithi067.stdout: "balancer", 2024-04-25T02:29:50.405 INFO:teuthology.orchestra.run.smithi067.stdout: "crash", 2024-04-25T02:29:50.405 INFO:teuthology.orchestra.run.smithi067.stdout: "devicehealth", 2024-04-25T02:29:50.406 INFO:teuthology.orchestra.run.smithi067.stdout: "orchestrator", 2024-04-25T02:29:50.406 INFO:teuthology.orchestra.run.smithi067.stdout: "pg_autoscaler", 2024-04-25T02:29:50.406 INFO:teuthology.orchestra.run.smithi067.stdout: "progress", 2024-04-25T02:29:50.406 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_support", 2024-04-25T02:29:50.406 INFO:teuthology.orchestra.run.smithi067.stdout: "status", 2024-04-25T02:29:50.406 INFO:teuthology.orchestra.run.smithi067.stdout: "telemetry", 2024-04-25T02:29:50.406 INFO:teuthology.orchestra.run.smithi067.stdout: "volumes" 2024-04-25T02:29:50.406 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.406 INFO:teuthology.orchestra.run.smithi067.stdout: "pacific": [ 2024-04-25T02:29:50.406 INFO:teuthology.orchestra.run.smithi067.stdout: "balancer", 2024-04-25T02:29:50.406 INFO:teuthology.orchestra.run.smithi067.stdout: "crash", 2024-04-25T02:29:50.406 INFO:teuthology.orchestra.run.smithi067.stdout: "devicehealth", 2024-04-25T02:29:50.406 INFO:teuthology.orchestra.run.smithi067.stdout: "orchestrator", 2024-04-25T02:29:50.406 INFO:teuthology.orchestra.run.smithi067.stdout: "pg_autoscaler", 2024-04-25T02:29:50.407 INFO:teuthology.orchestra.run.smithi067.stdout: "progress", 2024-04-25T02:29:50.407 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_support", 2024-04-25T02:29:50.407 INFO:teuthology.orchestra.run.smithi067.stdout: "status", 2024-04-25T02:29:50.407 INFO:teuthology.orchestra.run.smithi067.stdout: "telemetry", 2024-04-25T02:29:50.407 INFO:teuthology.orchestra.run.smithi067.stdout: "volumes" 2024-04-25T02:29:50.407 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.407 INFO:teuthology.orchestra.run.smithi067.stdout: "quincy": [ 2024-04-25T02:29:50.407 INFO:teuthology.orchestra.run.smithi067.stdout: "balancer", 2024-04-25T02:29:50.407 INFO:teuthology.orchestra.run.smithi067.stdout: "crash", 2024-04-25T02:29:50.407 INFO:teuthology.orchestra.run.smithi067.stdout: "devicehealth", 2024-04-25T02:29:50.407 INFO:teuthology.orchestra.run.smithi067.stdout: "orchestrator", 2024-04-25T02:29:50.407 INFO:teuthology.orchestra.run.smithi067.stdout: "pg_autoscaler", 2024-04-25T02:29:50.407 INFO:teuthology.orchestra.run.smithi067.stdout: "progress", 2024-04-25T02:29:50.408 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_support", 2024-04-25T02:29:50.408 INFO:teuthology.orchestra.run.smithi067.stdout: "status", 2024-04-25T02:29:50.408 INFO:teuthology.orchestra.run.smithi067.stdout: "telemetry", 2024-04-25T02:29:50.408 INFO:teuthology.orchestra.run.smithi067.stdout: "volumes" 2024-04-25T02:29:50.408 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.408 INFO:teuthology.orchestra.run.smithi067.stdout: "reef": [ 2024-04-25T02:29:50.408 INFO:teuthology.orchestra.run.smithi067.stdout: "balancer", 2024-04-25T02:29:50.408 INFO:teuthology.orchestra.run.smithi067.stdout: "crash", 2024-04-25T02:29:50.408 INFO:teuthology.orchestra.run.smithi067.stdout: "devicehealth", 2024-04-25T02:29:50.408 INFO:teuthology.orchestra.run.smithi067.stdout: "orchestrator", 2024-04-25T02:29:50.408 INFO:teuthology.orchestra.run.smithi067.stdout: "pg_autoscaler", 2024-04-25T02:29:50.408 INFO:teuthology.orchestra.run.smithi067.stdout: "progress", 2024-04-25T02:29:50.408 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_support", 2024-04-25T02:29:50.408 INFO:teuthology.orchestra.run.smithi067.stdout: "status", 2024-04-25T02:29:50.408 INFO:teuthology.orchestra.run.smithi067.stdout: "telemetry", 2024-04-25T02:29:50.409 INFO:teuthology.orchestra.run.smithi067.stdout: "volumes" 2024-04-25T02:29:50.409 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-04-25T02:29:50.409 INFO:teuthology.orchestra.run.smithi067.stdout: "squid": [ 2024-04-25T02:29:50.409 INFO:teuthology.orchestra.run.smithi067.stdout: "balancer", 2024-04-25T02:29:50.409 INFO:teuthology.orchestra.run.smithi067.stdout: "crash", 2024-04-25T02:29:50.409 INFO:teuthology.orchestra.run.smithi067.stdout: "devicehealth", 2024-04-25T02:29:50.409 INFO:teuthology.orchestra.run.smithi067.stdout: "orchestrator", 2024-04-25T02:29:50.409 INFO:teuthology.orchestra.run.smithi067.stdout: "pg_autoscaler", 2024-04-25T02:29:50.409 INFO:teuthology.orchestra.run.smithi067.stdout: "progress", 2024-04-25T02:29:50.409 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_support", 2024-04-25T02:29:50.409 INFO:teuthology.orchestra.run.smithi067.stdout: "status", 2024-04-25T02:29:50.409 INFO:teuthology.orchestra.run.smithi067.stdout: "telemetry", 2024-04-25T02:29:50.409 INFO:teuthology.orchestra.run.smithi067.stdout: "volumes" 2024-04-25T02:29:50.410 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-04-25T02:29:50.410 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.410 INFO:teuthology.orchestra.run.smithi067.stdout: "last_failure_osd_epoch": 0, 2024-04-25T02:29:50.410 INFO:teuthology.orchestra.run.smithi067.stdout: "active_clients": [ 2024-04-25T02:29:50.410 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.410 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "devicehealth", 2024-04-25T02:29:50.410 INFO:teuthology.orchestra.run.smithi067.stdout: "addrvec": [ 2024-04-25T02:29:50.410 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.410 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v2", 2024-04-25T02:29:50.410 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "172.21.15.176:0", 2024-04-25T02:29:50.410 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 1653669402 2024-04-25T02:29:50.410 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.410 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-04-25T02:29:50.410 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.411 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.411 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "libcephsqlite", 2024-04-25T02:29:50.411 INFO:teuthology.orchestra.run.smithi067.stdout: "addrvec": [ 2024-04-25T02:29:50.411 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.411 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v2", 2024-04-25T02:29:50.411 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "172.21.15.176:0", 2024-04-25T02:29:50.411 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 80674820 2024-04-25T02:29:50.411 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.411 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-04-25T02:29:50.411 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.411 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.411 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rbd_support", 2024-04-25T02:29:50.411 INFO:teuthology.orchestra.run.smithi067.stdout: "addrvec": [ 2024-04-25T02:29:50.411 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.412 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v2", 2024-04-25T02:29:50.412 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "172.21.15.176:0", 2024-04-25T02:29:50.412 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 3235069821 2024-04-25T02:29:50.412 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.412 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-04-25T02:29:50.412 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.412 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.412 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "volumes", 2024-04-25T02:29:50.412 INFO:teuthology.orchestra.run.smithi067.stdout: "addrvec": [ 2024-04-25T02:29:50.412 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.412 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v2", 2024-04-25T02:29:50.412 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "172.21.15.176:0", 2024-04-25T02:29:50.412 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 3703719612 2024-04-25T02:29:50.412 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.412 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-04-25T02:29:50.413 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.413 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.413 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "volumes", 2024-04-25T02:29:50.413 INFO:teuthology.orchestra.run.smithi067.stdout: "addrvec": [ 2024-04-25T02:29:50.413 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.413 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v2", 2024-04-25T02:29:50.413 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "172.21.15.176:0", 2024-04-25T02:29:50.413 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 2820869940 2024-04-25T02:29:50.413 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.413 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-04-25T02:29:50.413 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.413 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.413 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "volumes", 2024-04-25T02:29:50.413 INFO:teuthology.orchestra.run.smithi067.stdout: "addrvec": [ 2024-04-25T02:29:50.413 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.414 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v2", 2024-04-25T02:29:50.414 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "172.21.15.176:0", 2024-04-25T02:29:50.414 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 582062950 2024-04-25T02:29:50.414 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.414 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-04-25T02:29:50.414 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-25T02:29:50.414 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.414 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "volumes", 2024-04-25T02:29:50.414 INFO:teuthology.orchestra.run.smithi067.stdout: "addrvec": [ 2024-04-25T02:29:50.414 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-25T02:29:50.414 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v2", 2024-04-25T02:29:50.414 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "172.21.15.176:0", 2024-04-25T02:29:50.414 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 3007617949 2024-04-25T02:29:50.415 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.415 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-04-25T02:29:50.415 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-25T02:29:50.415 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-04-25T02:29:50.415 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-25T02:29:50.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.559+0000 7f4dfc012640 1 -- 172.21.15.67:0/1137846641 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f4de006bfe0 msgr2=0x7f4de006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:50.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.559+0000 7f4dfc012640 1 --2- 172.21.15.67:0/1137846641 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f4de006bfe0 0x7f4de006e4a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4dec005880 tx=0x7f4dec009040 comp rx=0 tx=0).stop 2024-04-25T02:29:50.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.559+0000 7f4dfc012640 1 -- 172.21.15.67:0/1137846641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4df40af120 msgr2=0x7f4df4158b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.559+0000 7f4dfc012640 1 --2- 172.21.15.67:0/1137846641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4df40af120 0x7f4df4158b90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4de800ebe0 tx=0x7f4de800c520 comp rx=0 tx=0).stop 2024-04-25T02:29:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.560+0000 7f4dfc012640 1 -- 172.21.15.67:0/1137846641 shutdown_connections 2024-04-25T02:29:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.560+0000 7f4dfc012640 1 --2- 172.21.15.67:0/1137846641 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f4de006bfe0 0x7f4de006e4a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.560+0000 7f4dfc012640 1 --2- 172.21.15.67:0/1137846641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4df415c230 0x7f4df40c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.560+0000 7f4dfc012640 1 --2- 172.21.15.67:0/1137846641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4df40af120 0x7f4df4158b90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.560+0000 7f4dfc012640 1 --2- 172.21.15.67:0/1137846641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4df40acda0 0x7f4df414fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.560+0000 7f4dfc012640 1 -- 172.21.15.67:0/1137846641 >> 172.21.15.67:0/1137846641 conn(0x7f4df40b19c0 msgr2=0x7f4df406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.560+0000 7f4dfc012640 1 -- 172.21.15.67:0/1137846641 shutdown_connections 2024-04-25T02:29:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:49.560+0000 7f4dfc012640 1 -- 172.21.15.67:0/1137846641 wait complete. 2024-04-25T02:29:50.421 DEBUG:tasks.check_counter:Getting stats from x 2024-04-25T02:29:50.421 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mgr.x.asok perf dump 2024-04-25T02:29:50.529 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-04-25T02:29:50.530 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T02:29:50.530 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 286, 2024-04-25T02:29:50.530 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 111, 2024-04-25T02:29:50.530 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 3078816, 2024-04-25T02:29:50.530 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 23008, 2024-04-25T02:29:50.530 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 67, 2024-04-25T02:29:50.530 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 17, 2024-04-25T02:29:50.530 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.055394293, 2024-04-25T02:29:50.530 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.002899437, 2024-04-25T02:29:50.530 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.048615387, 2024-04-25T02:29:50.530 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T02:29:50.530 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:29:50.531 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 93, 2024-04-25T02:29:50.531 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.212868704, 2024-04-25T02:29:50.531 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.002288910 2024-04-25T02:29:50.531 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.531 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:29:50.531 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 73, 2024-04-25T02:29:50.531 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000010887, 2024-04-25T02:29:50.531 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000149 2024-04-25T02:29:50.531 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.531 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 3078816, 2024-04-25T02:29:50.531 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 23008 2024-04-25T02:29:50.531 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.531 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T02:29:50.531 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 707, 2024-04-25T02:29:50.532 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 485, 2024-04-25T02:29:50.532 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 3799984, 2024-04-25T02:29:50.532 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 3323459, 2024-04-25T02:29:50.532 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 123, 2024-04-25T02:29:50.532 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 22, 2024-04-25T02:29:50.532 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.124150366, 2024-04-25T02:29:50.532 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.030472275, 2024-04-25T02:29:50.532 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.119656195, 2024-04-25T02:29:50.532 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.000062724, 2024-04-25T02:29:50.532 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:29:50.532 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 470, 2024-04-25T02:29:50.532 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.231760204, 2024-04-25T02:29:50.532 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000493106 2024-04-25T02:29:50.532 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.532 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:29:50.533 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 285, 2024-04-25T02:29:50.533 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000035561, 2024-04-25T02:29:50.533 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000124 2024-04-25T02:29:50.533 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.533 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 3799984, 2024-04-25T02:29:50.533 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 3323328 2024-04-25T02:29:50.533 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.533 INFO:teuthology.orchestra.run.smithi176.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T02:29:50.533 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_messages": 471, 2024-04-25T02:29:50.533 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages": 317, 2024-04-25T02:29:50.533 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_bytes": 2300960, 2024-04-25T02:29:50.533 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_bytes": 3046592, 2024-04-25T02:29:50.533 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_created_connections": 150, 2024-04-25T02:29:50.533 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_active_connections": 19, 2024-04-25T02:29:50.533 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_total_time": 0.088704481, 2024-04-25T02:29:50.534 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_send_time": 0.010317552, 2024-04-25T02:29:50.534 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_recv_time": 0.080390045, 2024-04-25T02:29:50.534 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_running_fast_dispatch_time": 0.002850761, 2024-04-25T02:29:50.534 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:29:50.534 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 303, 2024-04-25T02:29:50.534 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.016710890, 2024-04-25T02:29:50.534 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000055151 2024-04-25T02:29:50.534 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.534 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:29:50.534 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 141, 2024-04-25T02:29:50.534 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000017753, 2024-04-25T02:29:50.534 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000125 2024-04-25T02:29:50.534 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.534 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_recv_encrypted_bytes": 2300960, 2024-04-25T02:29:50.534 INFO:teuthology.orchestra.run.smithi176.stdout: "msgr_send_encrypted_bytes": 3046592 2024-04-25T02:29:50.535 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.535 INFO:teuthology.orchestra.run.smithi176.stdout: "cct": { 2024-04-25T02:29:50.535 INFO:teuthology.orchestra.run.smithi176.stdout: "total_workers": 0, 2024-04-25T02:29:50.535 INFO:teuthology.orchestra.run.smithi176.stdout: "unhealthy_workers": 0 2024-04-25T02:29:50.535 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.535 INFO:teuthology.orchestra.run.smithi176.stdout: "client": { 2024-04-25T02:29:50.535 INFO:teuthology.orchestra.run.smithi176.stdout: "reply": { 2024-04-25T02:29:50.535 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.535 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.535 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.535 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.535 INFO:teuthology.orchestra.run.smithi176.stdout: "lat": { 2024-04-25T02:29:50.535 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.535 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.535 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.536 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.536 INFO:teuthology.orchestra.run.smithi176.stdout: "wrlat": { 2024-04-25T02:29:50.536 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.536 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.536 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.536 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.536 INFO:teuthology.orchestra.run.smithi176.stdout: "rdlat": { 2024-04-25T02:29:50.536 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.536 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.536 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.536 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.536 INFO:teuthology.orchestra.run.smithi176.stdout: "fsync": { 2024-04-25T02:29:50.536 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.536 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.537 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.537 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.537 INFO:teuthology.orchestra.run.smithi176.stdout: "mdavg": 0.000000000, 2024-04-25T02:29:50.537 INFO:teuthology.orchestra.run.smithi176.stdout: "mdsqsum": 0, 2024-04-25T02:29:50.537 INFO:teuthology.orchestra.run.smithi176.stdout: "mdops": 0, 2024-04-25T02:29:50.537 INFO:teuthology.orchestra.run.smithi176.stdout: "readavg": 0.000000000, 2024-04-25T02:29:50.537 INFO:teuthology.orchestra.run.smithi176.stdout: "readsqsum": 0, 2024-04-25T02:29:50.537 INFO:teuthology.orchestra.run.smithi176.stdout: "rdops": 0, 2024-04-25T02:29:50.537 INFO:teuthology.orchestra.run.smithi176.stdout: "writeavg": 0.000000000, 2024-04-25T02:29:50.537 INFO:teuthology.orchestra.run.smithi176.stdout: "writesqsum": 0, 2024-04-25T02:29:50.537 INFO:teuthology.orchestra.run.smithi176.stdout: "rdops": 0 2024-04-25T02:29:50.537 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.537 INFO:teuthology.orchestra.run.smithi176.stdout: "client-0x55568218df40": { 2024-04-25T02:29:50.537 INFO:teuthology.orchestra.run.smithi176.stdout: "reply": { 2024-04-25T02:29:50.538 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 53, 2024-04-25T02:29:50.538 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.065698858, 2024-04-25T02:29:50.538 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.001239601 2024-04-25T02:29:50.538 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.538 INFO:teuthology.orchestra.run.smithi176.stdout: "lat": { 2024-04-25T02:29:50.538 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 53, 2024-04-25T02:29:50.538 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.065698858, 2024-04-25T02:29:50.538 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.001239601 2024-04-25T02:29:50.538 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.538 INFO:teuthology.orchestra.run.smithi176.stdout: "wrlat": { 2024-04-25T02:29:50.538 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.538 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.538 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.538 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.539 INFO:teuthology.orchestra.run.smithi176.stdout: "rdlat": { 2024-04-25T02:29:50.539 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.539 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.539 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.539 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.539 INFO:teuthology.orchestra.run.smithi176.stdout: "fsync": { 2024-04-25T02:29:50.539 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.539 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.539 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.539 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.539 INFO:teuthology.orchestra.run.smithi176.stdout: "mdavg": 0.001239586, 2024-04-25T02:29:50.539 INFO:teuthology.orchestra.run.smithi176.stdout: "mdsqsum": 125049105415003, 2024-04-25T02:29:50.539 INFO:teuthology.orchestra.run.smithi176.stdout: "mdops": 53, 2024-04-25T02:29:50.539 INFO:teuthology.orchestra.run.smithi176.stdout: "readavg": 0.000000000, 2024-04-25T02:29:50.539 INFO:teuthology.orchestra.run.smithi176.stdout: "readsqsum": 0, 2024-04-25T02:29:50.540 INFO:teuthology.orchestra.run.smithi176.stdout: "rdops": 0, 2024-04-25T02:29:50.540 INFO:teuthology.orchestra.run.smithi176.stdout: "writeavg": 0.000000000, 2024-04-25T02:29:50.540 INFO:teuthology.orchestra.run.smithi176.stdout: "writesqsum": 0, 2024-04-25T02:29:50.540 INFO:teuthology.orchestra.run.smithi176.stdout: "rdops": 0 2024-04-25T02:29:50.540 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.540 INFO:teuthology.orchestra.run.smithi176.stdout: "client-0x555682fa40a0": { 2024-04-25T02:29:50.540 INFO:teuthology.orchestra.run.smithi176.stdout: "reply": { 2024-04-25T02:29:50.540 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 22, 2024-04-25T02:29:50.540 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 3.608135999, 2024-04-25T02:29:50.540 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.164006181 2024-04-25T02:29:50.540 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.540 INFO:teuthology.orchestra.run.smithi176.stdout: "lat": { 2024-04-25T02:29:50.540 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 22, 2024-04-25T02:29:50.540 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 3.608135999, 2024-04-25T02:29:50.540 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.164006181 2024-04-25T02:29:50.541 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.541 INFO:teuthology.orchestra.run.smithi176.stdout: "wrlat": { 2024-04-25T02:29:50.541 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.541 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.541 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.541 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.541 INFO:teuthology.orchestra.run.smithi176.stdout: "rdlat": { 2024-04-25T02:29:50.541 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.541 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.541 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.541 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.541 INFO:teuthology.orchestra.run.smithi176.stdout: "fsync": { 2024-04-25T02:29:50.541 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.541 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.541 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.542 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.542 INFO:teuthology.orchestra.run.smithi176.stdout: "mdavg": 0.164006176, 2024-04-25T02:29:50.542 INFO:teuthology.orchestra.run.smithi176.stdout: "mdsqsum": 12297843699109677056, 2024-04-25T02:29:50.542 INFO:teuthology.orchestra.run.smithi176.stdout: "mdops": 22, 2024-04-25T02:29:50.542 INFO:teuthology.orchestra.run.smithi176.stdout: "readavg": 0.000000000, 2024-04-25T02:29:50.542 INFO:teuthology.orchestra.run.smithi176.stdout: "readsqsum": 0, 2024-04-25T02:29:50.542 INFO:teuthology.orchestra.run.smithi176.stdout: "rdops": 0, 2024-04-25T02:29:50.542 INFO:teuthology.orchestra.run.smithi176.stdout: "writeavg": 0.000000000, 2024-04-25T02:29:50.542 INFO:teuthology.orchestra.run.smithi176.stdout: "writesqsum": 0, 2024-04-25T02:29:50.542 INFO:teuthology.orchestra.run.smithi176.stdout: "rdops": 0 2024-04-25T02:29:50.542 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.542 INFO:teuthology.orchestra.run.smithi176.stdout: "client-0x555682fa45a0": { 2024-04-25T02:29:50.542 INFO:teuthology.orchestra.run.smithi176.stdout: "reply": { 2024-04-25T02:29:50.542 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 68, 2024-04-25T02:29:50.542 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 3.349705698, 2024-04-25T02:29:50.543 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.049260377 2024-04-25T02:29:50.543 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.543 INFO:teuthology.orchestra.run.smithi176.stdout: "lat": { 2024-04-25T02:29:50.543 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 68, 2024-04-25T02:29:50.543 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 3.349705698, 2024-04-25T02:29:50.543 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.049260377 2024-04-25T02:29:50.543 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.543 INFO:teuthology.orchestra.run.smithi176.stdout: "wrlat": { 2024-04-25T02:29:50.543 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 18, 2024-04-25T02:29:50.543 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000367570, 2024-04-25T02:29:50.543 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000020420 2024-04-25T02:29:50.543 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.543 INFO:teuthology.orchestra.run.smithi176.stdout: "rdlat": { 2024-04-25T02:29:50.543 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 18, 2024-04-25T02:29:50.544 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000315765, 2024-04-25T02:29:50.544 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000017542 2024-04-25T02:29:50.544 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.544 INFO:teuthology.orchestra.run.smithi176.stdout: "fsync": { 2024-04-25T02:29:50.544 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 3, 2024-04-25T02:29:50.544 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.009723815, 2024-04-25T02:29:50.544 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.003241271 2024-04-25T02:29:50.544 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.544 INFO:teuthology.orchestra.run.smithi176.stdout: "mdavg": 0.049260360, 2024-04-25T02:29:50.544 INFO:teuthology.orchestra.run.smithi176.stdout: "mdsqsum": 10520488090855354368, 2024-04-25T02:29:50.544 INFO:teuthology.orchestra.run.smithi176.stdout: "mdops": 68, 2024-04-25T02:29:50.544 INFO:teuthology.orchestra.run.smithi176.stdout: "readavg": 0.000017537, 2024-04-25T02:29:50.544 INFO:teuthology.orchestra.run.smithi176.stdout: "readsqsum": 1296634561, 2024-04-25T02:29:50.544 INFO:teuthology.orchestra.run.smithi176.stdout: "rdops": 18, 2024-04-25T02:29:50.544 INFO:teuthology.orchestra.run.smithi176.stdout: "writeavg": 0.000020417, 2024-04-25T02:29:50.544 INFO:teuthology.orchestra.run.smithi176.stdout: "writesqsum": 2055693598, 2024-04-25T02:29:50.545 INFO:teuthology.orchestra.run.smithi176.stdout: "rdops": 18 2024-04-25T02:29:50.545 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.545 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-Mgr": { 2024-04-25T02:29:50.545 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-04-25T02:29:50.545 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-04-25T02:29:50.545 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 2, 2024-04-25T02:29:50.545 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.030716011, 2024-04-25T02:29:50.545 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.015358005 2024-04-25T02:29:50.545 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.545 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.545 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-MgrStandby": { 2024-04-25T02:29:50.545 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-04-25T02:29:50.545 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-04-25T02:29:50.545 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.545 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.546 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.546 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.546 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.546 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-balancer": { 2024-04-25T02:29:50.546 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-04-25T02:29:50.546 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-04-25T02:29:50.546 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.546 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.546 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.546 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.546 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.546 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-cmd_finisher": { 2024-04-25T02:29:50.546 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-04-25T02:29:50.546 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-04-25T02:29:50.547 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 16, 2024-04-25T02:29:50.547 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000773637, 2024-04-25T02:29:50.547 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000048352 2024-04-25T02:29:50.547 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.547 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.547 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-crash": { 2024-04-25T02:29:50.547 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-04-25T02:29:50.547 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-04-25T02:29:50.547 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.547 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.547 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.547 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.547 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.547 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-devicehealth": { 2024-04-25T02:29:50.547 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-04-25T02:29:50.548 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-04-25T02:29:50.548 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.548 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.548 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.548 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.548 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.548 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-iostat": { 2024-04-25T02:29:50.548 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-04-25T02:29:50.548 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-04-25T02:29:50.548 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.548 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.548 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.548 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.548 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.548 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-nfs": { 2024-04-25T02:29:50.548 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-04-25T02:29:50.549 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-04-25T02:29:50.549 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.549 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.549 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.549 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.549 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.549 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-orchestrator": { 2024-04-25T02:29:50.549 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-04-25T02:29:50.549 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-04-25T02:29:50.549 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.549 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.549 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.549 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.549 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.549 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-pg_autoscaler": { 2024-04-25T02:29:50.550 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-04-25T02:29:50.550 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-04-25T02:29:50.550 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.550 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.550 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.550 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.550 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.550 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-progress": { 2024-04-25T02:29:50.550 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-04-25T02:29:50.550 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-04-25T02:29:50.550 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.550 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.550 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.551 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.551 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.551 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-rbd_support": { 2024-04-25T02:29:50.551 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-04-25T02:29:50.551 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-04-25T02:29:50.551 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.551 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.551 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.551 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.551 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.551 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-restful": { 2024-04-25T02:29:50.551 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-04-25T02:29:50.551 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-04-25T02:29:50.551 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 16, 2024-04-25T02:29:50.551 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.003023635, 2024-04-25T02:29:50.552 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000188977 2024-04-25T02:29:50.552 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.552 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.552 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-status": { 2024-04-25T02:29:50.552 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-04-25T02:29:50.552 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-04-25T02:29:50.552 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.552 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.552 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.552 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.552 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.552 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-telemetry": { 2024-04-25T02:29:50.552 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-04-25T02:29:50.552 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-04-25T02:29:50.553 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.553 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.553 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.553 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.553 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.553 INFO:teuthology.orchestra.run.smithi176.stdout: "finisher-volumes": { 2024-04-25T02:29:50.553 INFO:teuthology.orchestra.run.smithi176.stdout: "queue_len": 0, 2024-04-25T02:29:50.553 INFO:teuthology.orchestra.run.smithi176.stdout: "complete_latency": { 2024-04-25T02:29:50.553 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 9, 2024-04-25T02:29:50.553 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 3.402043045, 2024-04-25T02:29:50.553 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.378004782 2024-04-25T02:29:50.553 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.553 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.553 INFO:teuthology.orchestra.run.smithi176.stdout: "libcephsqlite_striper": { 2024-04-25T02:29:50.553 INFO:teuthology.orchestra.run.smithi176.stdout: "update_metadata": 8, 2024-04-25T02:29:50.553 INFO:teuthology.orchestra.run.smithi176.stdout: "update_allocated": 2, 2024-04-25T02:29:50.554 INFO:teuthology.orchestra.run.smithi176.stdout: "update_size": 6, 2024-04-25T02:29:50.554 INFO:teuthology.orchestra.run.smithi176.stdout: "update_version": 8, 2024-04-25T02:29:50.554 INFO:teuthology.orchestra.run.smithi176.stdout: "shrink": 0, 2024-04-25T02:29:50.554 INFO:teuthology.orchestra.run.smithi176.stdout: "shrink_bytes": 0, 2024-04-25T02:29:50.554 INFO:teuthology.orchestra.run.smithi176.stdout: "lock": 11, 2024-04-25T02:29:50.554 INFO:teuthology.orchestra.run.smithi176.stdout: "unlock": 11 2024-04-25T02:29:50.554 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.554 INFO:teuthology.orchestra.run.smithi176.stdout: "libcephsqlite_vfs": { 2024-04-25T02:29:50.554 INFO:teuthology.orchestra.run.smithi176.stdout: "op_open": { 2024-04-25T02:29:50.554 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 2, 2024-04-25T02:29:50.554 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.141998715, 2024-04-25T02:29:50.554 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.070999357 2024-04-25T02:29:50.554 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.554 INFO:teuthology.orchestra.run.smithi176.stdout: "op_delete": { 2024-04-25T02:29:50.554 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.555 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.555 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.555 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.555 INFO:teuthology.orchestra.run.smithi176.stdout: "op_access": { 2024-04-25T02:29:50.555 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.555 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.555 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.555 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.555 INFO:teuthology.orchestra.run.smithi176.stdout: "op_fullpathname": { 2024-04-25T02:29:50.555 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 1, 2024-04-25T02:29:50.555 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000999991, 2024-04-25T02:29:50.555 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000999991 2024-04-25T02:29:50.555 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.555 INFO:teuthology.orchestra.run.smithi176.stdout: "op_currenttime": { 2024-04-25T02:29:50.555 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 4, 2024-04-25T02:29:50.556 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.556 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.556 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.556 INFO:teuthology.orchestra.run.smithi176.stdout: "opf_close": { 2024-04-25T02:29:50.556 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.556 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.556 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.556 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.556 INFO:teuthology.orchestra.run.smithi176.stdout: "opf_read": { 2024-04-25T02:29:50.556 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 20, 2024-04-25T02:29:50.556 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.008999918, 2024-04-25T02:29:50.556 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000449995 2024-04-25T02:29:50.556 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.556 INFO:teuthology.orchestra.run.smithi176.stdout: "opf_write": { 2024-04-25T02:29:50.556 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 85, 2024-04-25T02:29:50.557 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.005999946, 2024-04-25T02:29:50.557 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000070587 2024-04-25T02:29:50.557 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.557 INFO:teuthology.orchestra.run.smithi176.stdout: "opf_truncate": { 2024-04-25T02:29:50.557 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.557 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.557 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.557 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.557 INFO:teuthology.orchestra.run.smithi176.stdout: "opf_sync": { 2024-04-25T02:29:50.557 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 24, 2024-04-25T02:29:50.557 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.111998987, 2024-04-25T02:29:50.557 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.004666624 2024-04-25T02:29:50.557 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.557 INFO:teuthology.orchestra.run.smithi176.stdout: "opf_filesize": { 2024-04-25T02:29:50.557 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 20, 2024-04-25T02:29:50.558 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.558 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.558 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.558 INFO:teuthology.orchestra.run.smithi176.stdout: "opf_lock": { 2024-04-25T02:29:50.558 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 27, 2024-04-25T02:29:50.558 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.026999756, 2024-04-25T02:29:50.558 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000999990 2024-04-25T02:29:50.558 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.558 INFO:teuthology.orchestra.run.smithi176.stdout: "opf_unlock": { 2024-04-25T02:29:50.558 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 19, 2024-04-25T02:29:50.558 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.016999846, 2024-04-25T02:29:50.558 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000894728 2024-04-25T02:29:50.558 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.558 INFO:teuthology.orchestra.run.smithi176.stdout: "opf_checkreservedlock": { 2024-04-25T02:29:50.558 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 9, 2024-04-25T02:29:50.559 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.559 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.559 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.559 INFO:teuthology.orchestra.run.smithi176.stdout: "opf_filecontrol": { 2024-04-25T02:29:50.559 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 26, 2024-04-25T02:29:50.559 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.559 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.559 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.559 INFO:teuthology.orchestra.run.smithi176.stdout: "opf_sectorsize": { 2024-04-25T02:29:50.559 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.559 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.559 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.559 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.559 INFO:teuthology.orchestra.run.smithi176.stdout: "opf_devicecharacteristics": { 2024-04-25T02:29:50.559 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 30, 2024-04-25T02:29:50.560 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.560 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.560 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.560 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.560 INFO:teuthology.orchestra.run.smithi176.stdout: "mempool": { 2024-04-25T02:29:50.560 INFO:teuthology.orchestra.run.smithi176.stdout: "bloom_filter_bytes": 0, 2024-04-25T02:29:50.560 INFO:teuthology.orchestra.run.smithi176.stdout: "bloom_filter_items": 0, 2024-04-25T02:29:50.560 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T02:29:50.560 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_alloc_items": 0, 2024-04-25T02:29:50.560 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T02:29:50.560 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_data_items": 0, 2024-04-25T02:29:50.560 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T02:29:50.560 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T02:29:50.560 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T02:29:50.560 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T02:29:50.561 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T02:29:50.561 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_other_items": 0, 2024-04-25T02:29:50.561 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T02:29:50.561 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T02:29:50.561 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_extent_bytes": 0, 2024-04-25T02:29:50.561 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_extent_items": 0, 2024-04-25T02:29:50.561 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_blob_bytes": 0, 2024-04-25T02:29:50.561 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_blob_items": 0, 2024-04-25T02:29:50.561 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T02:29:50.561 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T02:29:50.561 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T02:29:50.561 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T02:29:50.561 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T02:29:50.561 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_fsck_items": 0, 2024-04-25T02:29:50.561 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_txc_bytes": 0, 2024-04-25T02:29:50.561 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_txc_items": 0, 2024-04-25T02:29:50.562 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T02:29:50.562 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T02:29:50.562 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_bytes": 0, 2024-04-25T02:29:50.562 INFO:teuthology.orchestra.run.smithi176.stdout: "bluestore_writing_items": 0, 2024-04-25T02:29:50.562 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_bytes": 0, 2024-04-25T02:29:50.562 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_items": 0, 2024-04-25T02:29:50.562 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T02:29:50.562 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_reader_items": 0, 2024-04-25T02:29:50.562 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T02:29:50.562 INFO:teuthology.orchestra.run.smithi176.stdout: "bluefs_file_writer_items": 0, 2024-04-25T02:29:50.562 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_anon_bytes": 1649481, 2024-04-25T02:29:50.562 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_anon_items": 329, 2024-04-25T02:29:50.562 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_meta_bytes": 1496, 2024-04-25T02:29:50.562 INFO:teuthology.orchestra.run.smithi176.stdout: "buffer_meta_items": 17, 2024-04-25T02:29:50.563 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_bytes": 0, 2024-04-25T02:29:50.563 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_items": 0, 2024-04-25T02:29:50.563 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_mapbl_bytes": 0, 2024-04-25T02:29:50.563 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_mapbl_items": 0, 2024-04-25T02:29:50.563 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_pglog_bytes": 0, 2024-04-25T02:29:50.563 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_pglog_items": 0, 2024-04-25T02:29:50.563 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_bytes": 49224, 2024-04-25T02:29:50.563 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_items": 807, 2024-04-25T02:29:50.563 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T02:29:50.563 INFO:teuthology.orchestra.run.smithi176.stdout: "osdmap_mapping_items": 0, 2024-04-25T02:29:50.563 INFO:teuthology.orchestra.run.smithi176.stdout: "pgmap_bytes": 75168, 2024-04-25T02:29:50.563 INFO:teuthology.orchestra.run.smithi176.stdout: "pgmap_items": 414, 2024-04-25T02:29:50.563 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_co_bytes": 0, 2024-04-25T02:29:50.563 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_co_items": 0, 2024-04-25T02:29:50.563 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_1_bytes": 0, 2024-04-25T02:29:50.563 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_1_items": 0, 2024-04-25T02:29:50.564 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_2_bytes": 0, 2024-04-25T02:29:50.564 INFO:teuthology.orchestra.run.smithi176.stdout: "unittest_2_items": 0 2024-04-25T02:29:50.564 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.564 INFO:teuthology.orchestra.run.smithi176.stdout: "mgr": { 2024-04-25T02:29:50.564 INFO:teuthology.orchestra.run.smithi176.stdout: "cache_hit": 0, 2024-04-25T02:29:50.564 INFO:teuthology.orchestra.run.smithi176.stdout: "cache_miss": 0 2024-04-25T02:29:50.564 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.564 INFO:teuthology.orchestra.run.smithi176.stdout: "objectcacher-libcephfs": { 2024-04-25T02:29:50.564 INFO:teuthology.orchestra.run.smithi176.stdout: "cache_ops_hit": 0, 2024-04-25T02:29:50.564 INFO:teuthology.orchestra.run.smithi176.stdout: "cache_ops_miss": 0, 2024-04-25T02:29:50.564 INFO:teuthology.orchestra.run.smithi176.stdout: "cache_bytes_hit": 0, 2024-04-25T02:29:50.564 INFO:teuthology.orchestra.run.smithi176.stdout: "cache_bytes_miss": 0, 2024-04-25T02:29:50.564 INFO:teuthology.orchestra.run.smithi176.stdout: "data_read": 0, 2024-04-25T02:29:50.564 INFO:teuthology.orchestra.run.smithi176.stdout: "data_written": 0, 2024-04-25T02:29:50.564 INFO:teuthology.orchestra.run.smithi176.stdout: "data_flushed": 0, 2024-04-25T02:29:50.565 INFO:teuthology.orchestra.run.smithi176.stdout: "data_overwritten_while_flushing": 0, 2024-04-25T02:29:50.565 INFO:teuthology.orchestra.run.smithi176.stdout: "write_ops_blocked": 0, 2024-04-25T02:29:50.565 INFO:teuthology.orchestra.run.smithi176.stdout: "write_bytes_blocked": 0, 2024-04-25T02:29:50.565 INFO:teuthology.orchestra.run.smithi176.stdout: "write_time_blocked": 0.000000000 2024-04-25T02:29:50.565 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.565 INFO:teuthology.orchestra.run.smithi176.stdout: "objectcacher-libcephfs-0x55568218cf00": { 2024-04-25T02:29:50.565 INFO:teuthology.orchestra.run.smithi176.stdout: "cache_ops_hit": 0, 2024-04-25T02:29:50.565 INFO:teuthology.orchestra.run.smithi176.stdout: "cache_ops_miss": 0, 2024-04-25T02:29:50.565 INFO:teuthology.orchestra.run.smithi176.stdout: "cache_bytes_hit": 0, 2024-04-25T02:29:50.565 INFO:teuthology.orchestra.run.smithi176.stdout: "cache_bytes_miss": 0, 2024-04-25T02:29:50.565 INFO:teuthology.orchestra.run.smithi176.stdout: "data_read": 0, 2024-04-25T02:29:50.565 INFO:teuthology.orchestra.run.smithi176.stdout: "data_written": 0, 2024-04-25T02:29:50.565 INFO:teuthology.orchestra.run.smithi176.stdout: "data_flushed": 0, 2024-04-25T02:29:50.565 INFO:teuthology.orchestra.run.smithi176.stdout: "data_overwritten_while_flushing": 0, 2024-04-25T02:29:50.565 INFO:teuthology.orchestra.run.smithi176.stdout: "write_ops_blocked": 0, 2024-04-25T02:29:50.566 INFO:teuthology.orchestra.run.smithi176.stdout: "write_bytes_blocked": 0, 2024-04-25T02:29:50.566 INFO:teuthology.orchestra.run.smithi176.stdout: "write_time_blocked": 0.000000000 2024-04-25T02:29:50.566 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.566 INFO:teuthology.orchestra.run.smithi176.stdout: "objectcacher-libcephfs-0x55568218de00": { 2024-04-25T02:29:50.566 INFO:teuthology.orchestra.run.smithi176.stdout: "cache_ops_hit": 9, 2024-04-25T02:29:50.566 INFO:teuthology.orchestra.run.smithi176.stdout: "cache_ops_miss": 0, 2024-04-25T02:29:50.566 INFO:teuthology.orchestra.run.smithi176.stdout: "cache_bytes_hit": 1233, 2024-04-25T02:29:50.566 INFO:teuthology.orchestra.run.smithi176.stdout: "cache_bytes_miss": 0, 2024-04-25T02:29:50.566 INFO:teuthology.orchestra.run.smithi176.stdout: "data_read": 1233, 2024-04-25T02:29:50.566 INFO:teuthology.orchestra.run.smithi176.stdout: "data_written": 411, 2024-04-25T02:29:50.566 INFO:teuthology.orchestra.run.smithi176.stdout: "data_flushed": 411, 2024-04-25T02:29:50.566 INFO:teuthology.orchestra.run.smithi176.stdout: "data_overwritten_while_flushing": 0, 2024-04-25T02:29:50.566 INFO:teuthology.orchestra.run.smithi176.stdout: "write_ops_blocked": 0, 2024-04-25T02:29:50.566 INFO:teuthology.orchestra.run.smithi176.stdout: "write_bytes_blocked": 0, 2024-04-25T02:29:50.566 INFO:teuthology.orchestra.run.smithi176.stdout: "write_time_blocked": 0.000000000 2024-04-25T02:29:50.567 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.567 INFO:teuthology.orchestra.run.smithi176.stdout: "objectcacher-libcephfs-0x555682fa4aa0": { 2024-04-25T02:29:50.567 INFO:teuthology.orchestra.run.smithi176.stdout: "cache_ops_hit": 0, 2024-04-25T02:29:50.567 INFO:teuthology.orchestra.run.smithi176.stdout: "cache_ops_miss": 0, 2024-04-25T02:29:50.567 INFO:teuthology.orchestra.run.smithi176.stdout: "cache_bytes_hit": 0, 2024-04-25T02:29:50.567 INFO:teuthology.orchestra.run.smithi176.stdout: "cache_bytes_miss": 0, 2024-04-25T02:29:50.567 INFO:teuthology.orchestra.run.smithi176.stdout: "data_read": 0, 2024-04-25T02:29:50.567 INFO:teuthology.orchestra.run.smithi176.stdout: "data_written": 0, 2024-04-25T02:29:50.567 INFO:teuthology.orchestra.run.smithi176.stdout: "data_flushed": 0, 2024-04-25T02:29:50.567 INFO:teuthology.orchestra.run.smithi176.stdout: "data_overwritten_while_flushing": 0, 2024-04-25T02:29:50.567 INFO:teuthology.orchestra.run.smithi176.stdout: "write_ops_blocked": 0, 2024-04-25T02:29:50.567 INFO:teuthology.orchestra.run.smithi176.stdout: "write_bytes_blocked": 0, 2024-04-25T02:29:50.567 INFO:teuthology.orchestra.run.smithi176.stdout: "write_time_blocked": 0.000000000 2024-04-25T02:29:50.567 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.567 INFO:teuthology.orchestra.run.smithi176.stdout: "objecter": { 2024-04-25T02:29:50.568 INFO:teuthology.orchestra.run.smithi176.stdout: "op_active": 0, 2024-04-25T02:29:50.568 INFO:teuthology.orchestra.run.smithi176.stdout: "op_laggy": 0, 2024-04-25T02:29:50.568 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send": 0, 2024-04-25T02:29:50.568 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send_bytes": 0, 2024-04-25T02:29:50.568 INFO:teuthology.orchestra.run.smithi176.stdout: "op_resend": 0, 2024-04-25T02:29:50.568 INFO:teuthology.orchestra.run.smithi176.stdout: "op_reply": 0, 2024-04-25T02:29:50.568 INFO:teuthology.orchestra.run.smithi176.stdout: "op_latency": { 2024-04-25T02:29:50.568 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.568 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.568 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.568 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.568 INFO:teuthology.orchestra.run.smithi176.stdout: "op_inflight": 0, 2024-04-25T02:29:50.568 INFO:teuthology.orchestra.run.smithi176.stdout: "oplen_avg": { 2024-04-25T02:29:50.568 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.568 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0 2024-04-25T02:29:50.568 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.569 INFO:teuthology.orchestra.run.smithi176.stdout: "op": 0, 2024-04-25T02:29:50.569 INFO:teuthology.orchestra.run.smithi176.stdout: "op_r": 0, 2024-04-25T02:29:50.569 INFO:teuthology.orchestra.run.smithi176.stdout: "op_w": 0, 2024-04-25T02:29:50.569 INFO:teuthology.orchestra.run.smithi176.stdout: "op_rmw": 0, 2024-04-25T02:29:50.569 INFO:teuthology.orchestra.run.smithi176.stdout: "op_pg": 0, 2024-04-25T02:29:50.569 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_stat": 0, 2024-04-25T02:29:50.569 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_create": 0, 2024-04-25T02:29:50.569 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_read": 0, 2024-04-25T02:29:50.569 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_write": 0, 2024-04-25T02:29:50.569 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writefull": 0, 2024-04-25T02:29:50.569 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writesame": 0, 2024-04-25T02:29:50.569 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_append": 0, 2024-04-25T02:29:50.569 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_zero": 0, 2024-04-25T02:29:50.569 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_truncate": 0, 2024-04-25T02:29:50.569 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_delete": 0, 2024-04-25T02:29:50.570 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_mapext": 0, 2024-04-25T02:29:50.570 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_sparse_read": 0, 2024-04-25T02:29:50.570 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_clonerange": 0, 2024-04-25T02:29:50.570 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_getxattr": 0, 2024-04-25T02:29:50.570 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_setxattr": 0, 2024-04-25T02:29:50.570 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_cmpxattr": 0, 2024-04-25T02:29:50.570 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_rmxattr": 0, 2024-04-25T02:29:50.570 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_resetxattrs": 0, 2024-04-25T02:29:50.570 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_call": 0, 2024-04-25T02:29:50.570 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_watch": 0, 2024-04-25T02:29:50.570 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_notify": 0, 2024-04-25T02:29:50.570 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T02:29:50.570 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls": 0, 2024-04-25T02:29:50.570 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls_filter": 0, 2024-04-25T02:29:50.571 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_other": 0, 2024-04-25T02:29:50.571 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_active": 0, 2024-04-25T02:29:50.571 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_send": 0, 2024-04-25T02:29:50.571 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_resend": 0, 2024-04-25T02:29:50.571 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_ping": 0, 2024-04-25T02:29:50.571 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_active": 0, 2024-04-25T02:29:50.571 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_send": 0, 2024-04-25T02:29:50.571 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_resend": 0, 2024-04-25T02:29:50.571 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_active": 0, 2024-04-25T02:29:50.571 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_send": 0, 2024-04-25T02:29:50.571 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_resend": 0, 2024-04-25T02:29:50.571 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_active": 0, 2024-04-25T02:29:50.571 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_send": 0, 2024-04-25T02:29:50.571 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_resend": 0, 2024-04-25T02:29:50.571 INFO:teuthology.orchestra.run.smithi176.stdout: "command_active": 0, 2024-04-25T02:29:50.571 INFO:teuthology.orchestra.run.smithi176.stdout: "command_send": 8, 2024-04-25T02:29:50.572 INFO:teuthology.orchestra.run.smithi176.stdout: "command_resend": 0, 2024-04-25T02:29:50.572 INFO:teuthology.orchestra.run.smithi176.stdout: "map_epoch": 36, 2024-04-25T02:29:50.572 INFO:teuthology.orchestra.run.smithi176.stdout: "map_full": 0, 2024-04-25T02:29:50.572 INFO:teuthology.orchestra.run.smithi176.stdout: "map_inc": 35, 2024-04-25T02:29:50.572 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_sessions": 8, 2024-04-25T02:29:50.572 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_open": 8, 2024-04-25T02:29:50.572 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_close": 0, 2024-04-25T02:29:50.572 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_laggy": 0, 2024-04-25T02:29:50.572 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_wr": 0, 2024-04-25T02:29:50.572 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_rd": 0, 2024-04-25T02:29:50.572 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_del": 0 2024-04-25T02:29:50.572 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.572 INFO:teuthology.orchestra.run.smithi176.stdout: "objecter-0x555681ef2b40": { 2024-04-25T02:29:50.572 INFO:teuthology.orchestra.run.smithi176.stdout: "op_active": 0, 2024-04-25T02:29:50.572 INFO:teuthology.orchestra.run.smithi176.stdout: "op_laggy": 0, 2024-04-25T02:29:50.573 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send": 163, 2024-04-25T02:29:50.573 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send_bytes": 2434694, 2024-04-25T02:29:50.573 INFO:teuthology.orchestra.run.smithi176.stdout: "op_resend": 0, 2024-04-25T02:29:50.573 INFO:teuthology.orchestra.run.smithi176.stdout: "op_reply": 163, 2024-04-25T02:29:50.573 INFO:teuthology.orchestra.run.smithi176.stdout: "op_latency": { 2024-04-25T02:29:50.573 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 163, 2024-04-25T02:29:50.573 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.655994074, 2024-04-25T02:29:50.573 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.004024503 2024-04-25T02:29:50.573 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.573 INFO:teuthology.orchestra.run.smithi176.stdout: "op_inflight": 0, 2024-04-25T02:29:50.573 INFO:teuthology.orchestra.run.smithi176.stdout: "oplen_avg": { 2024-04-25T02:29:50.573 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 163, 2024-04-25T02:29:50.573 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 307 2024-04-25T02:29:50.573 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.573 INFO:teuthology.orchestra.run.smithi176.stdout: "op": 163, 2024-04-25T02:29:50.574 INFO:teuthology.orchestra.run.smithi176.stdout: "op_r": 46, 2024-04-25T02:29:50.574 INFO:teuthology.orchestra.run.smithi176.stdout: "op_w": 117, 2024-04-25T02:29:50.574 INFO:teuthology.orchestra.run.smithi176.stdout: "op_rmw": 0, 2024-04-25T02:29:50.574 INFO:teuthology.orchestra.run.smithi176.stdout: "op_pg": 0, 2024-04-25T02:29:50.574 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_stat": 0, 2024-04-25T02:29:50.574 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_create": 2, 2024-04-25T02:29:50.574 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_read": 20, 2024-04-25T02:29:50.574 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_write": 85, 2024-04-25T02:29:50.574 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writefull": 0, 2024-04-25T02:29:50.574 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writesame": 0, 2024-04-25T02:29:50.574 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_append": 0, 2024-04-25T02:29:50.574 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_zero": 0, 2024-04-25T02:29:50.574 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_truncate": 0, 2024-04-25T02:29:50.574 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_delete": 0, 2024-04-25T02:29:50.574 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_mapext": 0, 2024-04-25T02:29:50.575 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_sparse_read": 0, 2024-04-25T02:29:50.575 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_clonerange": 0, 2024-04-25T02:29:50.575 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_getxattr": 104, 2024-04-25T02:29:50.575 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_setxattr": 52, 2024-04-25T02:29:50.575 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_cmpxattr": 22, 2024-04-25T02:29:50.575 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_rmxattr": 0, 2024-04-25T02:29:50.575 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_resetxattrs": 0, 2024-04-25T02:29:50.575 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_call": 22, 2024-04-25T02:29:50.575 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_watch": 0, 2024-04-25T02:29:50.575 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_notify": 0, 2024-04-25T02:29:50.575 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T02:29:50.575 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls": 0, 2024-04-25T02:29:50.575 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls_filter": 0, 2024-04-25T02:29:50.575 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_other": 0, 2024-04-25T02:29:50.575 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_active": 0, 2024-04-25T02:29:50.576 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_send": 0, 2024-04-25T02:29:50.576 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_resend": 0, 2024-04-25T02:29:50.576 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_ping": 0, 2024-04-25T02:29:50.576 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_active": 0, 2024-04-25T02:29:50.576 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_send": 0, 2024-04-25T02:29:50.576 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_resend": 0, 2024-04-25T02:29:50.576 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_active": 0, 2024-04-25T02:29:50.576 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_send": 0, 2024-04-25T02:29:50.576 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_resend": 0, 2024-04-25T02:29:50.576 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_active": 0, 2024-04-25T02:29:50.576 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_send": 0, 2024-04-25T02:29:50.576 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_resend": 0, 2024-04-25T02:29:50.576 INFO:teuthology.orchestra.run.smithi176.stdout: "command_active": 0, 2024-04-25T02:29:50.576 INFO:teuthology.orchestra.run.smithi176.stdout: "command_send": 0, 2024-04-25T02:29:50.576 INFO:teuthology.orchestra.run.smithi176.stdout: "command_resend": 0, 2024-04-25T02:29:50.577 INFO:teuthology.orchestra.run.smithi176.stdout: "map_epoch": 16, 2024-04-25T02:29:50.577 INFO:teuthology.orchestra.run.smithi176.stdout: "map_full": 0, 2024-04-25T02:29:50.577 INFO:teuthology.orchestra.run.smithi176.stdout: "map_inc": 6, 2024-04-25T02:29:50.577 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_sessions": 1, 2024-04-25T02:29:50.577 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_open": 1, 2024-04-25T02:29:50.577 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_close": 0, 2024-04-25T02:29:50.577 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_laggy": 0, 2024-04-25T02:29:50.577 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_wr": 0, 2024-04-25T02:29:50.577 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_rd": 0, 2024-04-25T02:29:50.577 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_del": 0 2024-04-25T02:29:50.577 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.577 INFO:teuthology.orchestra.run.smithi176.stdout: "objecter-0x555681ef3220": { 2024-04-25T02:29:50.577 INFO:teuthology.orchestra.run.smithi176.stdout: "op_active": 0, 2024-04-25T02:29:50.577 INFO:teuthology.orchestra.run.smithi176.stdout: "op_laggy": 0, 2024-04-25T02:29:50.578 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send": 0, 2024-04-25T02:29:50.578 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send_bytes": 0, 2024-04-25T02:29:50.578 INFO:teuthology.orchestra.run.smithi176.stdout: "op_resend": 0, 2024-04-25T02:29:50.578 INFO:teuthology.orchestra.run.smithi176.stdout: "op_reply": 0, 2024-04-25T02:29:50.578 INFO:teuthology.orchestra.run.smithi176.stdout: "op_latency": { 2024-04-25T02:29:50.578 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.578 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.578 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.578 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.578 INFO:teuthology.orchestra.run.smithi176.stdout: "op_inflight": 0, 2024-04-25T02:29:50.578 INFO:teuthology.orchestra.run.smithi176.stdout: "oplen_avg": { 2024-04-25T02:29:50.578 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.578 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0 2024-04-25T02:29:50.578 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.579 INFO:teuthology.orchestra.run.smithi176.stdout: "op": 0, 2024-04-25T02:29:50.579 INFO:teuthology.orchestra.run.smithi176.stdout: "op_r": 0, 2024-04-25T02:29:50.579 INFO:teuthology.orchestra.run.smithi176.stdout: "op_w": 0, 2024-04-25T02:29:50.579 INFO:teuthology.orchestra.run.smithi176.stdout: "op_rmw": 0, 2024-04-25T02:29:50.579 INFO:teuthology.orchestra.run.smithi176.stdout: "op_pg": 0, 2024-04-25T02:29:50.579 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_stat": 0, 2024-04-25T02:29:50.579 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_create": 0, 2024-04-25T02:29:50.579 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_read": 0, 2024-04-25T02:29:50.579 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_write": 0, 2024-04-25T02:29:50.579 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writefull": 0, 2024-04-25T02:29:50.579 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writesame": 0, 2024-04-25T02:29:50.579 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_append": 0, 2024-04-25T02:29:50.579 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_zero": 0, 2024-04-25T02:29:50.579 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_truncate": 0, 2024-04-25T02:29:50.580 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_delete": 0, 2024-04-25T02:29:50.580 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_mapext": 0, 2024-04-25T02:29:50.580 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_sparse_read": 0, 2024-04-25T02:29:50.580 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_clonerange": 0, 2024-04-25T02:29:50.580 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_getxattr": 0, 2024-04-25T02:29:50.580 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_setxattr": 0, 2024-04-25T02:29:50.580 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_cmpxattr": 0, 2024-04-25T02:29:50.580 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_rmxattr": 0, 2024-04-25T02:29:50.580 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_resetxattrs": 0, 2024-04-25T02:29:50.580 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_call": 0, 2024-04-25T02:29:50.580 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_watch": 0, 2024-04-25T02:29:50.580 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_notify": 0, 2024-04-25T02:29:50.580 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T02:29:50.580 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls": 0, 2024-04-25T02:29:50.580 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls_filter": 0, 2024-04-25T02:29:50.581 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_other": 0, 2024-04-25T02:29:50.581 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_active": 0, 2024-04-25T02:29:50.581 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_send": 0, 2024-04-25T02:29:50.581 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_resend": 0, 2024-04-25T02:29:50.581 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_ping": 0, 2024-04-25T02:29:50.581 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_active": 0, 2024-04-25T02:29:50.581 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_send": 0, 2024-04-25T02:29:50.581 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_resend": 0, 2024-04-25T02:29:50.581 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_active": 0, 2024-04-25T02:29:50.581 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_send": 0, 2024-04-25T02:29:50.581 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_resend": 0, 2024-04-25T02:29:50.581 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_active": 0, 2024-04-25T02:29:50.581 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_send": 0, 2024-04-25T02:29:50.581 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_resend": 0, 2024-04-25T02:29:50.581 INFO:teuthology.orchestra.run.smithi176.stdout: "command_active": 0, 2024-04-25T02:29:50.582 INFO:teuthology.orchestra.run.smithi176.stdout: "command_send": 0, 2024-04-25T02:29:50.582 INFO:teuthology.orchestra.run.smithi176.stdout: "command_resend": 0, 2024-04-25T02:29:50.582 INFO:teuthology.orchestra.run.smithi176.stdout: "map_epoch": 0, 2024-04-25T02:29:50.582 INFO:teuthology.orchestra.run.smithi176.stdout: "map_full": 0, 2024-04-25T02:29:50.582 INFO:teuthology.orchestra.run.smithi176.stdout: "map_inc": 0, 2024-04-25T02:29:50.582 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_sessions": 0, 2024-04-25T02:29:50.582 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_open": 0, 2024-04-25T02:29:50.582 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_close": 0, 2024-04-25T02:29:50.582 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_laggy": 0, 2024-04-25T02:29:50.582 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_wr": 0, 2024-04-25T02:29:50.582 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_rd": 0, 2024-04-25T02:29:50.582 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_del": 0 2024-04-25T02:29:50.582 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.582 INFO:teuthology.orchestra.run.smithi176.stdout: "objecter-0x555681ef3ea0": { 2024-04-25T02:29:50.582 INFO:teuthology.orchestra.run.smithi176.stdout: "op_active": 0, 2024-04-25T02:29:50.583 INFO:teuthology.orchestra.run.smithi176.stdout: "op_laggy": 0, 2024-04-25T02:29:50.583 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send": 0, 2024-04-25T02:29:50.583 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send_bytes": 0, 2024-04-25T02:29:50.583 INFO:teuthology.orchestra.run.smithi176.stdout: "op_resend": 0, 2024-04-25T02:29:50.583 INFO:teuthology.orchestra.run.smithi176.stdout: "op_reply": 0, 2024-04-25T02:29:50.583 INFO:teuthology.orchestra.run.smithi176.stdout: "op_latency": { 2024-04-25T02:29:50.583 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.583 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.583 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.583 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.583 INFO:teuthology.orchestra.run.smithi176.stdout: "op_inflight": 0, 2024-04-25T02:29:50.583 INFO:teuthology.orchestra.run.smithi176.stdout: "oplen_avg": { 2024-04-25T02:29:50.583 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.583 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0 2024-04-25T02:29:50.583 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.584 INFO:teuthology.orchestra.run.smithi176.stdout: "op": 0, 2024-04-25T02:29:50.584 INFO:teuthology.orchestra.run.smithi176.stdout: "op_r": 0, 2024-04-25T02:29:50.584 INFO:teuthology.orchestra.run.smithi176.stdout: "op_w": 0, 2024-04-25T02:29:50.584 INFO:teuthology.orchestra.run.smithi176.stdout: "op_rmw": 0, 2024-04-25T02:29:50.584 INFO:teuthology.orchestra.run.smithi176.stdout: "op_pg": 0, 2024-04-25T02:29:50.584 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_stat": 0, 2024-04-25T02:29:50.584 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_create": 0, 2024-04-25T02:29:50.584 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_read": 0, 2024-04-25T02:29:50.584 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_write": 0, 2024-04-25T02:29:50.584 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writefull": 0, 2024-04-25T02:29:50.584 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writesame": 0, 2024-04-25T02:29:50.584 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_append": 0, 2024-04-25T02:29:50.584 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_zero": 0, 2024-04-25T02:29:50.584 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_truncate": 0, 2024-04-25T02:29:50.584 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_delete": 0, 2024-04-25T02:29:50.585 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_mapext": 0, 2024-04-25T02:29:50.585 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_sparse_read": 0, 2024-04-25T02:29:50.585 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_clonerange": 0, 2024-04-25T02:29:50.585 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_getxattr": 0, 2024-04-25T02:29:50.585 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_setxattr": 0, 2024-04-25T02:29:50.585 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_cmpxattr": 0, 2024-04-25T02:29:50.585 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_rmxattr": 0, 2024-04-25T02:29:50.585 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_resetxattrs": 0, 2024-04-25T02:29:50.585 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_call": 0, 2024-04-25T02:29:50.585 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_watch": 0, 2024-04-25T02:29:50.585 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_notify": 0, 2024-04-25T02:29:50.585 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T02:29:50.585 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls": 0, 2024-04-25T02:29:50.585 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls_filter": 0, 2024-04-25T02:29:50.585 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_other": 0, 2024-04-25T02:29:50.586 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_active": 0, 2024-04-25T02:29:50.586 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_send": 0, 2024-04-25T02:29:50.586 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_resend": 0, 2024-04-25T02:29:50.586 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_ping": 0, 2024-04-25T02:29:50.586 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_active": 0, 2024-04-25T02:29:50.586 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_send": 0, 2024-04-25T02:29:50.586 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_resend": 0, 2024-04-25T02:29:50.586 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_active": 0, 2024-04-25T02:29:50.586 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_send": 0, 2024-04-25T02:29:50.586 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_resend": 0, 2024-04-25T02:29:50.586 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_active": 0, 2024-04-25T02:29:50.586 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_send": 0, 2024-04-25T02:29:50.586 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_resend": 0, 2024-04-25T02:29:50.586 INFO:teuthology.orchestra.run.smithi176.stdout: "command_active": 0, 2024-04-25T02:29:50.587 INFO:teuthology.orchestra.run.smithi176.stdout: "command_send": 0, 2024-04-25T02:29:50.587 INFO:teuthology.orchestra.run.smithi176.stdout: "command_resend": 0, 2024-04-25T02:29:50.587 INFO:teuthology.orchestra.run.smithi176.stdout: "map_epoch": 0, 2024-04-25T02:29:50.587 INFO:teuthology.orchestra.run.smithi176.stdout: "map_full": 0, 2024-04-25T02:29:50.587 INFO:teuthology.orchestra.run.smithi176.stdout: "map_inc": 0, 2024-04-25T02:29:50.587 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_sessions": 0, 2024-04-25T02:29:50.587 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_open": 0, 2024-04-25T02:29:50.587 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_close": 0, 2024-04-25T02:29:50.587 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_laggy": 0, 2024-04-25T02:29:50.587 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_wr": 0, 2024-04-25T02:29:50.587 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_rd": 0, 2024-04-25T02:29:50.587 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_del": 0 2024-04-25T02:29:50.587 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.587 INFO:teuthology.orchestra.run.smithi176.stdout: "objecter-0x55568218c5a0": { 2024-04-25T02:29:50.587 INFO:teuthology.orchestra.run.smithi176.stdout: "op_active": 0, 2024-04-25T02:29:50.587 INFO:teuthology.orchestra.run.smithi176.stdout: "op_laggy": 0, 2024-04-25T02:29:50.588 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send": 1, 2024-04-25T02:29:50.588 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send_bytes": 39, 2024-04-25T02:29:50.588 INFO:teuthology.orchestra.run.smithi176.stdout: "op_resend": 0, 2024-04-25T02:29:50.588 INFO:teuthology.orchestra.run.smithi176.stdout: "op_reply": 1, 2024-04-25T02:29:50.588 INFO:teuthology.orchestra.run.smithi176.stdout: "op_latency": { 2024-04-25T02:29:50.588 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 1, 2024-04-25T02:29:50.588 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000999991, 2024-04-25T02:29:50.588 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000999991 2024-04-25T02:29:50.588 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.588 INFO:teuthology.orchestra.run.smithi176.stdout: "op_inflight": 0, 2024-04-25T02:29:50.588 INFO:teuthology.orchestra.run.smithi176.stdout: "oplen_avg": { 2024-04-25T02:29:50.588 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 1, 2024-04-25T02:29:50.588 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 1 2024-04-25T02:29:50.588 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.588 INFO:teuthology.orchestra.run.smithi176.stdout: "op": 1, 2024-04-25T02:29:50.589 INFO:teuthology.orchestra.run.smithi176.stdout: "op_r": 1, 2024-04-25T02:29:50.589 INFO:teuthology.orchestra.run.smithi176.stdout: "op_w": 0, 2024-04-25T02:29:50.589 INFO:teuthology.orchestra.run.smithi176.stdout: "op_rmw": 0, 2024-04-25T02:29:50.589 INFO:teuthology.orchestra.run.smithi176.stdout: "op_pg": 0, 2024-04-25T02:29:50.589 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_stat": 0, 2024-04-25T02:29:50.589 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_create": 0, 2024-04-25T02:29:50.589 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_read": 0, 2024-04-25T02:29:50.589 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_write": 0, 2024-04-25T02:29:50.589 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writefull": 0, 2024-04-25T02:29:50.589 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writesame": 0, 2024-04-25T02:29:50.589 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_append": 0, 2024-04-25T02:29:50.589 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_zero": 0, 2024-04-25T02:29:50.589 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_truncate": 0, 2024-04-25T02:29:50.589 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_delete": 0, 2024-04-25T02:29:50.589 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_mapext": 0, 2024-04-25T02:29:50.590 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_sparse_read": 0, 2024-04-25T02:29:50.590 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_clonerange": 0, 2024-04-25T02:29:50.590 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_getxattr": 0, 2024-04-25T02:29:50.590 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_setxattr": 0, 2024-04-25T02:29:50.590 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_cmpxattr": 0, 2024-04-25T02:29:50.590 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_rmxattr": 0, 2024-04-25T02:29:50.590 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_resetxattrs": 0, 2024-04-25T02:29:50.590 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_call": 0, 2024-04-25T02:29:50.590 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_watch": 0, 2024-04-25T02:29:50.590 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_notify": 0, 2024-04-25T02:29:50.590 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T02:29:50.590 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls": 0, 2024-04-25T02:29:50.590 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls_filter": 0, 2024-04-25T02:29:50.590 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_other": 1, 2024-04-25T02:29:50.590 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_active": 0, 2024-04-25T02:29:50.591 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_send": 0, 2024-04-25T02:29:50.591 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_resend": 0, 2024-04-25T02:29:50.591 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_ping": 0, 2024-04-25T02:29:50.591 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_active": 0, 2024-04-25T02:29:50.591 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_send": 0, 2024-04-25T02:29:50.591 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_resend": 0, 2024-04-25T02:29:50.591 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_active": 0, 2024-04-25T02:29:50.591 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_send": 0, 2024-04-25T02:29:50.591 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_resend": 0, 2024-04-25T02:29:50.591 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_active": 0, 2024-04-25T02:29:50.591 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_send": 0, 2024-04-25T02:29:50.591 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_resend": 0, 2024-04-25T02:29:50.591 INFO:teuthology.orchestra.run.smithi176.stdout: "command_active": 0, 2024-04-25T02:29:50.591 INFO:teuthology.orchestra.run.smithi176.stdout: "command_send": 0, 2024-04-25T02:29:50.591 INFO:teuthology.orchestra.run.smithi176.stdout: "command_resend": 0, 2024-04-25T02:29:50.592 INFO:teuthology.orchestra.run.smithi176.stdout: "map_epoch": 0, 2024-04-25T02:29:50.592 INFO:teuthology.orchestra.run.smithi176.stdout: "map_full": 0, 2024-04-25T02:29:50.592 INFO:teuthology.orchestra.run.smithi176.stdout: "map_inc": 0, 2024-04-25T02:29:50.592 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_sessions": 1, 2024-04-25T02:29:50.592 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_open": 1, 2024-04-25T02:29:50.592 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_close": 0, 2024-04-25T02:29:50.592 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_laggy": 0, 2024-04-25T02:29:50.592 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_wr": 0, 2024-04-25T02:29:50.592 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_rd": 0, 2024-04-25T02:29:50.592 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_del": 0 2024-04-25T02:29:50.592 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.592 INFO:teuthology.orchestra.run.smithi176.stdout: "objecter-0x55568218cd20": { 2024-04-25T02:29:50.592 INFO:teuthology.orchestra.run.smithi176.stdout: "op_active": 0, 2024-04-25T02:29:50.592 INFO:teuthology.orchestra.run.smithi176.stdout: "op_laggy": 0, 2024-04-25T02:29:50.592 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send": 0, 2024-04-25T02:29:50.593 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send_bytes": 0, 2024-04-25T02:29:50.593 INFO:teuthology.orchestra.run.smithi176.stdout: "op_resend": 0, 2024-04-25T02:29:50.593 INFO:teuthology.orchestra.run.smithi176.stdout: "op_reply": 0, 2024-04-25T02:29:50.593 INFO:teuthology.orchestra.run.smithi176.stdout: "op_latency": { 2024-04-25T02:29:50.593 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.593 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.593 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.593 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.593 INFO:teuthology.orchestra.run.smithi176.stdout: "op_inflight": 0, 2024-04-25T02:29:50.593 INFO:teuthology.orchestra.run.smithi176.stdout: "oplen_avg": { 2024-04-25T02:29:50.593 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.593 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0 2024-04-25T02:29:50.593 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.593 INFO:teuthology.orchestra.run.smithi176.stdout: "op": 0, 2024-04-25T02:29:50.593 INFO:teuthology.orchestra.run.smithi176.stdout: "op_r": 0, 2024-04-25T02:29:50.594 INFO:teuthology.orchestra.run.smithi176.stdout: "op_w": 0, 2024-04-25T02:29:50.594 INFO:teuthology.orchestra.run.smithi176.stdout: "op_rmw": 0, 2024-04-25T02:29:50.594 INFO:teuthology.orchestra.run.smithi176.stdout: "op_pg": 0, 2024-04-25T02:29:50.594 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_stat": 0, 2024-04-25T02:29:50.594 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_create": 0, 2024-04-25T02:29:50.594 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_read": 0, 2024-04-25T02:29:50.594 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_write": 0, 2024-04-25T02:29:50.594 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writefull": 0, 2024-04-25T02:29:50.594 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writesame": 0, 2024-04-25T02:29:50.594 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_append": 0, 2024-04-25T02:29:50.594 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_zero": 0, 2024-04-25T02:29:50.594 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_truncate": 0, 2024-04-25T02:29:50.594 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_delete": 0, 2024-04-25T02:29:50.594 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_mapext": 0, 2024-04-25T02:29:50.594 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_sparse_read": 0, 2024-04-25T02:29:50.595 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_clonerange": 0, 2024-04-25T02:29:50.595 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_getxattr": 0, 2024-04-25T02:29:50.595 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_setxattr": 0, 2024-04-25T02:29:50.595 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_cmpxattr": 0, 2024-04-25T02:29:50.595 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_rmxattr": 0, 2024-04-25T02:29:50.595 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_resetxattrs": 0, 2024-04-25T02:29:50.595 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_call": 0, 2024-04-25T02:29:50.595 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_watch": 0, 2024-04-25T02:29:50.595 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_notify": 0, 2024-04-25T02:29:50.595 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T02:29:50.595 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls": 0, 2024-04-25T02:29:50.595 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls_filter": 0, 2024-04-25T02:29:50.595 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_other": 0, 2024-04-25T02:29:50.595 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_active": 0, 2024-04-25T02:29:50.595 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_send": 0, 2024-04-25T02:29:50.596 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_resend": 0, 2024-04-25T02:29:50.596 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_ping": 0, 2024-04-25T02:29:50.596 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_active": 0, 2024-04-25T02:29:50.596 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_send": 0, 2024-04-25T02:29:50.596 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_resend": 0, 2024-04-25T02:29:50.596 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_active": 0, 2024-04-25T02:29:50.596 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_send": 0, 2024-04-25T02:29:50.596 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_resend": 0, 2024-04-25T02:29:50.596 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_active": 0, 2024-04-25T02:29:50.596 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_send": 0, 2024-04-25T02:29:50.596 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_resend": 0, 2024-04-25T02:29:50.596 INFO:teuthology.orchestra.run.smithi176.stdout: "command_active": 0, 2024-04-25T02:29:50.596 INFO:teuthology.orchestra.run.smithi176.stdout: "command_send": 0, 2024-04-25T02:29:50.596 INFO:teuthology.orchestra.run.smithi176.stdout: "command_resend": 0, 2024-04-25T02:29:50.596 INFO:teuthology.orchestra.run.smithi176.stdout: "map_epoch": 0, 2024-04-25T02:29:50.597 INFO:teuthology.orchestra.run.smithi176.stdout: "map_full": 0, 2024-04-25T02:29:50.597 INFO:teuthology.orchestra.run.smithi176.stdout: "map_inc": 0, 2024-04-25T02:29:50.597 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_sessions": 0, 2024-04-25T02:29:50.597 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_open": 0, 2024-04-25T02:29:50.597 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_close": 0, 2024-04-25T02:29:50.597 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_laggy": 0, 2024-04-25T02:29:50.597 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_wr": 0, 2024-04-25T02:29:50.597 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_rd": 0, 2024-04-25T02:29:50.597 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_del": 0 2024-04-25T02:29:50.597 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.597 INFO:teuthology.orchestra.run.smithi176.stdout: "objecter-0x55568218dea0": { 2024-04-25T02:29:50.597 INFO:teuthology.orchestra.run.smithi176.stdout: "op_active": 0, 2024-04-25T02:29:50.597 INFO:teuthology.orchestra.run.smithi176.stdout: "op_laggy": 0, 2024-04-25T02:29:50.597 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send": 3, 2024-04-25T02:29:50.597 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send_bytes": 411, 2024-04-25T02:29:50.598 INFO:teuthology.orchestra.run.smithi176.stdout: "op_resend": 0, 2024-04-25T02:29:50.598 INFO:teuthology.orchestra.run.smithi176.stdout: "op_reply": 3, 2024-04-25T02:29:50.598 INFO:teuthology.orchestra.run.smithi176.stdout: "op_latency": { 2024-04-25T02:29:50.598 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 3, 2024-04-25T02:29:50.598 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.006999934, 2024-04-25T02:29:50.598 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.002333311 2024-04-25T02:29:50.598 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.598 INFO:teuthology.orchestra.run.smithi176.stdout: "op_inflight": 0, 2024-04-25T02:29:50.598 INFO:teuthology.orchestra.run.smithi176.stdout: "oplen_avg": { 2024-04-25T02:29:50.598 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 3, 2024-04-25T02:29:50.598 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 3 2024-04-25T02:29:50.598 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.598 INFO:teuthology.orchestra.run.smithi176.stdout: "op": 3, 2024-04-25T02:29:50.598 INFO:teuthology.orchestra.run.smithi176.stdout: "op_r": 0, 2024-04-25T02:29:50.598 INFO:teuthology.orchestra.run.smithi176.stdout: "op_w": 3, 2024-04-25T02:29:50.599 INFO:teuthology.orchestra.run.smithi176.stdout: "op_rmw": 0, 2024-04-25T02:29:50.599 INFO:teuthology.orchestra.run.smithi176.stdout: "op_pg": 0, 2024-04-25T02:29:50.599 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_stat": 0, 2024-04-25T02:29:50.599 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_create": 0, 2024-04-25T02:29:50.599 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_read": 0, 2024-04-25T02:29:50.599 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_write": 3, 2024-04-25T02:29:50.599 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writefull": 0, 2024-04-25T02:29:50.599 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writesame": 0, 2024-04-25T02:29:50.599 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_append": 0, 2024-04-25T02:29:50.599 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_zero": 0, 2024-04-25T02:29:50.599 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_truncate": 0, 2024-04-25T02:29:50.599 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_delete": 0, 2024-04-25T02:29:50.599 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_mapext": 0, 2024-04-25T02:29:50.599 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_sparse_read": 0, 2024-04-25T02:29:50.599 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_clonerange": 0, 2024-04-25T02:29:50.600 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_getxattr": 0, 2024-04-25T02:29:50.600 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_setxattr": 0, 2024-04-25T02:29:50.600 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_cmpxattr": 0, 2024-04-25T02:29:50.600 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_rmxattr": 0, 2024-04-25T02:29:50.600 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_resetxattrs": 0, 2024-04-25T02:29:50.600 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_call": 0, 2024-04-25T02:29:50.600 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_watch": 0, 2024-04-25T02:29:50.600 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_notify": 0, 2024-04-25T02:29:50.600 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T02:29:50.600 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls": 0, 2024-04-25T02:29:50.600 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls_filter": 0, 2024-04-25T02:29:50.600 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_other": 0, 2024-04-25T02:29:50.600 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_active": 0, 2024-04-25T02:29:50.600 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_send": 0, 2024-04-25T02:29:50.600 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_resend": 0, 2024-04-25T02:29:50.600 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_ping": 0, 2024-04-25T02:29:50.601 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_active": 0, 2024-04-25T02:29:50.601 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_send": 0, 2024-04-25T02:29:50.601 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_resend": 0, 2024-04-25T02:29:50.601 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_active": 0, 2024-04-25T02:29:50.601 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_send": 0, 2024-04-25T02:29:50.601 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_resend": 0, 2024-04-25T02:29:50.601 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_active": 0, 2024-04-25T02:29:50.601 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_send": 0, 2024-04-25T02:29:50.601 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_resend": 0, 2024-04-25T02:29:50.601 INFO:teuthology.orchestra.run.smithi176.stdout: "command_active": 0, 2024-04-25T02:29:50.601 INFO:teuthology.orchestra.run.smithi176.stdout: "command_send": 0, 2024-04-25T02:29:50.601 INFO:teuthology.orchestra.run.smithi176.stdout: "command_resend": 0, 2024-04-25T02:29:50.601 INFO:teuthology.orchestra.run.smithi176.stdout: "map_epoch": 0, 2024-04-25T02:29:50.601 INFO:teuthology.orchestra.run.smithi176.stdout: "map_full": 0, 2024-04-25T02:29:50.601 INFO:teuthology.orchestra.run.smithi176.stdout: "map_inc": 0, 2024-04-25T02:29:50.602 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_sessions": 2, 2024-04-25T02:29:50.602 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_open": 2, 2024-04-25T02:29:50.602 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_close": 0, 2024-04-25T02:29:50.602 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_laggy": 0, 2024-04-25T02:29:50.602 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_wr": 0, 2024-04-25T02:29:50.602 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_rd": 0, 2024-04-25T02:29:50.602 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_del": 0 2024-04-25T02:29:50.602 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.602 INFO:teuthology.orchestra.run.smithi176.stdout: "objecter-0x555682fa4b40": { 2024-04-25T02:29:50.602 INFO:teuthology.orchestra.run.smithi176.stdout: "op_active": 0, 2024-04-25T02:29:50.602 INFO:teuthology.orchestra.run.smithi176.stdout: "op_laggy": 0, 2024-04-25T02:29:50.602 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send": 0, 2024-04-25T02:29:50.602 INFO:teuthology.orchestra.run.smithi176.stdout: "op_send_bytes": 0, 2024-04-25T02:29:50.602 INFO:teuthology.orchestra.run.smithi176.stdout: "op_resend": 0, 2024-04-25T02:29:50.603 INFO:teuthology.orchestra.run.smithi176.stdout: "op_reply": 0, 2024-04-25T02:29:50.603 INFO:teuthology.orchestra.run.smithi176.stdout: "op_latency": { 2024-04-25T02:29:50.603 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.603 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.603 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.603 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.603 INFO:teuthology.orchestra.run.smithi176.stdout: "op_inflight": 0, 2024-04-25T02:29:50.603 INFO:teuthology.orchestra.run.smithi176.stdout: "oplen_avg": { 2024-04-25T02:29:50.603 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.603 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0 2024-04-25T02:29:50.603 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.603 INFO:teuthology.orchestra.run.smithi176.stdout: "op": 0, 2024-04-25T02:29:50.603 INFO:teuthology.orchestra.run.smithi176.stdout: "op_r": 0, 2024-04-25T02:29:50.603 INFO:teuthology.orchestra.run.smithi176.stdout: "op_w": 0, 2024-04-25T02:29:50.603 INFO:teuthology.orchestra.run.smithi176.stdout: "op_rmw": 0, 2024-04-25T02:29:50.603 INFO:teuthology.orchestra.run.smithi176.stdout: "op_pg": 0, 2024-04-25T02:29:50.604 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_stat": 0, 2024-04-25T02:29:50.604 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_create": 0, 2024-04-25T02:29:50.604 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_read": 0, 2024-04-25T02:29:50.604 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_write": 0, 2024-04-25T02:29:50.604 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writefull": 0, 2024-04-25T02:29:50.604 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_writesame": 0, 2024-04-25T02:29:50.604 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_append": 0, 2024-04-25T02:29:50.604 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_zero": 0, 2024-04-25T02:29:50.604 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_truncate": 0, 2024-04-25T02:29:50.604 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_delete": 0, 2024-04-25T02:29:50.604 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_mapext": 0, 2024-04-25T02:29:50.604 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_sparse_read": 0, 2024-04-25T02:29:50.604 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_clonerange": 0, 2024-04-25T02:29:50.604 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_getxattr": 0, 2024-04-25T02:29:50.604 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_setxattr": 0, 2024-04-25T02:29:50.605 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_cmpxattr": 0, 2024-04-25T02:29:50.605 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_rmxattr": 0, 2024-04-25T02:29:50.605 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_resetxattrs": 0, 2024-04-25T02:29:50.605 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_call": 0, 2024-04-25T02:29:50.605 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_watch": 0, 2024-04-25T02:29:50.605 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_notify": 0, 2024-04-25T02:29:50.605 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T02:29:50.605 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls": 0, 2024-04-25T02:29:50.605 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_pgls_filter": 0, 2024-04-25T02:29:50.605 INFO:teuthology.orchestra.run.smithi176.stdout: "osdop_other": 0, 2024-04-25T02:29:50.605 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_active": 0, 2024-04-25T02:29:50.605 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_send": 0, 2024-04-25T02:29:50.605 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_resend": 0, 2024-04-25T02:29:50.605 INFO:teuthology.orchestra.run.smithi176.stdout: "linger_ping": 0, 2024-04-25T02:29:50.605 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_active": 0, 2024-04-25T02:29:50.605 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_send": 0, 2024-04-25T02:29:50.606 INFO:teuthology.orchestra.run.smithi176.stdout: "poolop_resend": 0, 2024-04-25T02:29:50.606 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_active": 0, 2024-04-25T02:29:50.606 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_send": 0, 2024-04-25T02:29:50.606 INFO:teuthology.orchestra.run.smithi176.stdout: "poolstat_resend": 0, 2024-04-25T02:29:50.606 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_active": 0, 2024-04-25T02:29:50.606 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_send": 0, 2024-04-25T02:29:50.606 INFO:teuthology.orchestra.run.smithi176.stdout: "statfs_resend": 0, 2024-04-25T02:29:50.606 INFO:teuthology.orchestra.run.smithi176.stdout: "command_active": 0, 2024-04-25T02:29:50.606 INFO:teuthology.orchestra.run.smithi176.stdout: "command_send": 0, 2024-04-25T02:29:50.606 INFO:teuthology.orchestra.run.smithi176.stdout: "command_resend": 0, 2024-04-25T02:29:50.606 INFO:teuthology.orchestra.run.smithi176.stdout: "map_epoch": 0, 2024-04-25T02:29:50.606 INFO:teuthology.orchestra.run.smithi176.stdout: "map_full": 0, 2024-04-25T02:29:50.606 INFO:teuthology.orchestra.run.smithi176.stdout: "map_inc": 0, 2024-04-25T02:29:50.606 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_sessions": 0, 2024-04-25T02:29:50.607 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_open": 0, 2024-04-25T02:29:50.607 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_session_close": 0, 2024-04-25T02:29:50.607 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_laggy": 0, 2024-04-25T02:29:50.607 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_wr": 0, 2024-04-25T02:29:50.607 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_rd": 0, 2024-04-25T02:29:50.607 INFO:teuthology.orchestra.run.smithi176.stdout: "omap_del": 0 2024-04-25T02:29:50.607 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.607 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-mgr_client_bytes": { 2024-04-25T02:29:50.607 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.607 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 134217728, 2024-04-25T02:29:50.607 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.607 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 63, 2024-04-25T02:29:50.607 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 250168, 2024-04-25T02:29:50.607 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.607 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 63, 2024-04-25T02:29:50.608 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.608 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.608 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 63, 2024-04-25T02:29:50.608 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 250168, 2024-04-25T02:29:50.608 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.608 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.608 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.608 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.608 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.608 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.608 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-mgr_client_messages": { 2024-04-25T02:29:50.608 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.608 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 512, 2024-04-25T02:29:50.608 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.608 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 63, 2024-04-25T02:29:50.608 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 63, 2024-04-25T02:29:50.609 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.609 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 63, 2024-04-25T02:29:50.609 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.609 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.609 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 63, 2024-04-25T02:29:50.609 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 63, 2024-04-25T02:29:50.609 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.609 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.609 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.609 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.609 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.609 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.609 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-mgr_mds_bytes": { 2024-04-25T02:29:50.609 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.609 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 134217728, 2024-04-25T02:29:50.610 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.610 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 86, 2024-04-25T02:29:50.610 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 975562, 2024-04-25T02:29:50.610 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.610 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 86, 2024-04-25T02:29:50.610 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.610 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.610 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 86, 2024-04-25T02:29:50.610 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 975562, 2024-04-25T02:29:50.610 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.610 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.610 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.610 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.610 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.611 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.611 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-mgr_mds_messsages": { 2024-04-25T02:29:50.611 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.611 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 128, 2024-04-25T02:29:50.611 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.611 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 86, 2024-04-25T02:29:50.611 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 86, 2024-04-25T02:29:50.611 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.611 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 86, 2024-04-25T02:29:50.611 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.611 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.611 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 86, 2024-04-25T02:29:50.611 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 86, 2024-04-25T02:29:50.611 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.611 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.612 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.612 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.612 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.612 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.612 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-mgr_mon_bytes": { 2024-04-25T02:29:50.612 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.612 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 134217728, 2024-04-25T02:29:50.612 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.612 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 66, 2024-04-25T02:29:50.612 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 466769, 2024-04-25T02:29:50.612 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.612 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 66, 2024-04-25T02:29:50.612 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.612 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.613 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 66, 2024-04-25T02:29:50.613 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 466769, 2024-04-25T02:29:50.613 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.613 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.613 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.613 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.613 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.613 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.613 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-mgr_mon_messsages": { 2024-04-25T02:29:50.613 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.613 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 128, 2024-04-25T02:29:50.613 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.613 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 66, 2024-04-25T02:29:50.613 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 66, 2024-04-25T02:29:50.613 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.614 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 66, 2024-04-25T02:29:50.614 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.614 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.614 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 66, 2024-04-25T02:29:50.614 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 66, 2024-04-25T02:29:50.614 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.614 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.614 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.614 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.614 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.614 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.614 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-mgr_osd_bytes": { 2024-04-25T02:29:50.614 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.614 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 536870912, 2024-04-25T02:29:50.615 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.615 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 360, 2024-04-25T02:29:50.615 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 4380761, 2024-04-25T02:29:50.615 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.615 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 360, 2024-04-25T02:29:50.615 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.615 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.615 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 360, 2024-04-25T02:29:50.615 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 4380761, 2024-04-25T02:29:50.615 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.615 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.615 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.615 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.615 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.616 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.616 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-mgr_osd_messsages": { 2024-04-25T02:29:50.616 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.616 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 8192, 2024-04-25T02:29:50.616 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.616 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 360, 2024-04-25T02:29:50.616 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 360, 2024-04-25T02:29:50.616 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.616 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 360, 2024-04-25T02:29:50.616 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.616 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.616 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 360, 2024-04-25T02:29:50.616 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 360, 2024-04-25T02:29:50.616 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.616 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.617 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.617 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.617 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.617 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.617 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-msgr_dispatch_throttler-client": { 2024-04-25T02:29:50.617 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.617 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-04-25T02:29:50.617 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.617 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 172, 2024-04-25T02:29:50.617 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 66997, 2024-04-25T02:29:50.617 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.617 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 172, 2024-04-25T02:29:50.618 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.618 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.618 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 172, 2024-04-25T02:29:50.618 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 66997, 2024-04-25T02:29:50.618 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.618 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.618 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.618 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.618 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.618 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.618 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-msgr_dispatch_throttler-client-0x55568218dd60": { 2024-04-25T02:29:50.618 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.618 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-04-25T02:29:50.618 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.618 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 83, 2024-04-25T02:29:50.619 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 44150, 2024-04-25T02:29:50.619 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.619 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 83, 2024-04-25T02:29:50.619 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.619 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.619 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 83, 2024-04-25T02:29:50.619 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 44150, 2024-04-25T02:29:50.619 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.619 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.619 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.619 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.619 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.619 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.619 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-msgr_dispatch_throttler-client-0x555682fa48c0": { 2024-04-25T02:29:50.620 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.620 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-04-25T02:29:50.620 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.620 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 40, 2024-04-25T02:29:50.620 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 22265, 2024-04-25T02:29:50.620 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.620 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 40, 2024-04-25T02:29:50.620 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.620 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.620 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 40, 2024-04-25T02:29:50.620 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 22265, 2024-04-25T02:29:50.620 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.620 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.620 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.621 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.621 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.621 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.621 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-msgr_dispatch_throttler-mgr": { 2024-04-25T02:29:50.621 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.621 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-04-25T02:29:50.621 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.621 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 352, 2024-04-25T02:29:50.621 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 853897, 2024-04-25T02:29:50.621 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.621 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 352, 2024-04-25T02:29:50.621 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.621 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.621 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 352, 2024-04-25T02:29:50.621 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 853897, 2024-04-25T02:29:50.622 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.622 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.622 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.622 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.622 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.622 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.622 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-msgr_dispatch_throttler-mgr-0x55567efa1c20": { 2024-04-25T02:29:50.622 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.622 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-04-25T02:29:50.622 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.622 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 575, 2024-04-25T02:29:50.622 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 6073260, 2024-04-25T02:29:50.622 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.623 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 575, 2024-04-25T02:29:50.623 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.623 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.623 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 575, 2024-04-25T02:29:50.623 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 6073260, 2024-04-25T02:29:50.623 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.623 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.623 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.623 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.623 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.623 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.623 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-msgr_dispatch_throttler-radosclient": { 2024-04-25T02:29:50.624 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.624 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-04-25T02:29:50.624 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.624 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 177, 2024-04-25T02:29:50.624 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 543251, 2024-04-25T02:29:50.624 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.624 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 177, 2024-04-25T02:29:50.624 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.624 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.624 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 177, 2024-04-25T02:29:50.624 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 543251, 2024-04-25T02:29:50.624 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.624 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.624 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.624 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.625 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.625 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.625 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x555681ef3180": { 2024-04-25T02:29:50.625 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.625 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-04-25T02:29:50.625 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.625 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 11, 2024-04-25T02:29:50.625 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 500419, 2024-04-25T02:29:50.625 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.625 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 11, 2024-04-25T02:29:50.625 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.625 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.625 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 11, 2024-04-25T02:29:50.625 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 500419, 2024-04-25T02:29:50.626 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.626 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.626 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.626 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.626 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.626 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.626 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x555681ef3400": { 2024-04-25T02:29:50.626 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.626 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-04-25T02:29:50.626 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.626 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 12, 2024-04-25T02:29:50.626 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 500443, 2024-04-25T02:29:50.626 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.626 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 12, 2024-04-25T02:29:50.627 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.627 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.627 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 12, 2024-04-25T02:29:50.627 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 500443, 2024-04-25T02:29:50.627 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.627 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.627 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.627 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.627 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.627 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.627 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55568218c280": { 2024-04-25T02:29:50.627 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.627 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-04-25T02:29:50.628 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.628 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 10, 2024-04-25T02:29:50.628 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 368214, 2024-04-25T02:29:50.628 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.628 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 10, 2024-04-25T02:29:50.628 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.628 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.628 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 10, 2024-04-25T02:29:50.628 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 368214, 2024-04-25T02:29:50.628 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.628 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.628 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.628 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.628 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.628 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.629 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_bytes": { 2024-04-25T02:29:50.629 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.629 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-04-25T02:29:50.629 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.629 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-04-25T02:29:50.629 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-04-25T02:29:50.629 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.629 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-04-25T02:29:50.629 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.629 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.629 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 0, 2024-04-25T02:29:50.629 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-04-25T02:29:50.629 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.629 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.630 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.630 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.630 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.630 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.630 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_bytes-0x555681ef2be0": { 2024-04-25T02:29:50.630 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.630 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-04-25T02:29:50.630 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.630 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 163, 2024-04-25T02:29:50.630 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 2433005, 2024-04-25T02:29:50.630 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.630 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 163, 2024-04-25T02:29:50.630 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.630 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.630 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 163, 2024-04-25T02:29:50.631 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 2433005, 2024-04-25T02:29:50.631 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.631 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.631 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.631 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.631 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.631 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.631 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_bytes-0x555681ef30e0": { 2024-04-25T02:29:50.631 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.631 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-04-25T02:29:50.631 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.631 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-04-25T02:29:50.631 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-04-25T02:29:50.631 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.631 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-04-25T02:29:50.632 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.632 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.632 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 0, 2024-04-25T02:29:50.632 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-04-25T02:29:50.632 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.632 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.632 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.632 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.632 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.632 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.632 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_bytes-0x555681ef3360": { 2024-04-25T02:29:50.632 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.632 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-04-25T02:29:50.632 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.632 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-04-25T02:29:50.633 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-04-25T02:29:50.633 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.633 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-04-25T02:29:50.633 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.633 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.633 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 0, 2024-04-25T02:29:50.633 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-04-25T02:29:50.633 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.633 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.633 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.633 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.633 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.633 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.633 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_bytes-0x55568218c0a0": { 2024-04-25T02:29:50.633 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.634 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-04-25T02:29:50.634 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.634 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 1, 2024-04-25T02:29:50.634 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-04-25T02:29:50.634 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.634 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 1, 2024-04-25T02:29:50.634 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.634 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.634 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 1, 2024-04-25T02:29:50.634 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-04-25T02:29:50.634 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.634 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.634 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.634 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.634 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.635 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.635 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_bytes-0x55568218c960": { 2024-04-25T02:29:50.635 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.635 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-04-25T02:29:50.635 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.635 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-04-25T02:29:50.635 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-04-25T02:29:50.635 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.635 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-04-25T02:29:50.635 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.635 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.635 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 0, 2024-04-25T02:29:50.635 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-04-25T02:29:50.635 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.635 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.636 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.636 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.636 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.636 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.636 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_bytes-0x55568218dc20": { 2024-04-25T02:29:50.636 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.636 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-04-25T02:29:50.636 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.636 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-04-25T02:29:50.636 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-04-25T02:29:50.636 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.636 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-04-25T02:29:50.636 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 3, 2024-04-25T02:29:50.636 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 411, 2024-04-25T02:29:50.637 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 3, 2024-04-25T02:29:50.637 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 411, 2024-04-25T02:29:50.637 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.637 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.637 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.637 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.637 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.637 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.637 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_bytes-0x555682fa4960": { 2024-04-25T02:29:50.637 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.637 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 104857600, 2024-04-25T02:29:50.637 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.637 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-04-25T02:29:50.637 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-04-25T02:29:50.637 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.638 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-04-25T02:29:50.638 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.638 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.638 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 0, 2024-04-25T02:29:50.638 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-04-25T02:29:50.638 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.638 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.638 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.638 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.638 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.638 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.638 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_ops": { 2024-04-25T02:29:50.638 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.638 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 1024, 2024-04-25T02:29:50.638 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.639 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-04-25T02:29:50.639 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-04-25T02:29:50.639 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.639 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-04-25T02:29:50.639 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.639 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.639 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 0, 2024-04-25T02:29:50.639 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-04-25T02:29:50.639 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.639 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.639 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.639 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.639 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.639 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.639 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_ops-0x555681ef2c80": { 2024-04-25T02:29:50.640 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.640 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 1024, 2024-04-25T02:29:50.640 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.640 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 163, 2024-04-25T02:29:50.640 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 163, 2024-04-25T02:29:50.640 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.640 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 163, 2024-04-25T02:29:50.640 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.640 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.640 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 163, 2024-04-25T02:29:50.640 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 163, 2024-04-25T02:29:50.640 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.640 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.640 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.640 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.641 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.641 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.641 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_ops-0x555681ef32c0": { 2024-04-25T02:29:50.641 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.641 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 1024, 2024-04-25T02:29:50.641 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.641 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-04-25T02:29:50.641 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-04-25T02:29:50.641 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.641 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-04-25T02:29:50.641 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.641 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.641 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 0, 2024-04-25T02:29:50.641 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-04-25T02:29:50.641 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.641 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.642 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.642 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.642 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.642 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.642 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_ops-0x555681ef3f40": { 2024-04-25T02:29:50.642 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.642 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 1024, 2024-04-25T02:29:50.642 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.642 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-04-25T02:29:50.642 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-04-25T02:29:50.642 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.642 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-04-25T02:29:50.642 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.642 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.642 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 0, 2024-04-25T02:29:50.643 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-04-25T02:29:50.643 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.643 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.643 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.643 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.643 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.643 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.643 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_ops-0x55568218c1e0": { 2024-04-25T02:29:50.643 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.643 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 1024, 2024-04-25T02:29:50.643 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.643 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 1, 2024-04-25T02:29:50.643 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 1, 2024-04-25T02:29:50.643 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.643 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 1, 2024-04-25T02:29:50.644 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.644 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.644 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 1, 2024-04-25T02:29:50.644 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 1, 2024-04-25T02:29:50.644 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.644 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.644 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.644 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.644 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.644 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.644 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_ops-0x55568218d180": { 2024-04-25T02:29:50.644 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.644 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 1024, 2024-04-25T02:29:50.644 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.644 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-04-25T02:29:50.645 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-04-25T02:29:50.645 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.645 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-04-25T02:29:50.645 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.645 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.645 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 0, 2024-04-25T02:29:50.645 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-04-25T02:29:50.645 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.645 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.645 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.645 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.645 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.645 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.645 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_ops-0x555682fa4640": { 2024-04-25T02:29:50.645 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.646 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 1024, 2024-04-25T02:29:50.646 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.646 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-04-25T02:29:50.646 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-04-25T02:29:50.646 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.646 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-04-25T02:29:50.646 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 3, 2024-04-25T02:29:50.646 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 3, 2024-04-25T02:29:50.646 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 3, 2024-04-25T02:29:50.646 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 3, 2024-04-25T02:29:50.646 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.646 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.646 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.646 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.646 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.647 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-04-25T02:29:50.647 INFO:teuthology.orchestra.run.smithi176.stdout: "throttle-objecter_ops-0x555682fa4a00": { 2024-04-25T02:29:50.647 INFO:teuthology.orchestra.run.smithi176.stdout: "val": 0, 2024-04-25T02:29:50.647 INFO:teuthology.orchestra.run.smithi176.stdout: "max": 1024, 2024-04-25T02:29:50.647 INFO:teuthology.orchestra.run.smithi176.stdout: "get_started": 0, 2024-04-25T02:29:50.647 INFO:teuthology.orchestra.run.smithi176.stdout: "get": 0, 2024-04-25T02:29:50.647 INFO:teuthology.orchestra.run.smithi176.stdout: "get_sum": 0, 2024-04-25T02:29:50.647 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_fail": 0, 2024-04-25T02:29:50.647 INFO:teuthology.orchestra.run.smithi176.stdout: "get_or_fail_success": 0, 2024-04-25T02:29:50.647 INFO:teuthology.orchestra.run.smithi176.stdout: "take": 0, 2024-04-25T02:29:50.647 INFO:teuthology.orchestra.run.smithi176.stdout: "take_sum": 0, 2024-04-25T02:29:50.647 INFO:teuthology.orchestra.run.smithi176.stdout: "put": 0, 2024-04-25T02:29:50.647 INFO:teuthology.orchestra.run.smithi176.stdout: "put_sum": 0, 2024-04-25T02:29:50.647 INFO:teuthology.orchestra.run.smithi176.stdout: "wait": { 2024-04-25T02:29:50.647 INFO:teuthology.orchestra.run.smithi176.stdout: "avgcount": 0, 2024-04-25T02:29:50.648 INFO:teuthology.orchestra.run.smithi176.stdout: "sum": 0.000000000, 2024-04-25T02:29:50.648 INFO:teuthology.orchestra.run.smithi176.stdout: "avgtime": 0.000000000 2024-04-25T02:29:50.648 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.648 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-04-25T02:29:50.648 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-04-25T02:29:50.649 INFO:tasks.check_counter:Daemon mgr.x finisher-volumes.complete_latency.avgcount=9 2024-04-25T02:29:50.650 INFO:tasks.check_counter:Daemon mgr.x finisher-volumes.queue_len=0 2024-04-25T02:29:50.650 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T02:29:50.660 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T02:29:50.660 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:29:50.660 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:29:50.680 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056113,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19720 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248848k,nr_inodes=812212,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:29:50.680 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-25T02:29:50.680 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:29:50.738 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056113,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19720 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248848k,nr_inodes=812212,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T02:29:50.738 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:29:50.739 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:29:50.755 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056111,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20664 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248848k,nr_inodes=812212,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:29:50.755 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-04-25T02:29:50.755 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:29:50.811 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056111,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20664 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248848k,nr_inodes=812212,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T02:29:50.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:50.811 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-04-25T02:29:50.830 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T02:29:50.830 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:29:50.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:50.830 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T02:29:50.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:50.900 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:29:50.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:50.970 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2024-04-25T02:29:51.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:51.072 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-04-25T02:29:51.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:51.088 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2024-04-25T02:29:51.157 INFO:teuthology.orchestra.run.smithi067.stderr:Cannot find device "ceph-brx" 2024-04-25T02:29:51.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:29:51.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:51.159 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-04-25T02:29:51.176 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T02:29:51.176 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T02:29:51.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:51.177 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T02:29:51.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:51.245 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T02:29:51.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:51.312 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-04-25T02:29:51.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:51.402 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-04-25T02:29:51.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:29:51.417 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-04-25T02:29:51.485 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-04-25T02:29:51.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:29:51.487 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T02:29:51.499 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T02:29:51.499 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:29:51.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.603+0000 7f64e9e9a640 1 Processor -- start 2024-04-25T02:29:51.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.603+0000 7f64e9e9a640 1 -- start start 2024-04-25T02:29:51.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.604+0000 7f64e9e9a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e40cf3d0 0x7f64e40d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:51.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.604+0000 7f64e9e9a640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64e40d2cc0 con 0x7f64e415e5f0 2024-04-25T02:29:51.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.604+0000 7f64e9e9a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64e40d2fa0 con 0x7f64e415e210 2024-04-25T02:29:51.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.604+0000 7f64e9e9a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f64e406c6f0 con 0x7f64e40cf3d0 2024-04-25T02:29:51.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.604+0000 7f64e2ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f64e415e5f0 0x7f64e40cecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55610/0 (socket says 172.21.15.67:55610) 2024-04-25T02:29:51.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.604+0000 7f64e2ffd640 1 -- 172.21.15.67:0/1968872309 learned_addr learned my addr 172.21.15.67:0/1968872309 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:51.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.604+0000 7f64e3fff640 1 --2- 172.21.15.67:0/1968872309 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e40cf3d0 0x7f64e40d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:51.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.605+0000 7f64e27fc640 1 -- 172.21.15.67:0/1968872309 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2053531915 0 0) 0x7f64e40d2cc0 con 0x7f64e415e5f0 2024-04-25T02:29:51.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.605+0000 7f64e27fc640 1 -- 172.21.15.67:0/1968872309 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64cc003520 con 0x7f64e415e5f0 2024-04-25T02:29:51.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.605+0000 7f64e3fff640 1 -- 172.21.15.67:0/1968872309 >> v1:172.21.15.176:6789/0 conn(0x7f64e415e210 legacy=0x7f64e406cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:51.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.605+0000 7f64e3fff640 1 -- 172.21.15.67:0/1968872309 >> v1:172.21.15.67:6789/0 conn(0x7f64e415e5f0 legacy=0x7f64e40cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:51.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.605+0000 7f64e27fc640 1 -- 172.21.15.67:0/1968872309 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2249813212 0 0) 0x7f64e40d2fa0 con 0x7f64e415e210 2024-04-25T02:29:51.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.605+0000 7f64e3fff640 1 -- 172.21.15.67:0/1968872309 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e406c0a0 con 0x7f64e40cf3d0 2024-04-25T02:29:51.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.606+0000 7f64e3fff640 1 --2- 172.21.15.67:0/1968872309 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e40cf3d0 0x7f64e40d3e60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f64e406c870 tx=0x7f64dc02a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f7d2df228b3c825 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:51.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.606+0000 7f64e27fc640 1 -- 172.21.15.67:0/1968872309 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc007740 con 0x7f64e40cf3d0 2024-04-25T02:29:51.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.606+0000 7f64e27fc640 1 -- 172.21.15.67:0/1968872309 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64dc0078e0 con 0x7f64e40cf3d0 2024-04-25T02:29:51.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.606+0000 7f64e27fc640 1 -- 172.21.15.67:0/1968872309 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc007cb0 con 0x7f64e40cf3d0 2024-04-25T02:29:51.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.606+0000 7f64e9e9a640 1 -- 172.21.15.67:0/1968872309 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e40cf3d0 msgr2=0x7f64e40d3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:51.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.606+0000 7f64e9e9a640 1 --2- 172.21.15.67:0/1968872309 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e40cf3d0 0x7f64e40d3e60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f64e406c870 tx=0x7f64dc02a6c0 comp rx=0 tx=0).stop 2024-04-25T02:29:51.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.606+0000 7f64e9e9a640 1 -- 172.21.15.67:0/1968872309 shutdown_connections 2024-04-25T02:29:51.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.606+0000 7f64e9e9a640 1 --2- 172.21.15.67:0/1968872309 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e40cf3d0 0x7f64e40d3e60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:51.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.606+0000 7f64e9e9a640 1 -- 172.21.15.67:0/1968872309 >> 172.21.15.67:0/1968872309 conn(0x7f64e408dbb0 msgr2=0x7f64e409d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:51.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.606+0000 7f64e9e9a640 1 -- 172.21.15.67:0/1968872309 shutdown_connections 2024-04-25T02:29:51.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.606+0000 7f64e9e9a640 1 -- 172.21.15.67:0/1968872309 wait complete. 2024-04-25T02:29:51.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.607+0000 7f64e9e9a640 1 Processor -- start 2024-04-25T02:29:51.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.608+0000 7f64e9e9a640 1 -- start start 2024-04-25T02:29:51.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.608+0000 7f64e9e9a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64e40cf3d0 0x7f64e415b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:51.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.608+0000 7f64e9e9a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e415e210 0x7f64e41498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:51.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.608+0000 7f64e9e9a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e415e5f0 0x7f64e41f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:51.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.608+0000 7f64e9e9a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f64e406d490 con 0x7f64e415e5f0 2024-04-25T02:29:51.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.608+0000 7f64e9e9a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f64e406d310 con 0x7f64e40cf3d0 2024-04-25T02:29:51.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.608+0000 7f64e9e9a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f64e40d43a0 con 0x7f64e415e210 2024-04-25T02:29:51.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.609+0000 7f64e3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e415e5f0 0x7f64e41f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:51.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.609+0000 7f64e3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e415e5f0 0x7f64e41f7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58872/0 (socket says 172.21.15.67:58872) 2024-04-25T02:29:51.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.609+0000 7f64e3fff640 1 -- 172.21.15.67:0/1474559718 learned_addr learned my addr 172.21.15.67:0/1474559718 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:51.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.609+0000 7f64e2ffd640 1 --2- 172.21.15.67:0/1474559718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e415e210 0x7f64e41498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:51.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.609+0000 7f64e37fe640 1 --2- 172.21.15.67:0/1474559718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64e40cf3d0 0x7f64e415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:51.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.609+0000 7f64e3fff640 1 -- 172.21.15.67:0/1474559718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e415e210 msgr2=0x7f64e41498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:51.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.609+0000 7f64e3fff640 1 --2- 172.21.15.67:0/1474559718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e415e210 0x7f64e41498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:51.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.609+0000 7f64e3fff640 1 -- 172.21.15.67:0/1474559718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64e40cf3d0 msgr2=0x7f64e415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:51.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.609+0000 7f64e3fff640 1 --2- 172.21.15.67:0/1474559718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64e40cf3d0 0x7f64e415b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:51.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.609+0000 7f64e3fff640 1 -- 172.21.15.67:0/1474559718 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e4149e00 con 0x7f64e415e5f0 2024-04-25T02:29:51.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.609+0000 7f64e2ffd640 1 --2- 172.21.15.67:0/1474559718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e415e210 0x7f64e41498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:51.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.609+0000 7f64e3fff640 1 --2- 172.21.15.67:0/1474559718 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e415e5f0 0x7f64e41f7230 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009d90 tx=0x7f64dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:51.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.609+0000 7f64cbfff640 1 -- 172.21.15.67:0/1474559718 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc040070 con 0x7f64e415e5f0 2024-04-25T02:29:51.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.609+0000 7f64cbfff640 1 -- 172.21.15.67:0/1474559718 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64dc031b40 con 0x7f64e415e5f0 2024-04-25T02:29:51.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.609+0000 7f64e9e9a640 1 -- 172.21.15.67:0/1474559718 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e414a1b0 con 0x7f64e415e5f0 2024-04-25T02:29:51.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.609+0000 7f64cbfff640 1 -- 172.21.15.67:0/1474559718 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc03c420 con 0x7f64e415e5f0 2024-04-25T02:29:51.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.609+0000 7f64e9e9a640 1 -- 172.21.15.67:0/1474559718 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e414a770 con 0x7f64e415e5f0 2024-04-25T02:29:51.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.610+0000 7f64e9e9a640 1 -- 172.21.15.67:0/1474559718 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e4069110 con 0x7f64e415e5f0 2024-04-25T02:29:51.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.611+0000 7f64cbfff640 1 -- 172.21.15.67:0/1474559718 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f64dc039040 con 0x7f64e415e5f0 2024-04-25T02:29:51.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.611+0000 7f64cbfff640 1 --2- 172.21.15.67:0/1474559718 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f64d006bfe0 0x7f64d006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:51.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.611+0000 7f64cbfff640 1 -- 172.21.15.67:0/1474559718 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f64dc0ac140 con 0x7f64e415e5f0 2024-04-25T02:29:51.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.611+0000 7f64e37fe640 1 --2- 172.21.15.67:0/1474559718 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f64d006bfe0 0x7f64d006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:51.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.612+0000 7f64e37fe640 1 --2- 172.21.15.67:0/1474559718 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f64d006bfe0 0x7f64d006e4a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f64d4000f60 tx=0x7f64d4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:51.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.616+0000 7f64cbfff640 1 -- 172.21.15.67:0/1474559718 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f64dc07a4a0 con 0x7f64e415e5f0 2024-04-25T02:29:51.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.793+0000 7f64e9e9a640 1 -- 172.21.15.67:0/1474559718 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f64e415d9c0 con 0x7f64d006bfe0 2024-04-25T02:29:51.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.795+0000 7f64cbfff640 1 -- 172.21.15.67:0/1474559718 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13491 (secure 0 0 0) 0x7f64e415d9c0 con 0x7f64d006bfe0 2024-04-25T02:29:51.798 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:51.798 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-25T02:29:51.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.796+0000 7f64e9e9a640 1 -- 172.21.15.67:0/1474559718 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f64d006bfe0 msgr2=0x7f64d006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:51.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.796+0000 7f64e9e9a640 1 --2- 172.21.15.67:0/1474559718 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f64d006bfe0 0x7f64d006e4a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f64d4000f60 tx=0x7f64d4009040 comp rx=0 tx=0).stop 2024-04-25T02:29:51.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.796+0000 7f64e9e9a640 1 -- 172.21.15.67:0/1474559718 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e415e5f0 msgr2=0x7f64e41f7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:51.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.796+0000 7f64e9e9a640 1 --2- 172.21.15.67:0/1474559718 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e415e5f0 0x7f64e41f7230 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009d90 tx=0x7f64dc004a40 comp rx=0 tx=0).stop 2024-04-25T02:29:51.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.796+0000 7f64e9e9a640 1 -- 172.21.15.67:0/1474559718 shutdown_connections 2024-04-25T02:29:51.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.796+0000 7f64e9e9a640 1 --2- 172.21.15.67:0/1474559718 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f64d006bfe0 0x7f64d006e4a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:51.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.796+0000 7f64e9e9a640 1 --2- 172.21.15.67:0/1474559718 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e415e5f0 0x7f64e41f7230 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:51.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.796+0000 7f64e9e9a640 1 --2- 172.21.15.67:0/1474559718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e415e210 0x7f64e41498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:51.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.796+0000 7f64e9e9a640 1 --2- 172.21.15.67:0/1474559718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64e40cf3d0 0x7f64e415b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:51.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.796+0000 7f64e9e9a640 1 -- 172.21.15.67:0/1474559718 >> 172.21.15.67:0/1474559718 conn(0x7f64e408dbb0 msgr2=0x7f64e40b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:51.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.796+0000 7f64e9e9a640 1 -- 172.21.15.67:0/1474559718 shutdown_connections 2024-04-25T02:29:51.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.796+0000 7f64e9e9a640 1 -- 172.21.15.67:0/1474559718 wait complete. 2024-04-25T02:29:51.810 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-04-25T02:29:50.350670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220556,"kb_used_data":4372,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754164,"statfs":{"total":773094113280,"available":772868263936,"internally_reserved":0,"allocated":4476928,"data_stored":2473208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-141992,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":-107,"num_write_kb":-185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001672"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T02:29:47.551145+0000","last_change":"2024-04-25T02:28:15.520345+0000","last_active":"2024-04-25T02:29:47.551145+0000","last_peered":"2024-04-25T02:29:47.551145+0000","last_clean":"2024-04-25T02:29:47.551145+0000","last_became_active":"2024-04-25T02:28:15.519317+0000","last_became_peered":"2024-04-25T02:28:15.519317+0000","last_unstale":"2024-04-25T02:29:47.551145+0000","last_undegraded":"2024-04-25T02:29:47.551145+0000","last_fullsized":"2024-04-25T02:29:47.551145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_clean_scrub_stamp":"2024-04-25T02:28:14.374327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:20.125523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":754625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":153803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":158692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":749060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:29:51.811 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:29:51.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.908+0000 7fe0be45d640 1 Processor -- start 2024-04-25T02:29:51.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.908+0000 7fe0be45d640 1 -- start start 2024-04-25T02:29:51.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.909+0000 7fe0be45d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0b815b220 0x7fe0b8070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:51.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.909+0000 7fe0be45d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe0b815ec70 0x7fe0b815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:51.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.909+0000 7fe0be45d640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0b80713d0 con 0x7fe0b815f630 2024-04-25T02:29:51.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.909+0000 7fe0be45d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe0b80aee00 con 0x7fe0b815ec70 2024-04-25T02:29:51.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.909+0000 7fe0be45d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe0b815fac0 con 0x7fe0b815b220 2024-04-25T02:29:51.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.909+0000 7fe0bc9fa640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe0b815f630 0x7fe0b8071660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57022/0 (socket says 172.21.15.67:57022) 2024-04-25T02:29:51.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.909+0000 7fe0bc9fa640 1 -- 172.21.15.67:0/604034421 learned_addr learned my addr 172.21.15.67:0/604034421 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:51.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.909+0000 7fe0b7fff640 1 --2- 172.21.15.67:0/604034421 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0b815b220 0x7fe0b8070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:51.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.909+0000 7fe0b77fe640 1 --2- 172.21.15.67:0/604034421 >> v2:172.21.15.176:3300/0 conn(0x7fe0b815ec70 0x7fe0b815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:51.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.909+0000 7fe0b6ffd640 1 -- 172.21.15.67:0/604034421 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1268694457 0 0) 0x7fe0b80713d0 con 0x7fe0b815f630 2024-04-25T02:29:51.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.909+0000 7fe0b6ffd640 1 -- 172.21.15.67:0/604034421 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0a4003520 con 0x7fe0b815f630 2024-04-25T02:29:51.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.910+0000 7fe0b7fff640 1 -- 172.21.15.67:0/604034421 >> v2:172.21.15.176:3300/0 conn(0x7fe0b815ec70 msgr2=0x7fe0b815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:51.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.910+0000 7fe0b7fff640 1 --2- 172.21.15.67:0/604034421 >> v2:172.21.15.176:3300/0 conn(0x7fe0b815ec70 0x7fe0b815f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:51.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.910+0000 7fe0b7fff640 1 -- 172.21.15.67:0/604034421 >> v1:172.21.15.67:6789/0 conn(0x7fe0b815f630 legacy=0x7fe0b8071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:51.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.910+0000 7fe0b7fff640 1 -- 172.21.15.67:0/604034421 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b80ae4d0 con 0x7fe0b815b220 2024-04-25T02:29:51.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.910+0000 7fe0b7fff640 1 --2- 172.21.15.67:0/604034421 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0b815b220 0x7fe0b8070df0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80097a0 tx=0x7fe0a802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50f8e49ec4f0cc9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:51.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.910+0000 7fe0b6ffd640 1 -- 172.21.15.67:0/604034421 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8037070 con 0x7fe0b815b220 2024-04-25T02:29:51.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.910+0000 7fe0b6ffd640 1 -- 172.21.15.67:0/604034421 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a8032440 con 0x7fe0b815b220 2024-04-25T02:29:51.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.910+0000 7fe0b6ffd640 1 -- 172.21.15.67:0/604034421 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8032810 con 0x7fe0b815b220 2024-04-25T02:29:51.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.911+0000 7fe0be45d640 1 -- 172.21.15.67:0/604034421 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0b815b220 msgr2=0x7fe0b8070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:51.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.911+0000 7fe0be45d640 1 --2- 172.21.15.67:0/604034421 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0b815b220 0x7fe0b8070df0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80097a0 tx=0x7fe0a802a180 comp rx=0 tx=0).stop 2024-04-25T02:29:51.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.911+0000 7fe0be45d640 1 -- 172.21.15.67:0/604034421 shutdown_connections 2024-04-25T02:29:51.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.911+0000 7fe0be45d640 1 --2- 172.21.15.67:0/604034421 >> v2:172.21.15.176:3300/0 conn(0x7fe0b815ec70 0x7fe0b815f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:51.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.911+0000 7fe0be45d640 1 --2- 172.21.15.67:0/604034421 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0b815b220 0x7fe0b8070df0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:51.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.911+0000 7fe0be45d640 1 -- 172.21.15.67:0/604034421 >> 172.21.15.67:0/604034421 conn(0x7fe0b80b19c0 msgr2=0x7fe0b80b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:51.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.911+0000 7fe0be45d640 1 -- 172.21.15.67:0/604034421 shutdown_connections 2024-04-25T02:29:51.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.911+0000 7fe0be45d640 1 -- 172.21.15.67:0/604034421 wait complete. 2024-04-25T02:29:51.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.912+0000 7fe0be45d640 1 Processor -- start 2024-04-25T02:29:51.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.912+0000 7fe0be45d640 1 -- start start 2024-04-25T02:29:51.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.913+0000 7fe0be45d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0b815b220 0x7fe0b81e5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:51.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.913+0000 7fe0be45d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0b815ec70 0x7fe0b814f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:51.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.913+0000 7fe0be45d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0b815f630 0x7fe0b81f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:51.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.913+0000 7fe0be45d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b806eb90 con 0x7fe0b815ec70 2024-04-25T02:29:51.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.913+0000 7fe0be45d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b80aea90 con 0x7fe0b815b220 2024-04-25T02:29:51.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.913+0000 7fe0be45d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe0b806ed10 con 0x7fe0b815f630 2024-04-25T02:29:51.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.913+0000 7fe0b77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0b815ec70 0x7fe0b814f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:51.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.913+0000 7fe0b77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0b815ec70 0x7fe0b814f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60376/0 (socket says 172.21.15.67:60376) 2024-04-25T02:29:51.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.913+0000 7fe0b77fe640 1 -- 172.21.15.67:0/1065468539 learned_addr learned my addr 172.21.15.67:0/1065468539 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:51.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.913+0000 7fe0b7fff640 1 --2- 172.21.15.67:0/1065468539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0b815b220 0x7fe0b81e5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:51.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.913+0000 7fe0bc9fa640 1 --2- 172.21.15.67:0/1065468539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0b815f630 0x7fe0b81f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:51.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.914+0000 7fe0b77fe640 1 -- 172.21.15.67:0/1065468539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0b815f630 msgr2=0x7fe0b81f5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:51.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.914+0000 7fe0b77fe640 1 --2- 172.21.15.67:0/1065468539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0b815f630 0x7fe0b81f5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:51.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.914+0000 7fe0b77fe640 1 -- 172.21.15.67:0/1065468539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0b815b220 msgr2=0x7fe0b81e5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:51.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.914+0000 7fe0b77fe640 1 --2- 172.21.15.67:0/1065468539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0b815b220 0x7fe0b81e5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:51.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.914+0000 7fe0b77fe640 1 -- 172.21.15.67:0/1065468539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b809b900 con 0x7fe0b815ec70 2024-04-25T02:29:51.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.914+0000 7fe0b77fe640 1 --2- 172.21.15.67:0/1065468539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0b815ec70 0x7fe0b814f4b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000e9b0 tx=0x7fe0a000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:51.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.914+0000 7fe0b4ff9640 1 -- 172.21.15.67:0/1065468539 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0017070 con 0x7fe0b815ec70 2024-04-25T02:29:51.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.914+0000 7fe0b4ff9640 1 -- 172.21.15.67:0/1065468539 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a000c9a0 con 0x7fe0b815ec70 2024-04-25T02:29:51.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.914+0000 7fe0be45d640 1 -- 172.21.15.67:0/1065468539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b81e6720 con 0x7fe0b815ec70 2024-04-25T02:29:51.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.914+0000 7fe0b4ff9640 1 -- 172.21.15.67:0/1065468539 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a000cd90 con 0x7fe0b815ec70 2024-04-25T02:29:51.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.914+0000 7fe0be45d640 1 -- 172.21.15.67:0/1065468539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b809b500 con 0x7fe0b815ec70 2024-04-25T02:29:51.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.915+0000 7fe0be45d640 1 -- 172.21.15.67:0/1065468539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0b8069110 con 0x7fe0b815ec70 2024-04-25T02:29:51.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.915+0000 7fe0b4ff9640 1 -- 172.21.15.67:0/1065468539 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fe0a001a070 con 0x7fe0b815ec70 2024-04-25T02:29:51.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.916+0000 7fe0b4ff9640 1 --2- 172.21.15.67:0/1065468539 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe09806bfe0 0x7fe09806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:51.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.916+0000 7fe0b4ff9640 1 -- 172.21.15.67:0/1065468539 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fe0a008b080 con 0x7fe0b815ec70 2024-04-25T02:29:51.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.916+0000 7fe0b7fff640 1 --2- 172.21.15.67:0/1065468539 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe09806bfe0 0x7fe09806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:51.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.917+0000 7fe0b7fff640 1 --2- 172.21.15.67:0/1065468539 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe09806bfe0 0x7fe09806e4a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8034000 tx=0x7fe0a802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:51.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:51.920+0000 7fe0b4ff9640 1 -- 172.21.15.67:0/1065468539 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe0a00595a0 con 0x7fe0b815ec70 2024-04-25T02:29:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.100+0000 7fe0be45d640 1 -- 172.21.15.67:0/1065468539 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0b806e610 con 0x7fe09806bfe0 2024-04-25T02:29:52.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.101+0000 7fe0b4ff9640 1 -- 172.21.15.67:0/1065468539 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13491 (secure 0 0 0) 0x7fe0b806e610 con 0x7fe09806bfe0 2024-04-25T02:29:52.104 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:52.104 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-25T02:29:52.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.103+0000 7fe0be45d640 1 -- 172.21.15.67:0/1065468539 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe09806bfe0 msgr2=0x7fe09806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:52.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.103+0000 7fe0be45d640 1 --2- 172.21.15.67:0/1065468539 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe09806bfe0 0x7fe09806e4a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8034000 tx=0x7fe0a802e000 comp rx=0 tx=0).stop 2024-04-25T02:29:52.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.103+0000 7fe0be45d640 1 -- 172.21.15.67:0/1065468539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0b815ec70 msgr2=0x7fe0b814f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:52.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.103+0000 7fe0be45d640 1 --2- 172.21.15.67:0/1065468539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0b815ec70 0x7fe0b814f4b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000e9b0 tx=0x7fe0a000ee70 comp rx=0 tx=0).stop 2024-04-25T02:29:52.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.103+0000 7fe0be45d640 1 -- 172.21.15.67:0/1065468539 shutdown_connections 2024-04-25T02:29:52.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.103+0000 7fe0be45d640 1 --2- 172.21.15.67:0/1065468539 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fe09806bfe0 0x7fe09806e4a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.103+0000 7fe0be45d640 1 --2- 172.21.15.67:0/1065468539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0b815f630 0x7fe0b81f5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.103+0000 7fe0be45d640 1 --2- 172.21.15.67:0/1065468539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0b815ec70 0x7fe0b814f4b0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.103+0000 7fe0be45d640 1 --2- 172.21.15.67:0/1065468539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0b815b220 0x7fe0b81e5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.103+0000 7fe0be45d640 1 -- 172.21.15.67:0/1065468539 >> 172.21.15.67:0/1065468539 conn(0x7fe0b80b19c0 msgr2=0x7fe0b80b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:52.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.103+0000 7fe0be45d640 1 -- 172.21.15.67:0/1065468539 shutdown_connections 2024-04-25T02:29:52.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.103+0000 7fe0be45d640 1 -- 172.21.15.67:0/1065468539 wait complete. 2024-04-25T02:29:52.117 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-04-25T02:29:50.350670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220556,"kb_used_data":4372,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754164,"statfs":{"total":773094113280,"available":772868263936,"internally_reserved":0,"allocated":4476928,"data_stored":2473208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-141992,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":-107,"num_write_kb":-185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001672"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T02:29:47.551145+0000","last_change":"2024-04-25T02:28:15.520345+0000","last_active":"2024-04-25T02:29:47.551145+0000","last_peered":"2024-04-25T02:29:47.551145+0000","last_clean":"2024-04-25T02:29:47.551145+0000","last_became_active":"2024-04-25T02:28:15.519317+0000","last_became_peered":"2024-04-25T02:28:15.519317+0000","last_unstale":"2024-04-25T02:29:47.551145+0000","last_undegraded":"2024-04-25T02:29:47.551145+0000","last_fullsized":"2024-04-25T02:29:47.551145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_clean_scrub_stamp":"2024-04-25T02:28:14.374327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:20.125523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":754625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":153803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":158692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":749060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:29:52.117 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T02:29:52.117 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:29:52.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.215+0000 7f5642509640 1 Processor -- start 2024-04-25T02:29:52.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.215+0000 7f5642509640 1 -- start start 2024-04-25T02:29:52.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.216+0000 7f5642509640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f563c156810 0x7f563c0d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:52.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.216+0000 7f5642509640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f563c0addb0 0x7f563c0d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:52.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.216+0000 7f5642509640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f563c15c7e0 con 0x7f563c0b5f40 2024-04-25T02:29:52.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.216+0000 7f5642509640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f563c15d3f0 con 0x7f563c156810 2024-04-25T02:29:52.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.216+0000 7f5642509640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f563c15cac0 con 0x7f563c0addb0 2024-04-25T02:29:52.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.216+0000 7f563bfff640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f563c156810 0x7f563c0d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:52.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.216+0000 7f5640aa6640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f563c0b5f40 0x7f563c15fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57024/0 (socket says 172.21.15.67:57024) 2024-04-25T02:29:52.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.216+0000 7f5640aa6640 1 -- 172.21.15.67:0/3702552341 learned_addr learned my addr 172.21.15.67:0/3702552341 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:52.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.216+0000 7f563bfff640 1 -- 172.21.15.67:0/3702552341 >> v2:172.21.15.176:3300/0 conn(0x7f563c0addb0 msgr2=0x7f563c0d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:52.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.216+0000 7f563b7fe640 1 --2- 172.21.15.67:0/3702552341 >> v2:172.21.15.176:3300/0 conn(0x7f563c0addb0 0x7f563c0d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:52.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.216+0000 7f563affd640 1 -- 172.21.15.67:0/3702552341 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3385691153 0 0) 0x7f563c15c7e0 con 0x7f563c0b5f40 2024-04-25T02:29:52.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.216+0000 7f563bfff640 1 --2- 172.21.15.67:0/3702552341 >> v2:172.21.15.176:3300/0 conn(0x7f563c0addb0 0x7f563c0d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.216+0000 7f563bfff640 1 -- 172.21.15.67:0/3702552341 >> v1:172.21.15.67:6789/0 conn(0x7f563c0b5f40 legacy=0x7f563c15fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:52.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.216+0000 7f563bfff640 1 -- 172.21.15.67:0/3702552341 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563c15cda0 con 0x7f563c156810 2024-04-25T02:29:52.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.216+0000 7f563b7fe640 1 --2- 172.21.15.67:0/3702552341 >> v2:172.21.15.176:3300/0 conn(0x7f563c0addb0 0x7f563c0d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:52.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.217+0000 7f563bfff640 1 --2- 172.21.15.67:0/3702552341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f563c156810 0x7f563c0d1010 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f563c0732b0 tx=0x7f562c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dcccd8f8a648c42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:52.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.217+0000 7f563affd640 1 -- 172.21.15.67:0/3702552341 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c037070 con 0x7f563c156810 2024-04-25T02:29:52.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.217+0000 7f563affd640 1 -- 172.21.15.67:0/3702552341 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f562c032440 con 0x7f563c156810 2024-04-25T02:29:52.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.217+0000 7f563affd640 1 -- 172.21.15.67:0/3702552341 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c032810 con 0x7f563c156810 2024-04-25T02:29:52.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.217+0000 7f5642509640 1 -- 172.21.15.67:0/3702552341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f563c156810 msgr2=0x7f563c0d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:52.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.217+0000 7f5642509640 1 --2- 172.21.15.67:0/3702552341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f563c156810 0x7f563c0d1010 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f563c0732b0 tx=0x7f562c02a1a0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.217+0000 7f5642509640 1 -- 172.21.15.67:0/3702552341 shutdown_connections 2024-04-25T02:29:52.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.218+0000 7f5642509640 1 --2- 172.21.15.67:0/3702552341 >> v2:172.21.15.176:3300/0 conn(0x7f563c0addb0 0x7f563c0d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.218+0000 7f5642509640 1 --2- 172.21.15.67:0/3702552341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f563c156810 0x7f563c0d1010 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.218+0000 7f5642509640 1 -- 172.21.15.67:0/3702552341 >> 172.21.15.67:0/3702552341 conn(0x7f563c06c3b0 msgr2=0x7f563c06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:52.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.218+0000 7f5642509640 1 -- 172.21.15.67:0/3702552341 shutdown_connections 2024-04-25T02:29:52.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.218+0000 7f5642509640 1 -- 172.21.15.67:0/3702552341 wait complete. 2024-04-25T02:29:52.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.219+0000 7f5642509640 1 Processor -- start 2024-04-25T02:29:52.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.219+0000 7f5642509640 1 -- start start 2024-04-25T02:29:52.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f5642509640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f563c0addb0 0x7f563c1f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:52.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f5642509640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f563c0b5f40 0x7f563c1f1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:52.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f5642509640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f563c156810 0x7f563c154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:52.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f5642509640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f563c072cd0 con 0x7f563c0b5f40 2024-04-25T02:29:52.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f5642509640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f563c072b50 con 0x7f563c156810 2024-04-25T02:29:52.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f5642509640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f563c0b4330 con 0x7f563c0addb0 2024-04-25T02:29:52.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f563b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f563c0b5f40 0x7f563c1f1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:52.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f563b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f563c0b5f40 0x7f563c1f1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60392/0 (socket says 172.21.15.67:60392) 2024-04-25T02:29:52.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f563b7fe640 1 -- 172.21.15.67:0/2788429284 learned_addr learned my addr 172.21.15.67:0/2788429284 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:52.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f563bfff640 1 --2- 172.21.15.67:0/2788429284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f563c0addb0 0x7f563c1f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:52.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f5640aa6640 1 --2- 172.21.15.67:0/2788429284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f563c156810 0x7f563c154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:52.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f563b7fe640 1 -- 172.21.15.67:0/2788429284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f563c0addb0 msgr2=0x7f563c1f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:52.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f563b7fe640 1 --2- 172.21.15.67:0/2788429284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f563c0addb0 0x7f563c1f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f563b7fe640 1 -- 172.21.15.67:0/2788429284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f563c156810 msgr2=0x7f563c154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:52.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f563b7fe640 1 --2- 172.21.15.67:0/2788429284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f563c156810 0x7f563c154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f563b7fe640 1 -- 172.21.15.67:0/2788429284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563c1f2a60 con 0x7f563c0b5f40 2024-04-25T02:29:52.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f563bfff640 1 --2- 172.21.15.67:0/2788429284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f563c0addb0 0x7f563c1f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:52.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f563b7fe640 1 --2- 172.21.15.67:0/2788429284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f563c0b5f40 0x7f563c1f1380 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f563000c7f0 tx=0x7f563000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:52.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f5638ff9640 1 -- 172.21.15.67:0/2788429284 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630004230 con 0x7f563c0b5f40 2024-04-25T02:29:52.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f5638ff9640 1 -- 172.21.15.67:0/2788429284 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56300043d0 con 0x7f563c0b5f40 2024-04-25T02:29:52.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f5642509640 1 -- 172.21.15.67:0/2788429284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f563c15d6d0 con 0x7f563c0b5f40 2024-04-25T02:29:52.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f5638ff9640 1 -- 172.21.15.67:0/2788429284 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630007a70 con 0x7f563c0b5f40 2024-04-25T02:29:52.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.220+0000 7f5642509640 1 -- 172.21.15.67:0/2788429284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f563c15dc90 con 0x7f563c0b5f40 2024-04-25T02:29:52.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.221+0000 7f5642509640 1 -- 172.21.15.67:0/2788429284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f563c069110 con 0x7f563c0b5f40 2024-04-25T02:29:52.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.222+0000 7f5638ff9640 1 -- 172.21.15.67:0/2788429284 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f5630007c10 con 0x7f563c0b5f40 2024-04-25T02:29:52.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.222+0000 7f5638ff9640 1 --2- 172.21.15.67:0/2788429284 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f562806bfe0 0x7f562806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:52.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.222+0000 7f5638ff9640 1 -- 172.21.15.67:0/2788429284 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f563008b060 con 0x7f563c0b5f40 2024-04-25T02:29:52.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.223+0000 7f563bfff640 1 --2- 172.21.15.67:0/2788429284 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f562806bfe0 0x7f562806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:52.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.223+0000 7f563bfff640 1 --2- 172.21.15.67:0/2788429284 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f562806bfe0 0x7f562806e4a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f562c034000 tx=0x7f562c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:52.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.227+0000 7f5638ff9640 1 -- 172.21.15.67:0/2788429284 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5630015020 con 0x7f563c0b5f40 2024-04-25T02:29:52.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.404+0000 7f5642509640 1 -- 172.21.15.67:0/2788429284 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f563c155390 con 0x7f562806bfe0 2024-04-25T02:29:52.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.405+0000 7f5638ff9640 1 -- 172.21.15.67:0/2788429284 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13491 (secure 0 0 0) 0x7f562c03c460 con 0x7f562806bfe0 2024-04-25T02:29:52.409 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:52.409 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-25T02:29:52.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.407+0000 7f5642509640 1 -- 172.21.15.67:0/2788429284 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f562806bfe0 msgr2=0x7f562806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:52.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.407+0000 7f5642509640 1 --2- 172.21.15.67:0/2788429284 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f562806bfe0 0x7f562806e4a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f562c034000 tx=0x7f562c02e000 comp rx=0 tx=0).stop 2024-04-25T02:29:52.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.407+0000 7f5642509640 1 -- 172.21.15.67:0/2788429284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f563c0b5f40 msgr2=0x7f563c1f1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:52.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.407+0000 7f5642509640 1 --2- 172.21.15.67:0/2788429284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f563c0b5f40 0x7f563c1f1380 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f563000c7f0 tx=0x7f563000ccb0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.407+0000 7f5642509640 1 -- 172.21.15.67:0/2788429284 shutdown_connections 2024-04-25T02:29:52.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.407+0000 7f5642509640 1 --2- 172.21.15.67:0/2788429284 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f562806bfe0 0x7f562806e4a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.407+0000 7f5642509640 1 --2- 172.21.15.67:0/2788429284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f563c156810 0x7f563c154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.407+0000 7f5642509640 1 --2- 172.21.15.67:0/2788429284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f563c0b5f40 0x7f563c1f1380 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.407+0000 7f5642509640 1 --2- 172.21.15.67:0/2788429284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f563c0addb0 0x7f563c1f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.407+0000 7f5642509640 1 -- 172.21.15.67:0/2788429284 >> 172.21.15.67:0/2788429284 conn(0x7f563c06c3b0 msgr2=0x7f563c0d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:52.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.407+0000 7f5642509640 1 -- 172.21.15.67:0/2788429284 shutdown_connections 2024-04-25T02:29:52.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.408+0000 7f5642509640 1 -- 172.21.15.67:0/2788429284 wait complete. 2024-04-25T02:29:52.421 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-04-25T02:29:52.351067+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220556,"kb_used_data":4372,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754164,"statfs":{"total":773094113280,"available":772868263936,"internally_reserved":0,"allocated":4476928,"data_stored":2473208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-141992,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":-107,"num_write_kb":-185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.819341"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T02:29:47.551145+0000","last_change":"2024-04-25T02:28:15.520345+0000","last_active":"2024-04-25T02:29:47.551145+0000","last_peered":"2024-04-25T02:29:47.551145+0000","last_clean":"2024-04-25T02:29:47.551145+0000","last_became_active":"2024-04-25T02:28:15.519317+0000","last_became_peered":"2024-04-25T02:28:15.519317+0000","last_unstale":"2024-04-25T02:29:47.551145+0000","last_undegraded":"2024-04-25T02:29:47.551145+0000","last_fullsized":"2024-04-25T02:29:47.551145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_clean_scrub_stamp":"2024-04-25T02:28:14.374327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:20.125523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":754625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":153803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":158692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":749060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:29:52.422 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:29:52.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.519+0000 7f5ad0190640 1 Processor -- start 2024-04-25T02:29:52.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.519+0000 7f5ad0190640 1 -- start start 2024-04-25T02:29:52.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.520+0000 7f5ad0190640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac815e660 0x7f5ac806ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:52.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.520+0000 7f5ad0190640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5ac8067200 0x7f5ac80715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:52.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.520+0000 7f5ad0190640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac806c9b0 con 0x7f5ac815e280 2024-04-25T02:29:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.520+0000 7f5ad0190640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5ac806e990 con 0x7f5ac8067200 2024-04-25T02:29:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.520+0000 7f5ad0190640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac806bc70 con 0x7f5ac815e660 2024-04-25T02:29:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.520+0000 7f5ace72d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5ac8067200 0x7f5ac80715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.520+0000 7f5acdf2c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5ac815e280 0x7f5ac806bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57030/0 (socket says 172.21.15.67:57030) 2024-04-25T02:29:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.520+0000 7f5acdf2c640 1 -- 172.21.15.67:0/371489205 learned_addr learned my addr 172.21.15.67:0/371489205 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.520+0000 7f5acd72b640 1 --2- 172.21.15.67:0/371489205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac815e660 0x7f5ac806ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.520+0000 7f5ace72d640 1 -- 172.21.15.67:0/371489205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac815e660 msgr2=0x7f5ac806ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.520+0000 7f5ace72d640 1 --2- 172.21.15.67:0/371489205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac815e660 0x7f5ac806ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.520+0000 7f5ace72d640 1 -- 172.21.15.67:0/371489205 >> v1:172.21.15.67:6789/0 conn(0x7f5ac815e280 legacy=0x7f5ac806bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.520+0000 7f5ace72d640 1 -- 172.21.15.67:0/371489205 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac806e340 con 0x7f5ac8067200 2024-04-25T02:29:52.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.520+0000 7f5accf2a640 1 -- 172.21.15.67:0/371489205 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1579178357 0 0) 0x7f5ac806c9b0 con 0x7f5ac815e280 2024-04-25T02:29:52.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.521+0000 7f5ace72d640 1 --2- 172.21.15.67:0/371489205 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac8067200 0x7f5ac80715e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009d90 tx=0x7f5ac002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ee128d7e528f42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:52.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.521+0000 7f5accf2a640 1 -- 172.21.15.67:0/371489205 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0007740 con 0x7f5ac8067200 2024-04-25T02:29:52.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.521+0000 7f5accf2a640 1 -- 172.21.15.67:0/371489205 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac00078e0 con 0x7f5ac8067200 2024-04-25T02:29:52.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.521+0000 7f5accf2a640 1 -- 172.21.15.67:0/371489205 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0007cb0 con 0x7f5ac8067200 2024-04-25T02:29:52.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.522+0000 7f5ad0190640 1 -- 172.21.15.67:0/371489205 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac8067200 msgr2=0x7f5ac80715e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:52.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.522+0000 7f5ad0190640 1 --2- 172.21.15.67:0/371489205 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac8067200 0x7f5ac80715e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009d90 tx=0x7f5ac002a660 comp rx=0 tx=0).stop 2024-04-25T02:29:52.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.522+0000 7f5ad0190640 1 -- 172.21.15.67:0/371489205 shutdown_connections 2024-04-25T02:29:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.522+0000 7f5ad0190640 1 --2- 172.21.15.67:0/371489205 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac8067200 0x7f5ac80715e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.522+0000 7f5ad0190640 1 --2- 172.21.15.67:0/371489205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac815e660 0x7f5ac806ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.522+0000 7f5ad0190640 1 -- 172.21.15.67:0/371489205 >> 172.21.15.67:0/371489205 conn(0x7f5ac80d04f0 msgr2=0x7f5ac80d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.522+0000 7f5ad0190640 1 -- 172.21.15.67:0/371489205 shutdown_connections 2024-04-25T02:29:52.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.522+0000 7f5ad0190640 1 -- 172.21.15.67:0/371489205 wait complete. 2024-04-25T02:29:52.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.523+0000 7f5ad0190640 1 Processor -- start 2024-04-25T02:29:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.523+0000 7f5ad0190640 1 -- start start 2024-04-25T02:29:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5ad0190640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac8067200 0x7f5ac8145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5ad0190640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac815e280 0x7f5ac8160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5ad0190640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac815e660 0x7f5ac8159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5ad0190640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac806f4e0 con 0x7f5ac815e660 2024-04-25T02:29:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5ad0190640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac806f360 con 0x7f5ac8067200 2024-04-25T02:29:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5ad0190640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac8071b20 con 0x7f5ac815e280 2024-04-25T02:29:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5ace72d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac815e660 0x7f5ac8159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5ace72d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac815e660 0x7f5ac8159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60412/0 (socket says 172.21.15.67:60412) 2024-04-25T02:29:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5ace72d640 1 -- 172.21.15.67:0/4133457423 learned_addr learned my addr 172.21.15.67:0/4133457423 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5acd72b640 1 --2- 172.21.15.67:0/4133457423 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac815e280 0x7f5ac8160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5acdf2c640 1 --2- 172.21.15.67:0/4133457423 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac8067200 0x7f5ac8145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5ace72d640 1 -- 172.21.15.67:0/4133457423 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac815e280 msgr2=0x7f5ac8160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:52.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5ace72d640 1 --2- 172.21.15.67:0/4133457423 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac815e280 0x7f5ac8160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5ace72d640 1 -- 172.21.15.67:0/4133457423 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac8067200 msgr2=0x7f5ac8145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5ace72d640 1 --2- 172.21.15.67:0/4133457423 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac8067200 0x7f5ac8145fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5ace72d640 1 -- 172.21.15.67:0/4133457423 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac8161260 con 0x7f5ac815e660 2024-04-25T02:29:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5acd72b640 1 --2- 172.21.15.67:0/4133457423 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac815e280 0x7f5ac8160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5acdf2c640 1 --2- 172.21.15.67:0/4133457423 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac8067200 0x7f5ac8145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5ace72d640 1 --2- 172.21.15.67:0/4133457423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac815e660 0x7f5ac8159a60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009eb0 tx=0x7f5ac0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.524+0000 7f5abe7fc640 1 -- 172.21.15.67:0/4133457423 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0040070 con 0x7f5ac815e660 2024-04-25T02:29:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.525+0000 7f5abe7fc640 1 -- 172.21.15.67:0/4133457423 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac0031bc0 con 0x7f5ac815e660 2024-04-25T02:29:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.525+0000 7f5ad0190640 1 -- 172.21.15.67:0/4133457423 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac815f730 con 0x7f5ac815e660 2024-04-25T02:29:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.525+0000 7f5abe7fc640 1 -- 172.21.15.67:0/4133457423 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac003c420 con 0x7f5ac815e660 2024-04-25T02:29:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.525+0000 7f5ad0190640 1 -- 172.21.15.67:0/4133457423 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac815fcf0 con 0x7f5ac815e660 2024-04-25T02:29:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.525+0000 7f5ad0190640 1 -- 172.21.15.67:0/4133457423 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac8069110 con 0x7f5ac815e660 2024-04-25T02:29:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.526+0000 7f5abe7fc640 1 -- 172.21.15.67:0/4133457423 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f5ac0039040 con 0x7f5ac815e660 2024-04-25T02:29:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.526+0000 7f5abe7fc640 1 --2- 172.21.15.67:0/4133457423 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f5aac06bfe0 0x7f5aac06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:52.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.526+0000 7f5abe7fc640 1 -- 172.21.15.67:0/4133457423 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f5ac00ac3d0 con 0x7f5ac815e660 2024-04-25T02:29:52.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.527+0000 7f5acdf2c640 1 --2- 172.21.15.67:0/4133457423 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f5aac06bfe0 0x7f5aac06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:52.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.527+0000 7f5acdf2c640 1 --2- 172.21.15.67:0/4133457423 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f5aac06bfe0 0x7f5aac06e4a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4000f60 tx=0x7f5ac4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:52.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.531+0000 7f5abe7fc640 1 -- 172.21.15.67:0/4133457423 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5ac007ad80 con 0x7f5ac815e660 2024-04-25T02:29:52.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.714+0000 7f5ad0190640 1 -- 172.21.15.67:0/4133457423 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ac815daa0 con 0x7f5ac815e660 2024-04-25T02:29:52.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.715+0000 7f5abe7fc640 1 -- 172.21.15.67:0/4133457423 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+12996 (secure 0 0 0) 0x7f5ac007a680 con 0x7f5ac815e660 2024-04-25T02:29:52.718 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:52.718 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":36,"fsid":"84283662-9e10-4d0d-b377-8e43b1f6e3af","created":"2024-04-25T02:28:02.158335+0000","modified":"2024-04-25T02:29:47.540527+0000","last_up_change":"2024-04-25T02:28:13.296860+0000","last_in_change":"2024-04-25T02:28:04.310396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:28:14.374244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb2ccd5c-757b-4db8-87c5-1b2ecf608400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6812","nonce":4042772984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6816","nonce":4042772984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6823","nonce":4042772984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4042772984},{"type":"v1","addr":"172.21.15.67:6820","nonce":4042772984}]},"public_addr":"172.21.15.67:6812/4042772984","cluster_addr":"172.21.15.67:6816/4042772984","heartbeat_back_addr":"172.21.15.67:6823/4042772984","heartbeat_front_addr":"172.21.15.67:6820/4042772984","state":["exists","up"]},{"osd":1,"uuid":"6e6a2fdf-4851-445b-891e-32c70858c1ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6801","nonce":2616951131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6803","nonce":2616951131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6807","nonce":2616951131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2616951131},{"type":"v1","addr":"172.21.15.67:6805","nonce":2616951131}]},"public_addr":"172.21.15.67:6801/2616951131","cluster_addr":"172.21.15.67:6803/2616951131","heartbeat_back_addr":"172.21.15.67:6807/2616951131","heartbeat_front_addr":"172.21.15.67:6805/2616951131","state":["exists","up"]},{"osd":2,"uuid":"31160699-f824-47fe-ad35-1211c5461ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6809","nonce":3238175451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6811","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6813","nonce":3238175451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6821","nonce":3238175451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":3238175451},{"type":"v1","addr":"172.21.15.67:6817","nonce":3238175451}]},"public_addr":"172.21.15.67:6809/3238175451","cluster_addr":"172.21.15.67:6813/3238175451","heartbeat_back_addr":"172.21.15.67:6821/3238175451","heartbeat_front_addr":"172.21.15.67:6817/3238175451","state":["exists","up"]},{"osd":3,"uuid":"f3e63257-ae6d-4588-9cba-f4639f27497a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6825","nonce":611839856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6827","nonce":611839856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6831","nonce":611839856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":611839856},{"type":"v1","addr":"172.21.15.67:6829","nonce":611839856}]},"public_addr":"172.21.15.67:6825/611839856","cluster_addr":"172.21.15.67:6827/611839856","heartbeat_back_addr":"172.21.15.67:6831/611839856","heartbeat_front_addr":"172.21.15.67:6829/611839856","state":["exists","up"]},{"osd":4,"uuid":"b7fd1a66-b411-4d8c-9daa-e13d551d421d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6819","nonce":828255462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6821","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6823","nonce":828255462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6829","nonce":828255462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":828255462},{"type":"v1","addr":"172.21.15.176:6826","nonce":828255462}]},"public_addr":"172.21.15.176:6819/828255462","cluster_addr":"172.21.15.176:6823/828255462","heartbeat_back_addr":"172.21.15.176:6829/828255462","heartbeat_front_addr":"172.21.15.176:6826/828255462","state":["exists","up"]},{"osd":5,"uuid":"8e677963-5047-40fe-bffa-80aeff20500d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6801","nonce":660324040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6803","nonce":660324040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6807","nonce":660324040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":660324040},{"type":"v1","addr":"172.21.15.176:6805","nonce":660324040}]},"public_addr":"172.21.15.176:6801/660324040","cluster_addr":"172.21.15.176:6803/660324040","heartbeat_back_addr":"172.21.15.176:6807/660324040","heartbeat_front_addr":"172.21.15.176:6805/660324040","state":["exists","up"]},{"osd":6,"uuid":"557dd6b1-d269-4c61-b41d-21f80688911c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6809","nonce":4103155408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6811","nonce":4103155408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6815","nonce":4103155408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4103155408},{"type":"v1","addr":"172.21.15.176:6813","nonce":4103155408}]},"public_addr":"172.21.15.176:6809/4103155408","cluster_addr":"172.21.15.176:6811/4103155408","heartbeat_back_addr":"172.21.15.176:6815/4103155408","heartbeat_front_addr":"172.21.15.176:6813/4103155408","state":["exists","up"]},{"osd":7,"uuid":"7a073ce6-b4ab-4f16-a37f-0fc2b602d687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6817","nonce":1381219465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6822","nonce":1381219465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6831","nonce":1381219465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":1381219465},{"type":"v1","addr":"172.21.15.176:6827","nonce":1381219465}]},"public_addr":"172.21.15.176:6817/1381219465","cluster_addr":"172.21.15.176:6822/1381219465","heartbeat_back_addr":"172.21.15.176:6831/1381219465","heartbeat_front_addr":"172.21.15.176:6827/1381219465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.465866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.433904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.497361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.524847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.457761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.461890+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.420780+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:28:09.494923+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6835/2564564590":"2024-04-26T02:29:44.528721+0000","172.21.15.67:6833/2564564590":"2024-04-26T02:29:44.528721+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:29:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.717+0000 7f5ad0190640 1 -- 172.21.15.67:0/4133457423 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f5aac06bfe0 msgr2=0x7f5aac06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.717+0000 7f5ad0190640 1 --2- 172.21.15.67:0/4133457423 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f5aac06bfe0 0x7f5aac06e4a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4000f60 tx=0x7f5ac4009040 comp rx=0 tx=0).stop 2024-04-25T02:29:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.717+0000 7f5ad0190640 1 -- 172.21.15.67:0/4133457423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac815e660 msgr2=0x7f5ac8159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.717+0000 7f5ad0190640 1 --2- 172.21.15.67:0/4133457423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac815e660 0x7f5ac8159a60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009eb0 tx=0x7f5ac0004a40 comp rx=0 tx=0).stop 2024-04-25T02:29:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.717+0000 7f5ad0190640 1 -- 172.21.15.67:0/4133457423 shutdown_connections 2024-04-25T02:29:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.717+0000 7f5ad0190640 1 --2- 172.21.15.67:0/4133457423 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f5aac06bfe0 0x7f5aac06e4a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.717+0000 7f5ad0190640 1 --2- 172.21.15.67:0/4133457423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ac815e660 0x7f5ac8159a60 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.717+0000 7f5ad0190640 1 --2- 172.21.15.67:0/4133457423 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac815e280 0x7f5ac8160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.717+0000 7f5ad0190640 1 --2- 172.21.15.67:0/4133457423 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac8067200 0x7f5ac8145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.717+0000 7f5ad0190640 1 -- 172.21.15.67:0/4133457423 >> 172.21.15.67:0/4133457423 conn(0x7f5ac80d04f0 msgr2=0x7f5ac806b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.717+0000 7f5ad0190640 1 -- 172.21.15.67:0/4133457423 shutdown_connections 2024-04-25T02:29:52.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:52.717+0000 7f5ad0190640 1 -- 172.21.15.67:0/4133457423 wait complete. 2024-04-25T02:29:53.732 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T02:29:53.732 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:29:53.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.847+0000 7f483d3dc640 1 Processor -- start 2024-04-25T02:29:53.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.847+0000 7f483d3dc640 1 -- start start 2024-04-25T02:29:53.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.848+0000 7f483d3dc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f483815e460 0x7f4838162d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:53.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.848+0000 7f483d3dc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48380cfe00 0x7f48380b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:53.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.848+0000 7f483d3dc640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48380b3850 con 0x7f4838162160 2024-04-25T02:29:53.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.848+0000 7f483d3dc640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f48380b1400 con 0x7f483815e460 2024-04-25T02:29:53.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.848+0000 7f483d3dc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f48380b1120 con 0x7f48380cfe00 2024-04-25T02:29:53.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.848+0000 7f482e7fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48380cfe00 0x7f48380b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:53.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.848+0000 7f482e7fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48380cfe00 0x7f48380b22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:36730/0 (socket says 172.21.15.67:36730) 2024-04-25T02:29:53.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.848+0000 7f4836ffd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f483815e460 0x7f4838162d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:53.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.848+0000 7f482e7fc640 1 -- 172.21.15.67:0/3340597742 learned_addr learned my addr 172.21.15.67:0/3340597742 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:53.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.848+0000 7f48377fe640 1 --1- 172.21.15.67:0/3340597742 >> v1:172.21.15.176:6789/0 conn(0x7f4838162160 0x7f48380d1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.67:57826/0 (socket says 172.21.15.67:57826) 2024-04-25T02:29:53.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.849+0000 7f482e7fc640 1 -- 172.21.15.67:0/3340597742 >> v2:172.21.15.176:3300/0 conn(0x7f483815e460 msgr2=0x7f4838162d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:53.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.849+0000 7f48367fc640 1 -- 172.21.15.67:0/3340597742 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3812357021 0 0) 0x7f48380b3850 con 0x7f4838162160 2024-04-25T02:29:53.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.849+0000 7f482e7fc640 1 --2- 172.21.15.67:0/3340597742 >> v2:172.21.15.176:3300/0 conn(0x7f483815e460 0x7f4838162d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:53.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.849+0000 7f482e7fc640 1 -- 172.21.15.67:0/3340597742 >> v1:172.21.15.176:6789/0 conn(0x7f4838162160 legacy=0x7f48380d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:53.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.849+0000 7f482e7fc640 1 -- 172.21.15.67:0/3340597742 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48380b3290 con 0x7f48380cfe00 2024-04-25T02:29:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.849+0000 7f482e7fc640 1 --2- 172.21.15.67:0/3340597742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48380cfe00 0x7f48380b22c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4820009870 tx=0x7f482002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86d80a2e87ab12cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.850+0000 7f48367fc640 1 -- 172.21.15.67:0/3340597742 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4820037070 con 0x7f48380cfe00 2024-04-25T02:29:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.850+0000 7f48367fc640 1 -- 172.21.15.67:0/3340597742 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4820032440 con 0x7f48380cfe00 2024-04-25T02:29:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.850+0000 7f48367fc640 1 -- 172.21.15.67:0/3340597742 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4820032810 con 0x7f48380cfe00 2024-04-25T02:29:53.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.850+0000 7f483d3dc640 1 -- 172.21.15.67:0/3340597742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48380cfe00 msgr2=0x7f48380b22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:53.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.850+0000 7f483d3dc640 1 --2- 172.21.15.67:0/3340597742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48380cfe00 0x7f48380b22c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4820009870 tx=0x7f482002a1c0 comp rx=0 tx=0).stop 2024-04-25T02:29:53.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.850+0000 7f483d3dc640 1 -- 172.21.15.67:0/3340597742 shutdown_connections 2024-04-25T02:29:53.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.850+0000 7f483d3dc640 1 --2- 172.21.15.67:0/3340597742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48380cfe00 0x7f48380b22c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:53.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.850+0000 7f483d3dc640 1 --2- 172.21.15.67:0/3340597742 >> v2:172.21.15.176:3300/0 conn(0x7f483815e460 0x7f4838162d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:53.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.850+0000 7f483d3dc640 1 -- 172.21.15.67:0/3340597742 >> 172.21.15.67:0/3340597742 conn(0x7f483809aa70 msgr2=0x7f483809ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:53.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.850+0000 7f483d3dc640 1 -- 172.21.15.67:0/3340597742 shutdown_connections 2024-04-25T02:29:53.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.850+0000 7f483d3dc640 1 -- 172.21.15.67:0/3340597742 wait complete. 2024-04-25T02:29:53.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.851+0000 7f483d3dc640 1 Processor -- start 2024-04-25T02:29:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.852+0000 7f483d3dc640 1 -- start start 2024-04-25T02:29:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.852+0000 7f483d3dc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48380cfe00 0x7f4838156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.852+0000 7f483d3dc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f483815e460 0x7f483815a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.852+0000 7f483d3dc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4838162160 0x7f48381f5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.852+0000 7f483d3dc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f48380b2800 con 0x7f48380cfe00 2024-04-25T02:29:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.852+0000 7f483d3dc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f48380d0240 con 0x7f4838162160 2024-04-25T02:29:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.852+0000 7f483d3dc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f483815b6c0 con 0x7f483815e460 2024-04-25T02:29:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.852+0000 7f4836ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48380cfe00 0x7f4838156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.853+0000 7f4836ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48380cfe00 0x7f4838156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60414/0 (socket says 172.21.15.67:60414) 2024-04-25T02:29:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.853+0000 7f4836ffd640 1 -- 172.21.15.67:0/1838787041 learned_addr learned my addr 172.21.15.67:0/1838787041 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:53.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.853+0000 7f482e7fc640 1 --2- 172.21.15.67:0/1838787041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f483815e460 0x7f483815a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:53.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.853+0000 7f48377fe640 1 --2- 172.21.15.67:0/1838787041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4838162160 0x7f48381f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:53.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.853+0000 7f4836ffd640 1 -- 172.21.15.67:0/1838787041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f483815e460 msgr2=0x7f483815a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:53.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.853+0000 7f4836ffd640 1 --2- 172.21.15.67:0/1838787041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f483815e460 0x7f483815a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:53.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.853+0000 7f4836ffd640 1 -- 172.21.15.67:0/1838787041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4838162160 msgr2=0x7f48381f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:53.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.853+0000 7f4836ffd640 1 --2- 172.21.15.67:0/1838787041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4838162160 0x7f48381f5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:53.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.853+0000 7f4836ffd640 1 -- 172.21.15.67:0/1838787041 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483815b100 con 0x7f48380cfe00 2024-04-25T02:29:53.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.853+0000 7f4836ffd640 1 --2- 172.21.15.67:0/1838787041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48380cfe00 0x7f4838156b40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f482800e9b0 tx=0x7f482800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:53.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.853+0000 7f482ffff640 1 -- 172.21.15.67:0/1838787041 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828017070 con 0x7f48380cfe00 2024-04-25T02:29:53.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.853+0000 7f482ffff640 1 -- 172.21.15.67:0/1838787041 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f482800c9a0 con 0x7f48380cfe00 2024-04-25T02:29:53.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.853+0000 7f482ffff640 1 -- 172.21.15.67:0/1838787041 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482800cd90 con 0x7f48380cfe00 2024-04-25T02:29:53.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.853+0000 7f483d3dc640 1 -- 172.21.15.67:0/1838787041 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f483815b3e0 con 0x7f48380cfe00 2024-04-25T02:29:53.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.853+0000 7f483d3dc640 1 -- 172.21.15.67:0/1838787041 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48380cb4b0 con 0x7f48380cfe00 2024-04-25T02:29:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.854+0000 7f483d3dc640 1 -- 172.21.15.67:0/1838787041 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4838069110 con 0x7f48380cfe00 2024-04-25T02:29:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.855+0000 7f482ffff640 1 -- 172.21.15.67:0/1838787041 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f482801a070 con 0x7f48380cfe00 2024-04-25T02:29:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.855+0000 7f482ffff640 1 --2- 172.21.15.67:0/1838787041 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f481806bfe0 0x7f481806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.855+0000 7f482ffff640 1 -- 172.21.15.67:0/1838787041 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f482808b270 con 0x7f48380cfe00 2024-04-25T02:29:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.855+0000 7f482ffff640 1 --2- 172.21.15.67:0/1838787041 >> [v2:172.21.15.67:6810/4042772984,v1:172.21.15.67:6812/4042772984] conn(0x7f4818071ea0 0x7f48180742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.855+0000 7f482ffff640 1 -- 172.21.15.67:0/1838787041 --> [v2:172.21.15.67:6810/4042772984,v1:172.21.15.67:6812/4042772984] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f482801fe50 con 0x7f4818071ea0 2024-04-25T02:29:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.855+0000 7f482ffff640 1 -- 172.21.15.67:0/1838787041 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f4828092050 con 0x7f48380cfe00 2024-04-25T02:29:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.855+0000 7f482e7fc640 1 --2- 172.21.15.67:0/1838787041 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f481806bfe0 0x7f481806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.856+0000 7f48377fe640 1 --2- 172.21.15.67:0/1838787041 >> [v2:172.21.15.67:6810/4042772984,v1:172.21.15.67:6812/4042772984] conn(0x7f4818071ea0 0x7f48180742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.856+0000 7f48377fe640 1 --2- 172.21.15.67:0/1838787041 >> [v2:172.21.15.67:6810/4042772984,v1:172.21.15.67:6812/4042772984] conn(0x7f4818071ea0 0x7f48180742c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.856+0000 7f482e7fc640 1 --2- 172.21.15.67:0/1838787041 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f481806bfe0 0x7f481806e4a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4820034000 tx=0x7f482002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:53.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.857+0000 7f482ffff640 1 -- 172.21.15.67:0/1838787041 <== osd.0 v2:172.21.15.67:6810/4042772984 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f482801fe50 con 0x7f4818071ea0 2024-04-25T02:29:53.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.870+0000 7f483d3dc640 1 -- 172.21.15.67:0/1838787041 --> [v2:172.21.15.67:6810/4042772984,v1:172.21.15.67:6812/4042772984] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f483815dde0 con 0x7f4818071ea0 2024-04-25T02:29:53.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.870+0000 7f482ffff640 1 -- 172.21.15.67:0/1838787041 <== osd.0 v2:172.21.15.67:6810/4042772984 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f483815dde0 con 0x7f4818071ea0 2024-04-25T02:29:53.873 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-25T02:29:53.873 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:29:53.874 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-25T02:29:53.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.870+0000 7f483d3dc640 1 -- 172.21.15.67:0/1838787041 >> [v2:172.21.15.67:6810/4042772984,v1:172.21.15.67:6812/4042772984] conn(0x7f4818071ea0 msgr2=0x7f48180742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:53.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.870+0000 7f483d3dc640 1 --2- 172.21.15.67:0/1838787041 >> [v2:172.21.15.67:6810/4042772984,v1:172.21.15.67:6812/4042772984] conn(0x7f4818071ea0 0x7f48180742c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:53.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.871+0000 7f483d3dc640 1 -- 172.21.15.67:0/1838787041 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f481806bfe0 msgr2=0x7f481806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:53.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.871+0000 7f483d3dc640 1 --2- 172.21.15.67:0/1838787041 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f481806bfe0 0x7f481806e4a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4820034000 tx=0x7f482002e000 comp rx=0 tx=0).stop 2024-04-25T02:29:53.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.871+0000 7f483d3dc640 1 -- 172.21.15.67:0/1838787041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48380cfe00 msgr2=0x7f4838156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:53.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.871+0000 7f483d3dc640 1 --2- 172.21.15.67:0/1838787041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48380cfe00 0x7f4838156b40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f482800e9b0 tx=0x7f482800ee70 comp rx=0 tx=0).stop 2024-04-25T02:29:53.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.871+0000 7f48377fe640 1 -- 172.21.15.67:0/1838787041 reap_dead start 2024-04-25T02:29:53.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.871+0000 7f483d3dc640 1 -- 172.21.15.67:0/1838787041 shutdown_connections 2024-04-25T02:29:53.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.871+0000 7f483d3dc640 1 -- 172.21.15.67:0/1838787041 >> 172.21.15.67:0/1838787041 conn(0x7f483809aa70 msgr2=0x7f483806c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:53.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.871+0000 7f483d3dc640 1 -- 172.21.15.67:0/1838787041 shutdown_connections 2024-04-25T02:29:53.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.871+0000 7f483d3dc640 1 -- 172.21.15.67:0/1838787041 wait complete. 2024-04-25T02:29:53.885 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T02:29:53.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.983+0000 7f88fe683640 1 Processor -- start 2024-04-25T02:29:53.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.983+0000 7f88fe683640 1 -- start start 2024-04-25T02:29:53.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.984+0000 7f88fe683640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f88f80cf8f0 0x7f88f80d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:53.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.984+0000 7f88fe683640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88f80cff80 con 0x7f88f815e760 2024-04-25T02:29:53.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.984+0000 7f88fe683640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88f80d2250 con 0x7f88f806bfb0 2024-04-25T02:29:53.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.984+0000 7f88fe683640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f88f80cfd50 con 0x7f88f80cf8f0 2024-04-25T02:29:53.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.984+0000 7f88f77fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f88f80cf8f0 0x7f88f80d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:53.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.984+0000 7f88f7fff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f88f815e760 0x7f88f80d0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57040/0 (socket says 172.21.15.67:57040) 2024-04-25T02:29:53.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.984+0000 7f88f7fff640 1 -- 172.21.15.67:0/1700276641 learned_addr learned my addr 172.21.15.67:0/1700276641 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:53.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.984+0000 7f88f77fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f88f80cf8f0 0x7f88f80d1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60424/0 (socket says 172.21.15.67:60424) 2024-04-25T02:29:53.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.984+0000 7f88f77fe640 1 -- 172.21.15.67:0/1700276641 >> v1:172.21.15.176:6789/0 conn(0x7f88f806bfb0 legacy=0x7f88f806c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:53.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.984+0000 7f88f6ffd640 1 -- 172.21.15.67:0/1700276641 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1229312797 0 0) 0x7f88f80cff80 con 0x7f88f815e760 2024-04-25T02:29:53.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.984+0000 7f88f77fe640 1 -- 172.21.15.67:0/1700276641 >> v1:172.21.15.67:6789/0 conn(0x7f88f815e760 legacy=0x7f88f80d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:53.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.984+0000 7f88f77fe640 1 -- 172.21.15.67:0/1700276641 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f80d2530 con 0x7f88f80cf8f0 2024-04-25T02:29:53.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.985+0000 7f88f77fe640 1 --2- 172.21.15.67:0/1700276641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88f80cf8f0 0x7f88f80d1010 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f88e00097a0 tx=0x7f88e002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5252b8e621e856 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:53.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.985+0000 7f88f6ffd640 1 -- 172.21.15.67:0/1700276641 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e0037070 con 0x7f88f80cf8f0 2024-04-25T02:29:53.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.985+0000 7f88f6ffd640 1 -- 172.21.15.67:0/1700276641 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88e0032440 con 0x7f88f80cf8f0 2024-04-25T02:29:53.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.985+0000 7f88f6ffd640 1 -- 172.21.15.67:0/1700276641 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e0032810 con 0x7f88f80cf8f0 2024-04-25T02:29:53.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.985+0000 7f88fe683640 1 -- 172.21.15.67:0/1700276641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88f80cf8f0 msgr2=0x7f88f80d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:53.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.985+0000 7f88fe683640 1 --2- 172.21.15.67:0/1700276641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88f80cf8f0 0x7f88f80d1010 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f88e00097a0 tx=0x7f88e002a230 comp rx=0 tx=0).stop 2024-04-25T02:29:53.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.986+0000 7f88fe683640 1 -- 172.21.15.67:0/1700276641 shutdown_connections 2024-04-25T02:29:53.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.986+0000 7f88fe683640 1 --2- 172.21.15.67:0/1700276641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88f80cf8f0 0x7f88f80d1010 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:53.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.986+0000 7f88fe683640 1 -- 172.21.15.67:0/1700276641 >> 172.21.15.67:0/1700276641 conn(0x7f88f80d41b0 msgr2=0x7f88f80d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:53.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.986+0000 7f88fe683640 1 -- 172.21.15.67:0/1700276641 shutdown_connections 2024-04-25T02:29:53.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.986+0000 7f88fe683640 1 -- 172.21.15.67:0/1700276641 wait complete. 2024-04-25T02:29:53.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.987+0000 7f88fe683640 1 Processor -- start 2024-04-25T02:29:53.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.987+0000 7f88fe683640 1 -- start start 2024-04-25T02:29:53.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88fe683640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88f806bfb0 0x7f88f80c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:53.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88fe683640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88f80cf8f0 0x7f88f80b6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:53.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88fe683640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88f815e760 0x7f88f8151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:53.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88fe683640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f88f80d3d40 con 0x7f88f806bfb0 2024-04-25T02:29:53.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88fe683640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f88f80d28a0 con 0x7f88f80cf8f0 2024-04-25T02:29:53.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88fe683640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f88f815eb40 con 0x7f88f815e760 2024-04-25T02:29:53.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88f7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88f806bfb0 0x7f88f80c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:53.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88f7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88f806bfb0 0x7f88f80c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60438/0 (socket says 172.21.15.67:60438) 2024-04-25T02:29:53.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88f7fff640 1 -- 172.21.15.67:0/1834502057 learned_addr learned my addr 172.21.15.67:0/1834502057 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:53.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88fcc20640 1 --2- 172.21.15.67:0/1834502057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88f815e760 0x7f88f8151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:53.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88f77fe640 1 --2- 172.21.15.67:0/1834502057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88f80cf8f0 0x7f88f80b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:53.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88f7fff640 1 -- 172.21.15.67:0/1834502057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88f815e760 msgr2=0x7f88f8151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:53.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88f7fff640 1 --2- 172.21.15.67:0/1834502057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88f815e760 0x7f88f8151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:53.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88f7fff640 1 -- 172.21.15.67:0/1834502057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88f80cf8f0 msgr2=0x7f88f80b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:53.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88f7fff640 1 --2- 172.21.15.67:0/1834502057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88f80cf8f0 0x7f88f80b6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:53.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88f7fff640 1 -- 172.21.15.67:0/1834502057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f80b6170 con 0x7f88f806bfb0 2024-04-25T02:29:54.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88f7fff640 1 --2- 172.21.15.67:0/1834502057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88f806bfb0 0x7f88f80c8050 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f88e800c3f0 tx=0x7f88e800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:54.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88f4ff9640 1 -- 172.21.15.67:0/1834502057 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e80074e0 con 0x7f88f806bfb0 2024-04-25T02:29:54.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88f4ff9640 1 -- 172.21.15.67:0/1834502057 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88e80047e0 con 0x7f88f806bfb0 2024-04-25T02:29:54.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88fe683640 1 -- 172.21.15.67:0/1834502057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f80c86a0 con 0x7f88f806bfb0 2024-04-25T02:29:54.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88f4ff9640 1 -- 172.21.15.67:0/1834502057 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e8004c10 con 0x7f88f806bfb0 2024-04-25T02:29:54.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.988+0000 7f88fe683640 1 -- 172.21.15.67:0/1834502057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f80b3d40 con 0x7f88f806bfb0 2024-04-25T02:29:54.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.989+0000 7f88fe683640 1 -- 172.21.15.67:0/1834502057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88f8069110 con 0x7f88f806bfb0 2024-04-25T02:29:54.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.990+0000 7f88f4ff9640 1 -- 172.21.15.67:0/1834502057 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f88e8011070 con 0x7f88f806bfb0 2024-04-25T02:29:54.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.990+0000 7f88f4ff9640 1 --2- 172.21.15.67:0/1834502057 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f88d806bfe0 0x7f88d806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.991+0000 7f88f4ff9640 1 -- 172.21.15.67:0/1834502057 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f88e808a9b0 con 0x7f88f806bfb0 2024-04-25T02:29:54.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.991+0000 7f88f77fe640 1 --2- 172.21.15.67:0/1834502057 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f88d806bfe0 0x7f88d806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.991+0000 7f88f77fe640 1 --2- 172.21.15.67:0/1834502057 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f88d806bfe0 0x7f88d806e4a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f88e0034000 tx=0x7f88e002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:54.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:53.995+0000 7f88f4ff9640 1 -- 172.21.15.67:0/1834502057 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f88e801a2b0 con 0x7f88f806bfb0 2024-04-25T02:29:54.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.177+0000 7f88fe683640 1 -- 172.21.15.67:0/1834502057 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f88f815da50 con 0x7f88d806bfe0 2024-04-25T02:29:54.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.178+0000 7f88f4ff9640 1 -- 172.21.15.67:0/1834502057 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f88f815da50 con 0x7f88d806bfe0 2024-04-25T02:29:54.181 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T02:29:54.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.180+0000 7f88fe683640 1 -- 172.21.15.67:0/1834502057 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f88d806bfe0 msgr2=0x7f88d806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.180+0000 7f88fe683640 1 --2- 172.21.15.67:0/1834502057 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f88d806bfe0 0x7f88d806e4a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f88e0034000 tx=0x7f88e002e000 comp rx=0 tx=0).stop 2024-04-25T02:29:54.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.180+0000 7f88fe683640 1 -- 172.21.15.67:0/1834502057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88f806bfb0 msgr2=0x7f88f80c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.180+0000 7f88fe683640 1 --2- 172.21.15.67:0/1834502057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88f806bfb0 0x7f88f80c8050 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f88e800c3f0 tx=0x7f88e800c8b0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.180+0000 7f88fe683640 1 -- 172.21.15.67:0/1834502057 shutdown_connections 2024-04-25T02:29:54.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.180+0000 7f88fe683640 1 --2- 172.21.15.67:0/1834502057 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f88d806bfe0 0x7f88d806e4a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.180+0000 7f88fe683640 1 --2- 172.21.15.67:0/1834502057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88f815e760 0x7f88f8151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.180+0000 7f88fe683640 1 --2- 172.21.15.67:0/1834502057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88f80cf8f0 0x7f88f80b6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.180+0000 7f88fe683640 1 --2- 172.21.15.67:0/1834502057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88f806bfb0 0x7f88f80c8050 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.180+0000 7f88fe683640 1 -- 172.21.15.67:0/1834502057 >> 172.21.15.67:0/1834502057 conn(0x7f88f80d41b0 msgr2=0x7f88f815fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:54.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.180+0000 7f88fe683640 1 -- 172.21.15.67:0/1834502057 shutdown_connections 2024-04-25T02:29:54.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.181+0000 7f88fe683640 1 -- 172.21.15.67:0/1834502057 wait complete. 2024-04-25T02:29:54.194 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T02:29:54.195 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:29:54.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.296+0000 7fbd1273b640 1 Processor -- start 2024-04-25T02:29:54.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.296+0000 7fbd1273b640 1 -- start start 2024-04-25T02:29:54.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.297+0000 7fbd1273b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbd0c0b4c80 0x7fbd0c0acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.297+0000 7fbd1273b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd0c15c810 con 0x7fbd0c0b3390 2024-04-25T02:29:54.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.297+0000 7fbd1273b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd0c15caf0 con 0x7fbd0c0cf100 2024-04-25T02:29:54.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.297+0000 7fbd1273b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fbd0c15d420 con 0x7fbd0c0b4c80 2024-04-25T02:29:54.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.297+0000 7fbd10cd8640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fbd0c0b3390 0x7fbd0c0b3840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57056/0 (socket says 172.21.15.67:57056) 2024-04-25T02:29:54.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.297+0000 7fbd10cd8640 1 -- 172.21.15.67:0/158989411 learned_addr learned my addr 172.21.15.67:0/158989411 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:54.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.297+0000 7fbd0b7fe640 1 --2- 172.21.15.67:0/158989411 >> v2:172.21.15.176:3300/0 conn(0x7fbd0c0b4c80 0x7fbd0c0acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.297+0000 7fbd0affd640 1 -- 172.21.15.67:0/158989411 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2601773128 0 0) 0x7fbd0c15c810 con 0x7fbd0c0b3390 2024-04-25T02:29:54.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.297+0000 7fbd0affd640 1 -- 172.21.15.67:0/158989411 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcf4003520 con 0x7fbd0c0b3390 2024-04-25T02:29:54.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.297+0000 7fbd0b7fe640 1 -- 172.21.15.67:0/158989411 >> v1:172.21.15.176:6789/0 conn(0x7fbd0c0cf100 legacy=0x7fbd0c0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.297+0000 7fbd0b7fe640 1 -- 172.21.15.67:0/158989411 >> v1:172.21.15.67:6789/0 conn(0x7fbd0c0b3390 legacy=0x7fbd0c0b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.297+0000 7fbd0b7fe640 1 -- 172.21.15.67:0/158989411 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd0c15cdd0 con 0x7fbd0c0b4c80 2024-04-25T02:29:54.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.298+0000 7fbd0b7fe640 1 --2- 172.21.15.67:0/158989411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0c0b4c80 0x7fbd0c0acda0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0097a0 tx=0x7fbcfc02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a83d2a38ee4c193d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:54.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.298+0000 7fbd0affd640 1 -- 172.21.15.67:0/158989411 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc037070 con 0x7fbd0c0b4c80 2024-04-25T02:29:54.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.299+0000 7fbd0affd640 1 -- 172.21.15.67:0/158989411 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcfc032440 con 0x7fbd0c0b4c80 2024-04-25T02:29:54.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.299+0000 7fbd0affd640 1 -- 172.21.15.67:0/158989411 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc032810 con 0x7fbd0c0b4c80 2024-04-25T02:29:54.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.299+0000 7fbd1273b640 1 -- 172.21.15.67:0/158989411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0c0b4c80 msgr2=0x7fbd0c0acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.299+0000 7fbd1273b640 1 --2- 172.21.15.67:0/158989411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0c0b4c80 0x7fbd0c0acda0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0097a0 tx=0x7fbcfc02a230 comp rx=0 tx=0).stop 2024-04-25T02:29:54.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.299+0000 7fbd1273b640 1 -- 172.21.15.67:0/158989411 shutdown_connections 2024-04-25T02:29:54.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.299+0000 7fbd1273b640 1 --2- 172.21.15.67:0/158989411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0c0b4c80 0x7fbd0c0acda0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.299+0000 7fbd1273b640 1 -- 172.21.15.67:0/158989411 >> 172.21.15.67:0/158989411 conn(0x7fbd0c0b19c0 msgr2=0x7fbd0c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:54.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.299+0000 7fbd1273b640 1 -- 172.21.15.67:0/158989411 shutdown_connections 2024-04-25T02:29:54.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.299+0000 7fbd1273b640 1 -- 172.21.15.67:0/158989411 wait complete. 2024-04-25T02:29:54.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.300+0000 7fbd1273b640 1 Processor -- start 2024-04-25T02:29:54.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.300+0000 7fbd1273b640 1 -- start start 2024-04-25T02:29:54.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.301+0000 7fbd1273b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0c0b3390 0x7fbd0c1467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.301+0000 7fbd1273b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd0c0cf100 0x7fbd0c0728c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.301+0000 7fbd1273b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd0c14ead0 0x7fbd0c15e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.301+0000 7fbd1273b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c0ad2e0 con 0x7fbd0c0cf100 2024-04-25T02:29:54.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.301+0000 7fbd1273b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c06cb90 con 0x7fbd0c0b3390 2024-04-25T02:29:54.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.301+0000 7fbd1273b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbd0c0ad460 con 0x7fbd0c14ead0 2024-04-25T02:29:54.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.301+0000 7fbd0b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd0c0cf100 0x7fbd0c0728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.301+0000 7fbd0b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd0c0cf100 0x7fbd0c0728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60440/0 (socket says 172.21.15.67:60440) 2024-04-25T02:29:54.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.301+0000 7fbd0b7fe640 1 -- 172.21.15.67:0/1316499638 learned_addr learned my addr 172.21.15.67:0/1316499638 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:54.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.301+0000 7fbd10cd8640 1 --2- 172.21.15.67:0/1316499638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd0c14ead0 0x7fbd0c15e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.301+0000 7fbd0bfff640 1 --2- 172.21.15.67:0/1316499638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0c0b3390 0x7fbd0c1467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.302+0000 7fbd0b7fe640 1 -- 172.21.15.67:0/1316499638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd0c14ead0 msgr2=0x7fbd0c15e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.302+0000 7fbd0b7fe640 1 --2- 172.21.15.67:0/1316499638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd0c14ead0 0x7fbd0c15e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.302+0000 7fbd0b7fe640 1 -- 172.21.15.67:0/1316499638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0c0b3390 msgr2=0x7fbd0c1467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.302+0000 7fbd0b7fe640 1 --2- 172.21.15.67:0/1316499638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0c0b3390 0x7fbd0c1467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.302+0000 7fbd0b7fe640 1 -- 172.21.15.67:0/1316499638 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd0c072e00 con 0x7fbd0c0cf100 2024-04-25T02:29:54.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.302+0000 7fbd0bfff640 1 --2- 172.21.15.67:0/1316499638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd0c0b3390 0x7fbd0c1467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:54.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.302+0000 7fbd0b7fe640 1 --2- 172.21.15.67:0/1316499638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd0c0cf100 0x7fbd0c0728c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0098c0 tx=0x7fbcfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:54.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.302+0000 7fbd08ff9640 1 -- 172.21.15.67:0/1316499638 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc037040 con 0x7fbd0c0cf100 2024-04-25T02:29:54.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.302+0000 7fbd08ff9640 1 -- 172.21.15.67:0/1316499638 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcfc030500 con 0x7fbd0c0cf100 2024-04-25T02:29:54.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.302+0000 7fbd08ff9640 1 -- 172.21.15.67:0/1316499638 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc0308d0 con 0x7fbd0c0cf100 2024-04-25T02:29:54.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.302+0000 7fbd1273b640 1 -- 172.21.15.67:0/1316499638 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd0c0720c0 con 0x7fbd0c0cf100 2024-04-25T02:29:54.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.302+0000 7fbd1273b640 1 -- 172.21.15.67:0/1316499638 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd0c071300 con 0x7fbd0c0cf100 2024-04-25T02:29:54.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.303+0000 7fbd1273b640 1 -- 172.21.15.67:0/1316499638 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd0c146d20 con 0x7fbd0c0cf100 2024-04-25T02:29:54.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.303+0000 7fbd08ff9640 1 -- 172.21.15.67:0/1316499638 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fbcfc044020 con 0x7fbd0c0cf100 2024-04-25T02:29:54.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.304+0000 7fbd08ff9640 1 --2- 172.21.15.67:0/1316499638 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbcf806c010 0x7fbcf806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.304+0000 7fbd08ff9640 1 -- 172.21.15.67:0/1316499638 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fbcfc0aafd0 con 0x7fbd0c0cf100 2024-04-25T02:29:54.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.304+0000 7fbd08ff9640 1 --2- 172.21.15.67:0/1316499638 >> [v2:172.21.15.67:6800/2616951131,v1:172.21.15.67:6801/2616951131] conn(0x7fbcf8071ed0 0x7fbcf80742f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.304+0000 7fbd08ff9640 1 -- 172.21.15.67:0/1316499638 --> [v2:172.21.15.67:6800/2616951131,v1:172.21.15.67:6801/2616951131] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbcfc032440 con 0x7fbcf8071ed0 2024-04-25T02:29:54.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.304+0000 7fbd08ff9640 1 -- 172.21.15.67:0/1316499638 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fbcfc0b2050 con 0x7fbd0c0cf100 2024-04-25T02:29:54.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.304+0000 7fbd0bfff640 1 --2- 172.21.15.67:0/1316499638 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbcf806c010 0x7fbcf806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.304+0000 7fbd10cd8640 1 --2- 172.21.15.67:0/1316499638 >> [v2:172.21.15.67:6800/2616951131,v1:172.21.15.67:6801/2616951131] conn(0x7fbcf8071ed0 0x7fbcf80742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.304+0000 7fbd10cd8640 1 --2- 172.21.15.67:0/1316499638 >> [v2:172.21.15.67:6800/2616951131,v1:172.21.15.67:6801/2616951131] conn(0x7fbcf8071ed0 0x7fbcf80742f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:54.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.305+0000 7fbd0bfff640 1 --2- 172.21.15.67:0/1316499638 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbcf806c010 0x7fbcf806e4d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbd00001660 tx=0x7fbd00009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:54.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.305+0000 7fbd08ff9640 1 -- 172.21.15.67:0/1316499638 <== osd.1 v2:172.21.15.67:6800/2616951131 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbcfc032440 con 0x7fbcf8071ed0 2024-04-25T02:29:54.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.318+0000 7fbd1273b640 1 -- 172.21.15.67:0/1316499638 --> [v2:172.21.15.67:6800/2616951131,v1:172.21.15.67:6801/2616951131] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbd0c069110 con 0x7fbcf8071ed0 2024-04-25T02:29:54.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.319+0000 7fbd08ff9640 1 -- 172.21.15.67:0/1316499638 <== osd.1 v2:172.21.15.67:6800/2616951131 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbd0c069110 con 0x7fbcf8071ed0 2024-04-25T02:29:54.322 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-25T02:29:54.323 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:29:54.323 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-25T02:29:54.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.319+0000 7fbd1273b640 1 -- 172.21.15.67:0/1316499638 >> [v2:172.21.15.67:6800/2616951131,v1:172.21.15.67:6801/2616951131] conn(0x7fbcf8071ed0 msgr2=0x7fbcf80742f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.319+0000 7fbd1273b640 1 --2- 172.21.15.67:0/1316499638 >> [v2:172.21.15.67:6800/2616951131,v1:172.21.15.67:6801/2616951131] conn(0x7fbcf8071ed0 0x7fbcf80742f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.319+0000 7fbd1273b640 1 -- 172.21.15.67:0/1316499638 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbcf806c010 msgr2=0x7fbcf806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.319+0000 7fbd1273b640 1 --2- 172.21.15.67:0/1316499638 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbcf806c010 0x7fbcf806e4d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbd00001660 tx=0x7fbd00009040 comp rx=0 tx=0).stop 2024-04-25T02:29:54.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.319+0000 7fbd1273b640 1 -- 172.21.15.67:0/1316499638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd0c0cf100 msgr2=0x7fbd0c0728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.319+0000 7fbd1273b640 1 --2- 172.21.15.67:0/1316499638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd0c0cf100 0x7fbd0c0728c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0098c0 tx=0x7fbcfc0046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.319+0000 7fbd10cd8640 1 -- 172.21.15.67:0/1316499638 reap_dead start 2024-04-25T02:29:54.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.319+0000 7fbd1273b640 1 -- 172.21.15.67:0/1316499638 shutdown_connections 2024-04-25T02:29:54.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.319+0000 7fbd1273b640 1 -- 172.21.15.67:0/1316499638 >> 172.21.15.67:0/1316499638 conn(0x7fbd0c0b19c0 msgr2=0x7fbd0c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:54.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.319+0000 7fbd1273b640 1 -- 172.21.15.67:0/1316499638 shutdown_connections 2024-04-25T02:29:54.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.319+0000 7fbd1273b640 1 -- 172.21.15.67:0/1316499638 wait complete. 2024-04-25T02:29:54.332 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T02:29:54.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.431+0000 7fced9883640 1 Processor -- start 2024-04-25T02:29:54.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.431+0000 7fced9883640 1 -- start start 2024-04-25T02:29:54.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.432+0000 7fced9883640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fced415e210 0x7fced406cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.432+0000 7fced9883640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fced40d2cc0 con 0x7fced40cf3d0 2024-04-25T02:29:54.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.432+0000 7fced9883640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fced40d2fa0 con 0x7fced415e5f0 2024-04-25T02:29:54.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.432+0000 7fced9883640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fced406c6f0 con 0x7fced415e210 2024-04-25T02:29:54.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.432+0000 7fced2ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fced415e210 0x7fced406cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.432+0000 7fced37fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fced40cf3d0 0x7fced40d3e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57072/0 (socket says 172.21.15.67:57072) 2024-04-25T02:29:54.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.432+0000 7fced37fe640 1 -- 172.21.15.67:0/2539639793 learned_addr learned my addr 172.21.15.67:0/2539639793 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:54.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.432+0000 7fced2ffd640 1 -- 172.21.15.67:0/2539639793 >> v1:172.21.15.176:6789/0 conn(0x7fced415e5f0 legacy=0x7fced40cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:54.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.432+0000 7fced2ffd640 1 -- 172.21.15.67:0/2539639793 >> v1:172.21.15.67:6789/0 conn(0x7fced40cf3d0 legacy=0x7fced40d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.432+0000 7fced2ffd640 1 -- 172.21.15.67:0/2539639793 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced406c0a0 con 0x7fced415e210 2024-04-25T02:29:54.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.433+0000 7fced2ffd640 1 --2- 172.21.15.67:0/2539639793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced415e210 0x7fced406cb80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0097a0 tx=0x7fcecc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5315e79bb9db22eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:54.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.433+0000 7fced1ffb640 1 -- 172.21.15.67:0/2539639793 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc037070 con 0x7fced415e210 2024-04-25T02:29:54.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.433+0000 7fced1ffb640 1 -- 172.21.15.67:0/2539639793 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcecc02ae50 con 0x7fced415e210 2024-04-25T02:29:54.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.433+0000 7fced1ffb640 1 -- 172.21.15.67:0/2539639793 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc032660 con 0x7fced415e210 2024-04-25T02:29:54.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.434+0000 7fced9883640 1 -- 172.21.15.67:0/2539639793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced415e210 msgr2=0x7fced406cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.434+0000 7fced9883640 1 --2- 172.21.15.67:0/2539639793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced415e210 0x7fced406cb80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0097a0 tx=0x7fcecc02a140 comp rx=0 tx=0).stop 2024-04-25T02:29:54.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.434+0000 7fced9883640 1 -- 172.21.15.67:0/2539639793 shutdown_connections 2024-04-25T02:29:54.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.434+0000 7fced9883640 1 --2- 172.21.15.67:0/2539639793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced415e210 0x7fced406cb80 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.434+0000 7fced9883640 1 -- 172.21.15.67:0/2539639793 >> 172.21.15.67:0/2539639793 conn(0x7fced408dbb0 msgr2=0x7fced409d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:54.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.434+0000 7fced9883640 1 -- 172.21.15.67:0/2539639793 shutdown_connections 2024-04-25T02:29:54.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.434+0000 7fced9883640 1 -- 172.21.15.67:0/2539639793 wait complete. 2024-04-25T02:29:54.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.435+0000 7fced9883640 1 Processor -- start 2024-04-25T02:29:54.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.435+0000 7fced9883640 1 -- start start 2024-04-25T02:29:54.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.436+0000 7fced9883640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced40cf3d0 0x7fced41f6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.436+0000 7fced9883640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fced415e210 0x7fced414cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.436+0000 7fced9883640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fced415e5f0 0x7fced40b9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.436+0000 7fced9883640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fced40d4730 con 0x7fced40cf3d0 2024-04-25T02:29:54.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.436+0000 7fced9883640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fced40d45b0 con 0x7fced415e210 2024-04-25T02:29:54.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.436+0000 7fced9883640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fced40d48b0 con 0x7fced415e5f0 2024-04-25T02:29:54.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.436+0000 7fced2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced40cf3d0 0x7fced41f6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.436+0000 7fced2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced40cf3d0 0x7fced41f6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60464/0 (socket says 172.21.15.67:60464) 2024-04-25T02:29:54.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.436+0000 7fced2ffd640 1 -- 172.21.15.67:0/1631776694 learned_addr learned my addr 172.21.15.67:0/1631776694 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:54.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.436+0000 7fced27fc640 1 --2- 172.21.15.67:0/1631776694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fced415e210 0x7fced414cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.436+0000 7fced37fe640 1 --2- 172.21.15.67:0/1631776694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fced415e5f0 0x7fced40b9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.436+0000 7fced2ffd640 1 -- 172.21.15.67:0/1631776694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fced415e5f0 msgr2=0x7fced40b9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.436+0000 7fced2ffd640 1 --2- 172.21.15.67:0/1631776694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fced415e5f0 0x7fced40b9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.436+0000 7fced2ffd640 1 -- 172.21.15.67:0/1631776694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fced415e210 msgr2=0x7fced414cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.436+0000 7fced2ffd640 1 --2- 172.21.15.67:0/1631776694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fced415e210 0x7fced414cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.436+0000 7fced2ffd640 1 -- 172.21.15.67:0/1631776694 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced414d260 con 0x7fced40cf3d0 2024-04-25T02:29:54.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.437+0000 7fced2ffd640 1 --2- 172.21.15.67:0/1631776694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced40cf3d0 0x7fced41f6f30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcecc000c00 tx=0x7fcecc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:54.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.437+0000 7fcecbfff640 1 -- 172.21.15.67:0/1631776694 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc042070 con 0x7fced40cf3d0 2024-04-25T02:29:54.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.437+0000 7fcecbfff640 1 -- 172.21.15.67:0/1631776694 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcecc03e670 con 0x7fced40cf3d0 2024-04-25T02:29:54.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.437+0000 7fced9883640 1 -- 172.21.15.67:0/1631776694 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced40b82d0 con 0x7fced40cf3d0 2024-04-25T02:29:54.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.437+0000 7fcecbfff640 1 -- 172.21.15.67:0/1631776694 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc037040 con 0x7fced40cf3d0 2024-04-25T02:29:54.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.437+0000 7fced9883640 1 -- 172.21.15.67:0/1631776694 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced40b8890 con 0x7fced40cf3d0 2024-04-25T02:29:54.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.438+0000 7fced9883640 1 -- 172.21.15.67:0/1631776694 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced4069110 con 0x7fced40cf3d0 2024-04-25T02:29:54.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.438+0000 7fcecbfff640 1 -- 172.21.15.67:0/1631776694 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fcecc045070 con 0x7fced40cf3d0 2024-04-25T02:29:54.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.439+0000 7fcecbfff640 1 --2- 172.21.15.67:0/1631776694 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fceb406c010 0x7fceb406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.439+0000 7fcecbfff640 1 -- 172.21.15.67:0/1631776694 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fcecc0ab610 con 0x7fced40cf3d0 2024-04-25T02:29:54.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.439+0000 7fced27fc640 1 --2- 172.21.15.67:0/1631776694 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fceb406c010 0x7fceb406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.439+0000 7fced27fc640 1 --2- 172.21.15.67:0/1631776694 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fceb406c010 0x7fceb406e4d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcebc006fd0 tx=0x7fcebc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:54.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.443+0000 7fcecbfff640 1 -- 172.21.15.67:0/1631776694 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcecc07a160 con 0x7fced40cf3d0 2024-04-25T02:29:54.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.625+0000 7fced9883640 1 -- 172.21.15.67:0/1631776694 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fced406be80 con 0x7fceb406c010 2024-04-25T02:29:54.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.626+0000 7fcecbfff640 1 -- 172.21.15.67:0/1631776694 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fced406be80 con 0x7fceb406c010 2024-04-25T02:29:54.629 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T02:29:54.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.628+0000 7fced9883640 1 -- 172.21.15.67:0/1631776694 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fceb406c010 msgr2=0x7fceb406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.628+0000 7fced9883640 1 --2- 172.21.15.67:0/1631776694 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fceb406c010 0x7fceb406e4d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcebc006fd0 tx=0x7fcebc008040 comp rx=0 tx=0).stop 2024-04-25T02:29:54.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.628+0000 7fced9883640 1 -- 172.21.15.67:0/1631776694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced40cf3d0 msgr2=0x7fced41f6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.628+0000 7fced9883640 1 --2- 172.21.15.67:0/1631776694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced40cf3d0 0x7fced41f6f30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcecc000c00 tx=0x7fcecc0046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.628+0000 7fced9883640 1 -- 172.21.15.67:0/1631776694 shutdown_connections 2024-04-25T02:29:54.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.628+0000 7fced9883640 1 --2- 172.21.15.67:0/1631776694 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fceb406c010 0x7fceb406e4d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.628+0000 7fced9883640 1 --2- 172.21.15.67:0/1631776694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fced415e5f0 0x7fced40b9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.628+0000 7fced9883640 1 --2- 172.21.15.67:0/1631776694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fced415e210 0x7fced414cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.628+0000 7fced9883640 1 --2- 172.21.15.67:0/1631776694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fced40cf3d0 0x7fced41f6f30 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.628+0000 7fced9883640 1 -- 172.21.15.67:0/1631776694 >> 172.21.15.67:0/1631776694 conn(0x7fced408dbb0 msgr2=0x7fced415f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:54.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.628+0000 7fced9883640 1 -- 172.21.15.67:0/1631776694 shutdown_connections 2024-04-25T02:29:54.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.628+0000 7fced9883640 1 -- 172.21.15.67:0/1631776694 wait complete. 2024-04-25T02:29:54.643 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T02:29:54.643 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:29:54.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.744+0000 7fdbe7446640 1 Processor -- start 2024-04-25T02:29:54.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.744+0000 7fdbe7446640 1 -- start start 2024-04-25T02:29:54.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.745+0000 7fdbe7446640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdbe006b7f0 0x7fdbe00b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.745+0000 7fdbe7446640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbe015e830 0x7fdbe00b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.745+0000 7fdbe7446640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdbe00b4310 0x7fdbe0071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.745+0000 7fdbe7446640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fdbe00b4760 con 0x7fdbe006b7f0 2024-04-25T02:29:54.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.745+0000 7fdbe7446640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdbe00b3880 con 0x7fdbe00b4310 2024-04-25T02:29:54.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.745+0000 7fdbe7446640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe015ede0 con 0x7fdbe015e830 2024-04-25T02:29:54.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.745+0000 7fdbe51e2640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdbe006b7f0 0x7fdbe00b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.745+0000 7fdbe51e2640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdbe006b7f0 0x7fdbe00b5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60478/0 (socket says 172.21.15.67:60478) 2024-04-25T02:29:54.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.745+0000 7fdbe51e2640 1 -- 172.21.15.67:0/2216756121 learned_addr learned my addr 172.21.15.67:0/2216756121 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:54.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.745+0000 7fdbe59e3640 1 --2- 172.21.15.67:0/2216756121 >> v2:172.21.15.176:3300/0 conn(0x7fdbe00b4310 0x7fdbe0071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.745+0000 7fdbe49e1640 1 --2- 172.21.15.67:0/2216756121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbe015e830 0x7fdbe00b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.746+0000 7fdbe51e2640 1 -- 172.21.15.67:0/2216756121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbe015e830 msgr2=0x7fdbe00b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:54.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.746+0000 7fdbe51e2640 1 --2- 172.21.15.67:0/2216756121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbe015e830 0x7fdbe00b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.746+0000 7fdbe51e2640 1 -- 172.21.15.67:0/2216756121 >> v2:172.21.15.176:3300/0 conn(0x7fdbe00b4310 msgr2=0x7fdbe0071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:54.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.746+0000 7fdbe51e2640 1 --2- 172.21.15.67:0/2216756121 >> v2:172.21.15.176:3300/0 conn(0x7fdbe00b4310 0x7fdbe0071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.746+0000 7fdbe51e2640 1 -- 172.21.15.67:0/2216756121 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe015f0c0 con 0x7fdbe006b7f0 2024-04-25T02:29:54.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.746+0000 7fdbe51e2640 1 --2- 172.21.15.67:0/2216756121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbe006b7f0 0x7fdbe00b5d40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0158f00 tx=0x7fdbd802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f939303ace39f3d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:54.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.746+0000 7fdbdffff640 1 -- 172.21.15.67:0/2216756121 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8037070 con 0x7fdbe006b7f0 2024-04-25T02:29:54.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.746+0000 7fdbdffff640 1 -- 172.21.15.67:0/2216756121 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd8032440 con 0x7fdbe006b7f0 2024-04-25T02:29:54.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.746+0000 7fdbdffff640 1 -- 172.21.15.67:0/2216756121 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8032810 con 0x7fdbe006b7f0 2024-04-25T02:29:54.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.747+0000 7fdbe7446640 1 -- 172.21.15.67:0/2216756121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbe006b7f0 msgr2=0x7fdbe00b5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.747+0000 7fdbe7446640 1 --2- 172.21.15.67:0/2216756121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbe006b7f0 0x7fdbe00b5d40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0158f00 tx=0x7fdbd802a140 comp rx=0 tx=0).stop 2024-04-25T02:29:54.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.747+0000 7fdbe7446640 1 -- 172.21.15.67:0/2216756121 shutdown_connections 2024-04-25T02:29:54.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.747+0000 7fdbe7446640 1 --2- 172.21.15.67:0/2216756121 >> v2:172.21.15.176:3300/0 conn(0x7fdbe00b4310 0x7fdbe0071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.747+0000 7fdbe7446640 1 --2- 172.21.15.67:0/2216756121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbe015e830 0x7fdbe00b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.747+0000 7fdbe7446640 1 --2- 172.21.15.67:0/2216756121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbe006b7f0 0x7fdbe00b5d40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.747+0000 7fdbe7446640 1 -- 172.21.15.67:0/2216756121 >> 172.21.15.67:0/2216756121 conn(0x7fdbe00b2ad0 msgr2=0x7fdbe00b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:54.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.747+0000 7fdbe7446640 1 -- 172.21.15.67:0/2216756121 shutdown_connections 2024-04-25T02:29:54.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.747+0000 7fdbe7446640 1 -- 172.21.15.67:0/2216756121 wait complete. 2024-04-25T02:29:54.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.748+0000 7fdbe7446640 1 Processor -- start 2024-04-25T02:29:54.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.748+0000 7fdbe7446640 1 -- start start 2024-04-25T02:29:54.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.749+0000 7fdbe7446640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbe006b7f0 0x7fdbe015de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.749+0000 7fdbe7446640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbe00b4310 0x7fdbe01f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.749+0000 7fdbe7446640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbe015e830 0x7fdbe006e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.749+0000 7fdbe7446640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe00b6280 con 0x7fdbe00b4310 2024-04-25T02:29:54.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.749+0000 7fdbe7446640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe015f680 con 0x7fdbe015e830 2024-04-25T02:29:54.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.749+0000 7fdbe7446640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe0072420 con 0x7fdbe006b7f0 2024-04-25T02:29:54.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.749+0000 7fdbe49e1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbe00b4310 0x7fdbe01f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.749+0000 7fdbe49e1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbe00b4310 0x7fdbe01f6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60490/0 (socket says 172.21.15.67:60490) 2024-04-25T02:29:54.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.749+0000 7fdbe49e1640 1 -- 172.21.15.67:0/2735924121 learned_addr learned my addr 172.21.15.67:0/2735924121 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:54.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.749+0000 7fdbe51e2640 1 --2- 172.21.15.67:0/2735924121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbe006b7f0 0x7fdbe015de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.749+0000 7fdbe59e3640 1 --2- 172.21.15.67:0/2735924121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbe015e830 0x7fdbe006e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.749+0000 7fdbe49e1640 1 -- 172.21.15.67:0/2735924121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbe006b7f0 msgr2=0x7fdbe015de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.749+0000 7fdbe49e1640 1 --2- 172.21.15.67:0/2735924121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbe006b7f0 0x7fdbe015de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.749+0000 7fdbe49e1640 1 -- 172.21.15.67:0/2735924121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbe015e830 msgr2=0x7fdbe006e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.749+0000 7fdbe49e1640 1 --2- 172.21.15.67:0/2735924121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbe015e830 0x7fdbe006e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.749+0000 7fdbe49e1640 1 -- 172.21.15.67:0/2735924121 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe015c830 con 0x7fdbe00b4310 2024-04-25T02:29:54.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.749+0000 7fdbe59e3640 1 --2- 172.21.15.67:0/2735924121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbe015e830 0x7fdbe006e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:54.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.750+0000 7fdbe49e1640 1 --2- 172.21.15.67:0/2735924121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbe00b4310 0x7fdbe01f6e50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400d620 tx=0x7fdbd400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:54.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.750+0000 7fdbddffb640 1 -- 172.21.15.67:0/2735924121 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd400b620 con 0x7fdbe00b4310 2024-04-25T02:29:54.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.750+0000 7fdbddffb640 1 -- 172.21.15.67:0/2735924121 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd4019070 con 0x7fdbe00b4310 2024-04-25T02:29:54.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.750+0000 7fdbe7446640 1 -- 172.21.15.67:0/2735924121 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe015cb10 con 0x7fdbe00b4310 2024-04-25T02:29:54.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.750+0000 7fdbddffb640 1 -- 172.21.15.67:0/2735924121 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd400ba00 con 0x7fdbe00b4310 2024-04-25T02:29:54.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.750+0000 7fdbe7446640 1 -- 172.21.15.67:0/2735924121 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe015d0d0 con 0x7fdbe00b4310 2024-04-25T02:29:54.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.751+0000 7fdbe7446640 1 -- 172.21.15.67:0/2735924121 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdbe015d4d0 con 0x7fdbe00b4310 2024-04-25T02:29:54.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.751+0000 7fdbddffb640 1 -- 172.21.15.67:0/2735924121 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fdbd400bba0 con 0x7fdbe00b4310 2024-04-25T02:29:54.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.752+0000 7fdbddffb640 1 --2- 172.21.15.67:0/2735924121 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdbcc06bfe0 0x7fdbcc06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.752+0000 7fdbddffb640 1 -- 172.21.15.67:0/2735924121 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fdbd408b1d0 con 0x7fdbe00b4310 2024-04-25T02:29:54.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.752+0000 7fdbddffb640 1 --2- 172.21.15.67:0/2735924121 >> [v2:172.21.15.67:6808/3238175451,v1:172.21.15.67:6809/3238175451] conn(0x7fdbcc071ea0 0x7fdbcc0742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.752+0000 7fdbddffb640 1 -- 172.21.15.67:0/2735924121 --> [v2:172.21.15.67:6808/3238175451,v1:172.21.15.67:6809/3238175451] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdbd4001d30 con 0x7fdbcc071ea0 2024-04-25T02:29:54.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.752+0000 7fdbddffb640 1 -- 172.21.15.67:0/2735924121 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fdbd4092050 con 0x7fdbe00b4310 2024-04-25T02:29:54.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.752+0000 7fdbe51e2640 1 --2- 172.21.15.67:0/2735924121 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdbcc06bfe0 0x7fdbcc06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.752+0000 7fdbe59e3640 1 --2- 172.21.15.67:0/2735924121 >> [v2:172.21.15.67:6808/3238175451,v1:172.21.15.67:6809/3238175451] conn(0x7fdbcc071ea0 0x7fdbcc0742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.752+0000 7fdbe59e3640 1 --2- 172.21.15.67:0/2735924121 >> [v2:172.21.15.67:6808/3238175451,v1:172.21.15.67:6809/3238175451] conn(0x7fdbcc071ea0 0x7fdbcc0742c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:54.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.753+0000 7fdbe51e2640 1 --2- 172.21.15.67:0/2735924121 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdbcc06bfe0 0x7fdbcc06e4a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8034000 tx=0x7fdbd802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:54.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.753+0000 7fdbddffb640 1 -- 172.21.15.67:0/2735924121 <== osd.2 v2:172.21.15.67:6808/3238175451 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdbd4001d30 con 0x7fdbcc071ea0 2024-04-25T02:29:54.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.766+0000 7fdbe7446640 1 -- 172.21.15.67:0/2735924121 --> [v2:172.21.15.67:6808/3238175451,v1:172.21.15.67:6809/3238175451] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdbe0069110 con 0x7fdbcc071ea0 2024-04-25T02:29:54.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.767+0000 7fdbddffb640 1 -- 172.21.15.67:0/2735924121 <== osd.2 v2:172.21.15.67:6808/3238175451 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdbe0069110 con 0x7fdbcc071ea0 2024-04-25T02:29:54.770 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-25T02:29:54.770 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:29:54.770 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-25T02:29:54.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.767+0000 7fdbe7446640 1 -- 172.21.15.67:0/2735924121 >> [v2:172.21.15.67:6808/3238175451,v1:172.21.15.67:6809/3238175451] conn(0x7fdbcc071ea0 msgr2=0x7fdbcc0742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.767+0000 7fdbe7446640 1 --2- 172.21.15.67:0/2735924121 >> [v2:172.21.15.67:6808/3238175451,v1:172.21.15.67:6809/3238175451] conn(0x7fdbcc071ea0 0x7fdbcc0742c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.767+0000 7fdbe7446640 1 -- 172.21.15.67:0/2735924121 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdbcc06bfe0 msgr2=0x7fdbcc06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.767+0000 7fdbe7446640 1 --2- 172.21.15.67:0/2735924121 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdbcc06bfe0 0x7fdbcc06e4a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8034000 tx=0x7fdbd802e000 comp rx=0 tx=0).stop 2024-04-25T02:29:54.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.767+0000 7fdbe7446640 1 -- 172.21.15.67:0/2735924121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbe00b4310 msgr2=0x7fdbe01f6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.767+0000 7fdbe7446640 1 --2- 172.21.15.67:0/2735924121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbe00b4310 0x7fdbe01f6e50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400d620 tx=0x7fdbd400dae0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.767+0000 7fdbe59e3640 1 -- 172.21.15.67:0/2735924121 reap_dead start 2024-04-25T02:29:54.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.767+0000 7fdbe7446640 1 -- 172.21.15.67:0/2735924121 shutdown_connections 2024-04-25T02:29:54.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.767+0000 7fdbe7446640 1 -- 172.21.15.67:0/2735924121 >> 172.21.15.67:0/2735924121 conn(0x7fdbe00b2ad0 msgr2=0x7fdbe00b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:54.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.767+0000 7fdbe7446640 1 -- 172.21.15.67:0/2735924121 shutdown_connections 2024-04-25T02:29:54.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.767+0000 7fdbe7446640 1 -- 172.21.15.67:0/2735924121 wait complete. 2024-04-25T02:29:54.780 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T02:29:54.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.879+0000 7f7f538ee640 1 Processor -- start 2024-04-25T02:29:54.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.879+0000 7f7f538ee640 1 -- start start 2024-04-25T02:29:54.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f538ee640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7f4c0d14a0 0x7f7f4c06e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f538ee640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f4c0b4470 con 0x7f7f4c147040 2024-04-25T02:29:54.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f538ee640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f4c161f90 con 0x7f7f4c0d1010 2024-04-25T02:29:54.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f538ee640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7f4c1628c0 con 0x7f7f4c0d14a0 2024-04-25T02:29:54.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f5168a640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7f4c147040 0x7f7f4c0b3d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57076/0 (socket says 172.21.15.67:57076) 2024-04-25T02:29:54.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f5168a640 1 -- 172.21.15.67:0/1129222305 learned_addr learned my addr 172.21.15.67:0/1129222305 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:54.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f43fff640 1 -- 172.21.15.67:0/1129222305 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2457611741 0 0) 0x7f7f4c0b4470 con 0x7f7f4c147040 2024-04-25T02:29:54.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f43fff640 1 -- 172.21.15.67:0/1129222305 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f38003520 con 0x7f7f4c147040 2024-04-25T02:29:54.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f51e8b640 1 --2- 172.21.15.67:0/1129222305 >> v2:172.21.15.176:3300/0 conn(0x7f7f4c0d14a0 0x7f7f4c06e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f43fff640 1 -- 172.21.15.67:0/1129222305 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3438578415 0 0) 0x7f7f38003520 con 0x7f7f4c147040 2024-04-25T02:29:54.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f43fff640 1 -- 172.21.15.67:0/1129222305 >> v2:172.21.15.176:3300/0 conn(0x7f7f4c0d14a0 msgr2=0x7f7f4c06e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:54.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f43fff640 1 --2- 172.21.15.67:0/1129222305 >> v2:172.21.15.176:3300/0 conn(0x7f7f4c0d14a0 0x7f7f4c06e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f43fff640 1 -- 172.21.15.67:0/1129222305 >> v1:172.21.15.176:6789/0 conn(0x7f7f4c0d1010 legacy=0x7f7f4c06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f43fff640 1 -- 172.21.15.67:0/1129222305 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4c162270 con 0x7f7f4c147040 2024-04-25T02:29:54.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f43fff640 1 -- 172.21.15.67:0/1129222305 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f7f48001670 con 0x7f7f4c147040 2024-04-25T02:29:54.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f51e8b640 1 --2- 172.21.15.67:0/1129222305 >> v2:172.21.15.176:3300/0 conn(0x7f7f4c0d14a0 0x7f7f4c06e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:54.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f43fff640 1 -- 172.21.15.67:0/1129222305 >> v1:172.21.15.67:6789/0 conn(0x7f7f4c147040 legacy=0x7f7f4c0b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f43fff640 1 --2- 172.21.15.67:0/1129222305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f380039b0 0x7f7f38003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f43fff640 1 --2- 172.21.15.67:0/1129222305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f38004800 0x7f7f38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f43fff640 1 --2- 172.21.15.67:0/1129222305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f380052e0 0x7f7f3800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f43fff640 1 -- 172.21.15.67:0/1129222305 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c1628c0 con 0x7f7f380039b0 2024-04-25T02:29:54.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.880+0000 7f7f43fff640 1 -- 172.21.15.67:0/1129222305 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3800c1b0 con 0x7f7f380052e0 2024-04-25T02:29:54.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.881+0000 7f7f43fff640 1 -- 172.21.15.67:0/1129222305 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7f3800c3b0 con 0x7f7f38004800 2024-04-25T02:29:54.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.881+0000 7f7f5168a640 1 --2- 172.21.15.67:0/1129222305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f380039b0 0x7f7f38003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.881+0000 7f7f50e89640 1 --2- 172.21.15.67:0/1129222305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f38004800 0x7f7f38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.881+0000 7f7f51e8b640 1 --2- 172.21.15.67:0/1129222305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f380052e0 0x7f7f3800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.881+0000 7f7f5168a640 1 -- 172.21.15.67:0/1129222305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f38004800 msgr2=0x7f7f38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:54.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.881+0000 7f7f5168a640 1 --2- 172.21.15.67:0/1129222305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f38004800 0x7f7f38004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.881+0000 7f7f5168a640 1 -- 172.21.15.67:0/1129222305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f380052e0 msgr2=0x7f7f3800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:54.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.881+0000 7f7f5168a640 1 --2- 172.21.15.67:0/1129222305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f380052e0 0x7f7f3800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.881+0000 7f7f51e8b640 1 -- 172.21.15.67:0/1129222305 reap_dead start 2024-04-25T02:29:54.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.881+0000 7f7f5168a640 1 -- 172.21.15.67:0/1129222305 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f38003520 con 0x7f7f380039b0 2024-04-25T02:29:54.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.882+0000 7f7f5168a640 1 --2- 172.21.15.67:0/1129222305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f380039b0 0x7f7f38003dd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800c210 tx=0x7f7f38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4775cdd3f09fd6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:54.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.882+0000 7f7f43fff640 1 -- 172.21.15.67:0/1129222305 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f48007cf0 con 0x7f7f380039b0 2024-04-25T02:29:54.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.882+0000 7f7f43fff640 1 -- 172.21.15.67:0/1129222305 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f48005af0 con 0x7f7f380039b0 2024-04-25T02:29:54.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.882+0000 7f7f43fff640 1 -- 172.21.15.67:0/1129222305 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f48007070 con 0x7f7f380039b0 2024-04-25T02:29:54.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.882+0000 7f7f538ee640 1 -- 172.21.15.67:0/1129222305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f380039b0 msgr2=0x7f7f38003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.882+0000 7f7f538ee640 1 --2- 172.21.15.67:0/1129222305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f380039b0 0x7f7f38003dd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800c210 tx=0x7f7f38005830 comp rx=0 tx=0).stop 2024-04-25T02:29:54.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.882+0000 7f7f538ee640 1 -- 172.21.15.67:0/1129222305 shutdown_connections 2024-04-25T02:29:54.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.882+0000 7f7f538ee640 1 --2- 172.21.15.67:0/1129222305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f380039b0 0x7f7f38003dd0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.882+0000 7f7f538ee640 1 -- 172.21.15.67:0/1129222305 >> 172.21.15.67:0/1129222305 conn(0x7f7f4c06c3b0 msgr2=0x7f7f4c06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:54.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.882+0000 7f7f538ee640 1 -- 172.21.15.67:0/1129222305 shutdown_connections 2024-04-25T02:29:54.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.882+0000 7f7f538ee640 1 -- 172.21.15.67:0/1129222305 wait complete. 2024-04-25T02:29:54.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.884+0000 7f7f538ee640 1 Processor -- start 2024-04-25T02:29:54.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.884+0000 7f7f538ee640 1 -- start start 2024-04-25T02:29:54.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.884+0000 7f7f538ee640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f380039b0 0x7f7f4c1f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.884+0000 7f7f538ee640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f4c1f7ba0 0x7f7f4c15d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.884+0000 7f7f538ee640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4c06eef0 0x7f7f4c06f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.884+0000 7f7f538ee640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c162d50 con 0x7f7f4c1f7ba0 2024-04-25T02:29:54.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.884+0000 7f7f538ee640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c0d18f0 con 0x7f7f380039b0 2024-04-25T02:29:54.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.884+0000 7f7f538ee640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4c0b4740 con 0x7f7f4c06eef0 2024-04-25T02:29:54.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.884+0000 7f7f50e89640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f4c1f7ba0 0x7f7f4c15d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.884+0000 7f7f50e89640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f4c1f7ba0 0x7f7f4c15d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60508/0 (socket says 172.21.15.67:60508) 2024-04-25T02:29:54.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.884+0000 7f7f50e89640 1 -- 172.21.15.67:0/141113619 learned_addr learned my addr 172.21.15.67:0/141113619 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:54.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.885+0000 7f7f51e8b640 1 --2- 172.21.15.67:0/141113619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4c06eef0 0x7f7f4c06f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.885+0000 7f7f5168a640 1 --2- 172.21.15.67:0/141113619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f380039b0 0x7f7f4c1f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.885+0000 7f7f50e89640 1 -- 172.21.15.67:0/141113619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4c06eef0 msgr2=0x7f7f4c06f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.885+0000 7f7f50e89640 1 --2- 172.21.15.67:0/141113619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4c06eef0 0x7f7f4c06f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.885+0000 7f7f50e89640 1 -- 172.21.15.67:0/141113619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f380039b0 msgr2=0x7f7f4c1f4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:54.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.885+0000 7f7f50e89640 1 --2- 172.21.15.67:0/141113619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f380039b0 0x7f7f4c1f4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:54.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.885+0000 7f7f50e89640 1 -- 172.21.15.67:0/141113619 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4c15de50 con 0x7f7f4c1f7ba0 2024-04-25T02:29:54.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.885+0000 7f7f50e89640 1 --2- 172.21.15.67:0/141113619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f4c1f7ba0 0x7f7f4c15d330 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00f650 tx=0x7f7f3c00fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:54.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.885+0000 7f7f41ffb640 1 -- 172.21.15.67:0/141113619 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c0050d0 con 0x7f7f4c1f7ba0 2024-04-25T02:29:54.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.885+0000 7f7f41ffb640 1 -- 172.21.15.67:0/141113619 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3c018070 con 0x7f7f4c1f7ba0 2024-04-25T02:29:54.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.885+0000 7f7f538ee640 1 -- 172.21.15.67:0/141113619 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f4c1f80d0 con 0x7f7f4c1f7ba0 2024-04-25T02:29:54.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.885+0000 7f7f41ffb640 1 -- 172.21.15.67:0/141113619 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c005490 con 0x7f7f4c1f7ba0 2024-04-25T02:29:54.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.885+0000 7f7f538ee640 1 -- 172.21.15.67:0/141113619 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f4c1f8690 con 0x7f7f4c1f7ba0 2024-04-25T02:29:54.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.886+0000 7f7f538ee640 1 -- 172.21.15.67:0/141113619 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f4c069110 con 0x7f7f4c1f7ba0 2024-04-25T02:29:54.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.887+0000 7f7f41ffb640 1 -- 172.21.15.67:0/141113619 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f7f3c00d6b0 con 0x7f7f4c1f7ba0 2024-04-25T02:29:54.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.887+0000 7f7f41ffb640 1 --2- 172.21.15.67:0/141113619 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7f3006c010 0x7f7f3006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:54.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.887+0000 7f7f41ffb640 1 -- 172.21.15.67:0/141113619 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f7f3c08ab50 con 0x7f7f4c1f7ba0 2024-04-25T02:29:54.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.887+0000 7f7f5168a640 1 --2- 172.21.15.67:0/141113619 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7f3006c010 0x7f7f3006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:54.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.888+0000 7f7f5168a640 1 --2- 172.21.15.67:0/141113619 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7f3006c010 0x7f7f3006e4d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7f38004780 tx=0x7f7f48034040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:54.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:54.891+0000 7f7f41ffb640 1 -- 172.21.15.67:0/141113619 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7f3c059580 con 0x7f7f4c1f7ba0 2024-04-25T02:29:55.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.078+0000 7f7f538ee640 1 -- 172.21.15.67:0/141113619 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f7f4c1f5520 con 0x7f7f3006c010 2024-04-25T02:29:55.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.078+0000 7f7f41ffb640 1 -- 172.21.15.67:0/141113619 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7f480014f0 con 0x7f7f3006c010 2024-04-25T02:29:55.081 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T02:29:55.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.080+0000 7f7f538ee640 1 -- 172.21.15.67:0/141113619 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7f3006c010 msgr2=0x7f7f3006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.080+0000 7f7f538ee640 1 --2- 172.21.15.67:0/141113619 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7f3006c010 0x7f7f3006e4d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7f38004780 tx=0x7f7f48034040 comp rx=0 tx=0).stop 2024-04-25T02:29:55.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.080+0000 7f7f538ee640 1 -- 172.21.15.67:0/141113619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f4c1f7ba0 msgr2=0x7f7f4c15d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.080+0000 7f7f538ee640 1 --2- 172.21.15.67:0/141113619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f4c1f7ba0 0x7f7f4c15d330 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00f650 tx=0x7f7f3c00fb10 comp rx=0 tx=0).stop 2024-04-25T02:29:55.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.081+0000 7f7f538ee640 1 -- 172.21.15.67:0/141113619 shutdown_connections 2024-04-25T02:29:55.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.081+0000 7f7f538ee640 1 --2- 172.21.15.67:0/141113619 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f7f3006c010 0x7f7f3006e4d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.081+0000 7f7f538ee640 1 --2- 172.21.15.67:0/141113619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f4c06eef0 0x7f7f4c06f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.081+0000 7f7f538ee640 1 --2- 172.21.15.67:0/141113619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f4c1f7ba0 0x7f7f4c15d330 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.081+0000 7f7f538ee640 1 --2- 172.21.15.67:0/141113619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f380039b0 0x7f7f4c1f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.081+0000 7f7f538ee640 1 -- 172.21.15.67:0/141113619 >> 172.21.15.67:0/141113619 conn(0x7f7f4c06c3b0 msgr2=0x7f7f4c0b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:55.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.081+0000 7f7f538ee640 1 -- 172.21.15.67:0/141113619 shutdown_connections 2024-04-25T02:29:55.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.081+0000 7f7f538ee640 1 -- 172.21.15.67:0/141113619 wait complete. 2024-04-25T02:29:55.094 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T02:29:55.094 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:29:55.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.196+0000 7fb39cda5640 1 Processor -- start 2024-04-25T02:29:55.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.196+0000 7fb39cda5640 1 -- start start 2024-04-25T02:29:55.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.197+0000 7fb39cda5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb3980727f0 0x7fb39815ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.197+0000 7fb39cda5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3980aebb0 0x7fb398154f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.197+0000 7fb39cda5640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb398072bd0 con 0x7fb39815f220 2024-04-25T02:29:55.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.197+0000 7fb39cda5640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb3980af040 con 0x7fb3980727f0 2024-04-25T02:29:55.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.197+0000 7fb39cda5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb39815f680 con 0x7fb3980aebb0 2024-04-25T02:29:55.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.197+0000 7fb395d9b640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb39815f220 0x7fb3980ae4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57080/0 (socket says 172.21.15.67:57080) 2024-04-25T02:29:55.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.197+0000 7fb395d9b640 1 -- 172.21.15.67:0/3681241652 learned_addr learned my addr 172.21.15.67:0/3681241652 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:55.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.197+0000 7fb396d9d640 1 --2- 172.21.15.67:0/3681241652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3980aebb0 0x7fb398154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.197+0000 7fb39659c640 1 --2- 172.21.15.67:0/3681241652 >> v2:172.21.15.176:3300/0 conn(0x7fb3980727f0 0x7fb39815ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39559a640 1 -- 172.21.15.67:0/3681241652 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1398135220 0 0) 0x7fb398072bd0 con 0x7fb39815f220 2024-04-25T02:29:55.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39559a640 1 -- 172.21.15.67:0/3681241652 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb384003520 con 0x7fb39815f220 2024-04-25T02:29:55.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39559a640 1 -- 172.21.15.67:0/3681241652 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2996381364 0 0) 0x7fb384003520 con 0x7fb39815f220 2024-04-25T02:29:55.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39559a640 1 -- 172.21.15.67:0/3681241652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3980aebb0 msgr2=0x7fb398154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:55.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39559a640 1 --2- 172.21.15.67:0/3681241652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3980aebb0 0x7fb398154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39559a640 1 -- 172.21.15.67:0/3681241652 >> v2:172.21.15.176:3300/0 conn(0x7fb3980727f0 msgr2=0x7fb39815ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:55.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39559a640 1 --2- 172.21.15.67:0/3681241652 >> v2:172.21.15.176:3300/0 conn(0x7fb3980727f0 0x7fb39815ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39559a640 1 -- 172.21.15.67:0/3681241652 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3980b4a90 con 0x7fb39815f220 2024-04-25T02:29:55.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39559a640 1 -- 172.21.15.67:0/3681241652 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7fb380001670 con 0x7fb39815f220 2024-04-25T02:29:55.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39559a640 1 -- 172.21.15.67:0/3681241652 >> v1:172.21.15.67:6789/0 conn(0x7fb39815f220 legacy=0x7fb3980ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39559a640 1 --2- 172.21.15.67:0/3681241652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3840039b0 0x7fb384003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39559a640 1 --2- 172.21.15.67:0/3681241652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3980aebb0 0x7fb384004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39559a640 1 --2- 172.21.15.67:0/3681241652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb384004d40 0x7fb3840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39559a640 1 -- 172.21.15.67:0/3681241652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb3980af040 con 0x7fb3840039b0 2024-04-25T02:29:55.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39559a640 1 -- 172.21.15.67:0/3681241652 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb38400b9c0 con 0x7fb384004d40 2024-04-25T02:29:55.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39559a640 1 -- 172.21.15.67:0/3681241652 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb38400bb40 con 0x7fb3980aebb0 2024-04-25T02:29:55.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39659c640 1 --2- 172.21.15.67:0/3681241652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3840039b0 0x7fb384003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb395d9b640 1 --2- 172.21.15.67:0/3681241652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3980aebb0 0x7fb384004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb396d9d640 1 --2- 172.21.15.67:0/3681241652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb384004d40 0x7fb3840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39659c640 1 -- 172.21.15.67:0/3681241652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3980aebb0 msgr2=0x7fb384004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:55.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39659c640 1 --2- 172.21.15.67:0/3681241652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3980aebb0 0x7fb384004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39659c640 1 -- 172.21.15.67:0/3681241652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb384004d40 msgr2=0x7fb3840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:55.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39659c640 1 --2- 172.21.15.67:0/3681241652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb384004d40 0x7fb3840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb39659c640 1 -- 172.21.15.67:0/3681241652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb384003520 con 0x7fb3840039b0 2024-04-25T02:29:55.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.198+0000 7fb396d9d640 1 --2- 172.21.15.67:0/3681241652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb384004d40 0x7fb3840051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:55.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.199+0000 7fb39659c640 1 --2- 172.21.15.67:0/3681241652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3840039b0 0x7fb384003dd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb390009af0 tx=0x7fb384005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d880b91a74074be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:55.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.199+0000 7fb39559a640 1 -- 172.21.15.67:0/3681241652 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390036070 con 0x7fb3840039b0 2024-04-25T02:29:55.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.199+0000 7fb39559a640 1 -- 172.21.15.67:0/3681241652 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb390031400 con 0x7fb3840039b0 2024-04-25T02:29:55.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.199+0000 7fb39559a640 1 -- 172.21.15.67:0/3681241652 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390009690 con 0x7fb3840039b0 2024-04-25T02:29:55.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.200+0000 7fb39cda5640 1 -- 172.21.15.67:0/3681241652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3840039b0 msgr2=0x7fb384003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.200+0000 7fb39cda5640 1 --2- 172.21.15.67:0/3681241652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3840039b0 0x7fb384003dd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb390009af0 tx=0x7fb384005830 comp rx=0 tx=0).stop 2024-04-25T02:29:55.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.200+0000 7fb396d9d640 1 -- 172.21.15.67:0/3681241652 reap_dead start 2024-04-25T02:29:55.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.200+0000 7fb39cda5640 1 -- 172.21.15.67:0/3681241652 shutdown_connections 2024-04-25T02:29:55.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.200+0000 7fb39cda5640 1 -- 172.21.15.67:0/3681241652 >> 172.21.15.67:0/3681241652 conn(0x7fb3980b19c0 msgr2=0x7fb3980b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:55.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.200+0000 7fb39cda5640 1 -- 172.21.15.67:0/3681241652 shutdown_connections 2024-04-25T02:29:55.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.200+0000 7fb39cda5640 1 -- 172.21.15.67:0/3681241652 wait complete. 2024-04-25T02:29:55.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.201+0000 7fb39cda5640 1 Processor -- start 2024-04-25T02:29:55.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.201+0000 7fb39cda5640 1 -- start start 2024-04-25T02:29:55.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.202+0000 7fb39cda5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3840039b0 0x7fb398147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.202+0000 7fb39cda5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb398149c70 0x7fb39814a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.202+0000 7fb39cda5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb398148780 0x7fb398148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.202+0000 7fb39cda5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb3980b2fa0 con 0x7fb3840039b0 2024-04-25T02:29:55.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.202+0000 7fb39cda5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb3980b2cc0 con 0x7fb398149c70 2024-04-25T02:29:55.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.202+0000 7fb39cda5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb3980b3280 con 0x7fb398148780 2024-04-25T02:29:55.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.202+0000 7fb39659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3840039b0 0x7fb398147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.202+0000 7fb39659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3840039b0 0x7fb398147f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60530/0 (socket says 172.21.15.67:60530) 2024-04-25T02:29:55.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.202+0000 7fb39659c640 1 -- 172.21.15.67:0/2583759023 learned_addr learned my addr 172.21.15.67:0/2583759023 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:55.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.202+0000 7fb395d9b640 1 --2- 172.21.15.67:0/2583759023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb398149c70 0x7fb39814a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.202+0000 7fb396d9d640 1 --2- 172.21.15.67:0/2583759023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb398148780 0x7fb398148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.202+0000 7fb39659c640 1 -- 172.21.15.67:0/2583759023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb398148780 msgr2=0x7fb398148c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.202+0000 7fb39659c640 1 --2- 172.21.15.67:0/2583759023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb398148780 0x7fb398148c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.202+0000 7fb39659c640 1 -- 172.21.15.67:0/2583759023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb398149c70 msgr2=0x7fb39814a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.202+0000 7fb39659c640 1 --2- 172.21.15.67:0/2583759023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb398149c70 0x7fb39814a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.202+0000 7fb39659c640 1 -- 172.21.15.67:0/2583759023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3981494f0 con 0x7fb3840039b0 2024-04-25T02:29:55.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.203+0000 7fb39659c640 1 --2- 172.21.15.67:0/2583759023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3840039b0 0x7fb398147f60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb390034040 tx=0x7fb390004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:55.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.203+0000 7fb38effd640 1 -- 172.21.15.67:0/2583759023 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390041020 con 0x7fb3840039b0 2024-04-25T02:29:55.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.203+0000 7fb38effd640 1 -- 172.21.15.67:0/2583759023 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39002ade0 con 0x7fb3840039b0 2024-04-25T02:29:55.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.203+0000 7fb38effd640 1 -- 172.21.15.67:0/2583759023 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390036040 con 0x7fb3840039b0 2024-04-25T02:29:55.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.203+0000 7fb39cda5640 1 -- 172.21.15.67:0/2583759023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3981497d0 con 0x7fb3840039b0 2024-04-25T02:29:55.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.203+0000 7fb39cda5640 1 -- 172.21.15.67:0/2583759023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3980affd0 con 0x7fb3840039b0 2024-04-25T02:29:55.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.204+0000 7fb39cda5640 1 -- 172.21.15.67:0/2583759023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb398149a10 con 0x7fb3840039b0 2024-04-25T02:29:55.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.204+0000 7fb38effd640 1 -- 172.21.15.67:0/2583759023 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fb390044020 con 0x7fb3840039b0 2024-04-25T02:29:55.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.205+0000 7fb38effd640 1 --2- 172.21.15.67:0/2583759023 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb37806bfe0 0x7fb37806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.205+0000 7fb38effd640 1 -- 172.21.15.67:0/2583759023 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fb3900ab210 con 0x7fb3840039b0 2024-04-25T02:29:55.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.205+0000 7fb395d9b640 1 --2- 172.21.15.67:0/2583759023 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb37806bfe0 0x7fb37806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.205+0000 7fb38effd640 1 --2- 172.21.15.67:0/2583759023 >> [v2:172.21.15.67:6824/611839856,v1:172.21.15.67:6825/611839856] conn(0x7fb378071ea0 0x7fb3780742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.205+0000 7fb38effd640 1 -- 172.21.15.67:0/2583759023 --> [v2:172.21.15.67:6824/611839856,v1:172.21.15.67:6825/611839856] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3900067f0 con 0x7fb378071ea0 2024-04-25T02:29:55.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.205+0000 7fb38effd640 1 -- 172.21.15.67:0/2583759023 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fb3900b2050 con 0x7fb3840039b0 2024-04-25T02:29:55.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.205+0000 7fb396d9d640 1 --2- 172.21.15.67:0/2583759023 >> [v2:172.21.15.67:6824/611839856,v1:172.21.15.67:6825/611839856] conn(0x7fb378071ea0 0x7fb3780742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.205+0000 7fb395d9b640 1 --2- 172.21.15.67:0/2583759023 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb37806bfe0 0x7fb37806e4a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb380000c00 tx=0x7fb380007970 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:55.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.205+0000 7fb396d9d640 1 --2- 172.21.15.67:0/2583759023 >> [v2:172.21.15.67:6824/611839856,v1:172.21.15.67:6825/611839856] conn(0x7fb378071ea0 0x7fb3780742c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:55.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.206+0000 7fb38effd640 1 -- 172.21.15.67:0/2583759023 <== osd.3 v2:172.21.15.67:6824/611839856 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb3900067f0 con 0x7fb378071ea0 2024-04-25T02:29:55.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.219+0000 7fb39cda5640 1 -- 172.21.15.67:0/2583759023 --> [v2:172.21.15.67:6824/611839856,v1:172.21.15.67:6825/611839856] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb398069110 con 0x7fb378071ea0 2024-04-25T02:29:55.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.219+0000 7fb38effd640 1 -- 172.21.15.67:0/2583759023 <== osd.3 v2:172.21.15.67:6824/611839856 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb398069110 con 0x7fb378071ea0 2024-04-25T02:29:55.223 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-25T02:29:55.223 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:29:55.223 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-25T02:29:55.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.220+0000 7fb39cda5640 1 -- 172.21.15.67:0/2583759023 >> [v2:172.21.15.67:6824/611839856,v1:172.21.15.67:6825/611839856] conn(0x7fb378071ea0 msgr2=0x7fb3780742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.220+0000 7fb39cda5640 1 --2- 172.21.15.67:0/2583759023 >> [v2:172.21.15.67:6824/611839856,v1:172.21.15.67:6825/611839856] conn(0x7fb378071ea0 0x7fb3780742c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.220+0000 7fb39cda5640 1 -- 172.21.15.67:0/2583759023 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb37806bfe0 msgr2=0x7fb37806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.220+0000 7fb39cda5640 1 --2- 172.21.15.67:0/2583759023 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fb37806bfe0 0x7fb37806e4a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb380000c00 tx=0x7fb380007970 comp rx=0 tx=0).stop 2024-04-25T02:29:55.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.220+0000 7fb39cda5640 1 -- 172.21.15.67:0/2583759023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3840039b0 msgr2=0x7fb398147f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.220+0000 7fb39cda5640 1 --2- 172.21.15.67:0/2583759023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3840039b0 0x7fb398147f60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb390034040 tx=0x7fb390004730 comp rx=0 tx=0).stop 2024-04-25T02:29:55.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.220+0000 7fb396d9d640 1 -- 172.21.15.67:0/2583759023 reap_dead start 2024-04-25T02:29:55.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.220+0000 7fb39cda5640 1 -- 172.21.15.67:0/2583759023 shutdown_connections 2024-04-25T02:29:55.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.220+0000 7fb39cda5640 1 -- 172.21.15.67:0/2583759023 >> 172.21.15.67:0/2583759023 conn(0x7fb3980b19c0 msgr2=0x7fb3980cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:55.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.220+0000 7fb39cda5640 1 -- 172.21.15.67:0/2583759023 shutdown_connections 2024-04-25T02:29:55.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.220+0000 7fb39cda5640 1 -- 172.21.15.67:0/2583759023 wait complete. 2024-04-25T02:29:55.233 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T02:29:55.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.332+0000 7f656d7b0640 1 Processor -- start 2024-04-25T02:29:55.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.332+0000 7f656d7b0640 1 -- start start 2024-04-25T02:29:55.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.333+0000 7f656d7b0640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6568147040 0x7f65680b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.333+0000 7f656d7b0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65680b42a0 0x7f65680d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.333+0000 7f656d7b0640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6568161f90 con 0x7f65680d1550 2024-04-25T02:29:55.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.333+0000 7f656d7b0640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f65681628c0 con 0x7f6568147040 2024-04-25T02:29:55.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.333+0000 7f656d7b0640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6568162270 con 0x7f65680b42a0 2024-04-25T02:29:55.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.333+0000 7f6566ffd640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6568147040 0x7f65680b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.333+0000 7f65677fe640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f65680d1550 0x7f656806b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57084/0 (socket says 172.21.15.67:57084) 2024-04-25T02:29:55.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.333+0000 7f65677fe640 1 -- 172.21.15.67:0/1432801790 learned_addr learned my addr 172.21.15.67:0/1432801790 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:55.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.333+0000 7f65667fc640 1 --2- 172.21.15.67:0/1432801790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65680b42a0 0x7f65680d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.333+0000 7f6566ffd640 1 -- 172.21.15.67:0/1432801790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65680b42a0 msgr2=0x7f65680d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:55.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.333+0000 7f6566ffd640 1 --2- 172.21.15.67:0/1432801790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65680b42a0 0x7f65680d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.333+0000 7f6566ffd640 1 -- 172.21.15.67:0/1432801790 >> v1:172.21.15.67:6789/0 conn(0x7f65680d1550 legacy=0x7f656806b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.333+0000 7f6566ffd640 1 -- 172.21.15.67:0/1432801790 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6568162550 con 0x7f6568147040 2024-04-25T02:29:55.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.333+0000 7f6565ffb640 1 -- 172.21.15.67:0/1432801790 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1826596240 0 0) 0x7f6568161f90 con 0x7f65680d1550 2024-04-25T02:29:55.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.334+0000 7f6566ffd640 1 --2- 172.21.15.67:0/1432801790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6568147040 0x7f65680b3d60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f65580097a0 tx=0x7f655802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde69f09080ef74b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:55.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.334+0000 7f6565ffb640 1 -- 172.21.15.67:0/1432801790 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558037070 con 0x7f6568147040 2024-04-25T02:29:55.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.334+0000 7f6565ffb640 1 -- 172.21.15.67:0/1432801790 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f655802ae50 con 0x7f6568147040 2024-04-25T02:29:55.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.334+0000 7f6565ffb640 1 -- 172.21.15.67:0/1432801790 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558032660 con 0x7f6568147040 2024-04-25T02:29:55.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.335+0000 7f656d7b0640 1 -- 172.21.15.67:0/1432801790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6568147040 msgr2=0x7f65680b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.335+0000 7f656d7b0640 1 --2- 172.21.15.67:0/1432801790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6568147040 0x7f65680b3d60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f65580097a0 tx=0x7f655802a100 comp rx=0 tx=0).stop 2024-04-25T02:29:55.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.335+0000 7f656d7b0640 1 -- 172.21.15.67:0/1432801790 shutdown_connections 2024-04-25T02:29:55.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.335+0000 7f656d7b0640 1 --2- 172.21.15.67:0/1432801790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65680b42a0 0x7f65680d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.335+0000 7f656d7b0640 1 --2- 172.21.15.67:0/1432801790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6568147040 0x7f65680b3d60 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.335+0000 7f656d7b0640 1 -- 172.21.15.67:0/1432801790 >> 172.21.15.67:0/1432801790 conn(0x7f656806c3b0 msgr2=0x7f656806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:55.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.335+0000 7f656d7b0640 1 -- 172.21.15.67:0/1432801790 shutdown_connections 2024-04-25T02:29:55.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.335+0000 7f656d7b0640 1 -- 172.21.15.67:0/1432801790 wait complete. 2024-04-25T02:29:55.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.336+0000 7f656d7b0640 1 Processor -- start 2024-04-25T02:29:55.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.336+0000 7f656d7b0640 1 -- start start 2024-04-25T02:29:55.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.337+0000 7f656d7b0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65680b42a0 0x7f65680b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.337+0000 7f656d7b0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65680d1550 0x7f65681609d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.337+0000 7f656d7b0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6568147040 0x7f6568160f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.337+0000 7f656d7b0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f65680b4740 con 0x7f65680b42a0 2024-04-25T02:29:55.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.337+0000 7f656d7b0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f656806ec50 con 0x7f6568147040 2024-04-25T02:29:55.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.337+0000 7f656d7b0640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f65680b5eb0 con 0x7f65680d1550 2024-04-25T02:29:55.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.337+0000 7f6566ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65680b42a0 0x7f65680b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.337+0000 7f6566ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65680b42a0 0x7f65680b1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60556/0 (socket says 172.21.15.67:60556) 2024-04-25T02:29:55.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.337+0000 7f6566ffd640 1 -- 172.21.15.67:0/2903347551 learned_addr learned my addr 172.21.15.67:0/2903347551 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:55.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.337+0000 7f65667fc640 1 --2- 172.21.15.67:0/2903347551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65680d1550 0x7f65681609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.337+0000 7f65677fe640 1 --2- 172.21.15.67:0/2903347551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6568147040 0x7f6568160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.337+0000 7f6566ffd640 1 -- 172.21.15.67:0/2903347551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65680d1550 msgr2=0x7f65681609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.337+0000 7f6566ffd640 1 --2- 172.21.15.67:0/2903347551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65680d1550 0x7f65681609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.337+0000 7f6566ffd640 1 -- 172.21.15.67:0/2903347551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6568147040 msgr2=0x7f6568160f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.337+0000 7f6566ffd640 1 --2- 172.21.15.67:0/2903347551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6568147040 0x7f6568160f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.337+0000 7f6566ffd640 1 -- 172.21.15.67:0/2903347551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f656815ec10 con 0x7f65680b42a0 2024-04-25T02:29:55.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.337+0000 7f65677fe640 1 --2- 172.21.15.67:0/2903347551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6568147040 0x7f6568160f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:55.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.338+0000 7f6566ffd640 1 --2- 172.21.15.67:0/2903347551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65680b42a0 0x7f65680b1740 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f65580098c0 tx=0x7f65580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:55.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.338+0000 7f654f7fe640 1 -- 172.21.15.67:0/2903347551 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558041030 con 0x7f65680b42a0 2024-04-25T02:29:55.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.338+0000 7f654f7fe640 1 -- 172.21.15.67:0/2903347551 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f655802ac50 con 0x7f65680b42a0 2024-04-25T02:29:55.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.338+0000 7f656d7b0640 1 -- 172.21.15.67:0/2903347551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f656815eef0 con 0x7f65680b42a0 2024-04-25T02:29:55.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.338+0000 7f654f7fe640 1 -- 172.21.15.67:0/2903347551 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558037040 con 0x7f65680b42a0 2024-04-25T02:29:55.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.338+0000 7f656d7b0640 1 -- 172.21.15.67:0/2903347551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f656815f790 con 0x7f65680b42a0 2024-04-25T02:29:55.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.339+0000 7f656d7b0640 1 -- 172.21.15.67:0/2903347551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f656815f0c0 con 0x7f65680b42a0 2024-04-25T02:29:55.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.339+0000 7f654f7fe640 1 -- 172.21.15.67:0/2903347551 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f6558044070 con 0x7f65680b42a0 2024-04-25T02:29:55.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.340+0000 7f654f7fe640 1 --2- 172.21.15.67:0/2903347551 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f655406bfe0 0x7f655406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.340+0000 7f654f7fe640 1 -- 172.21.15.67:0/2903347551 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f65580ab5d0 con 0x7f65680b42a0 2024-04-25T02:29:55.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.340+0000 7f65667fc640 1 --2- 172.21.15.67:0/2903347551 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f655406bfe0 0x7f655406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.340+0000 7f65667fc640 1 --2- 172.21.15.67:0/2903347551 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f655406bfe0 0x7f655406e4a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f655c006fd0 tx=0x7f655c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:55.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.344+0000 7f654f7fe640 1 -- 172.21.15.67:0/2903347551 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6558044e40 con 0x7f65680b42a0 2024-04-25T02:29:55.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.529+0000 7f656d7b0640 1 -- 172.21.15.67:0/2903347551 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f6568069110 con 0x7f655406bfe0 2024-04-25T02:29:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.530+0000 7f654f7fe640 1 -- 172.21.15.67:0/2903347551 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6568069110 con 0x7f655406bfe0 2024-04-25T02:29:55.533 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T02:29:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.532+0000 7f656d7b0640 1 -- 172.21.15.67:0/2903347551 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f655406bfe0 msgr2=0x7f655406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.532+0000 7f656d7b0640 1 --2- 172.21.15.67:0/2903347551 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f655406bfe0 0x7f655406e4a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f655c006fd0 tx=0x7f655c008040 comp rx=0 tx=0).stop 2024-04-25T02:29:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.532+0000 7f656d7b0640 1 -- 172.21.15.67:0/2903347551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65680b42a0 msgr2=0x7f65680b1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.532+0000 7f656d7b0640 1 --2- 172.21.15.67:0/2903347551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65680b42a0 0x7f65680b1740 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f65580098c0 tx=0x7f65580046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.532+0000 7f656d7b0640 1 -- 172.21.15.67:0/2903347551 shutdown_connections 2024-04-25T02:29:55.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.532+0000 7f656d7b0640 1 --2- 172.21.15.67:0/2903347551 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f655406bfe0 0x7f655406e4a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.532+0000 7f656d7b0640 1 --2- 172.21.15.67:0/2903347551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6568147040 0x7f6568160f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.532+0000 7f656d7b0640 1 --2- 172.21.15.67:0/2903347551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65680d1550 0x7f65681609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.532+0000 7f656d7b0640 1 --2- 172.21.15.67:0/2903347551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65680b42a0 0x7f65680b1740 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.532+0000 7f656d7b0640 1 -- 172.21.15.67:0/2903347551 >> 172.21.15.67:0/2903347551 conn(0x7f656806c3b0 msgr2=0x7f6568143e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:55.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.532+0000 7f656d7b0640 1 -- 172.21.15.67:0/2903347551 shutdown_connections 2024-04-25T02:29:55.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.532+0000 7f656d7b0640 1 -- 172.21.15.67:0/2903347551 wait complete. 2024-04-25T02:29:55.546 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T02:29:55.546 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:29:55.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.648+0000 7fac1feae640 1 Processor -- start 2024-04-25T02:29:55.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.649+0000 7fac1feae640 1 -- start start 2024-04-25T02:29:55.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.649+0000 7fac1feae640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac180b5410 0x7fac1806d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.649+0000 7fac1feae640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fac1806dc00 0x7fac18167d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.649+0000 7fac1feae640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac180b5850 con 0x7fac180b4020 2024-04-25T02:29:55.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.649+0000 7fac1feae640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fac1806bcd0 con 0x7fac1806dc00 2024-04-25T02:29:55.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.649+0000 7fac1feae640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fac1806b0c0 con 0x7fac180b5410 2024-04-25T02:29:55.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.649+0000 7fac1dc4a640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fac180b4020 0x7fac1806c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57098/0 (socket says 172.21.15.67:57098) 2024-04-25T02:29:55.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.649+0000 7fac1dc4a640 1 -- 172.21.15.67:0/593101630 learned_addr learned my addr 172.21.15.67:0/593101630 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:55.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1cc48640 1 -- 172.21.15.67:0/593101630 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 662485834 0 0) 0x7fac10001110 con 0x7fac180b4020 2024-04-25T02:29:55.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1d449640 1 --2- 172.21.15.67:0/593101630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac180b5410 0x7fac1806d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1cc48640 1 -- 172.21.15.67:0/593101630 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac00003520 con 0x7fac180b4020 2024-04-25T02:29:55.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1e44b640 1 --2- 172.21.15.67:0/593101630 >> v2:172.21.15.176:3300/0 conn(0x7fac1806dc00 0x7fac18167d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1cc48640 1 -- 172.21.15.67:0/593101630 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1227849782 0 0) 0x7fac00003520 con 0x7fac180b4020 2024-04-25T02:29:55.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1cc48640 1 -- 172.21.15.67:0/593101630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac180b5410 msgr2=0x7fac1806d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:55.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1cc48640 1 --2- 172.21.15.67:0/593101630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac180b5410 0x7fac1806d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1cc48640 1 -- 172.21.15.67:0/593101630 >> v2:172.21.15.176:3300/0 conn(0x7fac1806dc00 msgr2=0x7fac18167d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:55.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1cc48640 1 --2- 172.21.15.67:0/593101630 >> v2:172.21.15.176:3300/0 conn(0x7fac1806dc00 0x7fac18167d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1cc48640 1 -- 172.21.15.67:0/593101630 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1806b3a0 con 0x7fac180b4020 2024-04-25T02:29:55.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1cc48640 1 -- 172.21.15.67:0/593101630 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7fac10001840 con 0x7fac180b4020 2024-04-25T02:29:55.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1cc48640 1 -- 172.21.15.67:0/593101630 >> v1:172.21.15.67:6789/0 conn(0x7fac180b4020 legacy=0x7fac1806c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1cc48640 1 --2- 172.21.15.67:0/593101630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac000039b0 0x7fac00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1cc48640 1 --2- 172.21.15.67:0/593101630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac180b5410 0x7fac00004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1cc48640 1 --2- 172.21.15.67:0/593101630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac00004d40 0x7fac000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1cc48640 1 -- 172.21.15.67:0/593101630 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fac1806bcd0 con 0x7fac000039b0 2024-04-25T02:29:55.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1cc48640 1 -- 172.21.15.67:0/593101630 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fac1806b0c0 con 0x7fac00004d40 2024-04-25T02:29:55.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1cc48640 1 -- 172.21.15.67:0/593101630 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fac0000b9c0 con 0x7fac180b5410 2024-04-25T02:29:55.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1dc4a640 1 --2- 172.21.15.67:0/593101630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac000039b0 0x7fac00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1d449640 1 --2- 172.21.15.67:0/593101630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac180b5410 0x7fac00004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.650+0000 7fac1e44b640 1 --2- 172.21.15.67:0/593101630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac00004d40 0x7fac000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.651+0000 7fac1dc4a640 1 -- 172.21.15.67:0/593101630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac180b5410 msgr2=0x7fac00004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:55.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.651+0000 7fac1dc4a640 1 --2- 172.21.15.67:0/593101630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac180b5410 0x7fac00004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.651+0000 7fac1dc4a640 1 -- 172.21.15.67:0/593101630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac00004d40 msgr2=0x7fac000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:55.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.651+0000 7fac1dc4a640 1 --2- 172.21.15.67:0/593101630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac00004d40 0x7fac000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.651+0000 7fac1dc4a640 1 -- 172.21.15.67:0/593101630 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac00003520 con 0x7fac000039b0 2024-04-25T02:29:55.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.651+0000 7fac1dc4a640 1 --2- 172.21.15.67:0/593101630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac000039b0 0x7fac00003dd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fac1000c4c0 tx=0x7fac00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f524453c6bf701f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:55.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.651+0000 7fac1cc48640 1 -- 172.21.15.67:0/593101630 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1000c0e0 con 0x7fac000039b0 2024-04-25T02:29:55.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.651+0000 7fac1cc48640 1 -- 172.21.15.67:0/593101630 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac10034070 con 0x7fac000039b0 2024-04-25T02:29:55.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.651+0000 7fac1cc48640 1 -- 172.21.15.67:0/593101630 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac10005d30 con 0x7fac000039b0 2024-04-25T02:29:55.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.652+0000 7fac1feae640 1 -- 172.21.15.67:0/593101630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac000039b0 msgr2=0x7fac00003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.652+0000 7fac1feae640 1 --2- 172.21.15.67:0/593101630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac000039b0 0x7fac00003dd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fac1000c4c0 tx=0x7fac00005830 comp rx=0 tx=0).stop 2024-04-25T02:29:55.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.652+0000 7fac1e44b640 1 -- 172.21.15.67:0/593101630 reap_dead start 2024-04-25T02:29:55.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.652+0000 7fac1feae640 1 -- 172.21.15.67:0/593101630 shutdown_connections 2024-04-25T02:29:55.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.652+0000 7fac1feae640 1 -- 172.21.15.67:0/593101630 >> 172.21.15.67:0/593101630 conn(0x7fac180d04b0 msgr2=0x7fac180d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:55.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.652+0000 7fac1feae640 1 -- 172.21.15.67:0/593101630 shutdown_connections 2024-04-25T02:29:55.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.652+0000 7fac1feae640 1 -- 172.21.15.67:0/593101630 wait complete. 2024-04-25T02:29:55.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.653+0000 7fac1feae640 1 Processor -- start 2024-04-25T02:29:55.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.653+0000 7fac1feae640 1 -- start start 2024-04-25T02:29:55.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.654+0000 7fac1feae640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac000039b0 0x7fac18161020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.654+0000 7fac1feae640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac1815cc20 0x7fac1814f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.654+0000 7fac1feae640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1815d080 0x7fac1814f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.654+0000 7fac1feae640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fac180ada90 con 0x7fac1815d080 2024-04-25T02:29:55.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.654+0000 7fac1feae640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fac1806b960 con 0x7fac1815cc20 2024-04-25T02:29:55.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.654+0000 7fac1feae640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fac180adc10 con 0x7fac000039b0 2024-04-25T02:29:55.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.654+0000 7fac1e44b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1815d080 0x7fac1814f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.654+0000 7fac1e44b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1815d080 0x7fac1814f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60580/0 (socket says 172.21.15.67:60580) 2024-04-25T02:29:55.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.654+0000 7fac1e44b640 1 -- 172.21.15.67:0/90291763 learned_addr learned my addr 172.21.15.67:0/90291763 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:55.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.654+0000 7fac1dc4a640 1 --2- 172.21.15.67:0/90291763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac000039b0 0x7fac18161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.654+0000 7fac1d449640 1 --2- 172.21.15.67:0/90291763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac1815cc20 0x7fac1814f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.654+0000 7fac1e44b640 1 -- 172.21.15.67:0/90291763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac000039b0 msgr2=0x7fac18161020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.654+0000 7fac1e44b640 1 --2- 172.21.15.67:0/90291763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac000039b0 0x7fac18161020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.654+0000 7fac1e44b640 1 -- 172.21.15.67:0/90291763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac1815cc20 msgr2=0x7fac1814f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.654+0000 7fac1e44b640 1 --2- 172.21.15.67:0/90291763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac1815cc20 0x7fac1814f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.654+0000 7fac1e44b640 1 -- 172.21.15.67:0/90291763 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac18153b70 con 0x7fac1815d080 2024-04-25T02:29:55.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.654+0000 7fac1d449640 1 --2- 172.21.15.67:0/90291763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac1815cc20 0x7fac1814f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:55.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.654+0000 7fac1dc4a640 1 --2- 172.21.15.67:0/90291763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac000039b0 0x7fac18161020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:55.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.655+0000 7fac1e44b640 1 --2- 172.21.15.67:0/90291763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1815d080 0x7fac1814f8e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fac180adfc0 tx=0x7fac0800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:55.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.655+0000 7fac167fc640 1 -- 172.21.15.67:0/90291763 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0800fde0 con 0x7fac1815d080 2024-04-25T02:29:55.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.655+0000 7fac167fc640 1 -- 172.21.15.67:0/90291763 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac08015430 con 0x7fac1815d080 2024-04-25T02:29:55.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.655+0000 7fac1feae640 1 -- 172.21.15.67:0/90291763 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac18153f90 con 0x7fac1815d080 2024-04-25T02:29:55.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.655+0000 7fac167fc640 1 -- 172.21.15.67:0/90291763 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac08015820 con 0x7fac1815d080 2024-04-25T02:29:55.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.655+0000 7fac1feae640 1 -- 172.21.15.67:0/90291763 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac18154230 con 0x7fac1815d080 2024-04-25T02:29:55.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.656+0000 7fac1feae640 1 -- 172.21.15.67:0/90291763 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac18069110 con 0x7fac1815d080 2024-04-25T02:29:55.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.656+0000 7fac167fc640 1 -- 172.21.15.67:0/90291763 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fac080159c0 con 0x7fac1815d080 2024-04-25T02:29:55.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.657+0000 7fac167fc640 1 --2- 172.21.15.67:0/90291763 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fac0406bfe0 0x7fac0406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.657+0000 7fac167fc640 1 -- 172.21.15.67:0/90291763 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fac0808bcf0 con 0x7fac1815d080 2024-04-25T02:29:55.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.657+0000 7fac167fc640 1 --2- 172.21.15.67:0/90291763 >> [v2:172.21.15.176:6818/828255462,v1:172.21.15.176:6819/828255462] conn(0x7fac04071ea0 0x7fac040742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.657+0000 7fac167fc640 1 -- 172.21.15.67:0/90291763 --> [v2:172.21.15.176:6818/828255462,v1:172.21.15.176:6819/828255462] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac08015e50 con 0x7fac04071ea0 2024-04-25T02:29:55.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.657+0000 7fac167fc640 1 -- 172.21.15.67:0/90291763 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fac0808e3d0 con 0x7fac1815d080 2024-04-25T02:29:55.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.657+0000 7fac1dc4a640 1 --2- 172.21.15.67:0/90291763 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fac0406bfe0 0x7fac0406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.657+0000 7fac1d449640 1 --2- 172.21.15.67:0/90291763 >> [v2:172.21.15.176:6818/828255462,v1:172.21.15.176:6819/828255462] conn(0x7fac04071ea0 0x7fac040742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.658+0000 7fac1dc4a640 1 --2- 172.21.15.67:0/90291763 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fac0406bfe0 0x7fac0406e4a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fac10033000 tx=0x7fac10009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:55.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.658+0000 7fac1d449640 1 --2- 172.21.15.67:0/90291763 >> [v2:172.21.15.176:6818/828255462,v1:172.21.15.176:6819/828255462] conn(0x7fac04071ea0 0x7fac040742c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:55.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.658+0000 7fac167fc640 1 -- 172.21.15.67:0/90291763 <== osd.4 v2:172.21.15.176:6818/828255462 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fac08015e50 con 0x7fac04071ea0 2024-04-25T02:29:55.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.672+0000 7fac1feae640 1 -- 172.21.15.67:0/90291763 --> [v2:172.21.15.176:6818/828255462,v1:172.21.15.176:6819/828255462] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fac18161ad0 con 0x7fac04071ea0 2024-04-25T02:29:55.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.672+0000 7fac167fc640 1 -- 172.21.15.67:0/90291763 <== osd.4 v2:172.21.15.176:6818/828255462 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fac18161ad0 con 0x7fac04071ea0 2024-04-25T02:29:55.676 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-25T02:29:55.676 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:29:55.676 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-25T02:29:55.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.673+0000 7fac1feae640 1 -- 172.21.15.67:0/90291763 >> [v2:172.21.15.176:6818/828255462,v1:172.21.15.176:6819/828255462] conn(0x7fac04071ea0 msgr2=0x7fac040742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.673+0000 7fac1feae640 1 --2- 172.21.15.67:0/90291763 >> [v2:172.21.15.176:6818/828255462,v1:172.21.15.176:6819/828255462] conn(0x7fac04071ea0 0x7fac040742c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.673+0000 7fac1feae640 1 -- 172.21.15.67:0/90291763 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fac0406bfe0 msgr2=0x7fac0406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.673+0000 7fac1feae640 1 --2- 172.21.15.67:0/90291763 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fac0406bfe0 0x7fac0406e4a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fac10033000 tx=0x7fac10009030 comp rx=0 tx=0).stop 2024-04-25T02:29:55.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.673+0000 7fac1feae640 1 -- 172.21.15.67:0/90291763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1815d080 msgr2=0x7fac1814f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.673+0000 7fac1feae640 1 --2- 172.21.15.67:0/90291763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac1815d080 0x7fac1814f8e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fac180adfc0 tx=0x7fac0800f580 comp rx=0 tx=0).stop 2024-04-25T02:29:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.673+0000 7fac1e44b640 1 -- 172.21.15.67:0/90291763 reap_dead start 2024-04-25T02:29:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.673+0000 7fac1feae640 1 -- 172.21.15.67:0/90291763 shutdown_connections 2024-04-25T02:29:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.673+0000 7fac1feae640 1 -- 172.21.15.67:0/90291763 >> 172.21.15.67:0/90291763 conn(0x7fac180d04b0 msgr2=0x7fac181574f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.673+0000 7fac1feae640 1 -- 172.21.15.67:0/90291763 shutdown_connections 2024-04-25T02:29:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.673+0000 7fac1feae640 1 -- 172.21.15.67:0/90291763 wait complete. 2024-04-25T02:29:55.686 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T02:29:55.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.786+0000 7f4e12ff4640 1 Processor -- start 2024-04-25T02:29:55.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.786+0000 7f4e12ff4640 1 -- start start 2024-04-25T02:29:55.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.786+0000 7f4e12ff4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e0c15b220 0x7f4e0c070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.786+0000 7f4e12ff4640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e0c0713d0 con 0x7f4e0c15ec70 2024-04-25T02:29:55.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.786+0000 7f4e12ff4640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e0c0ae4d0 con 0x7f4e0c15f800 2024-04-25T02:29:55.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.786+0000 7f4e12ff4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0c0aee00 con 0x7f4e0c15b220 2024-04-25T02:29:55.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.787+0000 7f4e0bfff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f4e0c15ec70 0x7f4e0c15f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57106/0 (socket says 172.21.15.67:57106) 2024-04-25T02:29:55.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.787+0000 7f4e0bfff640 1 -- 172.21.15.67:0/3011147627 learned_addr learned my addr 172.21.15.67:0/3011147627 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:55.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.787+0000 7f4e10d90640 1 --2- 172.21.15.67:0/3011147627 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e0c15b220 0x7f4e0c070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.787+0000 7f4e0b7fe640 1 -- 172.21.15.67:0/3011147627 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1556973742 0 0) 0x7f4e0c0713d0 con 0x7f4e0c15ec70 2024-04-25T02:29:55.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.787+0000 7f4e0b7fe640 1 -- 172.21.15.67:0/3011147627 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dfc003520 con 0x7f4e0c15ec70 2024-04-25T02:29:55.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.787+0000 7f4e0b7fe640 1 -- 172.21.15.67:0/3011147627 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 692201837 0 0) 0x7f4e0c0ae4d0 con 0x7f4e0c15f800 2024-04-25T02:29:55.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.787+0000 7f4e0b7fe640 1 -- 172.21.15.67:0/3011147627 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e0c0713d0 con 0x7f4e0c15f800 2024-04-25T02:29:55.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.787+0000 7f4e0b7fe640 1 -- 172.21.15.67:0/3011147627 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1750719185 0 0) 0x7f4dfc003520 con 0x7f4e0c15ec70 2024-04-25T02:29:55.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.787+0000 7f4e10d90640 1 -- 172.21.15.67:0/3011147627 >> v1:172.21.15.176:6789/0 conn(0x7f4e0c15f800 legacy=0x7f4e0c0b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.787+0000 7f4e10d90640 1 -- 172.21.15.67:0/3011147627 >> v1:172.21.15.67:6789/0 conn(0x7f4e0c15ec70 legacy=0x7f4e0c15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.787+0000 7f4e10d90640 1 -- 172.21.15.67:0/3011147627 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0c0ae7b0 con 0x7f4e0c15b220 2024-04-25T02:29:55.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.788+0000 7f4e10d90640 1 --2- 172.21.15.67:0/3011147627 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e0c15b220 0x7f4e0c070df0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4e000097d0 tx=0x7f4e0002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=960d1bc195006fe4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:55.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.788+0000 7f4e0b7fe640 1 -- 172.21.15.67:0/3011147627 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e00037070 con 0x7f4e0c15b220 2024-04-25T02:29:55.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.788+0000 7f4e0b7fe640 1 -- 172.21.15.67:0/3011147627 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e0002ac30 con 0x7f4e0c15b220 2024-04-25T02:29:55.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.788+0000 7f4e0b7fe640 1 -- 172.21.15.67:0/3011147627 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8001670 con 0x7f4e0c15b220 2024-04-25T02:29:55.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.789+0000 7f4e12ff4640 1 -- 172.21.15.67:0/3011147627 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e0c15b220 msgr2=0x7f4e0c070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.789+0000 7f4e12ff4640 1 --2- 172.21.15.67:0/3011147627 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e0c15b220 0x7f4e0c070df0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4e000097d0 tx=0x7f4e0002a1a0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.789+0000 7f4e12ff4640 1 -- 172.21.15.67:0/3011147627 shutdown_connections 2024-04-25T02:29:55.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.789+0000 7f4e12ff4640 1 --2- 172.21.15.67:0/3011147627 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e0c15b220 0x7f4e0c070df0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.789+0000 7f4e12ff4640 1 -- 172.21.15.67:0/3011147627 >> 172.21.15.67:0/3011147627 conn(0x7f4e0c0b19c0 msgr2=0x7f4e0c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:55.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.789+0000 7f4e12ff4640 1 -- 172.21.15.67:0/3011147627 shutdown_connections 2024-04-25T02:29:55.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.789+0000 7f4e12ff4640 1 -- 172.21.15.67:0/3011147627 wait complete. 2024-04-25T02:29:55.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.790+0000 7f4e12ff4640 1 Processor -- start 2024-04-25T02:29:55.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.790+0000 7f4e12ff4640 1 -- start start 2024-04-25T02:29:55.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.791+0000 7f4e12ff4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e0c15b220 0x7f4e0c1f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.791+0000 7f4e12ff4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e0c15ec70 0x7f4e0c14a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.791+0000 7f4e12ff4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e0c15f800 0x7f4e0c14c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.791+0000 7f4e12ff4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c06ed10 con 0x7f4e0c15b220 2024-04-25T02:29:55.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.791+0000 7f4e12ff4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c06eb90 con 0x7f4e0c15ec70 2024-04-25T02:29:55.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.791+0000 7f4e12ff4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0c0b33d0 con 0x7f4e0c15f800 2024-04-25T02:29:55.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.791+0000 7f4e10d90640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e0c15b220 0x7f4e0c1f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.791+0000 7f4e10d90640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e0c15b220 0x7f4e0c1f4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60584/0 (socket says 172.21.15.67:60584) 2024-04-25T02:29:55.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.791+0000 7f4e10d90640 1 -- 172.21.15.67:0/687391288 learned_addr learned my addr 172.21.15.67:0/687391288 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:55.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.791+0000 7f4e11591640 1 --2- 172.21.15.67:0/687391288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e0c15f800 0x7f4e0c14c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.791+0000 7f4e0bfff640 1 --2- 172.21.15.67:0/687391288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e0c15ec70 0x7f4e0c14a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.791+0000 7f4e10d90640 1 -- 172.21.15.67:0/687391288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e0c15f800 msgr2=0x7f4e0c14c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.791+0000 7f4e10d90640 1 --2- 172.21.15.67:0/687391288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e0c15f800 0x7f4e0c14c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.791+0000 7f4e10d90640 1 -- 172.21.15.67:0/687391288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e0c15ec70 msgr2=0x7f4e0c14a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.791+0000 7f4e10d90640 1 --2- 172.21.15.67:0/687391288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e0c15ec70 0x7f4e0c14a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.791+0000 7f4e10d90640 1 -- 172.21.15.67:0/687391288 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0c1f5680 con 0x7f4e0c15b220 2024-04-25T02:29:55.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.791+0000 7f4e0bfff640 1 --2- 172.21.15.67:0/687391288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e0c15ec70 0x7f4e0c14a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:55.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.791+0000 7f4e10d90640 1 --2- 172.21.15.67:0/687391288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e0c15b220 0x7f4e0c1f4da0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4e000098f0 tx=0x7f4e000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:55.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.792+0000 7f4e097fa640 1 -- 172.21.15.67:0/687391288 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e00037050 con 0x7f4e0c15b220 2024-04-25T02:29:55.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.792+0000 7f4e097fa640 1 -- 172.21.15.67:0/687391288 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e00043070 con 0x7f4e0c15b220 2024-04-25T02:29:55.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.792+0000 7f4e12ff4640 1 -- 172.21.15.67:0/687391288 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e0c1f5960 con 0x7f4e0c15b220 2024-04-25T02:29:55.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.792+0000 7f4e097fa640 1 -- 172.21.15.67:0/687391288 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0003e690 con 0x7f4e0c15b220 2024-04-25T02:29:55.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.792+0000 7f4e12ff4640 1 -- 172.21.15.67:0/687391288 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e0c1f5f20 con 0x7f4e0c15b220 2024-04-25T02:29:55.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.793+0000 7f4e12ff4640 1 -- 172.21.15.67:0/687391288 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e0c1f6350 con 0x7f4e0c15b220 2024-04-25T02:29:55.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.793+0000 7f4e097fa640 1 -- 172.21.15.67:0/687391288 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f4e0003e830 con 0x7f4e0c15b220 2024-04-25T02:29:55.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.793+0000 7f4e097fa640 1 --2- 172.21.15.67:0/687391288 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f4df006bfe0 0x7f4df006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:55.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.794+0000 7f4e097fa640 1 -- 172.21.15.67:0/687391288 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f4e000ab8b0 con 0x7f4e0c15b220 2024-04-25T02:29:55.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.794+0000 7f4e0bfff640 1 --2- 172.21.15.67:0/687391288 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f4df006bfe0 0x7f4df006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:55.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.794+0000 7f4e0bfff640 1 --2- 172.21.15.67:0/687391288 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f4df006bfe0 0x7f4df006e4a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0b2720 tx=0x7f4df8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:55.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.798+0000 7f4e097fa640 1 -- 172.21.15.67:0/687391288 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4e0004d020 con 0x7f4e0c15b220 2024-04-25T02:29:55.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.983+0000 7f4e12ff4640 1 -- 172.21.15.67:0/687391288 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f4e0c06e610 con 0x7f4df006bfe0 2024-04-25T02:29:55.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.984+0000 7f4e097fa640 1 -- 172.21.15.67:0/687391288 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4e0c06e610 con 0x7f4df006bfe0 2024-04-25T02:29:55.987 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T02:29:55.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.986+0000 7f4e12ff4640 1 -- 172.21.15.67:0/687391288 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f4df006bfe0 msgr2=0x7f4df006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.986+0000 7f4e12ff4640 1 --2- 172.21.15.67:0/687391288 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f4df006bfe0 0x7f4df006e4a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0b2720 tx=0x7f4df8009040 comp rx=0 tx=0).stop 2024-04-25T02:29:55.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.986+0000 7f4e12ff4640 1 -- 172.21.15.67:0/687391288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e0c15b220 msgr2=0x7f4e0c1f4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:55.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.986+0000 7f4e12ff4640 1 --2- 172.21.15.67:0/687391288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e0c15b220 0x7f4e0c1f4da0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4e000098f0 tx=0x7f4e000046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.986+0000 7f4e12ff4640 1 -- 172.21.15.67:0/687391288 shutdown_connections 2024-04-25T02:29:55.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.986+0000 7f4e12ff4640 1 --2- 172.21.15.67:0/687391288 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f4df006bfe0 0x7f4df006e4a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.986+0000 7f4e12ff4640 1 --2- 172.21.15.67:0/687391288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e0c15f800 0x7f4e0c14c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.986+0000 7f4e12ff4640 1 --2- 172.21.15.67:0/687391288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e0c15ec70 0x7f4e0c14a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.986+0000 7f4e12ff4640 1 --2- 172.21.15.67:0/687391288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e0c15b220 0x7f4e0c1f4da0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:55.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.986+0000 7f4e12ff4640 1 -- 172.21.15.67:0/687391288 >> 172.21.15.67:0/687391288 conn(0x7f4e0c0b19c0 msgr2=0x7f4e0c15f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:55.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.986+0000 7f4e12ff4640 1 -- 172.21.15.67:0/687391288 shutdown_connections 2024-04-25T02:29:55.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:55.986+0000 7f4e12ff4640 1 -- 172.21.15.67:0/687391288 wait complete. 2024-04-25T02:29:56.000 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T02:29:56.000 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:29:56.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.102+0000 7f90b63d5640 1 Processor -- start 2024-04-25T02:29:56.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.102+0000 7f90b63d5640 1 -- start start 2024-04-25T02:29:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.103+0000 7f90b63d5640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90b015e830 0x7f90b00b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.103+0000 7f90b63d5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f90b00b4310 0x7f90b006e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.103+0000 7f90b63d5640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90b00b3880 con 0x7f90b006b7f0 2024-04-25T02:29:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.103+0000 7f90b63d5640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f90b00b4760 con 0x7f90b015e830 2024-04-25T02:29:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.103+0000 7f90b63d5640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f90b015ede0 con 0x7f90b00b4310 2024-04-25T02:29:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.103+0000 7f90af7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90b015e830 0x7f90b00b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.103+0000 7f90af7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90b015e830 0x7f90b00b3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60590/0 (socket says 172.21.15.67:60590) 2024-04-25T02:29:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.103+0000 7f90af7fe640 1 -- 172.21.15.67:0/3288233290 learned_addr learned my addr 172.21.15.67:0/3288233290 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:56.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.103+0000 7f90b4972640 1 --2- 172.21.15.67:0/3288233290 >> v2:172.21.15.176:3300/0 conn(0x7f90b00b4310 0x7f90b006e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.103+0000 7f90af7fe640 1 -- 172.21.15.67:0/3288233290 >> v2:172.21.15.176:3300/0 conn(0x7f90b00b4310 msgr2=0x7f90b006e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.103+0000 7f90af7fe640 1 --2- 172.21.15.67:0/3288233290 >> v2:172.21.15.176:3300/0 conn(0x7f90b00b4310 0x7f90b006e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.103+0000 7f90af7fe640 1 -- 172.21.15.67:0/3288233290 >> v1:172.21.15.176:6789/0 conn(0x7f90b006b7f0 legacy=0x7f90b00b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.104+0000 7f90af7fe640 1 -- 172.21.15.67:0/3288233290 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b015f0c0 con 0x7f90b015e830 2024-04-25T02:29:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.104+0000 7f90af7fe640 1 --2- 172.21.15.67:0/3288233290 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b015e830 0x7f90b00b3dd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009870 tx=0x7f90a402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c437341afba503 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:56.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.104+0000 7f90aeffd640 1 -- 172.21.15.67:0/3288233290 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a4037070 con 0x7f90b015e830 2024-04-25T02:29:56.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.104+0000 7f90aeffd640 1 -- 172.21.15.67:0/3288233290 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a4032440 con 0x7f90b015e830 2024-04-25T02:29:56.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.104+0000 7f90aeffd640 1 -- 172.21.15.67:0/3288233290 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a4032810 con 0x7f90b015e830 2024-04-25T02:29:56.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.105+0000 7f90b63d5640 1 -- 172.21.15.67:0/3288233290 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b015e830 msgr2=0x7f90b00b3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.105+0000 7f90b63d5640 1 --2- 172.21.15.67:0/3288233290 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b015e830 0x7f90b00b3dd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009870 tx=0x7f90a402a1c0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.105+0000 7f90b63d5640 1 -- 172.21.15.67:0/3288233290 shutdown_connections 2024-04-25T02:29:56.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.105+0000 7f90b63d5640 1 --2- 172.21.15.67:0/3288233290 >> v2:172.21.15.176:3300/0 conn(0x7f90b00b4310 0x7f90b006e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.105+0000 7f90b63d5640 1 --2- 172.21.15.67:0/3288233290 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b015e830 0x7f90b00b3dd0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.105+0000 7f90b63d5640 1 -- 172.21.15.67:0/3288233290 >> 172.21.15.67:0/3288233290 conn(0x7f90b00b2ad0 msgr2=0x7f90b00b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:56.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.105+0000 7f90b63d5640 1 -- 172.21.15.67:0/3288233290 shutdown_connections 2024-04-25T02:29:56.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.105+0000 7f90b63d5640 1 -- 172.21.15.67:0/3288233290 wait complete. 2024-04-25T02:29:56.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.106+0000 7f90b63d5640 1 Processor -- start 2024-04-25T02:29:56.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.106+0000 7f90b63d5640 1 -- start start 2024-04-25T02:29:56.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.107+0000 7f90b63d5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b006b7f0 0x7f90b0143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.107+0000 7f90b63d5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90b00b4310 0x7f90b01f75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.107+0000 7f90b63d5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b015e830 0x7f90b00aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.107+0000 7f90b63d5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f90b006e630 con 0x7f90b006b7f0 2024-04-25T02:29:56.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.107+0000 7f90b63d5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f90b015f680 con 0x7f90b00b4310 2024-04-25T02:29:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.107+0000 7f90b63d5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f90b006e7b0 con 0x7f90b015e830 2024-04-25T02:29:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.107+0000 7f90affff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b006b7f0 0x7f90b0143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.107+0000 7f90affff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b006b7f0 0x7f90b0143f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60596/0 (socket says 172.21.15.67:60596) 2024-04-25T02:29:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.107+0000 7f90affff640 1 -- 172.21.15.67:0/19868943 learned_addr learned my addr 172.21.15.67:0/19868943 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.107+0000 7f90af7fe640 1 --2- 172.21.15.67:0/19868943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90b00b4310 0x7f90b01f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.107+0000 7f90b4972640 1 --2- 172.21.15.67:0/19868943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b015e830 0x7f90b00aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.108+0000 7f90affff640 1 -- 172.21.15.67:0/19868943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b015e830 msgr2=0x7f90b00aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.108+0000 7f90affff640 1 --2- 172.21.15.67:0/19868943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b015e830 0x7f90b00aee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.108+0000 7f90affff640 1 -- 172.21.15.67:0/19868943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90b00b4310 msgr2=0x7f90b01f75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.108+0000 7f90affff640 1 --2- 172.21.15.67:0/19868943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90b00b4310 0x7f90b01f75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.108+0000 7f90affff640 1 -- 172.21.15.67:0/19868943 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b01f8080 con 0x7f90b006b7f0 2024-04-25T02:29:56.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.108+0000 7f90b4972640 1 --2- 172.21.15.67:0/19868943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b015e830 0x7f90b00aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:56.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.108+0000 7f90affff640 1 --2- 172.21.15.67:0/19868943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b006b7f0 0x7f90b0143f20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c430 tx=0x7f90a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:56.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.108+0000 7f90acff9640 1 -- 172.21.15.67:0/19868943 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0011790 con 0x7f90b006b7f0 2024-04-25T02:29:56.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.108+0000 7f90acff9640 1 -- 172.21.15.67:0/19868943 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a0017070 con 0x7f90b006b7f0 2024-04-25T02:29:56.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.108+0000 7f90b63d5640 1 -- 172.21.15.67:0/19868943 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b01f8360 con 0x7f90b006b7f0 2024-04-25T02:29:56.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.108+0000 7f90acff9640 1 -- 172.21.15.67:0/19868943 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0011bb0 con 0x7f90b006b7f0 2024-04-25T02:29:56.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.108+0000 7f90b63d5640 1 -- 172.21.15.67:0/19868943 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b015a5d0 con 0x7f90b006b7f0 2024-04-25T02:29:56.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.109+0000 7f90b63d5640 1 -- 172.21.15.67:0/19868943 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f90b0144460 con 0x7f90b006b7f0 2024-04-25T02:29:56.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.110+0000 7f90acff9640 1 -- 172.21.15.67:0/19868943 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f90a001c460 con 0x7f90b006b7f0 2024-04-25T02:29:56.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.110+0000 7f90acff9640 1 --2- 172.21.15.67:0/19868943 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f909c06bfe0 0x7f909c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.110+0000 7f90acff9640 1 -- 172.21.15.67:0/19868943 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f90a008b600 con 0x7f90b006b7f0 2024-04-25T02:29:56.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.110+0000 7f90acff9640 1 --2- 172.21.15.67:0/19868943 >> [v2:172.21.15.176:6800/660324040,v1:172.21.15.176:6801/660324040] conn(0x7f909c071ea0 0x7f909c0742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.110+0000 7f90acff9640 1 -- 172.21.15.67:0/19868943 --> [v2:172.21.15.176:6800/660324040,v1:172.21.15.176:6801/660324040] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f909c074970 con 0x7f909c071ea0 2024-04-25T02:29:56.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.110+0000 7f90acff9640 1 -- 172.21.15.67:0/19868943 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f90a008ba90 con 0x7f90b006b7f0 2024-04-25T02:29:56.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.110+0000 7f90af7fe640 1 --2- 172.21.15.67:0/19868943 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f909c06bfe0 0x7f909c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.110+0000 7f90b4972640 1 --2- 172.21.15.67:0/19868943 >> [v2:172.21.15.176:6800/660324040,v1:172.21.15.176:6801/660324040] conn(0x7f909c071ea0 0x7f909c0742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.111+0000 7f90af7fe640 1 --2- 172.21.15.67:0/19868943 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f909c06bfe0 0x7f909c06e4a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f90a4034000 tx=0x7f90a402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:56.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.111+0000 7f90b4972640 1 --2- 172.21.15.67:0/19868943 >> [v2:172.21.15.176:6800/660324040,v1:172.21.15.176:6801/660324040] conn(0x7f909c071ea0 0x7f909c0742c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:56.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.112+0000 7f90acff9640 1 -- 172.21.15.67:0/19868943 <== osd.5 v2:172.21.15.176:6800/660324040 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f909c074970 con 0x7f909c071ea0 2024-04-25T02:29:56.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.125+0000 7f90b63d5640 1 -- 172.21.15.67:0/19868943 --> [v2:172.21.15.176:6800/660324040,v1:172.21.15.176:6801/660324040] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f90b0069110 con 0x7f909c071ea0 2024-04-25T02:29:56.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.125+0000 7f90acff9640 1 -- 172.21.15.67:0/19868943 <== osd.5 v2:172.21.15.176:6800/660324040 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f90b0069110 con 0x7f909c071ea0 2024-04-25T02:29:56.129 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-25T02:29:56.129 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:29:56.129 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-25T02:29:56.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.126+0000 7f90b63d5640 1 -- 172.21.15.67:0/19868943 >> [v2:172.21.15.176:6800/660324040,v1:172.21.15.176:6801/660324040] conn(0x7f909c071ea0 msgr2=0x7f909c0742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.126+0000 7f90b63d5640 1 --2- 172.21.15.67:0/19868943 >> [v2:172.21.15.176:6800/660324040,v1:172.21.15.176:6801/660324040] conn(0x7f909c071ea0 0x7f909c0742c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.126+0000 7f90b63d5640 1 -- 172.21.15.67:0/19868943 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f909c06bfe0 msgr2=0x7f909c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.126+0000 7f90b63d5640 1 --2- 172.21.15.67:0/19868943 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f909c06bfe0 0x7f909c06e4a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f90a4034000 tx=0x7f90a402e000 comp rx=0 tx=0).stop 2024-04-25T02:29:56.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.126+0000 7f90b63d5640 1 -- 172.21.15.67:0/19868943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b006b7f0 msgr2=0x7f90b0143f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.126+0000 7f90b63d5640 1 --2- 172.21.15.67:0/19868943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b006b7f0 0x7f90b0143f20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c430 tx=0x7f90a000c8f0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.126+0000 7f90b4972640 1 -- 172.21.15.67:0/19868943 reap_dead start 2024-04-25T02:29:56.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.126+0000 7f90b63d5640 1 -- 172.21.15.67:0/19868943 shutdown_connections 2024-04-25T02:29:56.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.126+0000 7f90b63d5640 1 -- 172.21.15.67:0/19868943 >> 172.21.15.67:0/19868943 conn(0x7f90b00b2ad0 msgr2=0x7f90b00cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:56.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.126+0000 7f90b63d5640 1 -- 172.21.15.67:0/19868943 shutdown_connections 2024-04-25T02:29:56.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.126+0000 7f90b63d5640 1 -- 172.21.15.67:0/19868943 wait complete. 2024-04-25T02:29:56.140 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T02:29:56.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.239+0000 7f6e0bca5640 1 Processor -- start 2024-04-25T02:29:56.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.239+0000 7f6e0bca5640 1 -- start start 2024-04-25T02:29:56.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.240+0000 7f6e0bca5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6e040cee60 0x7f6e0406c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.240+0000 7f6e0bca5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e040d0210 0x7f6e0406c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.240+0000 7f6e0bca5640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e0415c3a0 con 0x7f6e0415bfc0 2024-04-25T02:29:56.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.240+0000 7f6e0bca5640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6e040d0760 con 0x7f6e040cee60 2024-04-25T02:29:56.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.240+0000 7f6e0bca5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6e040d0a40 con 0x7f6e040d0210 2024-04-25T02:29:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.240+0000 7f6e0a242640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e040d0210 0x7f6e0406c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.240+0000 7f6e09240640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6e040cee60 0x7f6e0406c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.240+0000 7f6e0a242640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e040d0210 0x7f6e0406c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.67:36894/0 (socket says 172.21.15.67:36894) 2024-04-25T02:29:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.240+0000 7f6e0a242640 1 -- 172.21.15.67:0/613636067 learned_addr learned my addr 172.21.15.67:0/613636067 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.241+0000 7f6e09240640 1 -- 172.21.15.67:0/613636067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e040d0210 msgr2=0x7f6e0406c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.241+0000 7f6e09240640 1 --2- 172.21.15.67:0/613636067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e040d0210 0x7f6e0406c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.241+0000 7f6e09240640 1 -- 172.21.15.67:0/613636067 >> v1:172.21.15.176:6789/0 conn(0x7f6e0415bfc0 legacy=0x7f6e040ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.241+0000 7f6e09240640 1 -- 172.21.15.67:0/613636067 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e040d0d20 con 0x7f6e040cee60 2024-04-25T02:29:56.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.241+0000 7f6e08a3f640 1 -- 172.21.15.67:0/613636067 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2860485132 0 0) 0x7f6e0415c3a0 con 0x7f6e0415bfc0 2024-04-25T02:29:56.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.241+0000 7f6e0a242640 1 --2- 172.21.15.67:0/613636067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e040d0210 0x7f6e0406c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:56.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.241+0000 7f6e09240640 1 --2- 172.21.15.67:0/613636067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e040cee60 0x7f6e0406c260 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6df40097d0 tx=0x7f6df402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe1a981c8f8aa62b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:56.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.241+0000 7f6e08a3f640 1 -- 172.21.15.67:0/613636067 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df4037070 con 0x7f6e040cee60 2024-04-25T02:29:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.242+0000 7f6e08a3f640 1 -- 172.21.15.67:0/613636067 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df4032440 con 0x7f6e040cee60 2024-04-25T02:29:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.242+0000 7f6e08a3f640 1 -- 172.21.15.67:0/613636067 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df4032810 con 0x7f6e040cee60 2024-04-25T02:29:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.242+0000 7f6e0bca5640 1 -- 172.21.15.67:0/613636067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e040cee60 msgr2=0x7f6e0406c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.242+0000 7f6e0bca5640 1 --2- 172.21.15.67:0/613636067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e040cee60 0x7f6e0406c260 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6df40097d0 tx=0x7f6df402a1c0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.242+0000 7f6e0bca5640 1 -- 172.21.15.67:0/613636067 shutdown_connections 2024-04-25T02:29:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.242+0000 7f6e0bca5640 1 --2- 172.21.15.67:0/613636067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e040d0210 0x7f6e0406c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.242+0000 7f6e0bca5640 1 --2- 172.21.15.67:0/613636067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e040cee60 0x7f6e0406c260 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.242+0000 7f6e0bca5640 1 -- 172.21.15.67:0/613636067 >> 172.21.15.67:0/613636067 conn(0x7f6e040d1ed0 msgr2=0x7f6e040d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.242+0000 7f6e0bca5640 1 -- 172.21.15.67:0/613636067 shutdown_connections 2024-04-25T02:29:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.242+0000 7f6e0bca5640 1 -- 172.21.15.67:0/613636067 wait complete. 2024-04-25T02:29:56.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.243+0000 7f6e0bca5640 1 Processor -- start 2024-04-25T02:29:56.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.243+0000 7f6e0bca5640 1 -- start start 2024-04-25T02:29:56.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.244+0000 7f6e0bca5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e040cee60 0x7f6e041f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.244+0000 7f6e0bca5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e040d0210 0x7f6e040c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.244+0000 7f6e0bca5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0415bfc0 0x7f6e0414c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.244+0000 7f6e0bca5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6e040cf690 con 0x7f6e0415bfc0 2024-04-25T02:29:56.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.244+0000 7f6e0bca5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6e040d12e0 con 0x7f6e040cee60 2024-04-25T02:29:56.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.244+0000 7f6e0bca5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6e040cf810 con 0x7f6e040d0210 2024-04-25T02:29:56.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.244+0000 7f6e0a242640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0415bfc0 0x7f6e0414c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.244+0000 7f6e0a242640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0415bfc0 0x7f6e0414c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60612/0 (socket says 172.21.15.67:60612) 2024-04-25T02:29:56.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.244+0000 7f6e0a242640 1 -- 172.21.15.67:0/3398169679 learned_addr learned my addr 172.21.15.67:0/3398169679 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:56.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.244+0000 7f6e09240640 1 --2- 172.21.15.67:0/3398169679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e040d0210 0x7f6e040c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.244+0000 7f6e09a41640 1 --2- 172.21.15.67:0/3398169679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e040cee60 0x7f6e041f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.244+0000 7f6e0a242640 1 -- 172.21.15.67:0/3398169679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e040d0210 msgr2=0x7f6e040c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.244+0000 7f6e0a242640 1 --2- 172.21.15.67:0/3398169679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e040d0210 0x7f6e040c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.245+0000 7f6e0a242640 1 -- 172.21.15.67:0/3398169679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e040cee60 msgr2=0x7f6e041f3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.245+0000 7f6e0a242640 1 --2- 172.21.15.67:0/3398169679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e040cee60 0x7f6e041f3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.245+0000 7f6e0a242640 1 -- 172.21.15.67:0/3398169679 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e040af7f0 con 0x7f6e0415bfc0 2024-04-25T02:29:56.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.245+0000 7f6e09a41640 1 --2- 172.21.15.67:0/3398169679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e040cee60 0x7f6e041f3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:56.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.245+0000 7f6e0a242640 1 --2- 172.21.15.67:0/3398169679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0415bfc0 0x7f6e0414c850 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00efc0 tx=0x7f6dfc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:56.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.245+0000 7f6dfa7fc640 1 -- 172.21.15.67:0/3398169679 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc00cbe0 con 0x7f6e0415bfc0 2024-04-25T02:29:56.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.245+0000 7f6dfa7fc640 1 -- 172.21.15.67:0/3398169679 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dfc00cd80 con 0x7f6e0415bfc0 2024-04-25T02:29:56.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.245+0000 7f6e0bca5640 1 -- 172.21.15.67:0/3398169679 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e040afad0 con 0x7f6e0415bfc0 2024-04-25T02:29:56.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.245+0000 7f6dfa7fc640 1 -- 172.21.15.67:0/3398169679 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc003bb0 con 0x7f6e0415bfc0 2024-04-25T02:29:56.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.245+0000 7f6e0bca5640 1 -- 172.21.15.67:0/3398169679 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e040b0090 con 0x7f6e0415bfc0 2024-04-25T02:29:56.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.246+0000 7f6e0bca5640 1 -- 172.21.15.67:0/3398169679 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e041556b0 con 0x7f6e0415bfc0 2024-04-25T02:29:56.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.246+0000 7f6dfa7fc640 1 -- 172.21.15.67:0/3398169679 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f6dfc01b030 con 0x7f6e0415bfc0 2024-04-25T02:29:56.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.247+0000 7f6dfa7fc640 1 --2- 172.21.15.67:0/3398169679 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6de806bfe0 0x7f6de806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.247+0000 7f6dfa7fc640 1 -- 172.21.15.67:0/3398169679 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f6dfc08b3a0 con 0x7f6e0415bfc0 2024-04-25T02:29:56.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.247+0000 7f6e09a41640 1 --2- 172.21.15.67:0/3398169679 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6de806bfe0 0x7f6de806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.248+0000 7f6e09a41640 1 --2- 172.21.15.67:0/3398169679 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6de806bfe0 0x7f6de806e4a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6e00000f60 tx=0x7f6e00009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:56.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.251+0000 7f6dfa7fc640 1 -- 172.21.15.67:0/3398169679 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6e041556b0 con 0x7f6e0415bfc0 2024-04-25T02:29:56.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.435+0000 7f6e0bca5640 1 -- 172.21.15.67:0/3398169679 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f6e04069110 con 0x7f6de806bfe0 2024-04-25T02:29:56.439 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:29:56.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.435+0000 7f6dfa7fc640 1 -- 172.21.15.67:0/3398169679 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6e04069110 con 0x7f6de806bfe0 2024-04-25T02:29:56.440 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T02:29:56.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.437+0000 7f6e0bca5640 1 -- 172.21.15.67:0/3398169679 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6de806bfe0 msgr2=0x7f6de806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.437+0000 7f6e0bca5640 1 --2- 172.21.15.67:0/3398169679 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6de806bfe0 0x7f6de806e4a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6e00000f60 tx=0x7f6e00009040 comp rx=0 tx=0).stop 2024-04-25T02:29:56.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.437+0000 7f6e0bca5640 1 -- 172.21.15.67:0/3398169679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0415bfc0 msgr2=0x7f6e0414c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.437+0000 7f6e0bca5640 1 --2- 172.21.15.67:0/3398169679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0415bfc0 0x7f6e0414c850 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00efc0 tx=0x7f6dfc00c490 comp rx=0 tx=0).stop 2024-04-25T02:29:56.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.437+0000 7f6e0bca5640 1 -- 172.21.15.67:0/3398169679 shutdown_connections 2024-04-25T02:29:56.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.437+0000 7f6e0bca5640 1 --2- 172.21.15.67:0/3398169679 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f6de806bfe0 0x7f6de806e4a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.438+0000 7f6e0bca5640 1 --2- 172.21.15.67:0/3398169679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0415bfc0 0x7f6e0414c850 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.438+0000 7f6e0bca5640 1 --2- 172.21.15.67:0/3398169679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e040d0210 0x7f6e040c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.438+0000 7f6e0bca5640 1 --2- 172.21.15.67:0/3398169679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e040cee60 0x7f6e041f3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.438+0000 7f6e0bca5640 1 -- 172.21.15.67:0/3398169679 >> 172.21.15.67:0/3398169679 conn(0x7f6e040d1ed0 msgr2=0x7f6e040d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:56.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.438+0000 7f6e0bca5640 1 -- 172.21.15.67:0/3398169679 shutdown_connections 2024-04-25T02:29:56.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.438+0000 7f6e0bca5640 1 -- 172.21.15.67:0/3398169679 wait complete. 2024-04-25T02:29:56.444 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:29:56.452 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T02:29:56.452 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:29:56.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.637+0000 7fdfe8bce640 1 Processor -- start 2024-04-25T02:29:56.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.637+0000 7fdfe8bce640 1 -- start start 2024-04-25T02:29:56.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.638+0000 7fdfe8bce640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdfe415e5a0 0x7fdfe40d0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.638+0000 7fdfe8bce640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdfe40cfdf0 0x7fdfe40d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.638+0000 7fdfe8bce640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfe40d1f70 con 0x7fdfe40d4cb0 2024-04-25T02:29:56.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.638+0000 7fdfe8bce640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fdfe40b3b20 con 0x7fdfe40cfdf0 2024-04-25T02:29:56.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.638+0000 7fdfe8bce640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdfe40d2530 con 0x7fdfe415e5a0 2024-04-25T02:29:56.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.638+0000 7fdfe2d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdfe40cfdf0 0x7fdfe40d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.638+0000 7fdfe2d9d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdfe40cfdf0 0x7fdfe40d10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60616/0 (socket says 172.21.15.67:60616) 2024-04-25T02:29:56.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.638+0000 7fdfe2d9d640 1 -- 172.21.15.67:0/3965207818 learned_addr learned my addr 172.21.15.67:0/3965207818 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:56.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.639+0000 7fdfe259c640 1 --2- 172.21.15.67:0/3965207818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdfe415e5a0 0x7fdfe40d0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.639+0000 7fdfe2d9d640 1 -- 172.21.15.67:0/3965207818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdfe415e5a0 msgr2=0x7fdfe40d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:56.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.639+0000 7fdfe2d9d640 1 --2- 172.21.15.67:0/3965207818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdfe415e5a0 0x7fdfe40d0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.639+0000 7fdfe2d9d640 1 -- 172.21.15.67:0/3965207818 >> v1:172.21.15.176:6789/0 conn(0x7fdfe40d4cb0 legacy=0x7fdfe40b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.639+0000 7fdfe2d9d640 1 -- 172.21.15.67:0/3965207818 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe40d2250 con 0x7fdfe40cfdf0 2024-04-25T02:29:56.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.639+0000 7fdfe2d9d640 1 --2- 172.21.15.67:0/3965207818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe40cfdf0 0x7fdfe40d10e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009e50 tx=0x7fdfd402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1235ae46bbb309db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:56.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.640+0000 7fdfe159a640 1 -- 172.21.15.67:0/3965207818 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4036070 con 0x7fdfe40cfdf0 2024-04-25T02:29:56.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.640+0000 7fdfe159a640 1 -- 172.21.15.67:0/3965207818 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd4031600 con 0x7fdfe40cfdf0 2024-04-25T02:29:56.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.640+0000 7fdfe159a640 1 -- 172.21.15.67:0/3965207818 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40319d0 con 0x7fdfe40cfdf0 2024-04-25T02:29:56.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.640+0000 7fdfe8bce640 1 -- 172.21.15.67:0/3965207818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe40cfdf0 msgr2=0x7fdfe40d10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.640+0000 7fdfe8bce640 1 --2- 172.21.15.67:0/3965207818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe40cfdf0 0x7fdfe40d10e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009e50 tx=0x7fdfd402a5f0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.640+0000 7fdfe8bce640 1 -- 172.21.15.67:0/3965207818 shutdown_connections 2024-04-25T02:29:56.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.640+0000 7fdfe8bce640 1 --2- 172.21.15.67:0/3965207818 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe40cfdf0 0x7fdfe40d10e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.640+0000 7fdfe8bce640 1 --2- 172.21.15.67:0/3965207818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdfe415e5a0 0x7fdfe40d0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.640+0000 7fdfe8bce640 1 -- 172.21.15.67:0/3965207818 >> 172.21.15.67:0/3965207818 conn(0x7fdfe40d4190 msgr2=0x7fdfe40d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:56.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.640+0000 7fdfe8bce640 1 -- 172.21.15.67:0/3965207818 shutdown_connections 2024-04-25T02:29:56.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.640+0000 7fdfe8bce640 1 -- 172.21.15.67:0/3965207818 wait complete. 2024-04-25T02:29:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.642+0000 7fdfe8bce640 1 Processor -- start 2024-04-25T02:29:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.642+0000 7fdfe8bce640 1 -- start start 2024-04-25T02:29:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.642+0000 7fdfe8bce640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdfe40cfdf0 0x7fdfe414c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.642+0000 7fdfe8bce640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfe40d4cb0 0x7fdfe40ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.642+0000 7fdfe8bce640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe415e5a0 0x7fdfe415fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.642+0000 7fdfe8bce640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe415e980 con 0x7fdfe415e5a0 2024-04-25T02:29:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.642+0000 7fdfe8bce640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe40d1a30 con 0x7fdfe40d4cb0 2024-04-25T02:29:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.642+0000 7fdfe8bce640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdfe40b46c0 con 0x7fdfe40cfdf0 2024-04-25T02:29:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.642+0000 7fdfe2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe415e5a0 0x7fdfe415fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.642+0000 7fdfe2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe415e5a0 0x7fdfe415fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60628/0 (socket says 172.21.15.67:60628) 2024-04-25T02:29:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.642+0000 7fdfe2d9d640 1 -- 172.21.15.67:0/3866478862 learned_addr learned my addr 172.21.15.67:0/3866478862 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.643+0000 7fdfe259c640 1 --2- 172.21.15.67:0/3866478862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdfe40cfdf0 0x7fdfe414c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.643+0000 7fdfe1d9b640 1 --2- 172.21.15.67:0/3866478862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfe40d4cb0 0x7fdfe40ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.643+0000 7fdfe2d9d640 1 -- 172.21.15.67:0/3866478862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdfe40cfdf0 msgr2=0x7fdfe414c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.643+0000 7fdfe2d9d640 1 --2- 172.21.15.67:0/3866478862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdfe40cfdf0 0x7fdfe414c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.643+0000 7fdfe2d9d640 1 -- 172.21.15.67:0/3866478862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfe40d4cb0 msgr2=0x7fdfe40ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.643+0000 7fdfe2d9d640 1 --2- 172.21.15.67:0/3866478862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfe40d4cb0 0x7fdfe40ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.643+0000 7fdfe2d9d640 1 -- 172.21.15.67:0/3866478862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe414caf0 con 0x7fdfe415e5a0 2024-04-25T02:29:56.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.643+0000 7fdfe2d9d640 1 --2- 172.21.15.67:0/3866478862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe415e5a0 0x7fdfe415fb00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009f70 tx=0x7fdfd4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:56.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.643+0000 7fdfd2ffd640 1 -- 172.21.15.67:0/3866478862 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4041020 con 0x7fdfe415e5a0 2024-04-25T02:29:56.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.643+0000 7fdfd2ffd640 1 -- 172.21.15.67:0/3866478862 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd4007800 con 0x7fdfe415e5a0 2024-04-25T02:29:56.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.643+0000 7fdfd2ffd640 1 -- 172.21.15.67:0/3866478862 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4036040 con 0x7fdfe415e5a0 2024-04-25T02:29:56.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.643+0000 7fdfe8bce640 1 -- 172.21.15.67:0/3866478862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe40c9400 con 0x7fdfe415e5a0 2024-04-25T02:29:56.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.643+0000 7fdfe8bce640 1 -- 172.21.15.67:0/3866478862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe40c99c0 con 0x7fdfe415e5a0 2024-04-25T02:29:56.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.644+0000 7fdfe8bce640 1 -- 172.21.15.67:0/3866478862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdfe40c91b0 con 0x7fdfe415e5a0 2024-04-25T02:29:56.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.645+0000 7fdfd2ffd640 1 -- 172.21.15.67:0/3866478862 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fdfd4044020 con 0x7fdfe415e5a0 2024-04-25T02:29:56.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.645+0000 7fdfd2ffd640 1 --2- 172.21.15.67:0/3866478862 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdfc406bfe0 0x7fdfc406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.645+0000 7fdfd2ffd640 1 -- 172.21.15.67:0/3866478862 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fdfd40abc70 con 0x7fdfe415e5a0 2024-04-25T02:29:56.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.645+0000 7fdfd2ffd640 1 --2- 172.21.15.67:0/3866478862 >> [v2:172.21.15.176:6808/4103155408,v1:172.21.15.176:6809/4103155408] conn(0x7fdfc4071ea0 0x7fdfc40742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.645+0000 7fdfd2ffd640 1 -- 172.21.15.67:0/3866478862 --> [v2:172.21.15.176:6808/4103155408,v1:172.21.15.176:6809/4103155408] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdfd4031600 con 0x7fdfc4071ea0 2024-04-25T02:29:56.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.645+0000 7fdfd2ffd640 1 -- 172.21.15.67:0/3866478862 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fdfd40ae350 con 0x7fdfe415e5a0 2024-04-25T02:29:56.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.645+0000 7fdfe259c640 1 --2- 172.21.15.67:0/3866478862 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdfc406bfe0 0x7fdfc406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.646+0000 7fdfe1d9b640 1 --2- 172.21.15.67:0/3866478862 >> [v2:172.21.15.176:6808/4103155408,v1:172.21.15.176:6809/4103155408] conn(0x7fdfc4071ea0 0x7fdfc40742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.646+0000 7fdfe259c640 1 --2- 172.21.15.67:0/3866478862 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdfc406bfe0 0x7fdfc406e4a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0079a0 tx=0x7fdfdc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:56.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.646+0000 7fdfe1d9b640 1 --2- 172.21.15.67:0/3866478862 >> [v2:172.21.15.176:6808/4103155408,v1:172.21.15.176:6809/4103155408] conn(0x7fdfc4071ea0 0x7fdfc40742c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:56.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.647+0000 7fdfd2ffd640 1 -- 172.21.15.67:0/3866478862 <== osd.6 v2:172.21.15.176:6808/4103155408 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdfd4031600 con 0x7fdfc4071ea0 2024-04-25T02:29:56.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.660+0000 7fdfe8bce640 1 -- 172.21.15.67:0/3866478862 --> [v2:172.21.15.176:6808/4103155408,v1:172.21.15.176:6809/4103155408] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdfe4069110 con 0x7fdfc4071ea0 2024-04-25T02:29:56.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.661+0000 7fdfd2ffd640 1 -- 172.21.15.67:0/3866478862 <== osd.6 v2:172.21.15.176:6808/4103155408 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdfe4069110 con 0x7fdfc4071ea0 2024-04-25T02:29:56.664 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-25T02:29:56.664 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:29:56.664 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-25T02:29:56.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.661+0000 7fdfe8bce640 1 -- 172.21.15.67:0/3866478862 >> [v2:172.21.15.176:6808/4103155408,v1:172.21.15.176:6809/4103155408] conn(0x7fdfc4071ea0 msgr2=0x7fdfc40742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.661+0000 7fdfe8bce640 1 --2- 172.21.15.67:0/3866478862 >> [v2:172.21.15.176:6808/4103155408,v1:172.21.15.176:6809/4103155408] conn(0x7fdfc4071ea0 0x7fdfc40742c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.661+0000 7fdfe8bce640 1 -- 172.21.15.67:0/3866478862 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdfc406bfe0 msgr2=0x7fdfc406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.661+0000 7fdfe8bce640 1 --2- 172.21.15.67:0/3866478862 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fdfc406bfe0 0x7fdfc406e4a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0079a0 tx=0x7fdfdc008040 comp rx=0 tx=0).stop 2024-04-25T02:29:56.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.661+0000 7fdfe8bce640 1 -- 172.21.15.67:0/3866478862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe415e5a0 msgr2=0x7fdfe415fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.661+0000 7fdfe8bce640 1 --2- 172.21.15.67:0/3866478862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe415e5a0 0x7fdfe415fb00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009f70 tx=0x7fdfd4004a40 comp rx=0 tx=0).stop 2024-04-25T02:29:56.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.661+0000 7fdfe2d9d640 1 -- 172.21.15.67:0/3866478862 reap_dead start 2024-04-25T02:29:56.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.661+0000 7fdfe8bce640 1 -- 172.21.15.67:0/3866478862 shutdown_connections 2024-04-25T02:29:56.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.661+0000 7fdfe8bce640 1 -- 172.21.15.67:0/3866478862 >> 172.21.15.67:0/3866478862 conn(0x7fdfe40d4190 msgr2=0x7fdfe406bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:56.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.661+0000 7fdfe8bce640 1 -- 172.21.15.67:0/3866478862 shutdown_connections 2024-04-25T02:29:56.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.661+0000 7fdfe8bce640 1 -- 172.21.15.67:0/3866478862 wait complete. 2024-04-25T02:29:56.676 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T02:29:56.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.774+0000 7f12268fc640 1 Processor -- start 2024-04-25T02:29:56.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.774+0000 7f12268fc640 1 -- start start 2024-04-25T02:29:56.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.775+0000 7f12268fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f12200cffb0 0x7f12200b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.775+0000 7f12268fc640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f122006d6c0 con 0x7f122015b0c0 2024-04-25T02:29:56.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.775+0000 7f12268fc640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f122006d9a0 con 0x7f12200b39e0 2024-04-25T02:29:56.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.775+0000 7f12268fc640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f122006dc80 con 0x7f12200cffb0 2024-04-25T02:29:56.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.775+0000 7f121f7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f12200cffb0 0x7f12200b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.775+0000 7f121ffff640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f122015b0c0 0x7f122006c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57112/0 (socket says 172.21.15.67:57112) 2024-04-25T02:29:56.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.775+0000 7f121ffff640 1 -- 172.21.15.67:0/3777703952 learned_addr learned my addr 172.21.15.67:0/3777703952 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:56.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.776+0000 7f121f7fe640 1 -- 172.21.15.67:0/3777703952 >> v1:172.21.15.176:6789/0 conn(0x7f12200b39e0 legacy=0x7f122015eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:56.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.776+0000 7f121f7fe640 1 -- 172.21.15.67:0/3777703952 >> v1:172.21.15.67:6789/0 conn(0x7f122015b0c0 legacy=0x7f122006c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.776+0000 7f121effd640 1 -- 172.21.15.67:0/3777703952 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4253437810 0 0) 0x7f122006d6c0 con 0x7f122015b0c0 2024-04-25T02:29:56.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.776+0000 7f121f7fe640 1 -- 172.21.15.67:0/3777703952 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f122006bad0 con 0x7f12200cffb0 2024-04-25T02:29:56.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.776+0000 7f121f7fe640 1 --2- 172.21.15.67:0/3777703952 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12200cffb0 0x7f12200b34a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f12100097a0 tx=0x7f121002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c75afeb5b0a7ddf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:56.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.776+0000 7f121effd640 1 -- 172.21.15.67:0/3777703952 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1210037070 con 0x7f12200cffb0 2024-04-25T02:29:56.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.777+0000 7f121effd640 1 -- 172.21.15.67:0/3777703952 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1210032440 con 0x7f12200cffb0 2024-04-25T02:29:56.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.777+0000 7f121effd640 1 -- 172.21.15.67:0/3777703952 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1210032810 con 0x7f12200cffb0 2024-04-25T02:29:56.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.777+0000 7f12268fc640 1 -- 172.21.15.67:0/3777703952 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12200cffb0 msgr2=0x7f12200b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.777+0000 7f12268fc640 1 --2- 172.21.15.67:0/3777703952 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12200cffb0 0x7f12200b34a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f12100097a0 tx=0x7f121002a1a0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.777+0000 7f12268fc640 1 -- 172.21.15.67:0/3777703952 shutdown_connections 2024-04-25T02:29:56.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.777+0000 7f12268fc640 1 --2- 172.21.15.67:0/3777703952 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12200cffb0 0x7f12200b34a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.777+0000 7f12268fc640 1 -- 172.21.15.67:0/3777703952 >> 172.21.15.67:0/3777703952 conn(0x7f12200d04f0 msgr2=0x7f12200d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:56.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.777+0000 7f12268fc640 1 -- 172.21.15.67:0/3777703952 shutdown_connections 2024-04-25T02:29:56.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.777+0000 7f12268fc640 1 -- 172.21.15.67:0/3777703952 wait complete. 2024-04-25T02:29:56.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.778+0000 7f12268fc640 1 Processor -- start 2024-04-25T02:29:56.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.778+0000 7f12268fc640 1 -- start start 2024-04-25T02:29:56.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.779+0000 7f12268fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12200b39e0 0x7f12201547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.779+0000 7f12268fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12200cffb0 0x7f1220158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.779+0000 7f12268fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f122015b0c0 0x7f1220159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.779+0000 7f12268fc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f12200cfcb0 con 0x7f12200b39e0 2024-04-25T02:29:56.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.779+0000 7f12268fc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f122006c9e0 con 0x7f122015b0c0 2024-04-25T02:29:56.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.779+0000 7f12268fc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f122015f250 con 0x7f12200cffb0 2024-04-25T02:29:56.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.779+0000 7f121ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12200b39e0 0x7f12201547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.779+0000 7f121ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12200b39e0 0x7f12201547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60636/0 (socket says 172.21.15.67:60636) 2024-04-25T02:29:56.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.779+0000 7f121ffff640 1 -- 172.21.15.67:0/3310548712 learned_addr learned my addr 172.21.15.67:0/3310548712 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:56.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.779+0000 7f121f7fe640 1 --2- 172.21.15.67:0/3310548712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12200cffb0 0x7f1220158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.779+0000 7f1224e99640 1 --2- 172.21.15.67:0/3310548712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f122015b0c0 0x7f1220159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.780+0000 7f121ffff640 1 -- 172.21.15.67:0/3310548712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12200cffb0 msgr2=0x7f1220158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.780+0000 7f121ffff640 1 --2- 172.21.15.67:0/3310548712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12200cffb0 0x7f1220158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.780+0000 7f121ffff640 1 -- 172.21.15.67:0/3310548712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f122015b0c0 msgr2=0x7f1220159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.780+0000 7f121ffff640 1 --2- 172.21.15.67:0/3310548712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f122015b0c0 0x7f1220159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.780+0000 7f121ffff640 1 -- 172.21.15.67:0/3310548712 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1220153d50 con 0x7f12200b39e0 2024-04-25T02:29:56.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.780+0000 7f121ffff640 1 --2- 172.21.15.67:0/3310548712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12200b39e0 0x7f12201547c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f121400c3f0 tx=0x7f121400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:56.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.780+0000 7f121cff9640 1 -- 172.21.15.67:0/3310548712 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12140074e0 con 0x7f12200b39e0 2024-04-25T02:29:56.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.780+0000 7f121cff9640 1 -- 172.21.15.67:0/3310548712 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12140047e0 con 0x7f12200b39e0 2024-04-25T02:29:56.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.780+0000 7f12268fc640 1 -- 172.21.15.67:0/3310548712 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1220155b70 con 0x7f12200b39e0 2024-04-25T02:29:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.780+0000 7f121cff9640 1 -- 172.21.15.67:0/3310548712 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1214004bd0 con 0x7f12200b39e0 2024-04-25T02:29:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.780+0000 7f12268fc640 1 -- 172.21.15.67:0/3310548712 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1220155e50 con 0x7f12200b39e0 2024-04-25T02:29:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.781+0000 7f12268fc640 1 -- 172.21.15.67:0/3310548712 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1220069110 con 0x7f12200b39e0 2024-04-25T02:29:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.781+0000 7f121cff9640 1 -- 172.21.15.67:0/3310548712 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f1214011070 con 0x7f12200b39e0 2024-04-25T02:29:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.782+0000 7f121cff9640 1 --2- 172.21.15.67:0/3310548712 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f120c06bfe0 0x7f120c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.782+0000 7f121cff9640 1 -- 172.21.15.67:0/3310548712 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f121408a9e0 con 0x7f12200b39e0 2024-04-25T02:29:56.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.782+0000 7f121f7fe640 1 --2- 172.21.15.67:0/3310548712 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f120c06bfe0 0x7f120c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:56.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.783+0000 7f121f7fe640 1 --2- 172.21.15.67:0/3310548712 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f120c06bfe0 0x7f120c06e4a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1210034000 tx=0x7f121002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:56.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.786+0000 7f121cff9640 1 -- 172.21.15.67:0/3310548712 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f121401a2b0 con 0x7f12200b39e0 2024-04-25T02:29:56.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.967+0000 7f12268fc640 1 -- 172.21.15.67:0/3310548712 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f122015a300 con 0x7f120c06bfe0 2024-04-25T02:29:56.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.968+0000 7f121cff9640 1 -- 172.21.15.67:0/3310548712 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f122015a300 con 0x7f120c06bfe0 2024-04-25T02:29:56.971 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T02:29:56.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.970+0000 7f12268fc640 1 -- 172.21.15.67:0/3310548712 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f120c06bfe0 msgr2=0x7f120c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.970+0000 7f12268fc640 1 --2- 172.21.15.67:0/3310548712 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f120c06bfe0 0x7f120c06e4a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1210034000 tx=0x7f121002e000 comp rx=0 tx=0).stop 2024-04-25T02:29:56.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.970+0000 7f12268fc640 1 -- 172.21.15.67:0/3310548712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12200b39e0 msgr2=0x7f12201547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:56.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.970+0000 7f12268fc640 1 --2- 172.21.15.67:0/3310548712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12200b39e0 0x7f12201547c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f121400c3f0 tx=0x7f121400c8b0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.970+0000 7f12268fc640 1 -- 172.21.15.67:0/3310548712 shutdown_connections 2024-04-25T02:29:56.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.970+0000 7f12268fc640 1 --2- 172.21.15.67:0/3310548712 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f120c06bfe0 0x7f120c06e4a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.970+0000 7f12268fc640 1 --2- 172.21.15.67:0/3310548712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f122015b0c0 0x7f1220159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.970+0000 7f12268fc640 1 --2- 172.21.15.67:0/3310548712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12200cffb0 0x7f1220158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.970+0000 7f12268fc640 1 --2- 172.21.15.67:0/3310548712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12200b39e0 0x7f12201547c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:56.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.970+0000 7f12268fc640 1 -- 172.21.15.67:0/3310548712 >> 172.21.15.67:0/3310548712 conn(0x7f12200d04f0 msgr2=0x7f12200b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:56.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.970+0000 7f12268fc640 1 -- 172.21.15.67:0/3310548712 shutdown_connections 2024-04-25T02:29:56.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:56.970+0000 7f12268fc640 1 -- 172.21.15.67:0/3310548712 wait complete. 2024-04-25T02:29:56.985 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T02:29:56.985 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:29:57.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.087+0000 7fbc4cf4c640 1 Processor -- start 2024-04-25T02:29:57.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.087+0000 7fbc4cf4c640 1 -- start start 2024-04-25T02:29:57.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.088+0000 7fbc4cf4c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbc480727f0 0x7fbc4815ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.088+0000 7fbc4cf4c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbc4815f220 0x7fbc480ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.088+0000 7fbc4cf4c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc48072bd0 con 0x7fbc480ae9e0 2024-04-25T02:29:57.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.088+0000 7fbc4cf4c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fbc4815f680 con 0x7fbc4815f220 2024-04-25T02:29:57.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.088+0000 7fbc4cf4c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fbc480b4a90 con 0x7fbc480727f0 2024-04-25T02:29:57.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.088+0000 7fbc45d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbc4815f220 0x7fbc480ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:57.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.088+0000 7fbc45d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbc4815f220 0x7fbc480ae4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60650/0 (socket says 172.21.15.67:60650) 2024-04-25T02:29:57.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.088+0000 7fbc45d9b640 1 -- 172.21.15.67:0/3177454178 learned_addr learned my addr 172.21.15.67:0/3177454178 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:57.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.088+0000 7fbc4659c640 1 --2- 172.21.15.67:0/3177454178 >> v2:172.21.15.176:3300/0 conn(0x7fbc480727f0 0x7fbc4815ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:57.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.088+0000 7fbc45d9b640 1 -- 172.21.15.67:0/3177454178 >> v2:172.21.15.176:3300/0 conn(0x7fbc480727f0 msgr2=0x7fbc4815ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:57.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.088+0000 7fbc45d9b640 1 --2- 172.21.15.67:0/3177454178 >> v2:172.21.15.176:3300/0 conn(0x7fbc480727f0 0x7fbc4815ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.088+0000 7fbc45d9b640 1 -- 172.21.15.67:0/3177454178 >> v1:172.21.15.176:6789/0 conn(0x7fbc480ae9e0 legacy=0x7fbc48154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:57.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.088+0000 7fbc45d9b640 1 -- 172.21.15.67:0/3177454178 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc480af260 con 0x7fbc4815f220 2024-04-25T02:29:57.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.089+0000 7fbc45d9b640 1 --2- 172.21.15.67:0/3177454178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc4815f220 0x7fbc480ae4a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbc4806c8d0 tx=0x7fbc3002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1481650624c7bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:57.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.089+0000 7fbc4559a640 1 -- 172.21.15.67:0/3177454178 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc30037070 con 0x7fbc4815f220 2024-04-25T02:29:57.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.089+0000 7fbc4559a640 1 -- 172.21.15.67:0/3177454178 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc30032440 con 0x7fbc4815f220 2024-04-25T02:29:57.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.089+0000 7fbc4559a640 1 -- 172.21.15.67:0/3177454178 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc30032810 con 0x7fbc4815f220 2024-04-25T02:29:57.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.090+0000 7fbc4cf4c640 1 -- 172.21.15.67:0/3177454178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc4815f220 msgr2=0x7fbc480ae4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:57.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.090+0000 7fbc4cf4c640 1 --2- 172.21.15.67:0/3177454178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc4815f220 0x7fbc480ae4a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbc4806c8d0 tx=0x7fbc3002a230 comp rx=0 tx=0).stop 2024-04-25T02:29:57.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.090+0000 7fbc4cf4c640 1 -- 172.21.15.67:0/3177454178 shutdown_connections 2024-04-25T02:29:57.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.090+0000 7fbc4cf4c640 1 --2- 172.21.15.67:0/3177454178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc4815f220 0x7fbc480ae4a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.090+0000 7fbc4cf4c640 1 --2- 172.21.15.67:0/3177454178 >> v2:172.21.15.176:3300/0 conn(0x7fbc480727f0 0x7fbc4815ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.090+0000 7fbc4cf4c640 1 -- 172.21.15.67:0/3177454178 >> 172.21.15.67:0/3177454178 conn(0x7fbc480b19c0 msgr2=0x7fbc480b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:57.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.090+0000 7fbc4cf4c640 1 -- 172.21.15.67:0/3177454178 shutdown_connections 2024-04-25T02:29:57.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.090+0000 7fbc4cf4c640 1 -- 172.21.15.67:0/3177454178 wait complete. 2024-04-25T02:29:57.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.091+0000 7fbc4cf4c640 1 Processor -- start 2024-04-25T02:29:57.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.091+0000 7fbc4cf4c640 1 -- start start 2024-04-25T02:29:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.092+0000 7fbc4cf4c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc480727f0 0x7fbc481e4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.092+0000 7fbc4cf4c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc480ae9e0 0x7fbc480ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.092+0000 7fbc4cf4c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc4815f220 0x7fbc4814e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.092+0000 7fbc4cf4c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbc480b3280 con 0x7fbc480ae9e0 2024-04-25T02:29:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.092+0000 7fbc4cf4c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbc480b2fa0 con 0x7fbc4815f220 2024-04-25T02:29:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.092+0000 7fbc4cf4c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbc480b3560 con 0x7fbc480727f0 2024-04-25T02:29:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.092+0000 7fbc45d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc480ae9e0 0x7fbc480ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.092+0000 7fbc45d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc480ae9e0 0x7fbc480ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60656/0 (socket says 172.21.15.67:60656) 2024-04-25T02:29:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.092+0000 7fbc45d9b640 1 -- 172.21.15.67:0/1322819680 learned_addr learned my addr 172.21.15.67:0/1322819680 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.092+0000 7fbc45d9b640 1 -- 172.21.15.67:0/1322819680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc480727f0 msgr2=0x7fbc481e4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.092+0000 7fbc45d9b640 1 --2- 172.21.15.67:0/1322819680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc480727f0 0x7fbc481e4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.092+0000 7fbc46d9d640 1 --2- 172.21.15.67:0/1322819680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc4815f220 0x7fbc4814e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.092+0000 7fbc45d9b640 1 -- 172.21.15.67:0/1322819680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc4815f220 msgr2=0x7fbc4814e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:57.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.092+0000 7fbc45d9b640 1 --2- 172.21.15.67:0/1322819680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc4815f220 0x7fbc4814e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.092+0000 7fbc45d9b640 1 -- 172.21.15.67:0/1322819680 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc480caa60 con 0x7fbc480ae9e0 2024-04-25T02:29:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.093+0000 7fbc45d9b640 1 --2- 172.21.15.67:0/1322819680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc480ae9e0 0x7fbc480ca520 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbc30000c00 tx=0x7fbc300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.093+0000 7fbc3effd640 1 -- 172.21.15.67:0/1322819680 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc30041020 con 0x7fbc480ae9e0 2024-04-25T02:29:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.093+0000 7fbc3effd640 1 -- 172.21.15.67:0/1322819680 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc300306c0 con 0x7fbc480ae9e0 2024-04-25T02:29:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.093+0000 7fbc4cf4c640 1 -- 172.21.15.67:0/1322819680 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc4809adc0 con 0x7fbc480ae9e0 2024-04-25T02:29:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.093+0000 7fbc3effd640 1 -- 172.21.15.67:0/1322819680 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc30037040 con 0x7fbc480ae9e0 2024-04-25T02:29:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.093+0000 7fbc4cf4c640 1 -- 172.21.15.67:0/1322819680 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc481e5440 con 0x7fbc480ae9e0 2024-04-25T02:29:57.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.094+0000 7fbc4cf4c640 1 -- 172.21.15.67:0/1322819680 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbc48069110 con 0x7fbc480ae9e0 2024-04-25T02:29:57.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.094+0000 7fbc3effd640 1 -- 172.21.15.67:0/1322819680 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fbc30044020 con 0x7fbc480ae9e0 2024-04-25T02:29:57.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.095+0000 7fbc3effd640 1 --2- 172.21.15.67:0/1322819680 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbc2806bfe0 0x7fbc2806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.095+0000 7fbc3effd640 1 -- 172.21.15.67:0/1322819680 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fbc300ab620 con 0x7fbc480ae9e0 2024-04-25T02:29:57.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.095+0000 7fbc3effd640 1 --2- 172.21.15.67:0/1322819680 >> [v2:172.21.15.176:6816/1381219465,v1:172.21.15.176:6817/1381219465] conn(0x7fbc28071ea0 0x7fbc280742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.095+0000 7fbc3effd640 1 -- 172.21.15.67:0/1322819680 --> [v2:172.21.15.176:6816/1381219465,v1:172.21.15.176:6817/1381219465] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc300067f0 con 0x7fbc28071ea0 2024-04-25T02:29:57.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.095+0000 7fbc3effd640 1 -- 172.21.15.67:0/1322819680 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fbc300b2050 con 0x7fbc480ae9e0 2024-04-25T02:29:57.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.095+0000 7fbc4659c640 1 --2- 172.21.15.67:0/1322819680 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbc2806bfe0 0x7fbc2806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:57.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.095+0000 7fbc46d9d640 1 --2- 172.21.15.67:0/1322819680 >> [v2:172.21.15.176:6816/1381219465,v1:172.21.15.176:6817/1381219465] conn(0x7fbc28071ea0 0x7fbc280742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:57.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.095+0000 7fbc4659c640 1 --2- 172.21.15.67:0/1322819680 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbc2806bfe0 0x7fbc2806e4a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbc400098f0 tx=0x7fbc40008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:57.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.096+0000 7fbc46d9d640 1 --2- 172.21.15.67:0/1322819680 >> [v2:172.21.15.176:6816/1381219465,v1:172.21.15.176:6817/1381219465] conn(0x7fbc28071ea0 0x7fbc280742c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:57.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.096+0000 7fbc3effd640 1 -- 172.21.15.67:0/1322819680 <== osd.7 v2:172.21.15.176:6816/1381219465 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbc300067f0 con 0x7fbc28071ea0 2024-04-25T02:29:57.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.110+0000 7fbc4cf4c640 1 -- 172.21.15.67:0/1322819680 --> [v2:172.21.15.176:6816/1381219465,v1:172.21.15.176:6817/1381219465] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbc4809af90 con 0x7fbc28071ea0 2024-04-25T02:29:57.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.110+0000 7fbc3effd640 1 -- 172.21.15.67:0/1322819680 <== osd.7 v2:172.21.15.176:6816/1381219465 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbc4809af90 con 0x7fbc28071ea0 2024-04-25T02:29:57.113 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-25T02:29:57.114 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:29:57.114 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-25T02:29:57.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.111+0000 7fbc4cf4c640 1 -- 172.21.15.67:0/1322819680 >> [v2:172.21.15.176:6816/1381219465,v1:172.21.15.176:6817/1381219465] conn(0x7fbc28071ea0 msgr2=0x7fbc280742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:57.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.111+0000 7fbc4cf4c640 1 --2- 172.21.15.67:0/1322819680 >> [v2:172.21.15.176:6816/1381219465,v1:172.21.15.176:6817/1381219465] conn(0x7fbc28071ea0 0x7fbc280742c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.111+0000 7fbc4cf4c640 1 -- 172.21.15.67:0/1322819680 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbc2806bfe0 msgr2=0x7fbc2806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:57.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.111+0000 7fbc4cf4c640 1 --2- 172.21.15.67:0/1322819680 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7fbc2806bfe0 0x7fbc2806e4a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbc400098f0 tx=0x7fbc40008040 comp rx=0 tx=0).stop 2024-04-25T02:29:57.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.111+0000 7fbc4cf4c640 1 -- 172.21.15.67:0/1322819680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc480ae9e0 msgr2=0x7fbc480ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:57.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.111+0000 7fbc4cf4c640 1 --2- 172.21.15.67:0/1322819680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc480ae9e0 0x7fbc480ca520 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbc30000c00 tx=0x7fbc300046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.111+0000 7fbc46d9d640 1 -- 172.21.15.67:0/1322819680 reap_dead start 2024-04-25T02:29:57.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.111+0000 7fbc4cf4c640 1 -- 172.21.15.67:0/1322819680 shutdown_connections 2024-04-25T02:29:57.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.111+0000 7fbc4cf4c640 1 -- 172.21.15.67:0/1322819680 >> 172.21.15.67:0/1322819680 conn(0x7fbc480b19c0 msgr2=0x7fbc480af930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:57.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.111+0000 7fbc4cf4c640 1 -- 172.21.15.67:0/1322819680 shutdown_connections 2024-04-25T02:29:57.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.111+0000 7fbc4cf4c640 1 -- 172.21.15.67:0/1322819680 wait complete. 2024-04-25T02:29:57.124 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T02:29:57.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.223+0000 7f80e0c1c640 1 Processor -- start 2024-04-25T02:29:57.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.224+0000 7f80e0c1c640 1 -- start start 2024-04-25T02:29:57.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.224+0000 7f80e0c1c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f80dc15e210 0x7f80dc06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.224+0000 7f80e0c1c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f80dc15e5f0 0x7f80dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.224+0000 7f80e0c1c640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80dc0d2cc0 con 0x7f80dc0cecc0 2024-04-25T02:29:57.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.224+0000 7f80e0c1c640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f80dc06c6f0 con 0x7f80dc15e5f0 2024-04-25T02:29:57.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.224+0000 7f80e0c1c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f80dc0d2fa0 con 0x7f80dc15e210 2024-04-25T02:29:57.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.225+0000 7f80d9d9b640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f80dc15e5f0 0x7f80dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:57.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.225+0000 7f80dad9d640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f80dc0cecc0 0x7f80dc0d3e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57120/0 (socket says 172.21.15.67:57120) 2024-04-25T02:29:57.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.225+0000 7f80dad9d640 1 -- 172.21.15.67:0/1819585289 learned_addr learned my addr 172.21.15.67:0/1819585289 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:29:57.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.225+0000 7f80da59c640 1 --2- 172.21.15.67:0/1819585289 >> v2:172.21.15.176:3300/0 conn(0x7f80dc15e210 0x7f80dc06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:57.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.225+0000 7f80d9d9b640 1 -- 172.21.15.67:0/1819585289 >> v2:172.21.15.176:3300/0 conn(0x7f80dc15e210 msgr2=0x7f80dc06cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:57.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.225+0000 7f80d9d9b640 1 --2- 172.21.15.67:0/1819585289 >> v2:172.21.15.176:3300/0 conn(0x7f80dc15e210 0x7f80dc06cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.225+0000 7f80d9d9b640 1 -- 172.21.15.67:0/1819585289 >> v1:172.21.15.67:6789/0 conn(0x7f80dc0cecc0 legacy=0x7f80dc0d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:57.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.225+0000 7f80d9d9b640 1 -- 172.21.15.67:0/1819585289 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80dc06c0a0 con 0x7f80dc15e5f0 2024-04-25T02:29:57.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.225+0000 7f80d959a640 1 -- 172.21.15.67:0/1819585289 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1952826064 0 0) 0x7f80dc0d2cc0 con 0x7f80dc0cecc0 2024-04-25T02:29:57.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.225+0000 7f80da59c640 1 --2- 172.21.15.67:0/1819585289 >> v2:172.21.15.176:3300/0 conn(0x7f80dc15e210 0x7f80dc06cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:29:57.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.226+0000 7f80d9d9b640 1 --2- 172.21.15.67:0/1819585289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80dc15e5f0 0x7f80dc06d0c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f80d00097a0 tx=0x7f80d002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa12d33ccba2101 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:57.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.226+0000 7f80d959a640 1 -- 172.21.15.67:0/1819585289 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0037070 con 0x7f80dc15e5f0 2024-04-25T02:29:57.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.226+0000 7f80d959a640 1 -- 172.21.15.67:0/1819585289 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d0032440 con 0x7f80dc15e5f0 2024-04-25T02:29:57.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.226+0000 7f80d959a640 1 -- 172.21.15.67:0/1819585289 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0032810 con 0x7f80dc15e5f0 2024-04-25T02:29:57.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.226+0000 7f80e0c1c640 1 -- 172.21.15.67:0/1819585289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80dc15e5f0 msgr2=0x7f80dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:57.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.226+0000 7f80e0c1c640 1 --2- 172.21.15.67:0/1819585289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80dc15e5f0 0x7f80dc06d0c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f80d00097a0 tx=0x7f80d002a1e0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.226+0000 7f80e0c1c640 1 -- 172.21.15.67:0/1819585289 shutdown_connections 2024-04-25T02:29:57.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.226+0000 7f80e0c1c640 1 --2- 172.21.15.67:0/1819585289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80dc15e5f0 0x7f80dc06d0c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.226+0000 7f80e0c1c640 1 --2- 172.21.15.67:0/1819585289 >> v2:172.21.15.176:3300/0 conn(0x7f80dc15e210 0x7f80dc06cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.226+0000 7f80e0c1c640 1 -- 172.21.15.67:0/1819585289 >> 172.21.15.67:0/1819585289 conn(0x7f80dc08dbb0 msgr2=0x7f80dc09d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:57.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.226+0000 7f80e0c1c640 1 -- 172.21.15.67:0/1819585289 shutdown_connections 2024-04-25T02:29:57.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.226+0000 7f80e0c1c640 1 -- 172.21.15.67:0/1819585289 wait complete. 2024-04-25T02:29:57.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.228+0000 7f80e0c1c640 1 Processor -- start 2024-04-25T02:29:57.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.228+0000 7f80e0c1c640 1 -- start start 2024-04-25T02:29:57.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.228+0000 7f80e0c1c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80dc0cecc0 0x7f80dc150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.228+0000 7f80e0c1c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80dc15e210 0x7f80dc15d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.228+0000 7f80e0c1c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80dc15e5f0 0x7f80dc0ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80e0c1c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc0d46f0 con 0x7f80dc15e210 2024-04-25T02:29:57.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80e0c1c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc0d4570 con 0x7f80dc0cecc0 2024-04-25T02:29:57.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80e0c1c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f80dc0d4870 con 0x7f80dc15e5f0 2024-04-25T02:29:57.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80d9d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80dc15e210 0x7f80dc15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:57.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80d9d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80dc15e210 0x7f80dc15d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60674/0 (socket says 172.21.15.67:60674) 2024-04-25T02:29:57.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80d9d9b640 1 -- 172.21.15.67:0/2672605908 learned_addr learned my addr 172.21.15.67:0/2672605908 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:57.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80dad9d640 1 --2- 172.21.15.67:0/2672605908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80dc15e5f0 0x7f80dc0ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:57.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80da59c640 1 --2- 172.21.15.67:0/2672605908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80dc0cecc0 0x7f80dc150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:57.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80d9d9b640 1 -- 172.21.15.67:0/2672605908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80dc15e5f0 msgr2=0x7f80dc0ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:57.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80d9d9b640 1 --2- 172.21.15.67:0/2672605908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80dc15e5f0 0x7f80dc0ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80d9d9b640 1 -- 172.21.15.67:0/2672605908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80dc0cecc0 msgr2=0x7f80dc150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:57.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80d9d9b640 1 --2- 172.21.15.67:0/2672605908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80dc0cecc0 0x7f80dc150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80d9d9b640 1 -- 172.21.15.67:0/2672605908 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80dc0ce540 con 0x7f80dc15e210 2024-04-25T02:29:57.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80dad9d640 1 --2- 172.21.15.67:0/2672605908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80dc15e5f0 0x7f80dc0ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:57.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80da59c640 1 --2- 172.21.15.67:0/2672605908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80dc0cecc0 0x7f80dc150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:29:57.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80d9d9b640 1 --2- 172.21.15.67:0/2672605908 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80dc15e210 0x7f80dc15d200 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f80d0035040 tx=0x7f80d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:57.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80caffd640 1 -- 172.21.15.67:0/2672605908 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0037040 con 0x7f80dc15e210 2024-04-25T02:29:57.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80caffd640 1 -- 172.21.15.67:0/2672605908 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d0030770 con 0x7f80dc15e210 2024-04-25T02:29:57.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80e0c1c640 1 -- 172.21.15.67:0/2672605908 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80dc0ccf60 con 0x7f80dc15e210 2024-04-25T02:29:57.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80caffd640 1 -- 172.21.15.67:0/2672605908 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0030b40 con 0x7f80dc15e210 2024-04-25T02:29:57.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.229+0000 7f80e0c1c640 1 -- 172.21.15.67:0/2672605908 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80dc0cd520 con 0x7f80dc15e210 2024-04-25T02:29:57.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.230+0000 7f80e0c1c640 1 -- 172.21.15.67:0/2672605908 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80dc0cab50 con 0x7f80dc15e210 2024-04-25T02:29:57.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.231+0000 7f80caffd640 1 -- 172.21.15.67:0/2672605908 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f80d0044020 con 0x7f80dc15e210 2024-04-25T02:29:57.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.231+0000 7f80caffd640 1 --2- 172.21.15.67:0/2672605908 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f80bc06bfe0 0x7f80bc06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.231+0000 7f80caffd640 1 -- 172.21.15.67:0/2672605908 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f80d00ab320 con 0x7f80dc15e210 2024-04-25T02:29:57.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.231+0000 7f80da59c640 1 --2- 172.21.15.67:0/2672605908 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f80bc06bfe0 0x7f80bc06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:57.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.232+0000 7f80da59c640 1 --2- 172.21.15.67:0/2672605908 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f80bc06bfe0 0x7f80bc06e4a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f80cc006fd0 tx=0x7f80cc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:57.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.235+0000 7f80caffd640 1 -- 172.21.15.67:0/2672605908 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f80dc0cab50 con 0x7f80dc15e210 2024-04-25T02:29:57.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.419+0000 7f80e0c1c640 1 -- 172.21.15.67:0/2672605908 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f80dc15d740 con 0x7f80bc06bfe0 2024-04-25T02:29:57.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.420+0000 7f80caffd640 1 -- 172.21.15.67:0/2672605908 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f80cc009100 con 0x7f80bc06bfe0 2024-04-25T02:29:57.423 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T02:29:57.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.421+0000 7f80e0c1c640 1 -- 172.21.15.67:0/2672605908 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f80bc06bfe0 msgr2=0x7f80bc06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:57.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.421+0000 7f80e0c1c640 1 --2- 172.21.15.67:0/2672605908 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f80bc06bfe0 0x7f80bc06e4a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f80cc006fd0 tx=0x7f80cc008040 comp rx=0 tx=0).stop 2024-04-25T02:29:57.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.422+0000 7f80e0c1c640 1 -- 172.21.15.67:0/2672605908 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80dc15e210 msgr2=0x7f80dc15d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:57.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.422+0000 7f80e0c1c640 1 --2- 172.21.15.67:0/2672605908 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80dc15e210 0x7f80dc15d200 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f80d0035040 tx=0x7f80d00046c0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.422+0000 7f80e0c1c640 1 -- 172.21.15.67:0/2672605908 shutdown_connections 2024-04-25T02:29:57.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.422+0000 7f80e0c1c640 1 --2- 172.21.15.67:0/2672605908 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f80bc06bfe0 0x7f80bc06e4a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.422+0000 7f80e0c1c640 1 --2- 172.21.15.67:0/2672605908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80dc15e5f0 0x7f80dc0ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.422+0000 7f80e0c1c640 1 --2- 172.21.15.67:0/2672605908 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80dc15e210 0x7f80dc15d200 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.422+0000 7f80e0c1c640 1 --2- 172.21.15.67:0/2672605908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80dc0cecc0 0x7f80dc150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.422+0000 7f80e0c1c640 1 -- 172.21.15.67:0/2672605908 >> 172.21.15.67:0/2672605908 conn(0x7f80dc08dbb0 msgr2=0x7f80dc0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:57.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.422+0000 7f80e0c1c640 1 -- 172.21.15.67:0/2672605908 shutdown_connections 2024-04-25T02:29:57.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.422+0000 7f80e0c1c640 1 -- 172.21.15.67:0/2672605908 wait complete. 2024-04-25T02:29:57.436 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:29:57.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.535+0000 7f2f693f9640 1 Processor -- start 2024-04-25T02:29:57.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.535+0000 7f2f693f9640 1 -- start start 2024-04-25T02:29:57.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.536+0000 7f2f693f9640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2f640af120 0x7f2f64071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.536+0000 7f2f693f9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f640acda0 0x7f2f6406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.536+0000 7f2f693f9640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f64160b20 con 0x7f2f6415c230 2024-04-25T02:29:57.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.536+0000 7f2f693f9640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f2f6415c610 con 0x7f2f640af120 2024-04-25T02:29:57.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.536+0000 7f2f693f9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2f640ad230 con 0x7f2f640acda0 2024-04-25T02:29:57.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.536+0000 7f2f627fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2f640af120 0x7f2f64071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:57.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.536+0000 7f2f627fc640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2f640af120 0x7f2f64071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60690/0 (socket says 172.21.15.67:60690) 2024-04-25T02:29:57.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.536+0000 7f2f627fc640 1 -- 172.21.15.67:0/2668590513 learned_addr learned my addr 172.21.15.67:0/2668590513 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:57.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.536+0000 7f2f637fe640 1 --2- 172.21.15.67:0/2668590513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f640acda0 0x7f2f6406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:57.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.536+0000 7f2f627fc640 1 -- 172.21.15.67:0/2668590513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f640acda0 msgr2=0x7f2f6406cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:57.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.536+0000 7f2f627fc640 1 --2- 172.21.15.67:0/2668590513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f640acda0 0x7f2f6406cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.536+0000 7f2f627fc640 1 -- 172.21.15.67:0/2668590513 >> v1:172.21.15.176:6789/0 conn(0x7f2f6415c230 legacy=0x7f2f640aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:57.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.536+0000 7f2f627fc640 1 -- 172.21.15.67:0/2668590513 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6415fd60 con 0x7f2f640af120 2024-04-25T02:29:57.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.537+0000 7f2f627fc640 1 --2- 172.21.15.67:0/2668590513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f640af120 0x7f2f64071800 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009870 tx=0x7f2f4c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4934ca372e4959 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:57.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.537+0000 7f2f61ffb640 1 -- 172.21.15.67:0/2668590513 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c037070 con 0x7f2f640af120 2024-04-25T02:29:57.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.537+0000 7f2f61ffb640 1 -- 172.21.15.67:0/2668590513 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f4c032440 con 0x7f2f640af120 2024-04-25T02:29:57.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.537+0000 7f2f61ffb640 1 -- 172.21.15.67:0/2668590513 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c032810 con 0x7f2f640af120 2024-04-25T02:29:57.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.538+0000 7f2f693f9640 1 -- 172.21.15.67:0/2668590513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f640af120 msgr2=0x7f2f64071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:57.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.538+0000 7f2f693f9640 1 --2- 172.21.15.67:0/2668590513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f640af120 0x7f2f64071800 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009870 tx=0x7f2f4c02a210 comp rx=0 tx=0).stop 2024-04-25T02:29:57.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.538+0000 7f2f693f9640 1 -- 172.21.15.67:0/2668590513 shutdown_connections 2024-04-25T02:29:57.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.538+0000 7f2f693f9640 1 --2- 172.21.15.67:0/2668590513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f640acda0 0x7f2f6406cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.538+0000 7f2f693f9640 1 --2- 172.21.15.67:0/2668590513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f640af120 0x7f2f64071800 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.538+0000 7f2f693f9640 1 -- 172.21.15.67:0/2668590513 >> 172.21.15.67:0/2668590513 conn(0x7f2f640b19c0 msgr2=0x7f2f640b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:57.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.538+0000 7f2f693f9640 1 -- 172.21.15.67:0/2668590513 shutdown_connections 2024-04-25T02:29:57.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.538+0000 7f2f693f9640 1 -- 172.21.15.67:0/2668590513 wait complete. 2024-04-25T02:29:57.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.539+0000 7f2f693f9640 1 Processor -- start 2024-04-25T02:29:57.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.539+0000 7f2f693f9640 1 -- start start 2024-04-25T02:29:57.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.540+0000 7f2f693f9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f640acda0 0x7f2f6414f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.540+0000 7f2f693f9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f640af120 0x7f2f6415ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.540+0000 7f2f693f9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6415c230 0x7f2f6415b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.540+0000 7f2f693f9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2f64160600 con 0x7f2f6415c230 2024-04-25T02:29:57.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.540+0000 7f2f693f9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2f64160320 con 0x7f2f640acda0 2024-04-25T02:29:57.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.540+0000 7f2f693f9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2f640ad4d0 con 0x7f2f640af120 2024-04-25T02:29:57.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.540+0000 7f2f637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6415c230 0x7f2f6415b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:57.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.540+0000 7f2f637fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6415c230 0x7f2f6415b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60696/0 (socket says 172.21.15.67:60696) 2024-04-25T02:29:57.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.540+0000 7f2f637fe640 1 -- 172.21.15.67:0/708237925 learned_addr learned my addr 172.21.15.67:0/708237925 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:29:57.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.540+0000 7f2f627fc640 1 --2- 172.21.15.67:0/708237925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f640af120 0x7f2f6415ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:57.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.540+0000 7f2f62ffd640 1 --2- 172.21.15.67:0/708237925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f640acda0 0x7f2f6414f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:57.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.540+0000 7f2f637fe640 1 -- 172.21.15.67:0/708237925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f640af120 msgr2=0x7f2f6415ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:57.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.540+0000 7f2f637fe640 1 --2- 172.21.15.67:0/708237925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f640af120 0x7f2f6415ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.540+0000 7f2f637fe640 1 -- 172.21.15.67:0/708237925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f640acda0 msgr2=0x7f2f6414f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:57.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.540+0000 7f2f637fe640 1 --2- 172.21.15.67:0/708237925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f640acda0 0x7f2f6414f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.540+0000 7f2f637fe640 1 -- 172.21.15.67:0/708237925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f641f7af0 con 0x7f2f6415c230 2024-04-25T02:29:57.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.540+0000 7f2f637fe640 1 --2- 172.21.15.67:0/708237925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6415c230 0x7f2f6415b060 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400cd50 tx=0x7f2f5400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:57.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.541+0000 7f2f5b7fe640 1 -- 172.21.15.67:0/708237925 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f54003b90 con 0x7f2f6415c230 2024-04-25T02:29:57.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.541+0000 7f2f5b7fe640 1 -- 172.21.15.67:0/708237925 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f54003d30 con 0x7f2f6415c230 2024-04-25T02:29:57.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.541+0000 7f2f693f9640 1 -- 172.21.15.67:0/708237925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f641f7d60 con 0x7f2f6415c230 2024-04-25T02:29:57.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.541+0000 7f2f5b7fe640 1 -- 172.21.15.67:0/708237925 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f54004240 con 0x7f2f6415c230 2024-04-25T02:29:57.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.541+0000 7f2f693f9640 1 -- 172.21.15.67:0/708237925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f641f8320 con 0x7f2f6415c230 2024-04-25T02:29:57.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.542+0000 7f2f693f9640 1 -- 172.21.15.67:0/708237925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f64069110 con 0x7f2f6415c230 2024-04-25T02:29:57.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.542+0000 7f2f5b7fe640 1 -- 172.21.15.67:0/708237925 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f2f540043e0 con 0x7f2f6415c230 2024-04-25T02:29:57.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.542+0000 7f2f5b7fe640 1 --2- 172.21.15.67:0/708237925 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2f4406c010 0x7f2f4406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:57.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.543+0000 7f2f5b7fe640 1 -- 172.21.15.67:0/708237925 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f2f5408b990 con 0x7f2f6415c230 2024-04-25T02:29:57.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.543+0000 7f2f62ffd640 1 --2- 172.21.15.67:0/708237925 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2f4406c010 0x7f2f4406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:57.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.543+0000 7f2f62ffd640 1 --2- 172.21.15.67:0/708237925 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2f4406c010 0x7f2f4406e4d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c006fd0 tx=0x7f2f5c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:57.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.547+0000 7f2f5b7fe640 1 -- 172.21.15.67:0/708237925 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2f5405a2b0 con 0x7f2f6415c230 2024-04-25T02:29:57.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.725+0000 7f2f693f9640 1 -- 172.21.15.67:0/708237925 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f640b12e0 con 0x7f2f4406c010 2024-04-25T02:29:57.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.726+0000 7f2f5b7fe640 1 -- 172.21.15.67:0/708237925 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13351 (secure 0 0 0) 0x7f2f640b12e0 con 0x7f2f4406c010 2024-04-25T02:29:57.730 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:29:57.733 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-25T02:29:57.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.728+0000 7f2f693f9640 1 -- 172.21.15.67:0/708237925 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2f4406c010 msgr2=0x7f2f4406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:57.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.728+0000 7f2f693f9640 1 --2- 172.21.15.67:0/708237925 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2f4406c010 0x7f2f4406e4d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c006fd0 tx=0x7f2f5c008040 comp rx=0 tx=0).stop 2024-04-25T02:29:57.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.728+0000 7f2f693f9640 1 -- 172.21.15.67:0/708237925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6415c230 msgr2=0x7f2f6415b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:57.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.728+0000 7f2f693f9640 1 --2- 172.21.15.67:0/708237925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6415c230 0x7f2f6415b060 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400cd50 tx=0x7f2f5400a660 comp rx=0 tx=0).stop 2024-04-25T02:29:57.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.728+0000 7f2f693f9640 1 -- 172.21.15.67:0/708237925 shutdown_connections 2024-04-25T02:29:57.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.728+0000 7f2f693f9640 1 --2- 172.21.15.67:0/708237925 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f2f4406c010 0x7f2f4406e4d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.728+0000 7f2f693f9640 1 --2- 172.21.15.67:0/708237925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6415c230 0x7f2f6415b060 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.728+0000 7f2f693f9640 1 --2- 172.21.15.67:0/708237925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f640af120 0x7f2f6415ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.728+0000 7f2f693f9640 1 --2- 172.21.15.67:0/708237925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f640acda0 0x7f2f6414f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:57.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.728+0000 7f2f693f9640 1 -- 172.21.15.67:0/708237925 >> 172.21.15.67:0/708237925 conn(0x7f2f640b19c0 msgr2=0x7f2f640cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:57.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.728+0000 7f2f693f9640 1 -- 172.21.15.67:0/708237925 shutdown_connections 2024-04-25T02:29:57.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:29:57.728+0000 7f2f693f9640 1 -- 172.21.15.67:0/708237925 wait complete. 2024-04-25T02:29:57.743 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-04-25T02:29:56.351891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220600,"kb_used_data":4424,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754120,"statfs":{"total":773094113280,"available":772868218880,"internally_reserved":0,"allocated":4530176,"data_stored":2494792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-6,"num_write_kb":-3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.810685"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T02:29:47.551145+0000","last_change":"2024-04-25T02:28:15.520345+0000","last_active":"2024-04-25T02:29:47.551145+0000","last_peered":"2024-04-25T02:29:47.551145+0000","last_clean":"2024-04-25T02:29:47.551145+0000","last_became_active":"2024-04-25T02:28:15.519317+0000","last_became_peered":"2024-04-25T02:28:15.519317+0000","last_unstale":"2024-04-25T02:29:47.551145+0000","last_undegraded":"2024-04-25T02:29:47.551145+0000","last_fullsized":"2024-04-25T02:29:47.551145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:14.374327+0000","last_clean_scrub_stamp":"2024-04-25T02:28:14.374327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:20.125523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":754625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":754625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:29:57.748 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T02:28:14.374327+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=29, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:57.749 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T02:30:17.750 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:30:17.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.864+0000 7f38b9990640 1 Processor -- start 2024-04-25T02:30:17.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.865+0000 7f38b9990640 1 -- start start 2024-04-25T02:30:17.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.865+0000 7f38b9990640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f38b40b3cd0 0x7f38b4165fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:17.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.865+0000 7f38b9990640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b415fa90 con 0x7f38b415b220 2024-04-25T02:30:17.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.865+0000 7f38b9990640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b40713d0 con 0x7f38b4070df0 2024-04-25T02:30:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.865+0000 7f38b9990640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f38b40aee00 con 0x7f38b40b3cd0 2024-04-25T02:30:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b2ffd640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f38b415b220 0x7f38b415ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47652/0 (socket says 172.21.15.67:47652) 2024-04-25T02:30:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b2ffd640 1 -- 172.21.15.67:0/1804578922 learned_addr learned my addr 172.21.15.67:0/1804578922 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:30:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b37fe640 1 --2- 172.21.15.67:0/1804578922 >> v2:172.21.15.176:3300/0 conn(0x7f38b40b3cd0 0x7f38b4165fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b1ffb640 1 -- 172.21.15.67:0/1804578922 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 852634845 0 0) 0x7f38b415fa90 con 0x7f38b415b220 2024-04-25T02:30:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b1ffb640 1 -- 172.21.15.67:0/1804578922 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f389c003520 con 0x7f38b415b220 2024-04-25T02:30:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b1ffb640 1 -- 172.21.15.67:0/1804578922 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1355880417 0 0) 0x7f389c003520 con 0x7f38b415b220 2024-04-25T02:30:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b1ffb640 1 -- 172.21.15.67:0/1804578922 >> v2:172.21.15.176:3300/0 conn(0x7f38b40b3cd0 msgr2=0x7f38b4165fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:30:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b1ffb640 1 --2- 172.21.15.67:0/1804578922 >> v2:172.21.15.176:3300/0 conn(0x7f38b40b3cd0 0x7f38b4165fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b1ffb640 1 -- 172.21.15.67:0/1804578922 >> v1:172.21.15.176:6789/0 conn(0x7f38b4070df0 legacy=0x7f38b415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b1ffb640 1 -- 172.21.15.67:0/1804578922 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b40ae4d0 con 0x7f38b415b220 2024-04-25T02:30:17.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b1ffb640 1 -- 172.21.15.67:0/1804578922 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3290447581 0 0) 0x7f38a8001670 con 0x7f38b415b220 2024-04-25T02:30:17.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b1ffb640 1 -- 172.21.15.67:0/1804578922 >> v1:172.21.15.67:6789/0 conn(0x7f38b415b220 legacy=0x7f38b415ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:17.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b1ffb640 1 --2- 172.21.15.67:0/1804578922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f389c0039b0 0x7f389c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:17.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b1ffb640 1 --2- 172.21.15.67:0/1804578922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f389c0043b0 0x7f389c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:17.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b1ffb640 1 --2- 172.21.15.67:0/1804578922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f389c005080 0x7f389c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:17.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b1ffb640 1 -- 172.21.15.67:0/1804578922 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f38b40aee00 con 0x7f389c0039b0 2024-04-25T02:30:17.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b1ffb640 1 -- 172.21.15.67:0/1804578922 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f389c00bfe0 con 0x7f389c005080 2024-04-25T02:30:17.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b1ffb640 1 -- 172.21.15.67:0/1804578922 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f389c00c1e0 con 0x7f389c0043b0 2024-04-25T02:30:17.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b2ffd640 1 --2- 172.21.15.67:0/1804578922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f389c0039b0 0x7f389c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:17.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b37fe640 1 --2- 172.21.15.67:0/1804578922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f389c005080 0x7f389c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:17.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.866+0000 7f38b27fc640 1 --2- 172.21.15.67:0/1804578922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f389c0043b0 0x7f389c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:17.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.867+0000 7f38b2ffd640 1 -- 172.21.15.67:0/1804578922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f389c0043b0 msgr2=0x7f389c004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:30:17.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.867+0000 7f38b2ffd640 1 --2- 172.21.15.67:0/1804578922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f389c0043b0 0x7f389c004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:17.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.867+0000 7f38b2ffd640 1 -- 172.21.15.67:0/1804578922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f389c005080 msgr2=0x7f389c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:30:17.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.867+0000 7f38b2ffd640 1 --2- 172.21.15.67:0/1804578922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f389c005080 0x7f389c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:17.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.867+0000 7f38b2ffd640 1 -- 172.21.15.67:0/1804578922 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389c003520 con 0x7f389c0039b0 2024-04-25T02:30:17.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.867+0000 7f38b37fe640 1 -- 172.21.15.67:0/1804578922 reap_dead start 2024-04-25T02:30:17.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.867+0000 7f38b2ffd640 1 --2- 172.21.15.67:0/1804578922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f389c0039b0 0x7f389c003d90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f38a800c190 tx=0x7f389c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c336e534052b35c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:17.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.868+0000 7f38b1ffb640 1 -- 172.21.15.67:0/1804578922 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a8007cc0 con 0x7f389c0039b0 2024-04-25T02:30:17.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.868+0000 7f38b1ffb640 1 -- 172.21.15.67:0/1804578922 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a8005ad0 con 0x7f389c0039b0 2024-04-25T02:30:17.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.868+0000 7f38b1ffb640 1 -- 172.21.15.67:0/1804578922 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a8007070 con 0x7f389c0039b0 2024-04-25T02:30:17.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.868+0000 7f38b9990640 1 -- 172.21.15.67:0/1804578922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f389c0039b0 msgr2=0x7f389c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:17.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.868+0000 7f38b9990640 1 --2- 172.21.15.67:0/1804578922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f389c0039b0 0x7f389c003d90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f38a800c190 tx=0x7f389c005830 comp rx=0 tx=0).stop 2024-04-25T02:30:17.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.868+0000 7f38b9990640 1 -- 172.21.15.67:0/1804578922 shutdown_connections 2024-04-25T02:30:17.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.868+0000 7f38b9990640 1 --2- 172.21.15.67:0/1804578922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f389c0039b0 0x7f389c003d90 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:17.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.868+0000 7f38b9990640 1 -- 172.21.15.67:0/1804578922 >> 172.21.15.67:0/1804578922 conn(0x7f38b40b19c0 msgr2=0x7f38b40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:17.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.868+0000 7f38b9990640 1 -- 172.21.15.67:0/1804578922 shutdown_connections 2024-04-25T02:30:17.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.868+0000 7f38b9990640 1 -- 172.21.15.67:0/1804578922 wait complete. 2024-04-25T02:30:17.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.870+0000 7f38b9990640 1 Processor -- start 2024-04-25T02:30:17.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.870+0000 7f38b9990640 1 -- start start 2024-04-25T02:30:17.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.870+0000 7f38b9990640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f389c0039b0 0x7f38b4156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:17.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.870+0000 7f38b9990640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38b4071670 0x7f38b4071af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:17.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.870+0000 7f38b9990640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38b41f76f0 0x7f38b41f7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:17.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.870+0000 7f38b9990640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f38b406eb90 con 0x7f38b41f76f0 2024-04-25T02:30:17.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.870+0000 7f38b9990640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f38b40aea90 con 0x7f38b4071670 2024-04-25T02:30:17.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.870+0000 7f38b9990640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f38b406ed10 con 0x7f389c0039b0 2024-04-25T02:30:17.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.871+0000 7f38b37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38b41f76f0 0x7f38b41f7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:17.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.871+0000 7f38b37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38b41f76f0 0x7f38b41f7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49044/0 (socket says 172.21.15.67:49044) 2024-04-25T02:30:17.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.871+0000 7f38b37fe640 1 -- 172.21.15.67:0/3114057243 learned_addr learned my addr 172.21.15.67:0/3114057243 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:30:17.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.871+0000 7f38b2ffd640 1 --2- 172.21.15.67:0/3114057243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f389c0039b0 0x7f38b4156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:17.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.871+0000 7f38b27fc640 1 --2- 172.21.15.67:0/3114057243 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38b4071670 0x7f38b4071af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:17.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.871+0000 7f38b37fe640 1 -- 172.21.15.67:0/3114057243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f389c0039b0 msgr2=0x7f38b4156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:17.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.871+0000 7f38b37fe640 1 --2- 172.21.15.67:0/3114057243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f389c0039b0 0x7f38b4156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:17.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.871+0000 7f38b37fe640 1 -- 172.21.15.67:0/3114057243 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38b4071670 msgr2=0x7f38b4071af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:17.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.871+0000 7f38b37fe640 1 --2- 172.21.15.67:0/3114057243 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38b4071670 0x7f38b4071af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:17.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.871+0000 7f38b37fe640 1 -- 172.21.15.67:0/3114057243 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b41f8420 con 0x7f38b41f76f0 2024-04-25T02:30:17.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.871+0000 7f38b27fc640 1 --2- 172.21.15.67:0/3114057243 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38b4071670 0x7f38b4071af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:30:17.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.871+0000 7f38b37fe640 1 --2- 172.21.15.67:0/3114057243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38b41f76f0 0x7f38b41f7b70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f38b406f090 tx=0x7f38ac00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:17.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.871+0000 7f389bfff640 1 -- 172.21.15.67:0/3114057243 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac00fce0 con 0x7f38b41f76f0 2024-04-25T02:30:17.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.871+0000 7f389bfff640 1 -- 172.21.15.67:0/3114057243 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38ac01d070 con 0x7f38b41f76f0 2024-04-25T02:30:17.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.871+0000 7f38b9990640 1 -- 172.21.15.67:0/3114057243 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b41486e0 con 0x7f38b41f76f0 2024-04-25T02:30:17.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.871+0000 7f389bfff640 1 -- 172.21.15.67:0/3114057243 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac015670 con 0x7f38b41f76f0 2024-04-25T02:30:17.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.871+0000 7f38b9990640 1 -- 172.21.15.67:0/3114057243 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b4148ca0 con 0x7f38b41f76f0 2024-04-25T02:30:17.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.873+0000 7f38b9990640 1 -- 172.21.15.67:0/3114057243 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b40acf00 con 0x7f38b41f76f0 2024-04-25T02:30:17.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.873+0000 7f389bfff640 1 -- 172.21.15.67:0/3114057243 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f38ac015810 con 0x7f38b41f76f0 2024-04-25T02:30:17.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.873+0000 7f389bfff640 1 --2- 172.21.15.67:0/3114057243 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f38a006c010 0x7f38a006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:17.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.873+0000 7f389bfff640 1 -- 172.21.15.67:0/3114057243 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f38ac08b890 con 0x7f38b41f76f0 2024-04-25T02:30:17.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.874+0000 7f38b2ffd640 1 --2- 172.21.15.67:0/3114057243 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f38a006c010 0x7f38a006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:17.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.874+0000 7f38b2ffd640 1 --2- 172.21.15.67:0/3114057243 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f38a006c010 0x7f38a006e4d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f38a8032000 tx=0x7f38a802d000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:17.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:17.878+0000 7f389bfff640 1 -- 172.21.15.67:0/3114057243 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f38b40acf00 con 0x7f38b41f76f0 2024-04-25T02:30:18.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.058+0000 7f38b9990640 1 -- 172.21.15.67:0/3114057243 --> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f38b4069110 con 0x7f38a006c010 2024-04-25T02:30:18.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.059+0000 7f389bfff640 1 -- 172.21.15.67:0/3114057243 <== mgr.4111 v2:172.21.15.176:6832/641694317 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13356 (secure 0 0 0) 0x7f38b4069110 con 0x7f38a006c010 2024-04-25T02:30:18.063 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:30:18.063 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-25T02:30:18.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.061+0000 7f38b9990640 1 -- 172.21.15.67:0/3114057243 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f38a006c010 msgr2=0x7f38a006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:18.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.061+0000 7f38b9990640 1 --2- 172.21.15.67:0/3114057243 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f38a006c010 0x7f38a006e4d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f38a8032000 tx=0x7f38a802d000 comp rx=0 tx=0).stop 2024-04-25T02:30:18.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.061+0000 7f38b9990640 1 -- 172.21.15.67:0/3114057243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38b41f76f0 msgr2=0x7f38b41f7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:18.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.061+0000 7f38b9990640 1 --2- 172.21.15.67:0/3114057243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38b41f76f0 0x7f38b41f7b70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f38b406f090 tx=0x7f38ac00f1b0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.061+0000 7f38b9990640 1 -- 172.21.15.67:0/3114057243 shutdown_connections 2024-04-25T02:30:18.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.061+0000 7f38b9990640 1 --2- 172.21.15.67:0/3114057243 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f38a006c010 0x7f38a006e4d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.061+0000 7f38b9990640 1 --2- 172.21.15.67:0/3114057243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38b41f76f0 0x7f38b41f7b70 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.061+0000 7f38b9990640 1 --2- 172.21.15.67:0/3114057243 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38b4071670 0x7f38b4071af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.061+0000 7f38b9990640 1 --2- 172.21.15.67:0/3114057243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f389c0039b0 0x7f38b4156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.061+0000 7f38b9990640 1 -- 172.21.15.67:0/3114057243 >> 172.21.15.67:0/3114057243 conn(0x7f38b40b19c0 msgr2=0x7f38b40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:18.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.062+0000 7f38b9990640 1 -- 172.21.15.67:0/3114057243 shutdown_connections 2024-04-25T02:30:18.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.062+0000 7f38b9990640 1 -- 172.21.15.67:0/3114057243 wait complete. 2024-04-25T02:30:18.076 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-04-25T02:30:16.355981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220592,"kb_used_data":4424,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754128,"statfs":{"total":773094113280,"available":772868227072,"internally_reserved":0,"allocated":4530176,"data_stored":2494792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002539"},"pg_stats":[{"pgid":"1.0","version":"36'119","reported_seq":210,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T02:29:57.579950+0000","last_change":"2024-04-25T02:29:57.580022+0000","last_active":"2024-04-25T02:29:57.579950+0000","last_peered":"2024-04-25T02:29:57.579950+0000","last_clean":"2024-04-25T02:29:57.579950+0000","last_became_active":"2024-04-25T02:28:15.519317+0000","last_became_peered":"2024-04-25T02:28:15.519317+0000","last_unstale":"2024-04-25T02:29:57.579950+0000","last_undegraded":"2024-04-25T02:29:57.579950+0000","last_fullsized":"2024-04-25T02:29:57.579950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2024-04-25T02:29:57.579838+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2024-04-25T02:29:57.579838+0000","last_clean_scrub_stamp":"2024-04-25T02:29:57.579838+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:48.409790+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1011712,"data_stored":754625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":164257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1011712,"data_stored":754625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:30:18.077 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T02:30:18.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.176+0000 7f5d972ca640 1 Processor -- start 2024-04-25T02:30:18.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.177+0000 7f5d972ca640 1 -- start start 2024-04-25T02:30:18.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.178+0000 7f5d972ca640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5d9015e760 0x7f5d900cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:18.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.178+0000 7f5d972ca640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d900d1470 0x7f5d9006bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:18.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.178+0000 7f5d972ca640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d900cff80 con 0x7f5d900d0900 2024-04-25T02:30:18.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.178+0000 7f5d972ca640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5d900d28a0 con 0x7f5d9015e760 2024-04-25T02:30:18.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.178+0000 7f5d972ca640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5d900d2250 con 0x7f5d900d1470 2024-04-25T02:30:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.178+0000 7f5d95066640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5d9015e760 0x7f5d900cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.178+0000 7f5d95066640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5d9015e760 0x7f5d900cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49058/0 (socket says 172.21.15.67:49058) 2024-04-25T02:30:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.178+0000 7f5d95066640 1 -- 172.21.15.67:0/3082005917 learned_addr learned my addr 172.21.15.67:0/3082005917 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:30:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.178+0000 7f5d95867640 1 --2- 172.21.15.67:0/3082005917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d900d1470 0x7f5d9006bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.178+0000 7f5d95066640 1 -- 172.21.15.67:0/3082005917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d900d1470 msgr2=0x7f5d9006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:30:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.178+0000 7f5d95066640 1 --2- 172.21.15.67:0/3082005917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d900d1470 0x7f5d9006bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.178+0000 7f5d95066640 1 -- 172.21.15.67:0/3082005917 >> v1:172.21.15.176:6789/0 conn(0x7f5d900d0900 legacy=0x7f5d900d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:18.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.178+0000 7f5d95066640 1 -- 172.21.15.67:0/3082005917 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d900d2530 con 0x7f5d9015e760 2024-04-25T02:30:18.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.179+0000 7f5d95066640 1 --2- 172.21.15.67:0/3082005917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d9015e760 0x7f5d900cf8f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009870 tx=0x7f5d8c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c026676eb20ac707 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:18.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.179+0000 7f5d87fff640 1 -- 172.21.15.67:0/3082005917 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c037070 con 0x7f5d9015e760 2024-04-25T02:30:18.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.179+0000 7f5d87fff640 1 -- 172.21.15.67:0/3082005917 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8c032440 con 0x7f5d9015e760 2024-04-25T02:30:18.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.179+0000 7f5d87fff640 1 -- 172.21.15.67:0/3082005917 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c032810 con 0x7f5d9015e760 2024-04-25T02:30:18.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.180+0000 7f5d972ca640 1 -- 172.21.15.67:0/3082005917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d9015e760 msgr2=0x7f5d900cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:18.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.180+0000 7f5d972ca640 1 --2- 172.21.15.67:0/3082005917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d9015e760 0x7f5d900cf8f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009870 tx=0x7f5d8c02a270 comp rx=0 tx=0).stop 2024-04-25T02:30:18.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.180+0000 7f5d972ca640 1 -- 172.21.15.67:0/3082005917 shutdown_connections 2024-04-25T02:30:18.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.180+0000 7f5d972ca640 1 --2- 172.21.15.67:0/3082005917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d900d1470 0x7f5d9006bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.180+0000 7f5d972ca640 1 --2- 172.21.15.67:0/3082005917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d9015e760 0x7f5d900cf8f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.180+0000 7f5d972ca640 1 -- 172.21.15.67:0/3082005917 >> 172.21.15.67:0/3082005917 conn(0x7f5d900d41b0 msgr2=0x7f5d900d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:18.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.180+0000 7f5d972ca640 1 -- 172.21.15.67:0/3082005917 shutdown_connections 2024-04-25T02:30:18.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.180+0000 7f5d972ca640 1 -- 172.21.15.67:0/3082005917 wait complete. 2024-04-25T02:30:18.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.181+0000 7f5d972ca640 1 Processor -- start 2024-04-25T02:30:18.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.181+0000 7f5d972ca640 1 -- start start 2024-04-25T02:30:18.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.182+0000 7f5d972ca640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d900d0900 0x7f5d900cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:18.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.182+0000 7f5d972ca640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d900d1470 0x7f5d90159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:18.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.182+0000 7f5d972ca640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d9015e760 0x7f5d9015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:18.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.182+0000 7f5d972ca640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9015eb40 con 0x7f5d900d1470 2024-04-25T02:30:18.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.182+0000 7f5d972ca640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5d900d3d40 con 0x7f5d9015e760 2024-04-25T02:30:18.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.182+0000 7f5d972ca640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9015ecc0 con 0x7f5d900d0900 2024-04-25T02:30:18.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.182+0000 7f5d94865640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d900d1470 0x7f5d90159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:18.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.182+0000 7f5d94865640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d900d1470 0x7f5d90159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49062/0 (socket says 172.21.15.67:49062) 2024-04-25T02:30:18.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.182+0000 7f5d94865640 1 -- 172.21.15.67:0/1310234089 learned_addr learned my addr 172.21.15.67:0/1310234089 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:30:18.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.182+0000 7f5d95066640 1 --2- 172.21.15.67:0/1310234089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d900d0900 0x7f5d900cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:18.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.182+0000 7f5d95867640 1 --2- 172.21.15.67:0/1310234089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d9015e760 0x7f5d9015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:18.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.182+0000 7f5d94865640 1 -- 172.21.15.67:0/1310234089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d900d0900 msgr2=0x7f5d900cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:18.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.182+0000 7f5d94865640 1 --2- 172.21.15.67:0/1310234089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d900d0900 0x7f5d900cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.182+0000 7f5d94865640 1 -- 172.21.15.67:0/1310234089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d9015e760 msgr2=0x7f5d9015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:18.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.182+0000 7f5d94865640 1 --2- 172.21.15.67:0/1310234089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d9015e760 0x7f5d9015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.182+0000 7f5d94865640 1 -- 172.21.15.67:0/1310234089 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d900ce180 con 0x7f5d900d1470 2024-04-25T02:30:18.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.183+0000 7f5d94865640 1 --2- 172.21.15.67:0/1310234089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d900d1470 0x7f5d90159ca0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5d8000c430 tx=0x7f5d8000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:18.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.183+0000 7f5d85ffb640 1 -- 172.21.15.67:0/1310234089 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d800052d0 con 0x7f5d900d1470 2024-04-25T02:30:18.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.183+0000 7f5d85ffb640 1 -- 172.21.15.67:0/1310234089 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d80005490 con 0x7f5d900d1470 2024-04-25T02:30:18.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.183+0000 7f5d972ca640 1 -- 172.21.15.67:0/1310234089 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d900cdea0 con 0x7f5d900d1470 2024-04-25T02:30:18.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.183+0000 7f5d85ffb640 1 -- 172.21.15.67:0/1310234089 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80007260 con 0x7f5d900d1470 2024-04-25T02:30:18.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.183+0000 7f5d972ca640 1 -- 172.21.15.67:0/1310234089 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d900c8230 con 0x7f5d900d1470 2024-04-25T02:30:18.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.184+0000 7f5d972ca640 1 -- 172.21.15.67:0/1310234089 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d90069110 con 0x7f5d900d1470 2024-04-25T02:30:18.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.185+0000 7f5d85ffb640 1 -- 172.21.15.67:0/1310234089 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f5d80007400 con 0x7f5d900d1470 2024-04-25T02:30:18.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.185+0000 7f5d85ffb640 1 --2- 172.21.15.67:0/1310234089 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f5d7406bfe0 0x7f5d7406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:18.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.185+0000 7f5d85ffb640 1 -- 172.21.15.67:0/1310234089 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f5d8008a320 con 0x7f5d900d1470 2024-04-25T02:30:18.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.186+0000 7f5d95066640 1 --2- 172.21.15.67:0/1310234089 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f5d7406bfe0 0x7f5d7406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:18.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.186+0000 7f5d95066640 1 --2- 172.21.15.67:0/1310234089 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f5d7406bfe0 0x7f5d7406e4a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c034000 tx=0x7f5d8c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:18.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.190+0000 7f5d85ffb640 1 -- 172.21.15.67:0/1310234089 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5d80058730 con 0x7f5d900d1470 2024-04-25T02:30:18.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.392+0000 7f5d972ca640 1 -- 172.21.15.67:0/1310234089 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f5d900cf9e0 con 0x7f5d900d1470 2024-04-25T02:30:18.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.395+0000 7f5d85ffb640 1 -- 172.21.15.67:0/1310234089 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f5d8005ca30 con 0x7f5d900d1470 2024-04-25T02:30:18.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.396+0000 7f5d85ffb640 1 -- 172.21.15.67:0/1310234089 <== mon.0 v2:172.21.15.67:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5d80061260 con 0x7f5d900d1470 2024-04-25T02:30:18.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.398+0000 7f5d972ca640 1 -- 172.21.15.67:0/1310234089 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f5d7406bfe0 msgr2=0x7f5d7406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:18.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.398+0000 7f5d972ca640 1 --2- 172.21.15.67:0/1310234089 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f5d7406bfe0 0x7f5d7406e4a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c034000 tx=0x7f5d8c02e000 comp rx=0 tx=0).stop 2024-04-25T02:30:18.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.398+0000 7f5d972ca640 1 -- 172.21.15.67:0/1310234089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d900d1470 msgr2=0x7f5d90159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:18.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.398+0000 7f5d972ca640 1 --2- 172.21.15.67:0/1310234089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d900d1470 0x7f5d90159ca0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5d8000c430 tx=0x7f5d8000c8f0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.398+0000 7f5d972ca640 1 -- 172.21.15.67:0/1310234089 shutdown_connections 2024-04-25T02:30:18.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.398+0000 7f5d972ca640 1 --2- 172.21.15.67:0/1310234089 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f5d7406bfe0 0x7f5d7406e4a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.398+0000 7f5d972ca640 1 --2- 172.21.15.67:0/1310234089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d9015e760 0x7f5d9015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.398+0000 7f5d972ca640 1 --2- 172.21.15.67:0/1310234089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d900d1470 0x7f5d90159ca0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.398+0000 7f5d972ca640 1 --2- 172.21.15.67:0/1310234089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d900d0900 0x7f5d900cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.398+0000 7f5d972ca640 1 -- 172.21.15.67:0/1310234089 >> 172.21.15.67:0/1310234089 conn(0x7f5d900d41b0 msgr2=0x7f5d9015efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:18.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.398+0000 7f5d972ca640 1 -- 172.21.15.67:0/1310234089 shutdown_connections 2024-04-25T02:30:18.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.398+0000 7f5d972ca640 1 -- 172.21.15.67:0/1310234089 wait complete. 2024-04-25T02:30:18.412 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T02:30:18.412 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:30:18.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.511+0000 7f1f645c1640 1 Processor -- start 2024-04-25T02:30:18.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.511+0000 7f1f645c1640 1 -- start start 2024-04-25T02:30:18.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.512+0000 7f1f645c1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c0b3cd0 0x7f1f5c165fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:18.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.512+0000 7f1f645c1640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f5c15fa90 con 0x7f1f5c070df0 2024-04-25T02:30:18.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.512+0000 7f1f645c1640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f5c0713d0 con 0x7f1f5c15b220 2024-04-25T02:30:18.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.512+0000 7f1f645c1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5c0aee00 con 0x7f1f5c0b3cd0 2024-04-25T02:30:18.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.512+0000 7f1f61b5c640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1f5c070df0 0x7f1f5c15f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47658/0 (socket says 172.21.15.67:47658) 2024-04-25T02:30:18.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.512+0000 7f1f61b5c640 1 -- 172.21.15.67:0/2747890586 learned_addr learned my addr 172.21.15.67:0/2747890586 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-25T02:30:18.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.512+0000 7f1f62b5e640 1 --2- 172.21.15.67:0/2747890586 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c0b3cd0 0x7f1f5c165fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:18.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.512+0000 7f1f6135b640 1 -- 172.21.15.67:0/2747890586 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3896172537 0 0) 0x7f1f5c15fa90 con 0x7f1f5c070df0 2024-04-25T02:30:18.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.512+0000 7f1f6135b640 1 -- 172.21.15.67:0/2747890586 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f48003520 con 0x7f1f5c070df0 2024-04-25T02:30:18.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.512+0000 7f1f6135b640 1 -- 172.21.15.67:0/2747890586 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3710490952 0 0) 0x7f1f5c0713d0 con 0x7f1f5c15b220 2024-04-25T02:30:18.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.512+0000 7f1f6135b640 1 -- 172.21.15.67:0/2747890586 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f5c15fa90 con 0x7f1f5c15b220 2024-04-25T02:30:18.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.513+0000 7f1f62b5e640 1 -- 172.21.15.67:0/2747890586 >> v1:172.21.15.176:6789/0 conn(0x7f1f5c15b220 legacy=0x7f1f5c15ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:18.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.513+0000 7f1f6135b640 1 -- 172.21.15.67:0/2747890586 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3878225894 0 0) 0x7f1f48003520 con 0x7f1f5c070df0 2024-04-25T02:30:18.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.513+0000 7f1f62b5e640 1 -- 172.21.15.67:0/2747890586 >> v1:172.21.15.67:6789/0 conn(0x7f1f5c070df0 legacy=0x7f1f5c15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:18.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.513+0000 7f1f62b5e640 1 -- 172.21.15.67:0/2747890586 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c0ae4d0 con 0x7f1f5c0b3cd0 2024-04-25T02:30:18.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.513+0000 7f1f62b5e640 1 --2- 172.21.15.67:0/2747890586 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c0b3cd0 0x7f1f5c165fa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009dc0 tx=0x7f1f5402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11f9527547444a8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:18.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.513+0000 7f1f6135b640 1 -- 172.21.15.67:0/2747890586 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c001670 con 0x7f1f5c0b3cd0 2024-04-25T02:30:18.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.514+0000 7f1f6135b640 1 -- 172.21.15.67:0/2747890586 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1f54007540 con 0x7f1f5c0b3cd0 2024-04-25T02:30:18.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.514+0000 7f1f6135b640 1 -- 172.21.15.67:0/2747890586 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54007930 con 0x7f1f5c0b3cd0 2024-04-25T02:30:18.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.514+0000 7f1f645c1640 1 -- 172.21.15.67:0/2747890586 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c0b3cd0 msgr2=0x7f1f5c165fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:18.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.514+0000 7f1f645c1640 1 --2- 172.21.15.67:0/2747890586 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c0b3cd0 0x7f1f5c165fa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009dc0 tx=0x7f1f5402a660 comp rx=0 tx=0).stop 2024-04-25T02:30:18.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.514+0000 7f1f645c1640 1 -- 172.21.15.67:0/2747890586 shutdown_connections 2024-04-25T02:30:18.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.514+0000 7f1f645c1640 1 --2- 172.21.15.67:0/2747890586 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c0b3cd0 0x7f1f5c165fa0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.514+0000 7f1f645c1640 1 -- 172.21.15.67:0/2747890586 >> 172.21.15.67:0/2747890586 conn(0x7f1f5c0b19c0 msgr2=0x7f1f5c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:18.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.514+0000 7f1f645c1640 1 -- 172.21.15.67:0/2747890586 shutdown_connections 2024-04-25T02:30:18.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.514+0000 7f1f645c1640 1 -- 172.21.15.67:0/2747890586 wait complete. 2024-04-25T02:30:18.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.515+0000 7f1f645c1640 1 Processor -- start 2024-04-25T02:30:18.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.515+0000 7f1f645c1640 1 -- start start 2024-04-25T02:30:18.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.516+0000 7f1f645c1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f5c070df0 0x7f1f5c159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:18.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.516+0000 7f1f645c1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f5c0b3cd0 0x7f1f5c1f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:18.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.516+0000 7f1f645c1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c15b220 0x7f1f5c1f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:18.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.516+0000 7f1f645c1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c06eb90 con 0x7f1f5c070df0 2024-04-25T02:30:18.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.516+0000 7f1f645c1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c0aea90 con 0x7f1f5c0b3cd0 2024-04-25T02:30:18.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.516+0000 7f1f645c1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5c06ed10 con 0x7f1f5c15b220 2024-04-25T02:30:18.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.516+0000 7f1f6235d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f5c070df0 0x7f1f5c159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:18.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.516+0000 7f1f6235d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f5c070df0 0x7f1f5c159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49076/0 (socket says 172.21.15.67:49076) 2024-04-25T02:30:18.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.516+0000 7f1f6235d640 1 -- 172.21.15.67:0/171837396 learned_addr learned my addr 172.21.15.67:0/171837396 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-25T02:30:18.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.516+0000 7f1f62b5e640 1 --2- 172.21.15.67:0/171837396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c15b220 0x7f1f5c1f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:18.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.517+0000 7f1f6235d640 1 -- 172.21.15.67:0/171837396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c15b220 msgr2=0x7f1f5c1f7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:18.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.517+0000 7f1f6235d640 1 --2- 172.21.15.67:0/171837396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c15b220 0x7f1f5c1f7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.517+0000 7f1f6235d640 1 -- 172.21.15.67:0/171837396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f5c0b3cd0 msgr2=0x7f1f5c1f3df0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T02:30:18.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.517+0000 7f1f6235d640 1 --2- 172.21.15.67:0/171837396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f5c0b3cd0 0x7f1f5c1f3df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.517+0000 7f1f6235d640 1 -- 172.21.15.67:0/171837396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c1e4a40 con 0x7f1f5c070df0 2024-04-25T02:30:18.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.517+0000 7f1f6235d640 1 --2- 172.21.15.67:0/171837396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f5c070df0 0x7f1f5c159c30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800c430 tx=0x7f1f5800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:18.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.517+0000 7f1f52ffd640 1 -- 172.21.15.67:0/171837396 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f58017070 con 0x7f1f5c070df0 2024-04-25T02:30:18.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.517+0000 7f1f52ffd640 1 -- 172.21.15.67:0/171837396 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1f580052f0 con 0x7f1f5c070df0 2024-04-25T02:30:18.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.517+0000 7f1f645c1640 1 -- 172.21.15.67:0/171837396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5c1e4ce0 con 0x7f1f5c070df0 2024-04-25T02:30:18.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.517+0000 7f1f52ffd640 1 -- 172.21.15.67:0/171837396 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f58003850 con 0x7f1f5c070df0 2024-04-25T02:30:18.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.517+0000 7f1f645c1640 1 -- 172.21.15.67:0/171837396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5c157770 con 0x7f1f5c070df0 2024-04-25T02:30:18.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.518+0000 7f1f645c1640 1 -- 172.21.15.67:0/171837396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f5c072bc0 con 0x7f1f5c070df0 2024-04-25T02:30:18.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.519+0000 7f1f52ffd640 1 -- 172.21.15.67:0/171837396 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f1f5801a070 con 0x7f1f5c070df0 2024-04-25T02:30:18.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.519+0000 7f1f52ffd640 1 --2- 172.21.15.67:0/171837396 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f1f4006bfe0 0x7f1f4006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:18.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.519+0000 7f1f52ffd640 1 -- 172.21.15.67:0/171837396 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f1f5808a300 con 0x7f1f5c070df0 2024-04-25T02:30:18.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.519+0000 7f1f61b5c640 1 --2- 172.21.15.67:0/171837396 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f1f4006bfe0 0x7f1f4006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:18.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.520+0000 7f1f61b5c640 1 --2- 172.21.15.67:0/171837396 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f1f4006bfe0 0x7f1f4006e4a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0010e0 tx=0x7f1f4c000ed0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:18.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.527+0000 7f1f52ffd640 1 -- 172.21.15.67:0/171837396 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1f5c072bc0 con 0x7f1f5c070df0 2024-04-25T02:30:18.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.750+0000 7f1f645c1640 1 -- 172.21.15.67:0/171837396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f5c069110 con 0x7f1f5c070df0 2024-04-25T02:30:18.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.750+0000 7f1f52ffd640 1 -- 172.21.15.67:0/171837396 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3869 (secure 0 0 0) 0x7f1f58058d30 con 0x7f1f5c070df0 2024-04-25T02:30:18.754 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-25T02:30:18.754 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/101037939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":101037939},{"type":"v1","addr":"172.21.15.176:6837","nonce":101037939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4873,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/958313587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":958313587},{"type":"v1","addr":"172.21.15.176:6836","nonce":958313587}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/2806970849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2806970849},{"type":"v1","addr":"172.21.15.67:6834","nonce":2806970849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5508,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2167826650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":2167826650},{"type":"v1","addr":"172.21.15.67:6835","nonce":2167826650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[]} 2024-04-25T02:30:18.754 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 17 2024-04-25T02:30:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.753+0000 7f1f645c1640 1 -- 172.21.15.67:0/171837396 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f1f4006bfe0 msgr2=0x7f1f4006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.753+0000 7f1f645c1640 1 --2- 172.21.15.67:0/171837396 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f1f4006bfe0 0x7f1f4006e4a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0010e0 tx=0x7f1f4c000ed0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.753+0000 7f1f645c1640 1 -- 172.21.15.67:0/171837396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f5c070df0 msgr2=0x7f1f5c159c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.753+0000 7f1f645c1640 1 --2- 172.21.15.67:0/171837396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f5c070df0 0x7f1f5c159c30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800c430 tx=0x7f1f5800c8f0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.753+0000 7f1f645c1640 1 -- 172.21.15.67:0/171837396 shutdown_connections 2024-04-25T02:30:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.753+0000 7f1f645c1640 1 --2- 172.21.15.67:0/171837396 >> [v2:172.21.15.176:6832/641694317,v1:172.21.15.176:6833/641694317] conn(0x7f1f4006bfe0 0x7f1f4006e4a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.753+0000 7f1f645c1640 1 --2- 172.21.15.67:0/171837396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c15b220 0x7f1f5c1f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.753+0000 7f1f645c1640 1 --2- 172.21.15.67:0/171837396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f5c0b3cd0 0x7f1f5c1f3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.753+0000 7f1f645c1640 1 --2- 172.21.15.67:0/171837396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f5c070df0 0x7f1f5c159c30 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.753+0000 7f1f645c1640 1 -- 172.21.15.67:0/171837396 >> 172.21.15.67:0/171837396 conn(0x7f1f5c0b19c0 msgr2=0x7f1f5c0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.753+0000 7f1f645c1640 1 -- 172.21.15.67:0/171837396 shutdown_connections 2024-04-25T02:30:18.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-25T02:30:18.753+0000 7f1f645c1640 1 -- 172.21.15.67:0/171837396 wait complete. 2024-04-25T02:30:18.766 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-25T02:30:18.767 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T02:30:18.767 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T02:30:18.767 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:18.777 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T02:30:18.777 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T02:30:18.777 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:18.826 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T02:30:18.826 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T02:30:18.827 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:18.839 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T02:30:18.839 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T02:30:18.839 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:18.891 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T02:30:18.892 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T02:30:18.892 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T02:30:18.892 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:18.929 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T02:30:18.930 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T02:30:18.930 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:19.003 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T02:30:19.004 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T02:30:19.004 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:19.080 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T02:30:19.080 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T02:30:19.080 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:19.148 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T02:30:19.148 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T02:30:19.148 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:19.175 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T02:30:19.175 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T02:30:19.175 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:19.240 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T02:30:19.241 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T02:30:19.241 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:19.305 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T02:30:19.305 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T02:30:19.306 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:19.375 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T02:30:19.376 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T02:30:19.376 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T02:30:19.376 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:19.400 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T02:30:19.400 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T02:30:19.400 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:19.446 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T02:30:19.446 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T02:30:19.447 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T02:30:19.447 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:19.458 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T02:30:19.458 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T02:30:19.458 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:19.499 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T02:30:19.499 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T02:30:19.499 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:19.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-25T02:30:19.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-25T02:30:19.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-25T02:30:19.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-25T02:30:19.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-25T02:30:19.552 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T02:30:19.552 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T02:30:19.552 DEBUG:teuthology.orchestra.run.smithi067:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-04-25T02:30:19.586 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-25T02:30:19.586 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T02:30:19.798 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-25T02:30:19.798 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T02:30:19.862 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-25T02:30:19.862 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T02:30:19.912 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-25T02:30:19.912 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T02:30:19.962 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi176.front.sepia.ceph.com 2024-04-25T02:30:19.962 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T02:30:20.117 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi176.front.sepia.ceph.com 2024-04-25T02:30:20.118 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T02:30:20.165 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi176.front.sepia.ceph.com 2024-04-25T02:30:20.166 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T02:30:20.215 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi176.front.sepia.ceph.com 2024-04-25T02:30:20.215 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T02:30:20.256 INFO:tasks.ceph:Archiving mon data... 2024-04-25T02:30:20.258 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672388/data/mon.a.tgz 2024-04-25T02:30:20.258 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-04-25T02:30:20.274 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.4HAYtrMQ7a 2024-04-25T02:30:20.275 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.4HAYtrMQ7a 2024-04-25T02:30:20.409 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.4HAYtrMQ7a 2024-04-25T02:30:20.492 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.4HAYtrMQ7a is 347KB 2024-04-25T02:30:20.587 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.4HAYtrMQ7a 2024-04-25T02:30:20.602 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672388/data/mon.b.tgz 2024-04-25T02:30:20.603 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-04-25T02:30:20.619 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.4IUeFWv3a3 2024-04-25T02:30:20.619 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.4IUeFWv3a3 2024-04-25T02:30:20.784 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.4IUeFWv3a3 2024-04-25T02:30:20.865 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.4IUeFWv3a3 is 478KB 2024-04-25T02:30:20.962 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.4IUeFWv3a3 2024-04-25T02:30:20.977 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672388/data/mon.c.tgz 2024-04-25T02:30:20.977 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-04-25T02:30:21.032 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.aZoKyhS9Z1 2024-04-25T02:30:21.033 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.aZoKyhS9Z1 2024-04-25T02:30:21.181 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.aZoKyhS9Z1 2024-04-25T02:30:21.261 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.aZoKyhS9Z1 is 478KB 2024-04-25T02:30:21.358 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.aZoKyhS9Z1 2024-04-25T02:30:21.372 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T02:30:21.373 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T02:30:21.375 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T02:30:21.455 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T02:30:21.491 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T02:30:21.492 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T02:30:21.494 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672388/remote/smithi067/crash 2024-04-25T02:30:21.495 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T02:30:21.521 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672388/remote/smithi176/crash 2024-04-25T02:30:21.523 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T02:30:21.555 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T02:30:21.555 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:30:21.566 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:30:21.654 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T02:30:21.679 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T02:30:21.702 INFO:tasks.ceph:Compressing logs... 2024-04-25T02:30:21.703 DEBUG:teuthology.orchestra.run.smithi067:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T02:30:21.722 DEBUG:teuthology.orchestra.run.smithi176:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T02:30:21.744 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51254.log 2024-04-25T02:30:21.778 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T02:30:21.778 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34715.log 2024-04-25T02:30:21.778 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T02:30:21.778 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.34715.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T02:30:21.779 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T02:30:21.779 INFO:teuthology.orchestra.run.smithi176.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34715.log.gz 2024-04-25T02:30:21.779 INFO:teuthology.orchestra.run.smithi176.stderr: 91.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T02:30:21.779 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T02:30:21.779 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T02:30:21.779 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34544.log 2024-04-25T02:30:21.779 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41774.log 2024-04-25T02:30:21.779 INFO:teuthology.orchestra.run.smithi176.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T02:30:21.779 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.34544.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T02:30:21.779 INFO:teuthology.orchestra.run.smithi176.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T02:30:21.779 INFO:teuthology.orchestra.run.smithi176.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34544.log.gz 2024-04-25T02:30:21.779 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.3.41774.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T02:30:21.779 INFO:teuthology.orchestra.run.smithi176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41774.log.gz 2024-04-25T02:30:21.779 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34624.log 2024-04-25T02:30:21.780 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T02:30:21.780 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.34624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41778.log 2024-04-25T02:30:21.780 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.6.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34624.log.gz 2024-04-25T02:30:21.780 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42391.log 2024-04-25T02:30:21.780 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.3.41778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34835.log 2024-04-25T02:30:21.780 INFO:teuthology.orchestra.run.smithi176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41778.log.gz 2024-04-25T02:30:21.780 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42395.log 2024-04-25T02:30:21.780 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.42391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42391.log.gz 2024-04-25T02:30:21.780 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.34835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41379.log 2024-04-25T02:30:21.780 INFO:teuthology.orchestra.run.smithi176.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34835.log.gz 2024-04-25T02:30:21.780 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.42395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34584.log 2024-04-25T02:30:21.780 INFO:teuthology.orchestra.run.smithi176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42395.log.gz 2024-04-25T02:30:21.780 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.41379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41379.log.gz 2024-04-25T02:30:21.780 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34795.log 2024-04-25T02:30:21.781 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41374.log 2024-04-25T02:30:21.781 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.34584.log: /var/log/ceph/ceph-client.admin.34795.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34584.log.gz 2024-04-25T02:30:21.781 INFO:teuthology.orchestra.run.smithi176.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34795.log.gz 2024-04-25T02:30:21.781 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T02:30:21.781 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.41374.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T02:30:21.781 INFO:teuthology.orchestra.run.smithi176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41374.log.gz 2024-04-25T02:30:21.792 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34668.log 2024-04-25T02:30:21.802 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34755.log 2024-04-25T02:30:21.803 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.34668.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34668.log.gz 2024-04-25T02:30:21.814 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.34755.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34755.log.gz 2024-04-25T02:30:21.829 INFO:teuthology.orchestra.run.smithi176.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T02:30:21.846 INFO:teuthology.orchestra.run.smithi176.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T02:30:21.853 INFO:teuthology.orchestra.run.smithi176.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T02:30:21.869 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47792.log 2024-04-25T02:30:21.870 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44241.log 2024-04-25T02:30:21.870 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51254.log: /var/log/ceph/ceph-client.admin.47792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47432.log 2024-04-25T02:30:21.870 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.2.44241.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47792.log.gz 2024-04-25T02:30:21.870 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46099.log 2024-04-25T02:30:21.870 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51254.log.gz 2024-04-25T02:30:21.870 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44241.log.gz 2024-04-25T02:30:21.870 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49074.log 2024-04-25T02:30:21.870 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47432.log: /var/log/ceph/ceph-client.admin.46099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43319.log 2024-04-25T02:30:21.870 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47432.log.gz 2024-04-25T02:30:21.871 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46099.log.gz 2024-04-25T02:30:21.871 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40695.log 2024-04-25T02:30:21.871 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45757.log 2024-04-25T02:30:21.871 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49074.log.gz 2024-04-25T02:30:21.871 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.40695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49785.log 2024-04-25T02:30:21.871 INFO:teuthology.orchestra.run.smithi067.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.43319.log.gz 2024-04-25T02:30:21.871 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40695.log.gz 2024-04-25T02:30:21.871 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49355.log 2024-04-25T02:30:21.871 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45757.log: /var/log/ceph/ceph-client.admin.49785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44542.log 2024-04-25T02:30:21.871 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45757.log.gz 2024-04-25T02:30:21.871 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48174.log 2024-04-25T02:30:21.871 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49785.log.gz 2024-04-25T02:30:21.872 INFO:teuthology.orchestra.run.smithi067.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49355.log.gz 2024-04-25T02:30:21.872 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41555.log 2024-04-25T02:30:21.872 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44542.log.gz 2024-04-25T02:30:21.872 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48090.log 2024-04-25T02:30:21.872 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48174.log: /var/log/ceph/ceph-client.admin.41555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41387.log 2024-04-25T02:30:21.872 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48174.log.gz 2024-04-25T02:30:21.872 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40518.log 89.3% 2024-04-25T02:30:21.872 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41555.log.gz 2024-04-25T02:30:21.872 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.41387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46387.log 2024-04-25T02:30:21.872 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48090.log.gz 2024-04-25T02:30:21.872 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.40518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50750.log 2024-04-25T02:30:21.872 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41387.log.gz 2024-04-25T02:30:21.872 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46387.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40518.log.gz 2024-04-25T02:30:21.872 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45511.log 2024-04-25T02:30:21.873 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46387.log.gz 2024-04-25T02:30:21.873 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50918.log 2024-04-25T02:30:21.873 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50750.log: /var/log/ceph/ceph-client.admin.45511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50121.log 2024-04-25T02:30:21.873 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50750.log.gz 2024-04-25T02:30:21.873 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.50918.log: -- /var/log/ceph/ceph-client.admin.47177.log 2024-04-25T02:30:21.873 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45511.log.gz 2024-04-25T02:30:21.873 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45172.log 2024-04-25T02:30:21.873 INFO:teuthology.orchestra.run.smithi067.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50918.log.gz 2024-04-25T02:30:21.873 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47177.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50121.log.gz 2024-04-25T02:30:21.873 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48948.log 2024-04-25T02:30:21.874 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47177.log.gz 2024-04-25T02:30:21.874 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46597.log 2024-04-25T02:30:21.874 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45172.log.gz 2024-04-25T02:30:21.874 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46057.log 2024-04-25T02:30:21.874 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48948.log: /var/log/ceph/ceph-client.admin.46597.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T02:30:21.874 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48948.log.gz 2024-04-25T02:30:21.874 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49475.log 2024-04-25T02:30:21.874 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46597.log.gz 2024-04-25T02:30:21.874 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44668.log 2024-04-25T02:30:21.874 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46057.log.gz 2024-04-25T02:30:21.874 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45046.log 2024-04-25T02:30:21.874 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44668.log: 84.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T02:30:21.874 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49475.log.gz 2024-04-25T02:30:21.875 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42113.log 2024-04-25T02:30:21.875 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44668.log.gz 2024-04-25T02:30:21.875 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43800.log 2024-04-25T02:30:21.875 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49911.log 2024-04-25T02:30:21.875 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45046.log.gz 2024-04-25T02:30:21.875 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.43800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44374.log 2024-04-25T02:30:21.875 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42113.log.gz 2024-04-25T02:30:21.875 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43800.log.gz 2024-04-25T02:30:21.875 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43277.log 2024-04-25T02:30:21.875 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44374.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49911.log.gz 2024-04-25T02:30:21.875 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48132.log 2024-04-25T02:30:21.875 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44374.log.gz 2024-04-25T02:30:21.876 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43277.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T02:30:21.876 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51398.log 2024-04-25T02:30:21.876 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43277.log.gz 2024-04-25T02:30:21.876 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42773.log 2024-04-25T02:30:21.876 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48132.log.gz 2024-04-25T02:30:21.876 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47055.log 2024-04-25T02:30:21.876 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42773.log: 87.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.51398.log.gz -5 2024-04-25T02:30:21.876 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose -- /var/log/ceph/ceph-client.0.48576.log 2024-04-25T02:30:21.876 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42773.log.gz 2024-04-25T02:30:21.876 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41345.log 2024-04-25T02:30:21.876 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47055.log.gz 2024-04-25T02:30:21.876 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.48576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46555.log 2024-04-25T02:30:21.876 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48576.log.gz 2024-04-25T02:30:21.877 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.41345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40903.log 2024-04-25T02:30:21.877 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45595.log 2024-04-25T02:30:21.877 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41345.log.gz 2024-04-25T02:30:21.877 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.40903.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46555.log.gz 2024-04-25T02:30:21.877 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48006.log 2024-04-25T02:30:21.877 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40903.log.gz 2024-04-25T02:30:21.877 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46639.log 2024-04-25T02:30:21.877 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48006.log: 87.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.45595.log.gz -5 2024-04-25T02:30:21.877 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45004.log 2024-04-25T02:30:21.877 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46639.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48006.log.gz 2024-04-25T02:30:21.877 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T02:30:21.878 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45004.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46639.log.gz 2024-04-25T02:30:21.878 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44920.log 2024-04-25T02:30:21.878 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45004.log.gz 2024-04-25T02:30:21.878 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40599.log 2024-04-25T02:30:21.878 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.44920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41073.log 2024-04-25T02:30:21.878 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.40599.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44920.log.gz 2024-04-25T02:30:21.878 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49701.log 2024-04-25T02:30:21.878 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40599.log.gz 2024-04-25T02:30:21.878 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47305.log 2024-04-25T02:30:21.878 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.41073.log: /var/log/ceph/ceph-client.admin.49701.log: gzip -5 89.0% --verbose -- -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T02:30:21.878 INFO:teuthology.orchestra.run.smithi067.stderr: /var/log/ceph/ceph-client.admin.44500.log 2024-04-25T02:30:21.879 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41073.log.gz 2024-04-25T02:30:21.879 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49701.log.gz 2024-04-25T02:30:21.879 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46141.log 2024-04-25T02:30:21.879 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47305.log.gz 2024-04-25T02:30:21.879 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5/var/log/ceph/ceph-client.admin.44500.log: --verbose -- /var/log/ceph/ceph-client.admin.40987.log 2024-04-25T02:30:21.879 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49743.log 2024-04-25T02:30:21.879 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44500.log.gz 2024-04-25T02:30:21.879 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46141.log: /var/log/ceph/ceph-client.admin.40987.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46141.log.gz 2024-04-25T02:30:21.879 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42115.log 2024-04-25T02:30:21.879 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40987.log.gz 2024-04-25T02:30:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50434.log 2024-04-25T02:30:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49743.log: /var/log/ceph/ceph-client.admin.42115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50079.log 2024-04-25T02:30:21.880 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49743.log.gz 2024-04-25T02:30:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50434.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42115.log.gz 2024-04-25T02:30:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50392.log 2024-04-25T02:30:21.880 INFO:teuthology.orchestra.run.smithi067.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50434.log.gz 2024-04-25T02:30:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42311.log 2024-04-25T02:30:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50079.log: /var/log/ceph/ceph-client.admin.50392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42451.log 2024-04-25T02:30:21.880 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50079.log.gz 2024-04-25T02:30:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42311.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50392.log.gz 2024-04-25T02:30:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40776.log 2024-04-25T02:30:21.880 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42311.log.gz 2024-04-25T02:30:21.880 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42731.log 2024-04-25T02:30:21.881 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.40776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48738.log 2024-04-25T02:30:21.881 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42451.log.gz 2024-04-25T02:30:21.881 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42731.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40776.log.gz 2024-04-25T02:30:21.881 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43457.log 2024-04-25T02:30:21.881 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42731.log.gz 2024-04-25T02:30:21.881 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.48738.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42111.log 2024-04-25T02:30:21.881 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44458.log 2024-04-25T02:30:21.881 INFO:teuthology.orchestra.run.smithi067.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48738.log.gz 2024-04-25T02:30:21.881 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42111.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43457.log.gz 2024-04-25T02:30:21.881 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45553.log 2024-04-25T02:30:21.882 INFO:teuthology.orchestra.run.smithi067.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42111.log.gz 2024-04-25T02:30:21.882 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T02:30:21.882 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44458.log: /var/log/ceph/ceph-client.admin.45553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46303.log 2024-04-25T02:30:21.882 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44458.log.gz 2024-04-25T02:30:21.882 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.3.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45553.log.gz 2024-04-25T02:30:21.882 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41773.log 2024-04-25T02:30:21.882 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50308.log 2024-04-25T02:30:21.882 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.41773.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.46303.log.gz 2024-04-25T02:30:21.882 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47568.log 2024-04-25T02:30:21.883 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41773.log.gz 2024-04-25T02:30:21.883 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43235.log 2024-04-25T02:30:21.883 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.47568.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42857.log 2024-04-25T02:30:21.883 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50308.log.gz 2024-04-25T02:30:21.883 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47135.log 2024-04-25T02:30:21.883 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47568.log.gz 2024-04-25T02:30:21.883 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43235.log.gz 2024-04-25T02:30:21.883 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.42857.log: -- /var/log/ceph/ceph-client.admin.45298.log 2024-04-25T02:30:21.884 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41117.log 2024-04-25T02:30:21.884 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42857.log.gz 2024-04-25T02:30:21.884 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45298.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47135.log.gz 2024-04-25T02:30:21.884 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49397.log 2024-04-25T02:30:21.884 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.41117.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45298.log.gz 2024-04-25T02:30:21.884 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46723.log 2024-04-25T02:30:21.884 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41117.log.gz 2024-04-25T02:30:21.884 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50708.log 2024-04-25T02:30:21.884 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49397.log: /var/log/ceph/ceph-client.admin.46723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41471.log 2024-04-25T02:30:21.884 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49397.log.gz 2024-04-25T02:30:21.884 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50708.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46723.log.gz 2024-04-25T02:30:21.884 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51608.log 2024-04-25T02:30:21.884 INFO:teuthology.orchestra.run.smithi067.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50708.log.gz 2024-04-25T02:30:21.884 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34819.log 2024-04-25T02:30:21.885 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.41471.log: /var/log/ceph/ceph-client.admin.51608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41770.log 2024-04-25T02:30:21.885 INFO:teuthology.orchestra.run.smithi067.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41471.log.gz 2024-04-25T02:30:21.885 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51608.log.gz 2024-04-25T02:30:21.885 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44836.log 2024-04-25T02:30:21.885 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47524.log 2024-04-25T02:30:21.885 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.41770.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34819.log.gz 2024-04-25T02:30:21.885 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43067.log 2024-04-25T02:30:21.885 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41770.log.gz 2024-04-25T02:30:21.885 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44836.log.gz 2024-04-25T02:30:21.885 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48864.log 2024-04-25T02:30:21.885 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42983.log 2024-04-25T02:30:21.885 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47524.log.gz 2024-04-25T02:30:21.885 INFO:teuthology.orchestra.run.smithi067.stderr: 89.4%/var/log/ceph/ceph-client.admin.48864.log: -- replaced with /var/log/ceph/ceph-client.admin.43067.log.gz 2024-04-25T02:30:21.885 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T02:30:21.885 INFO:teuthology.orchestra.run.smithi067.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48864.log.gz 2024-04-25T02:30:21.885 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40818.log 2024-04-25T02:30:21.886 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46345.log 2024-04-25T02:30:21.886 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mds.c.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42983.log.gz 2024-04-25T02:30:21.886 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.40818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46807.log 2024-04-25T02:30:21.886 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40818.log.gz 2024-04-25T02:30:21.886 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47347.log 2024-04-25T02:30:21.886 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46345.log: /var/log/ceph/ceph-client.admin.46807.log: 91.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T02:30:21.886 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T02:30:21.886 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46345.log.gz 2024-04-25T02:30:21.886 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46807.log.gz 2024-04-25T02:30:21.886 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41029.log 2024-04-25T02:30:21.886 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T02:30:21.886 INFO:teuthology.orchestra.run.smithi067.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47347.log.gz 2024-04-25T02:30:21.886 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.41029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44237.log 2024-04-25T02:30:21.887 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mgr.y.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41029.log.gz 2024-04-25T02:30:21.887 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44710.log 2024-04-25T02:30:21.887 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.2.44237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41778.log 2024-04-25T02:30:21.887 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44237.log.gz 2024-04-25T02:30:21.887 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44710.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T02:30:21.887 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.41778.log: -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44710.log.gz 2024-04-25T02:30:21.887 INFO:teuthology.orchestra.run.smithi067.stderr: -- /var/log/ceph/ceph-client.admin.49313.log 2024-04-25T02:30:21.887 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.0.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41778.log.gz 2024-04-25T02:30:21.887 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40945.log 2024-04-25T02:30:21.887 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47750.log 2024-04-25T02:30:21.887 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49313.log.gz/var/log/ceph/ceph-client.admin.40945.log: 2024-04-25T02:30:21.887 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42114.log 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40945.log.gz 2024-04-25T02:30:21.887 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-04-25T02:30:21.887 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47263.log 2024-04-25T02:30:21.888 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47750.log.gz 2024-04-25T02:30:21.888 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46429.log 2024-04-25T02:30:21.888 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42114.log.gz 2024-04-25T02:30:21.888 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47263.log: 92.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42098.log 2024-04-25T02:30:21.888 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T02:30:21.888 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47263.log.gz 2024-04-25T02:30:21.888 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43193.log 2024-04-25T02:30:21.888 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46429.log.gz 2024-04-25T02:30:21.888 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51356.log 2024-04-25T02:30:21.888 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9%/var/log/ceph/ceph-client.admin.43193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49827.log 2024-04-25T02:30:21.888 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42098.log.gz 2024-04-25T02:30:21.888 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51356.log: gzip -5 89.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.43193.log.gz 2024-04-25T02:30:21.888 INFO:teuthology.orchestra.run.smithi067.stderr: /var/log/ceph/ceph-client.admin.50666.log 2024-04-25T02:30:21.888 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42647.log 2024-04-25T02:30:21.888 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51356.log.gz 2024-04-25T02:30:21.888 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48906.log 2024-04-25T02:30:21.889 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49827.log.gz 2024-04-25T02:30:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45358.log 2024-04-25T02:30:21.889 INFO:teuthology.orchestra.run.smithi067.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50666.log.gz 2024-04-25T02:30:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42647.log: /var/log/ceph/ceph-client.admin.48906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41429.log 2024-04-25T02:30:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42450.log 2024-04-25T02:30:21.889 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42647.log.gz 2024-04-25T02:30:21.889 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48906.log.gz 2024-04-25T02:30:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.41429.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45358.log.gz 2024-04-25T02:30:21.889 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41429.log.gz 2024-04-25T02:30:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48048.log 2024-04-25T02:30:21.889 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44794.log 2024-04-25T02:30:21.889 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5%/var/log/ceph/ceph-client.admin.48048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41769.log 2024-04-25T02:30:21.889 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42450.log.gz 2024-04-25T02:30:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51212.log 2024-04-25T02:30:21.890 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48048.log.gz 2024-04-25T02:30:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44794.log.gz 2024-04-25T02:30:21.890 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose/var/log/ceph/ceph-client.admin.41769.log: -- /var/log/ceph/ceph-client.admin.51002.log 2024-04-25T02:30:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51212.log: gzip -5 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41769.log.gz 2024-04-25T02:30:21.890 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T02:30:21.890 INFO:teuthology.orchestra.run.smithi067.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51212.log.gz 2024-04-25T02:30:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48318.log 2024-04-25T02:30:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mon.a.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51002.log.gz 2024-04-25T02:30:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47922.log 2024-04-25T02:30:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47389.log 2024-04-25T02:30:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48318.log: gzip/var/log/ceph/ceph-client.admin.47922.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50960.log 2024-04-25T02:30:21.890 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47922.log.gz 2024-04-25T02:30:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47389.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48318.log.gz 2024-04-25T02:30:21.890 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42448.log 2024-04-25T02:30:21.890 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4%/var/log/ceph/ceph-client.admin.50960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49869.log 2024-04-25T02:30:21.891 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47389.log.gz/var/log/ceph/ceph-client.admin.42448.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50960.log.gz 2024-04-25T02:30:21.891 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-04-25T02:30:21.891 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42448.log.gz 2024-04-25T02:30:21.891 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42941.log 2024-04-25T02:30:21.891 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51567.log 2024-04-25T02:30:21.891 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49869.log.gz 2024-04-25T02:30:21.891 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41513.log 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42941.log.gz 2024-04-25T02:30:21.891 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-04-25T02:30:21.891 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45799.log 2024-04-25T02:30:21.891 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51567.log.gz 2024-04-25T02:30:21.891 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.41513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49229.log 2024-04-25T02:30:21.891 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41513.log.gz 2024-04-25T02:30:21.891 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47613.log 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45799.log.gz 2024-04-25T02:30:21.891 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-04-25T02:30:21.892 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50476.log 2024-04-25T02:30:21.892 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9%/var/log/ceph/ceph-client.admin.47613.log: -- replaced with /var/log/ceph/ceph-client.admin.49229.log.gz 2024-04-25T02:30:21.892 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49601.log 2024-04-25T02:30:21.892 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47613.log.gz/var/log/ceph/ceph-client.admin.50476.log: 2024-04-25T02:30:21.892 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46471.log 2024-04-25T02:30:21.892 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49601.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50476.log.gz 2024-04-25T02:30:21.892 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45256.log 2024-04-25T02:30:21.892 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49601.log.gz 2024-04-25T02:30:21.892 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41775.log 2024-04-25T02:30:21.892 INFO:teuthology.orchestra.run.smithi067.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46471.log.gz 2024-04-25T02:30:21.892 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34700.log 2024-04-25T02:30:21.892 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45256.log: /var/log/ceph/ceph-client.admin.41775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51482.log 2024-04-25T02:30:21.892 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34700.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45256.log.gz 2024-04-25T02:30:21.892 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41775.log.gz 2024-04-25T02:30:21.892 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34700.log.gz 2024-04-25T02:30:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46849.log 2024-04-25T02:30:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48276.log 2024-04-25T02:30:21.893 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51482.log.gz/var/log/ceph/ceph-client.admin.46849.log: 2024-04-25T02:30:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44416.log 2024-04-25T02:30:21.893 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46849.log.gz 2024-04-25T02:30:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41774.log 2024-04-25T02:30:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48276.log: /var/log/ceph/ceph-client.admin.44416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45214.log 2024-04-25T02:30:21.893 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48276.log.gz 2024-04-25T02:30:21.893 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3%/var/log/ceph/ceph-client.admin.41774.log: -- replaced with /var/log/ceph/ceph-client.admin.44416.log.gz 2024-04-25T02:30:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41774.log.gz 2024-04-25T02:30:21.893 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51086.log 2024-04-25T02:30:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47657.log 2024-04-25T02:30:21.893 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45214.log.gz/var/log/ceph/ceph-client.admin.51086.log: 2024-04-25T02:30:21.893 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42689.log 2024-04-25T02:30:21.894 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51086.log.gz 2024-04-25T02:30:21.894 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42815.log 2024-04-25T02:30:21.894 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47657.log: /var/log/ceph/ceph-client.admin.42689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44878.log 2024-04-25T02:30:21.894 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42815.log: 88.5% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42689.log.gz 2024-04-25T02:30:21.894 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47657.log.gz 2024-04-25T02:30:21.894 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42815.log.gz 2024-04-25T02:30:21.894 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51128.log 2024-04-25T02:30:21.894 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49643.log 2024-04-25T02:30:21.894 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44878.log.gz 2024-04-25T02:30:21.894 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43025.log 2024-04-25T02:30:21.894 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51128.log.gz 2024-04-25T02:30:21.894 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42447.log 2024-04-25T02:30:21.895 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49643.log.gzgzip 2024-04-25T02:30:21.895 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47708.log 2024-04-25T02:30:21.895 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47838.log 2024-04-25T02:30:21.895 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42447.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43025.log.gz 2024-04-25T02:30:21.895 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47708.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42447.log.gz 2024-04-25T02:30:21.895 INFO:teuthology.orchestra.run.smithi067.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47708.log.gz 2024-04-25T02:30:21.895 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45973.log 2024-04-25T02:30:21.895 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41303.log 2024-04-25T02:30:21.895 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45973.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47838.log.gz 2024-04-25T02:30:21.895 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46219.log 2024-04-25T02:30:21.895 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45973.log.gz 2024-04-25T02:30:21.895 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49271.log 2024-04-25T02:30:21.895 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.41303.log: /var/log/ceph/ceph-client.admin.46219.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41303.log.gz 2024-04-25T02:30:21.895 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46219.log.gz 2024-04-25T02:30:21.895 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34436.log 2024-04-25T02:30:21.896 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42095.log 2024-04-25T02:30:21.896 INFO:teuthology.orchestra.run.smithi067.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49271.log.gz 2024-04-25T02:30:21.896 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.34436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44626.log 2024-04-25T02:30:21.896 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42095.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34436.log.gz 2024-04-25T02:30:21.896 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42445.log 2024-04-25T02:30:21.896 INFO:teuthology.orchestra.run.smithi067.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42446.log 2024-04-25T02:30:21.896 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42095.log.gz 2024-04-25T02:30:21.896 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44626.log: /var/log/ceph/ceph-client.admin.42445.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44626.log.gz 2024-04-25T02:30:21.896 INFO:teuthology.orchestra.run.smithi067.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42445.log.gz 2024-04-25T02:30:21.896 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51440.log 2024-04-25T02:30:21.896 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42443.log 2024-04-25T02:30:21.896 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42446.log.gz 2024-04-25T02:30:21.896 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48384.log 2024-04-25T02:30:21.896 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51440.log.gz/var/log/ceph/ceph-client.admin.42443.log: 2024-04-25T02:30:21.896 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48216.log 2024-04-25T02:30:21.896 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42443.log.gz 2024-04-25T02:30:21.897 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41261.log 2024-04-25T02:30:21.897 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48384.log: /var/log/ceph/ceph-client.admin.48216.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48384.log.gz 2024-04-25T02:30:21.897 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48216.log.gz 2024-04-25T02:30:21.897 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50876.log 2024-04-25T02:30:21.897 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.41261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49995.log 2024-04-25T02:30:21.897 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41261.log.gz 2024-04-25T02:30:21.897 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46765.log 2024-04-25T02:30:21.897 INFO:teuthology.orchestra.run.smithi067.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50876.log.gz 2024-04-25T02:30:21.897 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45130.log 2024-04-25T02:30:21.897 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49995.log.gz 2024-04-25T02:30:21.897 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49032.log 2024-04-25T02:30:21.897 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46765.log: /var/log/ceph/ceph-client.admin.45130.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46765.log.gz 2024-04-25T02:30:21.897 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45130.log.gz 2024-04-25T02:30:21.897 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41779.log 2024-04-25T02:30:21.897 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50266.log 2024-04-25T02:30:21.897 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49032.log.gz 2024-04-25T02:30:21.898 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.41779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48696.log 2024-04-25T02:30:21.898 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41779.log.gz/var/log/ceph/ceph-client.admin.50266.log: 2024-04-25T02:30:21.898 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43795.log 2024-04-25T02:30:21.898 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50266.log.gz 2024-04-25T02:30:21.898 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45715.log 2024-04-25T02:30:21.898 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48696.log: /var/log/ceph/ceph-client.0.43795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44752.log 2024-04-25T02:30:21.898 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43795.log.gz 2024-04-25T02:30:21.898 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45715.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48696.log.gz 2024-04-25T02:30:21.898 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28334.log 2024-04-25T02:30:21.898 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45715.log.gz 2024-04-25T02:30:21.898 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49116.log 2024-04-25T02:30:21.898 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44752.log: /var/log/ceph/ceph.tmp-client.admin.28334.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28334.log.gz 2024-04-25T02:30:21.898 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44752.log.gz 2024-04-25T02:30:21.898 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48572.log 2024-04-25T02:30:21.899 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44962.log 2024-04-25T02:30:21.899 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.48572.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49116.log.gz 2024-04-25T02:30:21.899 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42899.log 2024-04-25T02:30:21.899 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.0.48572.log.gz 2024-04-25T02:30:21.899 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.44962.log: -- /var/log/ceph/ceph-client.admin.46513.log 2024-04-25T02:30:21.899 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42899.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.44962.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.41177.log 2024-04-25T02:30:21.899 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-04-25T02:30:21.899 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42899.log.gz 2024-04-25T02:30:21.899 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49953.log 2024-04-25T02:30:21.899 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46513.log: /var/log/ceph/ceph-client.admin.41177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51170.log 2024-04-25T02:30:21.899 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49953.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46513.log.gz 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41177.log.gz 2024-04-25T02:30:21.899 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-04-25T02:30:21.899 INFO:teuthology.orchestra.run.smithi067.stderr:gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49953.log.gz 2024-04-25T02:30:21.899 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42110.log 2024-04-25T02:30:21.899 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46681.log 2024-04-25T02:30:21.899 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51170.log.gz 2024-04-25T02:30:21.900 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41597.log 2024-04-25T02:30:21.900 INFO:teuthology.orchestra.run.smithi067.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42110.log.gz 2024-04-25T02:30:21.900 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46015.log 2024-04-25T02:30:21.900 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50224.log 2024-04-25T02:30:21.900 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.41597.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46681.log.gz 2024-04-25T02:30:21.900 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46015.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41597.log.gz 2024-04-25T02:30:21.900 INFO:teuthology.orchestra.run.smithi067.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46015.log.gz 2024-04-25T02:30:21.900 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50834.log 2024-04-25T02:30:21.900 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43109.log 2024-04-25T02:30:21.900 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50224.log.gz 2024-04-25T02:30:21.900 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50834.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T02:30:21.900 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50834.log.gz/var/log/ceph/ceph-client.admin.43109.log: 2024-04-25T02:30:21.900 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50171.log 2024-04-25T02:30:21.900 INFO:teuthology.orchestra.run.smithi067.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43109.log.gz 2024-04-25T02:30:21.901 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47880.log 2024-04-25T02:30:21.901 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42109.log 2024-04-25T02:30:21.901 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50171.log: /var/log/ceph/ceph-client.admin.47880.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50171.log.gz 2024-04-25T02:30:21.901 INFO:teuthology.orchestra.run.smithi067.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47880.log.gz 2024-04-25T02:30:21.901 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48822.log 2024-04-25T02:30:21.901 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47474.log 2024-04-25T02:30:21.901 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42109.log.gz 2024-04-25T02:30:21.901 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50350.log 2024-04-25T02:30:21.901 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48822.log.gz 2024-04-25T02:30:21.901 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40861.log 2024-04-25T02:30:21.901 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1%/var/log/ceph/ceph-client.admin.50350.log: -- replaced with /var/log/ceph/ceph-client.admin.47474.log.gz 2024-04-25T02:30:21.901 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46891.log 2024-04-25T02:30:21.901 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50350.log.gz/var/log/ceph/ceph-client.admin.40861.log: 2024-04-25T02:30:21.901 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41777.log 2024-04-25T02:30:21.902 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40861.log.gz 2024-04-25T02:30:21.902 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45088.log 2024-04-25T02:30:21.902 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.41777.log: /var/log/ceph/ceph-client.admin.46891.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46891.log.gz 2024-04-25T02:30:21.902 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41777.log.gz 2024-04-25T02:30:21.902 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44584.log 2024-04-25T02:30:21.902 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43933.log 2024-04-25T02:30:21.902 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45088.log: /var/log/ceph/ceph-client.admin.44584.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45088.log.gz 2024-04-25T02:30:21.902 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44584.log.gz 2024-04-25T02:30:21.902 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50792.log 2024-04-25T02:30:21.902 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51658.log 2024-04-25T02:30:21.902 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43933.log: /var/log/ceph/ceph-client.admin.50792.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43933.log.gz 2024-04-25T02:30:21.902 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49517.log 2024-04-25T02:30:21.902 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50792.log.gz 2024-04-25T02:30:21.902 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45883.log 2024-04-25T02:30:21.903 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51658.log: /var/log/ceph/ceph-client.admin.49517.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49517.log.gz 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51658.log.gz 2024-04-25T02:30:21.903 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-04-25T02:30:21.903 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48990.log 2024-04-25T02:30:21.903 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51524.log 2024-04-25T02:30:21.903 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45883.log: /var/log/ceph/ceph-client.admin.48990.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45883.log.gz 2024-04-25T02:30:21.903 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48990.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47219.log 2024-04-25T02:30:21.903 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-04-25T02:30:21.903 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48780.log 2024-04-25T02:30:21.903 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47219.log: /var/log/ceph/ceph-client.admin.51524.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51524.log.gz 2024-04-25T02:30:21.903 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47219.log.gz 2024-04-25T02:30:21.903 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45469.log 2024-04-25T02:30:21.903 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50037.log 2024-04-25T02:30:21.903 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48780.log: /var/log/ceph/ceph-client.admin.45469.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48780.log.gz 2024-04-25T02:30:21.904 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45469.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46261.log 2024-04-25T02:30:21.904 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-04-25T02:30:21.904 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51296.log 2024-04-25T02:30:21.904 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46261.log: /var/log/ceph/ceph-client.admin.50037.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50037.log.gz 2024-04-25T02:30:21.904 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46261.log.gz 2024-04-25T02:30:21.904 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51044.log 2024-04-25T02:30:21.904 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48654.log 2024-04-25T02:30:21.904 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51296.log: /var/log/ceph/ceph-client.admin.51044.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51296.log.gz 2024-04-25T02:30:21.904 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41219.log 2024-04-25T02:30:21.904 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51044.log.gz 2024-04-25T02:30:21.904 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43151.log 2024-04-25T02:30:21.904 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48654.log: /var/log/ceph/ceph-client.admin.41219.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41219.log.gz 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48654.log.gz 2024-04-25T02:30:21.904 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-04-25T02:30:21.904 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49559.log 2024-04-25T02:30:21.904 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45637.log 2024-04-25T02:30:21.905 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43151.log: /var/log/ceph/ceph-client.admin.49559.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43151.log.gz 2024-04-25T02:30:21.905 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49559.log.gz 2024-04-25T02:30:21.905 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46975.log 2024-04-25T02:30:21.905 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46933.log 2024-04-25T02:30:21.905 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46975.log: /var/log/ceph/ceph-client.admin.45637.log: 88.4% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45637.log.gz 2024-04-25T02:30:21.905 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46975.log.gz 2024-04-25T02:30:21.905 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47964.log 2024-04-25T02:30:21.905 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45841.log 2024-04-25T02:30:21.905 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46933.log: /var/log/ceph/ceph-client.admin.47964.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46933.log.gz 2024-04-25T02:30:21.905 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47964.log.gz 2024-04-25T02:30:21.905 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45841.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45841.log.gz 2024-04-25T02:30:21.905 INFO:teuthology.orchestra.run.smithi067.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T02:30:21.906 INFO:teuthology.orchestra.run.smithi067.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T02:30:21.906 INFO:teuthology.orchestra.run.smithi067.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T02:30:21.907 INFO:teuthology.orchestra.run.smithi176.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T02:30:21.907 INFO:teuthology.orchestra.run.smithi176.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T02:30:21.907 INFO:teuthology.orchestra.run.smithi176.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T02:30:21.907 INFO:teuthology.orchestra.run.smithi176.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T02:30:21.915 INFO:teuthology.orchestra.run.smithi067.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T02:30:21.922 INFO:teuthology.orchestra.run.smithi176.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T02:30:21.922 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-04-25T02:30:21.922 INFO:teuthology.orchestra.run.smithi176.stderr:real 0m0.166s 2024-04-25T02:30:21.922 INFO:teuthology.orchestra.run.smithi176.stderr:user 0m0.833s 2024-04-25T02:30:21.922 INFO:teuthology.orchestra.run.smithi176.stderr:sys 0m0.050s 2024-04-25T02:30:21.958 INFO:teuthology.orchestra.run.smithi067.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T02:30:21.965 INFO:teuthology.orchestra.run.smithi067.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T02:30:21.967 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-04-25T02:30:21.967 INFO:teuthology.orchestra.run.smithi067.stderr:real 0m0.232s 2024-04-25T02:30:21.967 INFO:teuthology.orchestra.run.smithi067.stderr:user 0m0.912s 2024-04-25T02:30:21.967 INFO:teuthology.orchestra.run.smithi067.stderr:sys 0m0.165s 2024-04-25T02:30:21.967 INFO:tasks.ceph:Archiving logs... 2024-04-25T02:30:21.967 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672388/remote/smithi067/log 2024-04-25T02:30:21.968 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T02:30:22.325 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672388/remote/smithi176/log 2024-04-25T02:30:22.326 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T02:30:22.479 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T02:30:22.505 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T02:30:22.506 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T02:30:22.508 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T02:30:22.583 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T02:30:22.593 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T02:30:22.593 DEBUG:teuthology.orchestra.run.smithi067:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:30:22.596 DEBUG:teuthology.orchestra.run.smithi176:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:30:22.608 INFO:teuthology.orchestra.run.smithi067.stderr:bash: line 1: ntpq: command not found 2024-04-25T02:30:22.609 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2024-04-25T02:30:22.613 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:30:22.613 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2024-04-25T02:30:22.613 INFO:teuthology.orchestra.run.smithi067.stdout:^- hv01.front.sepia.ceph.com 2 6 377 24 +1735us[+1735us] +/- 579ms 2024-04-25T02:30:22.613 INFO:teuthology.orchestra.run.smithi067.stdout:^* hv02.front.sepia.ceph.com 3 6 377 24 -267us[ -260us] +/- 60ms 2024-04-25T02:30:22.613 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 +303us[ +310us] +/- 67ms 2024-04-25T02:30:22.614 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:30:22.615 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:30:22.615 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2024-04-25T02:30:22.615 INFO:teuthology.orchestra.run.smithi176.stdout:^- hv01.front.sepia.ceph.com 2 6 377 24 +1755us[+1754us] +/- 579ms 2024-04-25T02:30:22.615 INFO:teuthology.orchestra.run.smithi176.stdout:^* hv02.front.sepia.ceph.com 3 6 377 23 -277us[ -279us] +/- 60ms 2024-04-25T02:30:22.615 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 +309us[ +308us] +/- 67ms 2024-04-25T02:30:22.615 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:30:22.615 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T02:30:22.625 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T02:30:22.626 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T02:30:22.636 DEBUG:teuthology.orchestra.run.smithi067:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T02:30:22.721 DEBUG:teuthology.orchestra.run.smithi176:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T02:30:22.780 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T02:30:22.807 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:30:22.807 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T02:30:22.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:30:22.834 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T02:30:22.845 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T02:30:22.854 INFO:teuthology.task.internal:Duration was 502.153120 seconds 2024-04-25T02:30:22.854 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T02:30:22.863 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T02:30:22.863 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T02:30:22.866 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T02:30:22.901 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:30:22.911 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:30:23.197 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T02:30:23.198 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi067.front.sepia.ceph.com 2024-04-25T02:30:23.198 DEBUG:teuthology.orchestra.run.smithi067:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T02:30:23.219 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi176.front.sepia.ceph.com 2024-04-25T02:30:23.220 DEBUG:teuthology.orchestra.run.smithi176:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T02:30:23.263 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T02:30:23.263 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T02:30:23.265 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T02:30:23.327 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T02:30:23.327 DEBUG:teuthology.orchestra.run.smithi067:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T02:30:23.332 DEBUG:teuthology.orchestra.run.smithi176:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T02:30:23.463 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T02:30:23.474 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T02:30:23.474 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T02:30:23.499 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T02:30:23.522 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T02:30:23.532 DEBUG:teuthology.orchestra.run.smithi067:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:30:23.541 DEBUG:teuthology.orchestra.run.smithi176:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:30:23.561 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = core 2024-04-25T02:30:23.584 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = core 2024-04-25T02:30:23.596 DEBUG:teuthology.orchestra.run.smithi067:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:30:23.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:30:23.634 DEBUG:teuthology.orchestra.run.smithi176:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:30:23.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:30:23.651 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T02:30:23.663 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T02:30:23.663 DEBUG:teuthology.misc:Transferring archived files from smithi067:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672388/remote/smithi067 2024-04-25T02:30:23.664 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T02:30:23.707 DEBUG:teuthology.misc:Transferring archived files from smithi176:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672388/remote/smithi176 2024-04-25T02:30:23.708 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T02:30:23.740 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T02:30:23.740 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T02:30:23.744 DEBUG:teuthology.orchestra.run.smithi176:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T02:30:23.789 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T02:30:23.803 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T02:30:23.804 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T02:30:23.814 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T02:30:23.814 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T02:30:23.817 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T02:30:23.829 INFO:teuthology.orchestra.run.smithi067.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 02:30 /home/ubuntu/cephtest 2024-04-25T02:30:23.844 INFO:teuthology.orchestra.run.smithi176.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 02:30 /home/ubuntu/cephtest 2024-04-25T02:30:23.845 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T02:30:23.856 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T02:30:23.881 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}} duration: 502.1531195640564 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-25T02:30:23.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T02:30:23.971 INFO:teuthology.run:pass